00010000:02000000:3.1F:1787498063.291608:0:8412:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:02000000:3.1:1787498064.315774:0:6484:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:02000000:3.1:1787498065.340194:0:6484:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:02000000:3.1:1787498066.362251:0:6484:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:02000000:2.1F:1787498085.992448:0:35126:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:02000000:3.1:1787498087.037844:0:6484:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:02000000:3.1:1787498088.058199:0:6484:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:02000000:3.1:1787498089.082192:0:6484:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:02000000:2.1:1787498090.099644:0:35126:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:02000000:1.1F:1787498091.130854:0:6484:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:02000000:1.1:1787498092.154198:0:6484:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:02000000:3.1:1787498093.178658:0:6484:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:02000000:0.1F:1787498099.921333:0:20252:0:(ldlm_lockd.c:391:__ldlm_add_waiting_lock()) *** cfs_fail_loc=511, val=0*** 00010000:02000000:0.1:1787498099.940790:0:20252:0:(ldlm_lockd.c:391:__ldlm_add_waiting_lock()) *** cfs_fail_loc=511, val=0*** 00010000:02000000:1.1:1787498115.520343:0:35125:0:(ldlm_lockd.c:391:__ldlm_add_waiting_lock()) *** cfs_fail_loc=511, val=0*** 00010000:00010000:0.0:1787508611.457250:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31931 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x16b:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508611.457298:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a0:0x16b:0x0]: returning size 4096 00000004:00200000:0.0:1787508611.457303:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508611.457337:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3192a lrc: 0/0,0 mode: --/CR res: [0x2000013a0:0x16b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad63a expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.457354:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31931 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x16b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad63a expref: 586 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.457361:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16b:0x0].0x0 (ffff9090ccb87700) 00010000:00010000:0.0:1787508611.457364:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508611.457367:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6400, rc 0) 00000100:00100000:0.0:1787508611.457461:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:335988:x1874324509417856:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 323us (1795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.457469:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93372 00000100:00100000:0.0:1787508611.461159:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509418112 00000100:00100000:0.0:1787508611.461165:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509418112 00000100:00100000:0.0:1787508611.461206:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93373 00000100:00100000:0.0:1787508611.461215:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:335989:x1874324509417984:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508611.461233:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508611.461266:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f31938 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad641 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.461335:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3193f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.461350:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3193f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.461361:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3193f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.461375:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31946 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.461383:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.461389:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.461444:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3193f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.461452:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3193f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.461458:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3193f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.461465:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3193f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.461470:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508611.461474:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3193f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.461482:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3193f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.461494:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508611.461508:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508611.461512:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3193f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.461519:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3193f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.461530:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31946 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.461535:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31946 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.461541:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31946 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.461545:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508611.461548:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31946 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.461554:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31946 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.461560:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090e460ff00) 00010000:00010000:0.0:1787508611.461563:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508611.461565:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31946 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.461571:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31946 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.461601:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f31938 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad641 expref: 14 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.461611:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508611.461614:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508611.461617:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f31938 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad641 expref: 14 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.461626:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6800, rc 0) 00000100:00100000:0.0:1787508611.461692:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:335989:x1874324509417984:12345-192.168.201.30@tcp:101:rm.0 Request processed in 478us (1240us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508611.461700:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93373 00000100:00100000:0.0:1787508611.461725:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93374 00000100:00100000:0.0:1787508611.461733:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:335988:x1874324509418112:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508611.461746:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508611.461756:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f3194d lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x163:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad648 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.462259:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f31954 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x163:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.462269:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f31954 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x163:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.462278:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f31954 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x163:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508611.462319:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd2:0x163:0x0]: returning size 4096 00000004:00200000:0.0:1787508611.462324:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508611.462356:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f3194d lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x163:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad648 expref: 642 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.462370:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f31954 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x163:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad648 expref: 641 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.462377:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x163:0x0].0x0 (ffff9090d36fd800) 00010000:00010000:0.0:1787508611.462379:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508611.462382:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6e00, rc 0) 00000100:00100000:0.0:1787508611.462460:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+641:335988:x1874324509418112:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 727us (1910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.462466:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93374 00000100:00100000:0.0:1787508611.472451:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509418496 00000100:00100000:0.0:1787508611.472462:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509418496 00000100:00100000:0.0:1787508611.473452:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93377 00000100:00100000:0.0:1787508611.473465:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:335989:x1874324509418752:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508611.473477:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508611.473489:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31977 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad656 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.474273:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3197e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.474289:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3197e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.474300:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3197e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.474317:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31985 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.474324:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31985 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.474330:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31985 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.474384:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3197e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.474391:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3197e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.474396:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3197e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.474402:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3197e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.474408:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508611.474412:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3197e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.474419:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3197e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.474430:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508611.474433:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508611.474437:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3197e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.474443:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3197e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.474455:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31985 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.474461:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31985 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.474467:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31985 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.474472:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508611.474475:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31985 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.474481:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31985 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.474488:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090e460ff00) 00010000:00010000:0.0:1787508611.474490:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508611.474493:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31985 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.474510:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31985 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.474543:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31977 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad656 expref: 14 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.474553:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508611.474555:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508611.474560:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31977 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad656 expref: 14 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.474568:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6000, rc 0) 00000100:00100000:0.0:1787508611.474625:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:335989:x1874324509418752:12345-192.168.201.30@tcp:101:rm.0 Request processed in 1163us (2472us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508611.474632:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93377 00000100:00100000:0.0:1787508611.482615:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509418880 00000100:00100000:0.0:1787508611.482628:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509418880 00010000:00010000:0.0:1787508611.482671:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ece00/0xb126349c40f31874 lrc: 5/0,0 mode: PR/PR res: [0x2000013a4:0x1255:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad5f4 expref: 15 pid: 203348 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508611.482704:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27715 00000100:00100000:0.0:1787508611.482712:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2401:x1874324509418880:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508611.482725:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508611.482730:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ece00/0xb126349c40f31874 lrc: 5/0,0 mode: PR/PR res: [0x2000013a4:0x1255:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad5f4 expref: 15 pid: 203348 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.482745:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ece00/0xb126349c40f31874 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1255:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad5f4 expref: 15 pid: 203348 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.482767:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1255:0x0].0x0 (ffff9090ccb87e00) 00010000:00010000:0.0:1787508611.482771:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9ff0a00/0xb126349c40f319a1 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1255:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.482779:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f31970 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1255:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.482791:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f31970 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1255:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.482797:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f31970 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x1255:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.482804:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9ff0a00/0xb126349c40f319a1 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1255:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.482809:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9ff0a00/0xb126349c40f319a1 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1255:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.482824:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508611.482890:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2401:x1874324509418880:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 179us (2396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.482897:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27715 00000100:00100000:0.0:1787508611.500104:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509419392 00000100:00100000:0.0:1787508611.500113:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509419392 00010000:00010000:0.0:1787508611.500153:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f31954 lrc: 5/0,0 mode: PR/PR res: [0x240000bd2:0x163:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad648 expref: 641 pid: 205405 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508611.500194:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27718 00000100:00100000:0.0:1787508611.500204:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+641:2400:x1874324509419392:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508611.500219:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508611.500226:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f31954 lrc: 5/0,0 mode: PR/PR res: [0x240000bd2:0x163:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad648 expref: 641 pid: 205405 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.500240:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f31954 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x163:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad648 expref: 641 pid: 205405 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.500261:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x163:0x0].0x0 (ffff9090d36fd800) 00010000:00010000:0.0:1787508611.500268:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b800/0xb126349c40f319b6 lrc: 3/0,0 mode: --/PW res: [0x240000bd2:0x163:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f319af expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.500278:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b800/0xb126349c40f319b6 lrc: 3/0,0 mode: --/PW res: [0x240000bd2:0x163:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f319af expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.500286:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508611.500332:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+641:2400:x1874324509419392:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 131us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.500339:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27718 00000100:00100000:0.0:1787508611.503971:0:202227:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589961951 gen 2 00000004:00080000:0.0:1787508611.503982:0:202227:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961942 committed transno 8589961951 00000020:00080000:0.0:1787508611.503989:0:202227:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9090d74d9300 refcount 2 committed 0 result 0 batchid 8589961969 00000020:00080000:0.0:1787508611.503993:0:202227:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cbc97700 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d74d9f00 00000020:00080000:0.0:1787508611.503997:0:202227:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd2:0x1:0x0].1770 00000020:00080000:0.0:1787508611.504000:0:202227:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cbc97800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090ca672000 00000020:00080000:0.0:1787508611.504002:0:202227:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1:0x0].1764 00000004:00080000:0.0:1787508611.504037:0:202227:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961943 committed transno 8589961951 00000004:00080000:0.0:1787508611.504047:0:202227:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961945 committed transno 8589961951 00000004:00080000:0.0:1787508611.504056:0:202227:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961946 committed transno 8589961951 00000004:00080000:0.0:1787508611.504063:0:202227:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961951 committed transno 8589961951 00000100:00100000:0.0:1787508611.504078:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b02a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:202227:1874324480046848:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1787508611.504097:0:202227:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2ab800/0xb126349c40f319af lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x163:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f319b6 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787508611.504297:0:202227:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1:0x0].1766, 344 off1817456 00000040:00080000:0.0:1787508611.504359:0:202227:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x1:0x0].1772, 552 off2021120 00000004:00080000:0.0:1787508611.504364:0:202227:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d9e8d0c0 with version 3427 00000004:00010000:0.0:1787508611.509536:0:202227:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023246ab5 reply state 000000000201612c transno 12884944016 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f319a8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x16b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.509557:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f319a8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x16b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.509567:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16b:0x0].0x0 (ffff9090ccb87700) 00010000:00010000:0.0:1787508611.509570:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787508611.509574:0:202227:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787508611.509582:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2ab800/0xb126349c40f319af lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x163:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f319b6 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.509591:0:202227:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2ab800/0xb126349c40f319af lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x163:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f319b6 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787508611.509602:0:202227:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd2:0x163:0x0] 00000004:00010000:0.0:1787508611.509611:0:202227:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023246ab5 reply state 000000000201612c transno 12884944016 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f31970 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1255:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.509620:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f31970 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1255:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.509626:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1255:0x0].0x0 (ffff9090ccb87e00) 00010000:00010000:0.0:1787508611.509628:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508611.509632:0:202227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9ff0a00/0xb126349c40f319a1 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1255:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.509642:0:202227:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9ff0a00/0xb126349c40f319a1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1255:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.509647:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9ff0a00/0xb126349c40f319a1 lrc: 4/1,0 mode: PR/PR res: [0x2000013a4:0x1255:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508611.509683:0:202227:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1787508611.509695:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1255:0x0]: returning size 4096 00000100:00100000:0.0:1787508611.509790:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:335988:x1874324509418496:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 37115us (40182us total) trans 12884944016 rc 0/0 00000100:00100000:0.0:1787508611.509799:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93376 00000100:00100000:0.0:1787508611.514826:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:0.0:1787508611.520201:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b800/0xb126349c40f319b6 lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x163:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f319af expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.520220:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x163:0x0].0x0 (ffff9090d36fd800) 00010000:00010000:0.0:1787508611.520225:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f319d2 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x163:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.520234:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f319d2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x163:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.520241:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f319d2 lrc: 4/1,0 mode: PR/PR res: [0x240000bd2:0x163:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.520280:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508611.520361:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480047744:12345-0@lo:103:ldlm_bl.0 Request processed in 4360us (4553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.520372:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27720 00000100:00100000:0.0:1787508611.531480:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508611.531520:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508611.531543:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509420032 00000100:00100000:0.0:1787508611.531549:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509420032 00000100:00100000:0.0:1787508611.531584:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509420288 00000100:00100000:0.0:1787508611.531586:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509420288 00000100:00100000:0.0:1787508611.531609:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93381 00000100:00100000:0.0:1787508611.531616:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:335990:x1874324509420032:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508611.531631:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508611.531651:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f319d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad672 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.531716:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f319e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.531729:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f319e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.531740:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f319e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.531755:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f319e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.531761:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f319e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.531767:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f319e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.531833:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f319e0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.531842:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f319e0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.531847:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f319e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.531854:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f319e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.531860:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508611.531865:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f319e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.531872:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f319e0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.531884:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508611.531887:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508611.531891:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f319e0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.531897:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f319e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.531910:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f319e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.531916:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f319e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.531922:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f319e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.531927:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508611.531930:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f319e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.531936:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f319e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.531967:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xce5b6a33 (ffff9090e460ff00) 00010000:00010000:0.0:1787508611.531969:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508611.531973:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f319e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.531979:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f319e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.532009:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f319d9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad672 expref: 587 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.532020:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508611.532022:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508611.532025:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f319d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad672 expref: 587 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.532033:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7e00, rc 0) 00000100:00100000:0.0:1787508611.532074:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:335990:x1874324509420032:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 458us (596us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508611.532080:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93381 00000100:00100000:0.0:1787508611.532097:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93382 00000100:00100000:0.0:1787508611.532105:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:335989:x1874324509420288:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508611.532114:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508611.532123:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f319ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad679 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508611.532222:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1255:0x0]: returning size 4096 00010000:00010000:0.0:1787508611.532304:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f319ee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad679 expref: 15 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.532313:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508611.532315:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508611.532319:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f319ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad679 expref: 15 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.532328:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6c00, rc 0) 00000100:00100000:0.0:1787508611.532351:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:335989:x1874324509420288:12345-192.168.201.30@tcp:101:rm.0 Request processed in 247us (830us total) trans 12884944020 rc 301/301 00000100:00100000:0.0:1787508611.532357:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93382 00000100:00100000:0.0:1787508611.536163:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508611.541820:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508611.541857:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509420672 00000100:00100000:0.0:1787508611.541868:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509420672 00000100:00100000:0.0:1787508611.541928:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93383 00000100:00100000:0.0:1787508611.541960:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:335990:x1874324509420672:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508611.541981:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508611.542002:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f319fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad680 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.542078:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a03 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.542093:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.542104:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.542119:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31a0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.542127:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31a0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.542133:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31a0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.542199:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a03 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.542206:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a03 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.542213:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.542219:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a03 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.542225:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508611.542229:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a03 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.542237:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a03 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.542248:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508611.542251:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508611.542255:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a03 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.542261:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.542273:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31a0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.542278:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31a0a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.542284:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31a0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.542289:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508611.542292:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31a0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.542298:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31a0a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.542305:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaf7dd568 (ffff9090e460f400) 00010000:00010000:0.0:1787508611.542307:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508611.542310:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31a0a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.542316:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31a0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.542349:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f319fc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad680 expref: 587 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.542360:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508611.542362:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508611.542365:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f319fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad680 expref: 587 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.542376:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7c00, rc 0) 00000100:00100000:0.0:1787508611.542711:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:335990:x1874324509420672:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 772us (900us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508611.542720:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93383 00000100:00100000:0.0:1787508611.547071:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508611.558379:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508611.558440:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508611.560156:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509421056 00000100:00100000:0.0:1787508611.560168:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509421056 00000100:00100000:0.0:1787508611.560252:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15375 00000100:00100000:0.0:1787508611.560261:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:335989:x1874324509421056:12345-192.168.201.30@tcp:37:rm.0 00000100:00100000:0.0:1787508611.568603:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509421568 00000100:00100000:0.0:1787508611.568613:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509421568 00000100:00100000:0.0:1787508611.568679:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93386 00000100:00100000:0.0:1787508611.568688:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:335990:x1874324509421568:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508611.568709:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508611.568730:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31a3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad695 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.568810:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a42 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.568826:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.568836:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.568851:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31a49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.568857:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31a49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.568863:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31a49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.568926:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a42 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.568933:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a42 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.568977:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.568984:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a42 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.568990:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508611.568995:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a42 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.569001:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a42 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.569014:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508611.569017:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508611.569021:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a42 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.569039:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.569053:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31a49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.569058:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31a49 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.569063:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31a49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.569068:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508611.569070:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31a49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.569076:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31a49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.569088:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbfff8436 (ffff9090e460f400) 00010000:00010000:0.0:1787508611.569090:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508611.569093:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31a49 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.569099:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31a49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.569131:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31a3b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad695 expref: 587 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.569141:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508611.569143:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508611.569147:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31a3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad695 expref: 587 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.569155:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6400, rc 0) 00000100:00100000:0.0:1787508611.569208:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:335990:x1874324509421568:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 521us (718us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508611.569216:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93386 00000100:00100000:0.0:1787508611.571692:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508611.577697:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509422080 00000100:00100000:0.0:1787508611.577707:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509422080 00000100:00100000:0.0:1787508611.577770:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509422336 00000100:00100000:0.0:1787508611.577774:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509422336 00000100:00100000:0.0:1787508611.577814:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93387 00000100:00100000:0.0:1787508611.577823:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:335990:x1874324509422080:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508611.577846:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508611.577866:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31a50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad69c expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.577936:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31a57 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.577982:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31a57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.577993:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31a57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.578009:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.578016:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.578022:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.578082:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31a57 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.578089:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31a57 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.578095:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31a57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.578101:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31a57 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.578108:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508611.578113:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31a57 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.578120:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31a57 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.578132:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508611.578135:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508611.578140:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31a57 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.578147:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31a57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.578162:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.578167:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.578173:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.578178:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508611.578180:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.578186:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a5e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.578196:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x594a0ca2 (ffff9090e460f400) 00010000:00010000:0.0:1787508611.578199:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508611.578202:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a5e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.578208:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31a5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.578239:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31a50 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad69c expref: 587 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.578266:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508611.578268:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508611.578273:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31a50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad69c expref: 587 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.578281:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6400, rc 0) 00000100:00100000:0.0:1787508611.578339:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:335990:x1874324509422080:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 516us (783us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508611.578346:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93387 00000100:00100000:0.0:1787508611.578366:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93388 00000100:00100000:0.0:1787508611.578374:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:335989:x1874324509422336:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:0.0:1787508611.578401:0:205405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787508611.578415:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9ff0a00/0xb126349c40f319a1 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1255:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad65d expref: 15 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.578432:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1255:0x0].0x0 (ffff9090ccb87e00) 00010000:00010000:0.0:1787508611.578440:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec600/0xb126349c40f3183c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad5ed expref: 14 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.578448:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508611.578450:0:205405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508611.578461:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f31a65 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.578470:0:205405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed800/0xb126349c40f31882 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad5fb expref: 585 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.578478:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f31a65 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.578523:0:205405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed800/0xb126349c40f31882 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad5fb expref: 585 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.578538:0:205405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed800/0xb126349c40f31882 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad5fb expref: 585 pid: 209004 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508611.578552:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6ac7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480048640:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508611.578607:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9e8d600 going to sleep for 11 seconds 00000100:00100000:0.0:1787508611.585790:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6ac7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480048640:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508611.585820:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f31a65 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508611.588234:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509422464 00000100:00100000:0.0:1787508611.588239:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509422464 00010000:00010000:0.0:1787508611.588268:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed800/0xb126349c40f31882 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad5fb expref: 588 pid: 209004 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508611.588287:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27721 00000100:00100000:0.0:1787508611.588292:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde1a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+588:2401:x1874324509422464:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508611.588301:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508611.588306:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed800/0xb126349c40f31882 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad5fb expref: 588 pid: 209004 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.588319:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed800/0xb126349c40f31882 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad5fb expref: 588 pid: 209004 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.588337:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed800/0xb126349c40f31882 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad5fb expref: 588 pid: 209004 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.588351:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508611.588356:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f31a73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.588362:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f31a65 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.588370:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f31a65 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.588380:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f31a65 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.588387:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f31a73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.588393:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f31a73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.588416:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508611.588464:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde1a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+587:2401:x1874324509422464:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 171us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.588471:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27721 00000100:00100000:0.0:1787508611.592147:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb38e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480048768:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508611.592176:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f31a88 lrc: 3/0,1 mode: --/EX res: [0x2000013a0:0x16b:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.593095:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f319c4 lrc: 0/0,0 mode: --/PR res: [0x2000013a0:0x16b:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad664 expref: 14 pid: 230618 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.593115:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16b:0x0].0x0 (ffff9090ccb87700) 00010000:00010000:1.0:1787508611.593120:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f31a88 lrc: 3/0,1 mode: --/EX res: [0x2000013a0:0x16b:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.593131:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f31a88 lrc: 3/0,1 mode: EX/EX res: [0x2000013a0:0x16b:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.593139:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f31a88 lrc: 4/0,1 mode: EX/EX res: [0x2000013a0:0x16b:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.593203:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508611.593269:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2401:x1874324509422720:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 592us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508611.593277:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27722 00010000:00010000:0.0:1787508611.593435:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f31a88 lrc: 3/0,1 mode: EX/EX res: [0x2000013a0:0x16b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.593442:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f31a88 lrc: 3/0,1 mode: EX/EX res: [0x2000013a0:0x16b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.593489:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f31a8f lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x163:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.593512:0:205405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f31a8f lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x163:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.593523:0:205405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f31a8f lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x163:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508611.593543:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6ac7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:205405:1874324480048896:0@lo:101:mdt00_004.0 00000100:00100000:0.0:1787508611.593591:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508611.593620:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9e8dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508611.593695:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29514 00000100:00100000:1.0:1787508611.593705:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:205405:x1874324480048896:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1787508611.593723:0:203182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508611.593738:0:203182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f31a96 lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x163:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f31a8f expref: -99 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.593757:0:203182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f319d2 lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x163:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad66b expref: 5 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.593766:0:203182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f31a96 lrc: 4/0,0 mode: --/EX res: [0x240000bd2:0x163:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f31a8f expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.594395:0:203182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f319d2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x163:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad66b expref: 5 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.594411:0:203182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f319d2 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x163:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad66b expref: 5 pid: 203348 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508611.594423:0:203182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0ed80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:203182:1874324480049024:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508611.594519:0:203182:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9180 going to sleep for 11 seconds 00000100:00100000:1.0:1787508611.599278:0:203182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0ed80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:203182:1874324480049024:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508611.599319:0:203182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f31a96 lrc: 3/0,0 mode: --/EX res: [0x240000bd2:0x163:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f31a8f expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.599332:0:203182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x163:0x0].0x0 (ffff9090d36fd800) 00010000:00010000:1.0:1787508611.599336:0:203182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787508611.599340:0:203182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f31a96 lrc: 3/0,0 mode: --/EX res: [0x240000bd2:0x163:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f31a8f expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.599359:0:203182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f31a96 lrc: 3/0,0 mode: --/EX res: [0x240000bd2:0x163:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f31a8f expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.599374:0:203182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ae00, rc 0) 00000100:00100000:1.0:1787508611.599448:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:205405:x1874324480048896:12345-0@lo:101:mdt00_004.0 Request processed in 5743us (5854us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508611.599464:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29514 00000100:00100000:1.0:1787508611.599791:0:229386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480049152 00000100:00100000:1.0:1787508611.599796:0:229386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480049152 00000100:00100000:1.0:1787508611.599834:0:229386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18084 00000100:00100000:1.0:1787508611.599841:0:229386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:202211:x1874324480049152:12345-0@lo:105: 00010000:00010000:1.0:1787508611.599851:0:229386:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f31a8f lrc: 5/0,1 mode: --/EX res: [0x240000bd2:0x163:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f31a96 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.599860:0:229386:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f31a8f lrc: 5/0,1 mode: --/EX res: [0x240000bd2:0x163:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f31a96 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.599868:0:229386:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f31a8f lrc: 5/0,1 mode: --/EX res: [0x240000bd2:0x163:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f31a96 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.599876:0:229386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f31a8f lrc: 5/0,1 mode: EX/EX res: [0x240000bd2:0x163:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f31a96 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.599883:0:229386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f31a8f lrc: 6/0,1 mode: EX/EX res: [0x240000bd2:0x163:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f31a96 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.599890:0:229386:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f31a8f lrc: 6/0,1 mode: EX/EX res: [0x240000bd2:0x163:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f31a96 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.599915:0:229386:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d56f7600) 00000100:00100000:1.0:1787508611.599973:0:229386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:202211:x1874324480049152:12345-0@lo:105: Request processed in 131us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508611.599980:0:229386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18084 00000100:00100000:0.0:1787508611.601090:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480049280 00000100:00100000:0.0:1787508611.601097:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480049280 00000100:00100000:0.0:1787508611.601126:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29515 00000100:00100000:0.0:1787508611.601133:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c819ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:205405:x1874324480049280:12345-0@lo:403:mdt00_004.0 00000100:00100000:0.0:1787508611.604634:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c819ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:205405:x1874324480049280:12345-0@lo:403:mdt00_004.0 Request processed in 2798us (3056us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.604652:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29515 00000004:00080000:1.0:1787508611.606371:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3428 rpc_version 3428 00000020:00100000:1.0:1787508611.606402:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787508611.606412:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091ffc0ed80 x1874324480049536/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1448/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787508611.606561:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0ed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480049536:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787508611.606625:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508611.606845:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9180 going to sleep for 11 seconds 00000100:00100000:1.0:1787508611.608001:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29516 00000100:00100000:1.0:1787508611.608018:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:202248:x1874324480049536:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787508611.608423:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:202248:x1874324480049536:12345-0@lo:1000:osp_up1-0.0 Request processed in 411us (1797us total) trans 8589961953 rc 0/0 00000100:00100000:1.0:1787508611.608429:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29516 00000100:00100000:0.0:1787508611.608977:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0ed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480049536:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1787508611.611390:0:202215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787508611.611400:0:202215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f31a8f lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x163:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xb126349c40f31a96 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.611409:0:202215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7600 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:1.0:1787508611.611414:0:202215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f31a8f lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x163:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xb126349c40f31a96 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508611.611422:0:202215:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f31a8f lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x163:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xb126349c40f31a96 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.611460:0:202215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f31a8f lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x163:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f31a96 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.611528:0:202215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787508611.611721:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480049664 00000100:00100000:0.0:1787508611.611729:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480049664 00000100:00100000:0.0:1787508611.611788:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9759 00000100:00100000:0.0:1787508611.611798:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+7:3617:x1874324480049664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508611.611810:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508611.611830:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f31a96 lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x163:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f31a8f expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.611847:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x163:0x0].0x0 (ffff9090d36fd800) 00010000:00010000:0.0:1787508611.611857:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787508611.612038:0:202215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f31a8f lrc: 1/0,0 mode: --/EX res: [0x240000bd2:0x163:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f31a96 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.612047:0:202215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f31a8f lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x163:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f31a96 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.612068:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508611.612070:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508611.612072:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508611.612655:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508611.613197:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+6:3617:x1874324480049664:12345-0@lo:103:ldlm_bl.0 Request processed in 1402us (1561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.613203:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9759 00000100:00100000:0.0:1787508611.620753:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508611.626295:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508611.626363:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509423232 00000100:00100000:1.0:1787508611.626371:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509423232 00000100:00100000:1.0:1787508611.626418:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93392 00000100:00100000:1.0:1787508611.626428:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:335990:x1874324509423232:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508611.626457:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508611.626478:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31ac0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad6b8 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.626560:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31ac7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.626575:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31ac7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.626586:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31ac7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.626601:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31ace lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.626608:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31ace lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.626614:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31ace lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.626689:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31ac7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.626697:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31ac7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.626703:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31ac7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.626710:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31ac7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.626716:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508611.626721:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31ac7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.626728:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31ac7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.626739:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508611.626742:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508611.626746:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31ac7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.626753:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31ac7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.626766:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31ace lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.626772:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31ace lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.626777:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31ace lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.626782:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508611.626786:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31ace lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.626791:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31ace lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.626797:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090c5b9e000) 00010000:00010000:1.0:1787508611.626799:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508611.626802:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31ace lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.626808:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31ace lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.626837:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31ac0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad6b8 expref: 587 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.626846:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508611.626849:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508611.626852:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31ac0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad6b8 expref: 587 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.626861:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247bc00, rc 0) 00000100:00100000:1.0:1787508611.626920:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:335990:x1874324509423232:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 493us (632us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508611.626931:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93392 00000100:00100000:1.0:1787508611.635086:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508611.635132:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508611.639214:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508611.639285:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:1.0:1787508611.642395:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508611.646884:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508611.655014:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508611.666900:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:335991:x1874324509424768:12345-192.168.201.30@tcp:101:rm.0 Request processed in 2817us (3058us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508611.666909:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93400 00000100:00100000:1.0:1787508611.671213:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509425152 00000100:00100000:1.0:1787508611.671223:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509425152 00000100:00100000:1.0:1787508611.671333:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93402 00000100:00100000:1.0:1787508611.671344:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:335990:x1874324509425152:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508611.671365:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508611.671384:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31b92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad6fe expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.671460:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f31b99 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.671474:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f31b99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.671485:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f31b99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.671507:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31ba0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.671515:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.671521:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.671586:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f31b99 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.671593:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f31b99 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.671599:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f31b99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.671606:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f31b99 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.671612:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508611.671617:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f31b99 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.671625:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f31b99 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.671638:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508611.671646:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508611.671651:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f31b99 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.671658:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f31b99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.671670:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.671676:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31ba0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.671682:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.671687:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508611.671690:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.671695:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31ba0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.671702:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd300) 00010000:00010000:1.0:1787508611.671704:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508611.671707:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31ba0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.671713:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31ba0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.671739:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31b92 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad6fe expref: 587 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.671750:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508611.671752:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508611.671756:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31b92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad6fe expref: 587 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.671765:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a000, rc 0) 00000100:00100000:1.0:1787508611.671829:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:335990:x1874324509425152:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 486us (897us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508611.671839:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93402 00000100:00100000:0.0:1787508611.673152:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509425280 00000100:00100000:0.0:1787508611.673160:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509425280 00000100:00100000:0.0:1787508611.673211:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93403 00000100:00100000:0.0:1787508611.673220:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:335991:x1874324509425280:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508611.673235:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508611.673260:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f31ba7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad705 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.673309:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31bae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.673320:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31bae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.673328:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31bae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.673338:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31bb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.673345:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.673352:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.673395:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31bae lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.673401:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31bae lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.673418:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31bae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.673424:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31bae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.673430:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508611.673433:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31bae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.673439:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31bae lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.673449:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508611.673452:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508611.673456:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31bae lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.673462:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31bae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.673473:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.673480:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31bb5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.673485:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.673491:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508611.673503:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.673510:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31bb5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.673518:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd300) 00010000:00010000:0.0:1787508611.673520:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508611.673523:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31bb5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.673528:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31bb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.673552:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f31ba7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad705 expref: 16 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.673562:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508611.673563:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508611.673567:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f31ba7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad705 expref: 16 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.673580:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7e00, rc 0) 00000100:00100000:0.0:1787508611.673625:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:335991:x1874324509425280:12345-192.168.201.30@tcp:101:rm.0 Request processed in 406us (780us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508611.673634:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93403 00000100:00100000:0.0:1787508611.684388:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508611.684569:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509425536 00000100:00100000:1.0:1787508611.684581:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509425536 00000100:00100000:1.0:1787508611.684702:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93404 00000100:00100000:1.0:1787508611.684713:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:335990:x1874324509425536:12345-192.168.201.30@tcp:36:lfs.0 00000100:00100000:1.0:1787508611.684837:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480049792:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787508611.684884:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508611.684917:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9540 going to sleep for 11 seconds 00000100:00100000:1.0:1787508611.688972:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480049792:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787508611.689065:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480049920:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787508611.689125:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508611.689162:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9540 going to sleep for 11 seconds 00000100:00100000:1.0:1787508611.689725:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480049920:0@lo:1000:mdt00_005.0 00010000:00010000:1.0:1787508611.689774:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a000/0xb126349c40f31bbc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.689785:0:209004:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a000/0xb126349c40f31bbc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.689795:0:209004:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a000/0xb126349c40f31bbc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508611.689808:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480050048:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1787508611.689832:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508611.689854:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787508611.693063:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508611.693096:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508611.694813:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480050048:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1787508611.694832:0:209004:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a000/0xb126349c40f31bbc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f31bc3 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787508611.694854:0:209004:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787508611.694888:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247bc00/0xb126349c40f31bca lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.694894:0:209004:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247bc00/0xb126349c40f31bca lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.694902:0:209004:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247bc00/0xb126349c40f31bca lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508611.694916:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480050560:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1787508611.694991:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508611.695013:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508611.696604:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480050560:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1787508611.696625:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247bc00/0xb126349c40f31bca lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f31bd1 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.696635:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247bc00/0xb126349c40f31bca lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f31bd1 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.699602:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3182e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.699610:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3182e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.699615:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3182e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.699622:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508611.699625:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3182e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.699631:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3182e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.699641:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd300) 00010000:00010000:1.0:1787508611.699644:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508611.699647:0:3603:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f31bd1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f31bca expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.699657:0:3603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f31bd1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f31bca expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.699666:0:3603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f31bd1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f31bca expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.699698:0:3603:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f31bd1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f31bca expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508611.699708:0:3603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d38db100 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3603:1874324480050944:0@lo:105: 00000100:00100000:1.0:1787508611.699764:0:3603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508611.699821:0:3603:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508611.700027:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480050816 00000100:00100000:1.0:1787508611.700035:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480050816 00000100:00100000:1.0:1787508611.700084:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29521 00000100:00100000:1.0:1787508611.700092:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c819ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:202248:x1874324480050816:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787508611.700220:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c819ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:202248:x1874324480050816:12345-0@lo:1000:osp_up1-0.0 Request processed in 128us (295us total) trans 8589961954 rc 0/0 00000100:00100000:1.0:1787508611.700227:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29521 00000100:00100000:0.0:1787508611.702147:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508611.702174:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509425920 00000100:00100000:0.0:1787508611.702179:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509425920 00000100:00100000:0.0:1787508611.702208:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93405 00000100:00100000:0.0:1787508611.702215:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:335993:x1874324509425920:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508611.702225:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508611.702255:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f31bd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad70c expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.702307:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31bdf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.702319:0:202227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f31bc3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f31bbc expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.702326:0:202227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31bdf lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.702346:0:202227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f31bc3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f31bbc expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508611.702361:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0877480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:202227:1874324480051456:0@lo:104: 00000100:00100000:0.0:1787508611.702388:0:202227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508611.702432:0:202210:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787508611.702442:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480051456 00000100:00100000:0.0:1787508611.702445:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480051456 00000100:00100000:0.0:1787508611.702471:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18087 00000100:00100000:0.0:1787508611.702478:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d18ae050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:202227:x1874324480051456:12345-0@lo:104: 00010000:00010000:0.0:1787508611.702488:0:202210:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a000/0xb126349c40f31bbc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f31bc3 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.702536:0:202210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787508611.702542:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d18ae050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:202227:x1874324480051456:12345-0@lo:104: Request processed in 65us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.702548:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18087 00010000:00010000:0.0:1787508611.702589:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508611.702595:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a000/0xb126349c40f31bbc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f31bc3 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.702602:0:204785:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9090d247a000 is referenced, will be cancelled later 00010000:00010000:0.0:1787508611.702605:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a000/0xb126349c40f31bbc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f31bc3 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.702611:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508611.702613:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508611.702614:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508611.702647:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9e8d180 going to sleep for 11 seconds 00000100:00100000:0.0:1787508611.702660:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0877480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:202227:1874324480051456:0@lo:104: 00010000:00010000:0.0:1787508611.702672:0:202227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31bdf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508611.703347:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480051328 00000100:00100000:1.0:1787508611.703353:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480051328 00000100:00100000:0.0:1787508611.703894:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480051584 00000100:00100000:0.0:1787508611.703899:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480051584 00000100:00100000:0.0:1787508611.703923:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29525 00000100:00100000:0.0:1787508611.703928:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d5738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:209004:x1874324480051584:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787508611.703996:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d5738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:209004:x1874324480051584:12345-0@lo:1000:mdt00_005.0 Request processed in 67us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.704002:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29525 00000100:00100000:0.0:1787508611.704471:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480051712 00000100:00100000:0.0:1787508611.704475:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480051712 00000100:00100000:0.0:1787508611.704549:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29526 00000100:00100000:0.0:1787508611.704557:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d5739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:209004:x1874324480051712:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787508611.704628:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d5739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:209004:x1874324480051712:12345-0@lo:1000:mdt00_005.0 Request processed in 72us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.704633:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29526 00000100:00100000:1.0:1787508611.704907:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480051840 00000100:00100000:1.0:1787508611.704911:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480051840 00000100:00100000:1.0:1787508611.704973:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29527 00000100:00100000:1.0:1787508611.704981:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:209004:x1874324480051840:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787508611.705036:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:209004:x1874324480051840:12345-0@lo:1000:mdt00_005.0 Request processed in 57us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508611.705042:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29527 00000004:00080000:1.0:1787508611.706251:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13575 rpc_version 13575 00000020:00100000:1.0:1787508611.706283:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787508611.706291:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d38d8380 x1874324480052096/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787508611.706309:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d38d8380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480052096:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508611.706357:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508611.706391:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9540 going to sleep for 11 seconds 00000100:00100000:0.0:1787508611.709812:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480052352 00000100:00100000:0.0:1787508611.709822:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480052352 00010000:00010000:0.0:1787508611.709856:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f31bc3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f31bbc expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508611.709893:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27726 00000100:00100000:0.0:1787508611.709901:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+10:3618:x1874324480052352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508611.709914:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508611.709933:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f31bc3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f31bbc expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.709978:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508611.709983:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31bdf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.709991:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31bdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.709998:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31bdf lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.710175:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508611.710379:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3618:x1874324480052352:12345-0@lo:103:ldlm_bl.0 Request processed in 339us (2055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.710387:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27726 00010000:00010000:1.0:1787508611.710503:0:202227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31bdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.710512:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31bdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508611.710565:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508611.710569:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508611.710589:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31bdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.710619:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f31bd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad70c expref: 12 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.710632:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31bdf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad70c expref: 11 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.710639:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508611.710641:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508611.710644:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6400, rc 0) 00000100:00100000:1.0:1787508611.710736:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:335993:x1874324509425920:12345-192.168.201.30@tcp:101:rm.0 Request processed in 8521us (8590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508611.710743:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93405 00000100:00100000:0.0:1787508611.721284:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508611.722017:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480052480 00000100:00100000:0.0:1787508611.722024:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480052480 00000100:00100000:0.0:1787508611.722062:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18088 00000100:00100000:0.0:1787508611.722070:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d5739500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:202226:x1874324480052480:12345-0@lo:104: 00010000:00010000:0.0:1787508611.722083:0:229363:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247bc00/0xb126349c40f31bca lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f31bd1 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.722149:0:229363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787508611.722155:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d5739500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:202226:x1874324480052480:12345-0@lo:104: Request processed in 87us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.722163:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18088 00000100:00100000:1.0:1787508611.722451:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480052608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508611.722487:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1787508611.725233:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961971 00000004:00080000:1.0:1787508611.725300:0:202262:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d01c9300 with version 3430 00000020:00080000:1.0:1787508611.725319:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589961970 cancel update log [0x240000bd2:0x1:0x0].1771: rc = 0 00000020:00080000:1.0:1787508611.725392:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589961970 cancel update log [0x2000013a0:0x1:0x0].1765: rc = 0 00000004:00080000:1.0:1787508611.725414:0:202262:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d01c9c00 with version 3431 00000020:00080000:1.0:1787508611.725417:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589961971 cancel update log [0x240000bd2:0x1:0x0].1772: rc = 0 00000020:00080000:1.0:1787508611.725436:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589961971 cancel update log [0x2000013a0:0x1:0x0].1766: rc = 0 00000020:00080000:1.0:1787508611.725445:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961971 00000100:00100000:0.0:1787508611.725852:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480052864 00000100:00100000:0.0:1787508611.725860:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480052864 00000100:00100000:0.0:1787508611.725914:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29530 00000100:00100000:0.0:1787508611.725923:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:202248:x1874324480052864:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787508611.726089:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:202248:x1874324480052864:12345-0@lo:1000:osp_up1-0.0 Request processed in 167us (428us total) trans 8589961956 rc 0/0 00000100:00100000:0.0:1787508611.726096:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29530 00000100:00100000:0.0:1787508611.726541:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480053120 00000100:00100000:0.0:1787508611.726547:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480053120 00000100:00100000:0.0:1787508611.726585:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29531 00000100:00100000:0.0:1787508611.726592:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:202248:x1874324480053120:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787508611.726897:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:202248:x1874324480053120:12345-0@lo:1000:osp_up1-0.0 Request processed in 305us (526us total) trans 8589961957 rc 0/0 00000100:00100000:0.0:1787508611.726904:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29531 00010000:00010000:1.0:1787508611.727124:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f31bd1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f31bca expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.727149:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd300) 00010000:00010000:1.0:1787508611.727155:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f31c10 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.727164:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f31c10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.727171:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f31c10 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.727201:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508611.727255:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde18050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:3619:x1874324480052608:12345-0@lo:103:ldlm_bl.0 Request processed in 4574us (4766us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508611.727262:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27727 00010000:00010000:0.0:1787508611.727346:0:202226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f31c10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.727354:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f31c10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508611.727465:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0874a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:202226:1874324480053248:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787508611.727514:0:202226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508611.727539:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9e8d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508611.727633:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480053248 00000100:00100000:1.0:1787508611.727639:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480053248 00000100:00100000:1.0:1787508611.727681:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29532 00000100:00100000:1.0:1787508611.727689:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:202226:x1874324480053248:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787508611.727749:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:202226:x1874324480053248:12345-0@lo:1000:mdt00_000.0 Request processed in 61us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508611.727756:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29532 00000100:00100000:0.0:1787508611.728052:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0874a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:202226:1874324480053248:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1787508611.728100:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31c17 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.728111:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31c17 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.728122:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31c17 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508611.728142:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31c17 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.728154:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f31c09 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.728161:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f31c09 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.728166:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f31c09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.728171:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f31c09 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.728177:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ede00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508611.728181:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f31c09 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.728187:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f31c09 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.728197:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508611.728199:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508611.728203:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f31c09 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.728208:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f31c09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.728218:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f31c10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.728223:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f31c10 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.728228:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f31c10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.728232:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22edc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508611.728234:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f31c10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.728252:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f31c10 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.728259:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd300) 00010000:00010000:0.0:1787508611.728261:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508611.728264:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f31c10 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.728269:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f31c10 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.728305:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f31c02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad713 expref: 13 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.728317:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31c17 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad713 expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.728328:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13ce:0x0].0x0 (ffff9090e460f400) 00010000:00010000:0.0:1787508611.728330:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508611.728332:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6000, rc 0) 00000100:00100000:0.0:1787508611.728375:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:335993:x1874324509426048:12345-192.168.201.30@tcp:101:rm.0 Request processed in 6916us (7101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.728382:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93406 00000100:00100000:0.0:1787508611.733653:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93407 00000100:00100000:0.0:1787508611.733675:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+581:335994:x1874324509426176:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508611.733696:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508611.733716:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31c1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad71a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.733777:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f31c25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.733806:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f31c25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.733817:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f31c25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508611.733864:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787508611.733867:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508611.733887:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f31c25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.733918:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31c1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad71a expref: 583 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.733936:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f31c25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad71a expref: 582 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.733978:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508611.733982:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508611.733985:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7800, rc 0) 00000100:00100000:0.0:1787508611.734047:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:335994:x1874324509426176:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 385us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.734055:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93407 00000100:00100000:0.0:1787508611.734078:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93408 00000100:00100000:0.0:1787508611.734086:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c968a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:335993:x1874324509426304:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508611.734095:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508611.734105:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f31c2c lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad721 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.734137:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f31c33 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.734146:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f31c33 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.734154:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f31c33 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508611.734233:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13ce:0x0]: returning size 4096 00000004:00200000:0.0:1787508611.734238:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508611.734278:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f31c2c lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad721 expref: 7 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.734291:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f31c33 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad721 expref: 6 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.734298:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13ce:0x0].0x0 (ffff9090ccb87900) 00010000:00010000:0.0:1787508611.734301:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508611.734303:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7c00, rc 0) 00000100:00100000:0.0:1787508611.734325:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c968a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:335993:x1874324509426304:12345-192.168.201.30@tcp:101:rm.0 Request processed in 240us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.734331:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93408 00000100:00100000:0.0:1787508611.738289:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508611.738363:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508611.738792:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509426432 00000100:00100000:1.0:1787508611.738803:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509426432 00000100:00100000:0.0:1787508611.745255:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93411 00000100:00100000:0.0:1787508611.745268:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:335994:x1874324509426688:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508611.745289:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508611.745310:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f31c5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad736 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.745376:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f31c64 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.745389:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f31c64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.745400:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f31c64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.745437:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31c6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.745444:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31c6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.745450:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31c6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.745519:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f31c64 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.745527:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f31c64 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.745534:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f31c64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.745540:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f31c64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.745546:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508611.745549:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f31c64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.745556:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f31c64 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.745568:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508611.745571:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508611.745575:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f31c64 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.745580:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f31c64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.745593:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31c6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.745599:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31c6b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.745604:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31c6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.745608:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508611.745611:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31c6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.745616:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31c6b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.745623:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090e460f700) 00010000:00010000:0.0:1787508611.745625:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508611.745627:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31c6b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.745632:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31c6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.745661:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f31c5d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad736 expref: 583 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.745683:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508611.745686:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508611.745690:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f31c5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad736 expref: 583 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.745699:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7e00, rc 0) 00000100:00100000:0.0:1787508611.746169:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:335994:x1874324509426688:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 903us (1503us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508611.746176:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93411 00000100:00100000:0.0:1787508611.746204:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480053376 00000100:00100000:0.0:1787508611.746209:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480053376 00000100:00100000:0.0:1787508611.746246:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18089 00000100:00100000:0.0:1787508611.746253:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9688380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:209004:x1874324480053376:12345-0@lo:104: 00010000:00010000:0.0:1787508611.746263:0:202210:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec600/0xb126349c40f31bf4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f31bfb expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.746309:0:202210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787508611.746314:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9688380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:209004:x1874324480053376:12345-0@lo:104: Request processed in 62us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.746320:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18089 00010000:00010000:0.0:1787508611.746337:0:202214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508611.746342:0:202214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec600/0xb126349c40f31bf4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f31bfb expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.746348:0:202214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ec600 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:0.0:1787508611.746353:0:202214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec600/0xb126349c40f31bf4 lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f31bfb expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508611.746360:0:202214:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec600/0xb126349c40f31bf4 lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f31bfb expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.746388:0:202214:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec600/0xb126349c40f31bf4 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f31bfb expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.746394:0:202214:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787508611.746419:0:202214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec600/0xb126349c40f31bf4 lrc: 1/0,0 mode: --/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f31bfb expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.746425:0:202214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec600/0xb126349c40f31bf4 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f31bfb expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.746439:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508611.746441:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508611.746442:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508611.746454:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480053504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508611.746482:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508611.746527:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480053504 00000100:00100000:0.0:1787508611.746531:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480053504 00010000:00010000:0.0:1787508611.746546:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f31bfb lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f31bf4 expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508611.746564:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27728 00000100:00100000:0.0:1787508611.746570:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0874000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3616:x1874324480053504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508611.746578:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787508611.747071:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9689880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480053376:0@lo:104: 00010000:00010000:0.0:1787508611.747089:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f31c79 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.749689:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f31bfb lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f31bf4 expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.749713:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x283:0x0].0x0 (ffff9090ccb87c00) 00010000:00010000:1.0:1787508611.749719:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f31c79 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.749727:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f31c79 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.749733:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f31c79 lrc: 4/1,0 mode: PR/PR res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.749767:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508611.749843:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0874000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480053504:12345-0@lo:103:ldlm_bl.0 Request processed in 3272us (3359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508611.749853:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27728 00000100:00100000:1.0:1787508611.749908:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480053504:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508611.750072:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f31c79 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.750080:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f31c79 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508611.750131:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a2:0x283:0x0]: returning size 4096 00000004:00200000:0.0:1787508611.750137:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508611.750180:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f31c72 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x283:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad73d expref: 14 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.750197:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f31c79 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad73d expref: 13 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.750204:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x283:0x0].0x0 (ffff9090ccb87c00) 00010000:00010000:0.0:1787508611.750207:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508611.750209:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aaa00, rc 0) 00000100:00100000:0.0:1787508611.750254:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c968aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:335993:x1874324509426816:12345-192.168.201.30@tcp:101:rm.0 Request processed in 4434us (5396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.750260:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93412 00000100:00100000:0.0:1787508611.751269:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509426944 00000100:00100000:0.0:1787508611.751278:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509426944 00000100:00100000:0.0:1787508611.751333:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93413 00000100:00100000:0.0:1787508611.751343:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c968bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:335994:x1874324509426944:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508611.751362:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508611.751380:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f31c80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad744 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.751609:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31c87 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.751621:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31c87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.751630:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31c87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.751644:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f31c8e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.751650:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f31c8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.751657:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f31c8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.752234:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31c87 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.752243:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31c87 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.752249:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31c87 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.752256:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31c87 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.752262:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508611.752266:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31c87 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.752274:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31c87 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.752286:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508611.752289:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508611.752293:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31c87 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.752300:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f31c87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.752313:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f31c8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.752318:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f31c8e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.752324:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f31c8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.752329:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508611.752332:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f31c8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.752338:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f31c8e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.752345:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090e460f900) 00010000:00010000:0.0:1787508611.752348:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508611.752351:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f31c8e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.752356:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f31c8e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.752389:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f31c80 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad744 expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.752399:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508611.752401:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508611.752585:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f31c80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad744 expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.752597:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7a00, rc 0) 00000100:00100000:0.0:1787508611.752721:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c968bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:335994:x1874324509426944:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 1377us (1564us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508611.752729:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93413 00000100:00100000:1.0:1787508611.758058:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508611.758152:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509427200 00000100:00100000:0.0:1787508611.758162:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509427200 00000100:00100000:0.0:1787508611.758265:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93414 00000100:00100000:0.0:1787508611.758276:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d38db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:335994:x1874324509427200:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508611.758296:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508611.758319:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f31c95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad74b expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.758389:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31c9c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.758406:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31c9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.758417:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31c9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.758442:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f31ca3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.758449:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f31ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.758456:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f31ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.758523:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31c9c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.758530:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31c9c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.758536:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31c9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.758543:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31c9c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.758549:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508611.758553:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31c9c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.758559:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31c9c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.758572:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508611.758575:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508611.758580:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31c9c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.758586:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31c9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.758599:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f31ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.758604:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f31ca3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.758610:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f31ca3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.758615:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508611.758617:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f31ca3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.758624:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f31ca3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.758631:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090e460f700) 00010000:00010000:0.0:1787508611.758633:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508611.758636:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f31ca3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.758642:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f31ca3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.758690:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f31c95 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad74b expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.758700:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508611.758703:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508611.758707:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f31c95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad74b expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.758717:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7e00, rc 0) 00000100:00100000:0.0:1787508611.758782:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d38db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:335994:x1874324509427200:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 507us (733us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508611.758789:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93414 00000100:00100000:1.0:1787508611.771085:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509427328 00000100:00100000:1.0:1787508611.771095:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509427328 00000100:00100000:1.0:1787508611.771201:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93415 00000100:00100000:1.0:1787508611.771212:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c968b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:335994:x1874324509427328:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508611.771232:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508611.771264:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f31caa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad752 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.771326:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f31cb1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.771339:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f31cb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.771350:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f31cb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.771367:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31cb8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.771373:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.771379:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.771454:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f31cbf lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.771463:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f31cbf lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.771471:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f31cbf lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508611.771503:0:205405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f31cbf lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.771524:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f31cb1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.771533:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f31cb1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.771539:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f31cb1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.771546:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f31cb1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.771552:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508611.771556:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f31cb1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.771563:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f31cb1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.771574:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508611.771577:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508611.771581:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f31cb1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.771586:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f31cb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.771598:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.771604:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31cb8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.771609:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31cb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.771614:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508611.771617:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31cb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.771623:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31cb8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.771633:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090cda8aa00) 00010000:00010000:1.0:1787508611.771636:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508611.771650:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31cb8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.771657:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31cb8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.771693:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f31caa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad752 expref: 584 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.771706:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f31cbf lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad752 expref: 583 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.771713:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13ce:0x0].0x0 (ffff9090e460f400) 00010000:00010000:1.0:1787508611.771716:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508611.771719:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b800, rc 0) 00000100:00100000:1.0:1787508611.771825:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c968b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:335994:x1874324509427328:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 614us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508611.771832:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93415 00000100:00100000:1.0:1787508611.778603:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509427584 00000100:00100000:1.0:1787508611.778614:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509427584 00000100:00100000:1.0:1787508611.778829:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93416 00000100:00100000:1.0:1787508611.778841:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:335993:x1874324509427584:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508611.778862:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508611.778887:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f31cc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad759 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508611.779070:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13ce:0x0]: returning size 4096 00010000:00010000:1.0:1787508611.779164:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f31cc6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad759 expref: 9 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.779177:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090cda8a900) 00010000:00010000:1.0:1787508611.779179:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508611.779185:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f31cc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad759 expref: 9 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.779202:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a200, rc 0) 00000100:00100000:1.0:1787508611.779277:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:335993:x1874324509427584:12345-192.168.201.30@tcp:101:rm.0 Request processed in 438us (1185us total) trans 8589961958 rc 301/301 00000100:00100000:1.0:1787508611.779284:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93416 00000100:00100000:0.0:1787508611.780292:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509427712 00000100:00100000:0.0:1787508611.780300:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509427712 00000100:00100000:0.0:1787508611.780381:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93417 00000100:00100000:0.0:1787508611.780391:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c968b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+642:335994:x1874324509427712:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508611.780421:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508611.780438:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f31cd4 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad760 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.780482:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f31cdb lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.780505:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f31cdb lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.780517:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f31cdb lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508611.780585:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13ce:0x0]: returning size 4096 00000004:00200000:0.0:1787508611.780591:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508611.780622:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f31cd4 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad760 expref: 644 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.780636:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f31cdb lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad760 expref: 643 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.780809:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13ce:0x0].0x0 (ffff9090ccb87900) 00010000:00010000:0.0:1787508611.780812:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508611.780815:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6800, rc 0) 00000100:00100000:0.0:1787508611.780908:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c968b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+643:335994:x1874324509427712:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 519us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.780916:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93417 00000100:00100000:0.0:1787508611.783048:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509427840 00000100:00100000:0.0:1787508611.783057:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509427840 00000100:00100000:0.0:1787508611.783151:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93418 00000100:00100000:0.0:1787508611.783161:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+643:335994:x1874324509427840:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508611.783179:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508611.783199:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f31ce2 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x28d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad767 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.783248:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f31ce9 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x28d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.783261:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f31ce9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.783270:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f31ce9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508611.783307:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x28d:0x0]: returning size 4096 00000004:00200000:0.0:1787508611.783312:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508611.783342:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f31ce2 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad767 expref: 645 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.783359:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f31ce9 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad767 expref: 644 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.783367:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28d:0x0].0x0 (ffff9090ccb87d00) 00010000:00010000:0.0:1787508611.783369:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508611.783373:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7a00, rc 0) 00000100:00100000:0.0:1787508611.783438:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:335994:x1874324509427840:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 278us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.783445:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93418 00000100:00100000:1.0:1787508611.801557:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509428096 00000100:00100000:1.0:1787508611.801569:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509428096 00000100:00100000:1.0:1787508611.801640:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93419 00000100:00100000:1.0:1787508611.801650:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:335994:x1874324509428096:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508611.801680:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508611.801702:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f31cf0 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x283:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad76e expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.801763:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31cf7 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x283:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.801777:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31cf7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.801792:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31cf7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508611.801845:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a2:0x283:0x0]: returning size 4096 00000004:00200000:1.0:1787508611.801851:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787508611.801889:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f31cf0 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x283:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad76e expref: 585 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.801907:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31cf7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad76e expref: 584 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.801915:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x283:0x0].0x0 (ffff9090ccb87c00) 00010000:00010000:1.0:1787508611.801918:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508611.801922:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b600, rc 0) 00000100:00100000:1.0:1787508611.802030:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:335994:x1874324509428096:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 380us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508611.802038:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93419 00000100:00100000:1.0:1787508611.812933:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509428352 00000100:00100000:1.0:1787508611.812967:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509428352 00000100:00100000:1.0:1787508611.813033:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93420 00000100:00100000:1.0:1787508611.813044:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:335994:x1874324509428352:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:1.0:1787508611.813096:0:202228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508611.813125:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f31cdb lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad760 expref: 644 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.813147:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13ce:0x0].0x0 (ffff9090ccb87900) 00010000:00010000:1.0:1787508611.813153:0:202228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787508611.813177:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f31cfe lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.813191:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f31c33 lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad721 expref: 7 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.813200:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f31cfe lrc: 4/0,1 mode: --/PW res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.813233:0:202228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f31c33 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad721 expref: 7 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.813248:0:202228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f31c33 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad721 expref: 7 pid: 230618 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508611.813261:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb38e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:202228:1874324480053632:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508611.813346:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508611.819180:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508611.821828:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509428608 00000100:00100000:0.0:1787508611.821837:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509428608 00010000:00010000:0.0:1787508611.821875:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f31c33 lrc: 5/0,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad721 expref: 8 pid: 230618 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508611.821921:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27729 00000100:00100000:0.0:1787508611.821930:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2400:x1874324509428608:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508611.821977:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508611.821984:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f31c33 lrc: 5/0,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad721 expref: 8 pid: 230618 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.822000:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f31c33 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad721 expref: 8 pid: 230618 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.822020:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13ce:0x0].0x0 (ffff9090ccb87900) 00010000:00010000:0.0:1787508611.822025:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f31cfe lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.822036:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f31cfe lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.822043:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f31cfe lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.822061:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508611.822095:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2400:x1874324509428608:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 166us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.822103:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27729 00010000:00010000:1.0:1787508611.823047:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f31c33 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad721 expref: 7 pid: 230618 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508611.823069:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb38e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:202228:1874324480053632:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508611.823093:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f31cfe lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.823103:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f31cfe lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.823113:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f31cfe lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.823142:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f31d05 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x28d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.823153:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f31c41 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad728 expref: 6 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.823161:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f31ce9 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad767 expref: 643 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.823169:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f31d05 lrc: 5/0,1 mode: --/PW res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.823197:0:202228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f31ce9 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad767 expref: 643 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.823210:0:202228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f31ce9 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad767 expref: 643 pid: 202226 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508611.823223:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb38e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:202228:1874324480053760:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508611.823419:0:202228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f31c41 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad728 expref: 6 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.823429:0:202228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f31c41 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad728 expref: 6 pid: 205405 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508611.823450:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b02680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:202228:1874324480053888:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508611.823474:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787508611.845894:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509428736 00000100:00100000:0.0:1787508611.845903:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509428736 00010000:00010000:0.0:1787508611.845979:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f31c41 lrc: 5/0,0 mode: PR/PR res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad728 expref: 7 pid: 205405 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508611.846011:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509428864 00000100:00100000:0.0:1787508611.846014:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509428864 00010000:00010000:0.0:1787508611.846028:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f31ce9 lrc: 5/0,0 mode: PR/PR res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad767 expref: 644 pid: 202226 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508611.846051:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27730 00000100:00100000:0.0:1787508611.846061:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2401:x1874324509428736:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508611.846076:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508611.846083:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f31c41 lrc: 5/0,0 mode: PR/PR res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad728 expref: 7 pid: 205405 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.846093:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f31c41 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad728 expref: 7 pid: 205405 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.846114:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28d:0x0].0x0 (ffff9090ccb87d00) 00010000:00010000:0.0:1787508611.846118:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f31d05 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.846127:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f31d05 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.846133:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508611.846180:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2401:x1874324509428736:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 120us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.846187:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27730 00000100:00100000:0.0:1787508611.846206:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27731 00000100:00100000:0.0:1787508611.846212:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:2401:x1874324509428864:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508611.846220:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508611.846225:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f31ce9 lrc: 5/0,0 mode: PR/PR res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad767 expref: 644 pid: 202226 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.846236:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f31ce9 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad767 expref: 644 pid: 202226 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.846252:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28d:0x0].0x0 (ffff9090ccb87d00) 00010000:00010000:0.0:1787508611.846256:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f31d05 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.846263:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f31d05 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.846269:0:202212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f31d05 lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.846285:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508611.846304:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:2401:x1874324509428864:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 92us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.846310:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27731 00010000:00010000:1.0:1787508611.846885:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f31c41 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad728 expref: 6 pid: 205405 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508611.846905:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b02680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:202228:1874324480053888:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508611.848318:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480054016 00000100:00100000:1.0:1787508611.848326:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480054016 00000100:00100000:1.0:1787508611.848377:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29533 00000100:00100000:1.0:1787508611.848386:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed03e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:202228:x1874324480054016:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1787508611.848401:0:225829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508611.848414:0:225829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31d13 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f31d0c expref: -99 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.848437:0:225829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f31c79 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad73d expref: 13 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.848447:0:225829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31cf7 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad76e expref: 583 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.848455:0:225829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31d13 lrc: 5/0,0 mode: --/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f31d0c expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.848477:0:225829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31cf7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad76e expref: 583 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.848506:0:225829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31cf7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad76e expref: 583 pid: 205405 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508611.848518:0:225829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b02680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480054144:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508611.848584:0:225829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f31c79 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad73d expref: 13 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.848593:0:225829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f31c79 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad73d expref: 13 pid: 209004 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508611.848601:0:225829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b3bb80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480054272:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508611.848623:0:225829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9780 going to sleep for 11 seconds 00000100:00100000:0.0:1787508611.848723:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:335993:x1874324509428480:12345-192.168.201.30@tcp:37:rm.0 Request processed in 29274us (29553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.848733:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15378 00000100:00100000:1.0:1787508611.858430:0:225829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b02680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480054144:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508611.860360:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509428992 00000100:00100000:0.0:1787508611.860370:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509428992 00010000:00010000:0.0:1787508611.860535:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31cf7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad76e expref: 584 pid: 205405 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508611.860582:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27732 00000100:00100000:0.0:1787508611.860592:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:2400:x1874324509428992:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508611.860606:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508611.860613:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31cf7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad76e expref: 584 pid: 205405 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.860631:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31cf7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad76e expref: 584 pid: 205405 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.860652:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31cf7 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad76e expref: 584 pid: 205405 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.860668:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x283:0x0].0x0 (ffff9090ccb87c00) 00010000:00010000:0.0:1787508611.860675:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31d13 lrc: 3/0,0 mode: --/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f31d0c expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.860683:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31d13 lrc: 3/0,0 mode: --/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f31d0c expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.860690:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508611.860735:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:2400:x1874324509428992:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 145us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.860742:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27732 00000100:00100000:1.0:1787508611.862988:0:225829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b3bb80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480054272:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508611.863024:0:225829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31d13 lrc: 3/0,0 mode: --/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f31d0c expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.863038:0:225829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x283:0x0].0x0 (ffff9090ccb87c00) 00010000:00010000:1.0:1787508611.863041:0:225829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508611.863045:0:225829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31d13 lrc: 3/0,0 mode: --/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f31d0c expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.863055:0:225829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31d13 lrc: 3/0,0 mode: --/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f31d0c expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.863069:0:225829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247bc00, rc 0) 00000100:00100000:1.0:1787508611.863126:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed03e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:202228:x1874324480054016:12345-0@lo:101:mdt00_002.0 Request processed in 14741us (15134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508611.863134:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29533 00000100:00100000:0.0:1787508611.874307:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509429376 00000100:00100000:0.0:1787508611.874317:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509429376 00010000:00010000:0.0:1787508611.874359:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f31c79 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad73d expref: 13 pid: 209004 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508611.874469:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27733 00000100:00100000:0.0:1787508611.874481:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2400:x1874324509429376:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508611.874614:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508611.874624:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f31c79 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad73d expref: 13 pid: 209004 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.874640:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f31c79 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad73d expref: 13 pid: 209004 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.874662:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f31c79 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad73d expref: 13 pid: 209004 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.874680:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x283:0x0].0x0 (ffff9090ccb87c00) 00010000:00010000:0.0:1787508611.874687:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31d13 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f31d0c expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.874698:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31d13 lrc: 2/0,0 mode: PW/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f31d0c expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.874707:0:202212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31d13 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f31d0c expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.874741:0:202212:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31d13 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f31d0c expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508611.874754:0:202212:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0877100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:202212:1874324480054400:0@lo:105: 00000100:00100000:0.0:1787508611.874801:0:202212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508611.874845:0:202212:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9e8d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508611.874977:0:229386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18090 00000100:00100000:1.0:1787508611.874988:0:229386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0876300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:202212:x1874324480054400:12345-0@lo:105: 00010000:00010000:1.0:1787508611.875060:0:229386:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f31d0c lrc: 5/0,1 mode: --/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f31d13 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875070:0:229386:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f31d0c lrc: 5/0,1 mode: --/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f31d13 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875079:0:229386:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f31d0c lrc: 5/0,1 mode: --/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f31d13 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875087:0:229386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f31d0c lrc: 5/0,1 mode: PW/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f31d13 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875092:0:229386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f31d0c lrc: 6/0,1 mode: PW/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f31d13 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875099:0:229386:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f31d0c lrc: 6/0,1 mode: PW/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f31d13 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875215:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31d28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875229:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31d28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875237:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31d28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875301:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f31d2f lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875309:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f31d2f lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875316:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f31d2f lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508611.875335:0:209004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f31d2f lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875349:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f31d21 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875355:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f31d21 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875361:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f31d21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875367:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f31d21 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875373:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508611.875376:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f31d21 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875384:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f31d21 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875392:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508611.875395:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508611.875398:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f31d21 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875404:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f31d21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875413:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31d28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875419:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31d28 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875424:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31d28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875428:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508611.875573:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31d28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875581:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31d28 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875590:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090cda8a900) 00010000:00010000:1.0:1787508611.875592:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508611.875595:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31d28 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875601:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31d28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875630:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f31d1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad775 expref: 14 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875641:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f31d2f lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad775 expref: 13 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.875660:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13ce:0x0].0x0 (ffff9090e460f400) 00010000:00010000:1.0:1787508611.875662:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508611.875666:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247be00, rc 0) 00000100:00100000:1.0:1787508611.875689:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:335993:x1874324509429504:12345-192.168.201.30@tcp:101:rm.0 Request processed in 650us (1487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508611.875694:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93421 00000004:00080000:1.0:1787508611.875894:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13576 rpc_version 13576 00000020:00100000:1.0:1787508611.875917:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787508611.875925:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091f9b3bb80 x1874324480054656/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1528/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787508611.875964:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b3bb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480054656:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508611.876253:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508611.876275:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9780 going to sleep for 11 seconds 00000100:00100000:1.0:1787508611.878618:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b3bb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480054656:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508611.887533:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509429760 00000100:00100000:1.0:1787508611.887544:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509429760 00000100:00100000:0.0:1787508611.887552:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509429632 00000100:00100000:0.0:1787508611.887558:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509429632 00000100:00100000:0.0:1787508611.887597:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509430016 00000100:00100000:0.0:1787508611.887600:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509430016 00000100:00100000:0.0:1787508611.887629:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93422 00000100:00100000:0.0:1787508611.887639:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:335993:x1874324509429632:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508611.887661:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508611.887681:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f31d36 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad77c expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.887747:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f31d44 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.887760:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f31d44 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.887772:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f31d44 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508611.887878:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13ce:0x0]: returning size 4096 00000004:00200000:0.0:1787508611.887884:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508611.887922:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f31d36 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad77c expref: 9 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.887982:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f31d44 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad77c expref: 8 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.887994:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13ce:0x0].0x0 (ffff9090ccb87900) 00010000:00010000:0.0:1787508611.887997:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508611.888001:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7600, rc 0) 00000100:00100000:1.0:1787508611.888369:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9760 00000100:00100000:1.0:1787508611.888379:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde18850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2402:x1874324509429760:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508611.888391:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508611.888404:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f31d2f lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad775 expref: 13 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.888414:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13ce:0x0].0x0 (ffff9090e460f400) 00010000:00010000:1.0:1787508611.888417:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508611.888449:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde18850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2402:x1874324509429760:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 72us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508611.888455:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9760 00000100:00100000:0.0:1787508611.891347:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:335993:x1874324509429632:12345-192.168.201.30@tcp:101:rm.0 Request processed in 3696us (3945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.891365:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93422 00000100:00100000:0.0:1787508611.894907:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509430400 00000100:00100000:0.0:1787508611.894916:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509430400 00000100:00100000:0.0:1787508611.895155:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9761 00000100:00100000:0.0:1787508611.895167:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2400:x1874324509430400:12345-192.168.201.30@tcp:103:rm.0 00010000:00010000:0.0:1787508611.895181:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508611.895203:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f31c17 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad713 expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.895219:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13ce:0x0].0x0 (ffff9090e460f400) 00010000:00010000:0.0:1787508611.895223:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508611.895272:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2400:x1874324509430400:12345-192.168.201.30@tcp:103:rm.0 Request processed in 108us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.895279:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9761 00000100:00100000:0.0:1787508611.900331:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509430656 00000100:00100000:0.0:1787508611.900343:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509430656 00000100:00100000:0.0:1787508611.900407:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509430912 00000100:00100000:0.0:1787508611.900411:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509430912 00000100:00100000:0.0:1787508611.900560:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93425 00000100:00100000:0.0:1787508611.900571:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:335993:x1874324509430656:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:0.0:1787508611.900627:0:202228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508611.900674:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f31d44 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad77c expref: 8 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.900693:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13ce:0x0].0x0 (ffff9090ccb87900) 00010000:00010000:0.0:1787508611.900698:0:202228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508611.900746:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7e00/0xb126349c40f31d6e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.900755:0:202228:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7e00/0xb126349c40f31d6e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.900764:0:202228:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7e00/0xb126349c40f31d6e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508611.900784:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0874700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480054784:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1787508611.900842:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508611.900877:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9e8d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508611.905714:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27734 00000100:00100000:1.0:1787508611.905726:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1515f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2401:x1874324509431168:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508611.905741:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508611.905747:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31bdf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad70c expref: 11 pid: 202227 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.905758:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31bdf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad70c expref: 11 pid: 202227 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.905778:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31bdf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad70c expref: 11 pid: 202227 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.905791:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508611.905796:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f31d75 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f31d6e expref: 8 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.905808:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508611.907227:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1515f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2401:x1874324509431168:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1495us (2307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508611.907682:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27734 00000100:00100000:1.0:1787508611.907750:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0874700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480054784:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1787508611.907771:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7e00/0xb126349c40f31d6e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f31d75 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.907782:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7e00/0xb126349c40f31d6e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f31d75 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508611.911856:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c818c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480055168:0@lo:104: 00010000:00010000:1.0:1787508611.911878:0:202226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f31d98 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.911897:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7e00/0xb126349c40f31d6e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f31d75 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.911905:0:202228:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7e00/0xb126349c40f31d6e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f31d75 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787508611.911925:0:202228:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787508611.911976:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f31d9f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.911984:0:202228:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f31d9f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.911993:0:202228:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f31d9f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508611.912009:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480055424:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1787508611.912038:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508611.912065:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480055424 00000100:00100000:1.0:1787508611.912069:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480055424 00000100:00100000:1.0:1787508611.912104:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29536 00000100:00100000:1.0:1787508611.912110:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:202228:x1874324480055424:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1787508611.912125:0:202231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508611.912139:0:202231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31da6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f31d9f expref: -99 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.912158:0:202231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31da6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f31d9f expref: 10 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.912171:0:202231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31da6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f31d9f expref: 10 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.912180:0:202231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090cda8aa00) 00010000:00010000:1.0:1787508611.912183:0:202231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508611.912186:0:202231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a000, rc 0) 00000100:00100000:1.0:1787508611.912214:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:202228:x1874324480055424:12345-0@lo:101:mdt00_002.0 Request processed in 104us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508611.912220:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29536 00000100:00100000:1.0:1787508611.912248:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787508611.912262:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480055424:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1787508611.912277:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f31d9f lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f31da6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.912285:0:202228:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f31d9f lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f31da6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787508611.912295:0:202228:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1787508611.912327:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480055552:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787508611.912354:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508611.912368:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787508611.914136:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480055552 00000100:00100000:0.0:1787508611.914143:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480055552 00000100:00100000:0.0:1787508611.914192:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29537 00000100:00100000:0.0:1787508611.914200:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:202228:x1874324480055552:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787508611.914294:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:202228:x1874324480055552:12345-0@lo:1000:mdt00_002.0 Request processed in 95us (1938us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.914301:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29537 00000100:00100000:1.0:1787508611.914384:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480055552:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787508611.914448:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480055680:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787508611.914480:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508611.914521:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508611.914835:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480055680:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787508611.914885:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b200/0xb126349c40f31dad lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.914894:0:202228:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b200/0xb126349c40f31dad lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.914904:0:202228:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b200/0xb126349c40f31dad lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508611.914916:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480055808:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1787508611.914972:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508611.914991:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787508611.915060:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480055808 00000100:00100000:0.0:1787508611.915064:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480055808 00000100:00100000:0.0:1787508611.915092:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29539 00000100:00100000:0.0:1787508611.915098:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:202228:x1874324480055808:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1787508611.915108:0:202231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508611.915124:0:202231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f31db4 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f31dad expref: -99 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.915145:0:202231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f31cbf lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad752 expref: 583 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.915160:0:202231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f31db4 lrc: 4/0,0 mode: --/EX res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f31dad expref: 11 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.915185:0:202231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f31cbf lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad752 expref: 583 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.915199:0:202231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f31cbf lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad752 expref: 583 pid: 205405 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508611.915210:0:202231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0874700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480055936:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508611.915256:0:202231:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9e8d840 going to sleep for 11 seconds 00000100:00100000:1.0:1787508611.918763:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480056064 00000100:00100000:1.0:1787508611.918767:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480056064 00000100:00100000:1.0:1787508611.918804:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18093 00000100:00100000:1.0:1787508611.918811:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1514a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:225839:x1874324480056064:12345-0@lo:105: 00010000:00010000:1.0:1787508611.918821:0:202210:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b200/0xb126349c40f31dad lrc: 4/0,1 mode: --/EX res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f31db4 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.918830:0:202210:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b200/0xb126349c40f31dad lrc: 4/0,1 mode: --/EX res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f31db4 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.918839:0:202210:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b200/0xb126349c40f31dad lrc: 4/0,1 mode: --/EX res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f31db4 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.918845:0:202210:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b200/0xb126349c40f31dad lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f31db4 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.918852:0:202210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b200/0xb126349c40f31dad lrc: 5/0,1 mode: EX/EX res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f31db4 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.918860:0:202210:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b200/0xb126349c40f31dad lrc: 5/0,1 mode: EX/EX res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f31db4 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.918876:0:202210:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d247b200) 00000100:00100000:1.0:1787508611.918922:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1514a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:225839:x1874324480056064:12345-0@lo:105: Request processed in 111us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508611.918929:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18093 00010000:00010000:0.0:1787508611.920588:0:202231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f31cbf lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad752 expref: 583 pid: 205405 timeout: 13682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508611.920611:0:202231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0874700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480055936:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508611.920641:0:202231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f31db4 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f31dad expref: 11 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.920651:0:202231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13ce:0x0].0x0 (ffff9090e460f400) 00010000:00010000:0.0:1787508611.920654:0:202231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508611.920658:0:202231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7600, rc 0) 00000100:00100000:0.0:1787508611.920790:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:202228:x1874324480055808:12345-0@lo:101:mdt00_002.0 Request processed in 5692us (5850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.920798:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29539 00000100:00100000:1.0:1787508611.920863:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480055808:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1787508611.920883:0:202228:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b200/0xb126349c40f31dad lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f31db4 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.920912:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f31dbb lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.920924:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f31dbb lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.920933:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f31dbb lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.922516:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f31dc2 lrc: 3/0,1 mode: --/EX res: [0x240000bd1:0x28d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.922534:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f31dc2 lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x28d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.922545:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f31dc2 lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x28d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.922584:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f31dc9 lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x283:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.922591:0:202228:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f31dc9 lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x283:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x0 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.922603:0:202228:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f31dc9 lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x283:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508611.922624:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480056192:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1787508611.922677:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508611.922792:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9e40 going to sleep for 11 seconds 00010000:00010000:1.0:1787508611.923848:0:226765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787508611.923855:0:226765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f31d0c lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f31d13 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.923863:0:226765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab800 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:1.0:1787508611.923869:0:226765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f31d0c lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f31d13 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508611.923877:0:226765:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f31d0c lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f31d13 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.923901:0:226765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f31d0c lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f31d13 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.923907:0:226765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787508611.923925:0:226765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f31d0c lrc: 1/0,0 mode: --/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f31d13 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.923933:0:226765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f31d0c lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f31d13 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.923963:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508611.923965:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508611.923966:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508611.923972:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787508611.923983:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480056448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508611.924012:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508611.924038:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480056448 00000100:00100000:1.0:1787508611.924042:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480056448 00010000:00010000:1.0:1787508611.924060:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31d13 lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f31d0c expref: 13 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508611.924081:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27737 00000100:00100000:1.0:1787508611.924087:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+13:3616:x1874324480056448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508611.924096:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787508611.924557:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480056192:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1787508611.924574:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f31dc9 lrc: 4/0,1 mode: --/EX res: [0x2000013a2:0x283:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f31dd0 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.924582:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f31dc9 lrc: 4/0,1 mode: --/EX res: [0x2000013a2:0x283:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f31dd0 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787508611.926834:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944024 is committed 00010000:00010000:1.0:1787508611.928303:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31d13 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x283:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f31d0c expref: 11 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.928328:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x283:0x0].0x0 (ffff9090ccb87c00) 00010000:00010000:1.0:1787508611.928335:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f31dd0 lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0x283:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f31dc9 expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.928345:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f31dd0 lrc: 2/0,0 mode: EX/EX res: [0x2000013a2:0x283:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f31dc9 expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.928353:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f31dd0 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x283:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f31dc9 expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.928455:0:202213:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f31dd0 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x283:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f31dc9 expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508611.928477:0:202213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6ac4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:202213:1874324480056576:0@lo:105: 00000100:00100000:1.0:1787508611.928556:0:202213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508611.928652:0:202213:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787508611.929083:0:202213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6ac4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:202213:1874324480056576:0@lo:105: 00010000:00010000:1.0:1787508611.929102:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508611.929146:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3616:x1874324480056448:12345-0@lo:103:ldlm_bl.0 Request processed in 5059us (5133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508611.929153:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27737 00000100:00100000:1.0:1787508611.929185:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480056448:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508611.929205:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f31dc9 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x283:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f31dd0 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.929214:0:202228:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f31dc9 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x283:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f31dd0 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508611.929854:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480056704:0@lo:403:mdt00_002.0 00000100:00100000:1.0:1787508611.929900:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508611.929925:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787508611.929963:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480056704 00000100:00100000:1.0:1787508611.929968:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480056704 00000100:00100000:1.0:1787508611.930002:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29541 00000100:00100000:1.0:1787508611.930009:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:202228:x1874324480056704:12345-0@lo:403:mdt00_002.0 00000100:00100000:1.0:1787508611.931703:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:202228:x1874324480056704:12345-0@lo:403:mdt00_002.0 Request processed in 1686us (1795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508611.931714:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29541 00000100:00100000:1.0:1787508611.931768:0:202228:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944024 gen 2 00000004:00080000:1.0:1787508611.931774:0:202228:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944024 committed transno 12884944024 00000100:00100000:1.0:1787508611.931796:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480056704:0@lo:403:mdt00_002.0 00000040:00080000:1.0:1787508611.933384:0:202228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xf:0x0].32, 664 off65536 00000040:00080000:1.0:1787508611.933647:0:202228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x5:0x0].575, 744 off729520 00000004:00080000:1.0:1787508611.933654:0:202228:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d01c9e40 with version 13577 00000100:00100000:0.0:1787508611.933973:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480056960 00000100:00100000:0.0:1787508611.933981:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480056960 00000100:00100000:0.0:1787508611.934028:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29542 00000100:00100000:0.0:1787508611.934037:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:202961:x1874324480056960:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508611.934788:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:202961:x1874324480056960:12345-0@lo:1000:osp_up0-1.0 Request processed in 749us (928us total) trans 12884944025 rc 0/0 00000100:00100000:1.0:1787508611.934796:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29542 00000004:00200000:1.0:1787508611.934965:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13ce:0x0]: returning size 4096 00010000:00010000:1.0:1787508611.934985:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f31dc2 lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x28d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.934994:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f31dc2 lrc: 2/0,0 mode: EX/EX res: [0x240000bd1:0x28d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.935002:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f31dc2 lrc: 3/0,0 mode: EX/EX res: [0x240000bd1:0x28d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.935008:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508611.935012:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f31dc2 lrc: 3/0,0 mode: EX/EX res: [0x240000bd1:0x28d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.935019:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f31dc2 lrc: 4/0,0 mode: EX/EX res: [0x240000bd1:0x28d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.935033:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28d:0x0].0x0 (ffff9090ccb87d00) 00010000:00010000:1.0:1787508611.935036:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787508611.935040:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f31dc2 lrc: 2/0,0 mode: --/EX res: [0x240000bd1:0x28d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.935051:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f31dc2 lrc: 0/0,0 mode: --/EX res: [0x240000bd1:0x28d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.935062:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f31dc9 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x283:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f31dd0 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.935070:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f31dc9 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x283:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f31dd0 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.935078:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f31dc9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x283:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f31dd0 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.935097:0:202228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787508611.935104:0:202228:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x283:0x0] 00010000:00010000:1.0:1787508611.935109:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f31dbb lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.935115:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f31dbb lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.935121:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f31dbb lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.935125:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508611.935128:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f31dbb lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.935134:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f31dbb lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.935146:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13ce:0x0].0x0 (ffff9090ccb87900) 00010000:00010000:1.0:1787508611.935148:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508611.935151:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f31dbb lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.935156:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f31dbb lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.935164:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b200/0xb126349c40f31dad lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f31db4 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.935170:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b200/0xb126349c40f31dad lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f31db4 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.935176:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b200/0xb126349c40f31dad lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f31db4 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.935185:0:202228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1787508611.935194:0:202228:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787508611.935198:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7e00/0xb126349c40f31d6e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f31d75 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.935205:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7e00/0xb126349c40f31d6e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xb126349c40f31d75 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.935212:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7e00/0xb126349c40f31d6e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xb126349c40f31d75 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.935227:0:202228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000004:00080000:1.0:1787508611.935231:0:202228:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787508611.935235:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f31d9f lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f31da6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.936343:0:202228:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f31d9f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f31da6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508611.936386:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9762 00000100:00100000:1.0:1787508611.936393:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1516a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+12:3619:x1874324480057216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508611.936503:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508611.936519:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9763 00000100:00100000:0.0:1787508611.936528:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1515880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+12:3617:x1874324480057344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508611.936536:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508611.936547:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f31db4 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f31dad expref: 12 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508611.936557:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13ce:0x0].0x0 (ffff9090e460f400) 00010000:00010000:0.0:1787508611.936564:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508611.936601:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1515880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:3617:x1874324480057344:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.936608:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9763 00000100:00100000:0.0:1787508611.936640:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1514a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480057344:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508611.936680:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508611.936691:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f31dd0 lrc: 0/0,0 mode: --/EX res: [0x2000013a2:0x283:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f31dc9 expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.936701:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x283:0x0].0x0 (ffff9090ccb87c00) 00010000:00010000:1.0:1787508611.936707:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508611.936741:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1516a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3619:x1874324480057216:12345-0@lo:103:ldlm_bl.0 Request processed in 349us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508611.936747:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9762 00010000:00010000:1.0:1787508611.936766:0:202226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f31d98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.936773:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f31d98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508611.936815:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508611.936818:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508611.936834:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f31d98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.936856:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f31d91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad798 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.936871:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f31d98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad798 expref: 582 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.936878:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508611.936881:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508611.936883:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d22ed200, rc 0) 00000100:00100000:1.0:1787508611.936922:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:335995:x1874324509431296:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 29051us (29561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508611.936928:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93427 00000100:00100000:1.0:1787508611.936980:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:335993:x1874324509430656:12345-192.168.201.30@tcp:36:rm.0 Request processed in 36412us (39746us total) trans 8589961961 rc 0/0 00000100:00100000:1.0:1787508611.936986:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93425 00000100:00100000:0.0:1787508611.937306:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480057088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508611.937317:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480057216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508611.951203:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509431808 00000100:00100000:1.0:1787508611.951212:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509431808 00000100:00100000:1.0:1787508611.951271:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93430 00000100:00100000:1.0:1787508611.951281:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:335995:x1874324509431808:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508611.951297:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508611.951313:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f31e01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad7ad expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.951361:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e08 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.951371:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.951381:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.951390:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e0f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.951394:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.951398:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.951569:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e08 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.951577:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e08 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.951582:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e08 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.951587:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e08 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.951590:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508611.951594:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e08 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.951598:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e08 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.951607:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508611.951610:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508611.951613:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e08 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.951617:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.951626:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.951629:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e0f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.951632:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.951635:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247bc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508611.951637:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.951640:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e0f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.951644:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090cda8af00) 00010000:00010000:1.0:1787508611.951645:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508611.951647:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e0f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.951650:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e0f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.951673:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f31e01 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad7ad expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.951683:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508611.951685:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508611.951689:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f31e01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad7ad expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.951697:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a400, rc 0) 00000100:00100000:1.0:1787508611.951786:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:335995:x1874324509431808:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 507us (906us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508611.951792:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93430 00000100:00100000:0.0:1787508611.958217:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508611.958309:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509432064 00000100:00100000:1.0:1787508611.958318:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509432064 00000100:00100000:1.0:1787508611.958382:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93431 00000100:00100000:1.0:1787508611.958393:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:335995:x1874324509432064:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508611.958713:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508611.958735:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f31e16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad7b4 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.958809:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e1d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.958823:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.958836:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.958849:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.958856:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.958862:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.958918:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e1d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.958925:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e1d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.958929:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e1d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.958933:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e1d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.958937:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247bc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508611.958965:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e1d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.958971:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e1d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.958979:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508611.958981:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508611.958985:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e1d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.958991:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.959003:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.959009:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e24 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.959015:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.959021:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508611.959024:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.959030:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e24 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.959038:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ad43c78 (ffff9090cda8af00) 00010000:00010000:1.0:1787508611.959039:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508611.959041:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e24 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.959045:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.959069:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f31e16 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad7b4 expref: 583 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.959075:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508611.959077:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508611.959080:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f31e16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad7b4 expref: 583 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508611.959086:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a400, rc 0) 00000100:00100000:1.0:1787508611.959139:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:335995:x1874324509432064:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 750us (932us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508611.959145:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93431 00000100:00100000:0.0:1787508611.975861:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508611.983902:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:335996:x1874324509432448:12345-192.168.201.30@tcp:101:rm.0 Request processed in 7859us (8037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508611.983912:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93433 00000100:00100000:0.0:1787508611.995845:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508611.995891:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.003909:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508612.004622:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509432960 00000100:00100000:1.0:1787508612.004634:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509432960 00000100:00100000:1.0:1787508612.004707:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93436 00000100:00100000:1.0:1787508612.004719:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:335996:x1874324509432960:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508612.004739:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508612.004762:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f31e78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad7d7 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.004828:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.004843:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.004853:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.004867:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.004874:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.004883:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.004936:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e7f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.004976:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e7f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.004982:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.004988:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e7f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.004995:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.004998:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e7f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.005005:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e7f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.005018:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508612.005021:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508612.005026:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e7f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.005032:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31e7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.005044:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.005050:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.005055:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.005060:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247bc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.005062:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.005067:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.005075:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090cda8af00) 00010000:00010000:1.0:1787508612.005077:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508612.005081:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e86 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.005087:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f31e86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.005115:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f31e78 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad7d7 expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.005124:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508612.005126:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508612.005130:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f31e78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad7d7 expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.005145:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a400, rc 0) 00000100:00100000:1.0:1787508612.005206:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:335996:x1874324509432960:12345-192.168.201.30@tcp:101:rm.0 Request processed in 490us (1309us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508612.005214:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93436 00000100:00080000:0.0:1787508612.005342:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787508612.008596:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.008722:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00080000:0.0:1787508612.016722:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787508612.016767:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93438 00000100:00100000:1.0:1787508612.016779:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:335996:x1874324509433344:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508612.016790:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508612.016799:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f31ea2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad7e5 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.016835:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f31ea9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.016863:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f31ea9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.016882:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f31ea9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.016899:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f31eb0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.016911:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f31eb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.016925:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f31eb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.016984:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f31ea9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.017004:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f31ea9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.017020:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f31ea9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.017033:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f31ea9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.017046:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.017052:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f31ea9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.017062:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f31ea9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.017077:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508612.017084:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508612.017089:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f31ea9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.017097:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f31ea9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.017109:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f31eb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.017118:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f31eb0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.017131:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f31eb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.017144:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.017150:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f31eb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.017162:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f31eb0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.017173:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090cda8ad00) 00010000:00010000:1.0:1787508612.017176:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508612.017179:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f31eb0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.017184:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f31eb0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.017208:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f31ea2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad7e5 expref: 12 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.017217:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508612.017219:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508612.017223:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f31ea2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad7e5 expref: 12 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.017231:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b000, rc 0) 00000100:00100000:1.0:1787508612.017261:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:335996:x1874324509433344:12345-192.168.201.30@tcp:101:rm.0 Request processed in 485us (8538us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508612.017273:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93438 00000100:00100000:0.0:1787508612.025741:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.032610:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.032661:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508612.032754:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509433984 00000100:00100000:1.0:1787508612.032765:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509433984 00000100:00100000:1.0:1787508612.032818:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509434240 00000100:00100000:1.0:1787508612.032822:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509434240 00000100:00100000:1.0:1787508612.032860:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93441 00000100:00100000:1.0:1787508612.032871:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:335996:x1874324509433984:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508612.032892:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508612.032913:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f31ee1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad7fa expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.033005:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f31ee8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.033019:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f31ee8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.033029:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f31ee8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.033039:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f31eef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.033048:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31da6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f31d9f expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.033056:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f31eef lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.033088:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31da6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f31d9f expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508612.033115:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480057472:0@lo:104: 00000100:00100000:1.0:1787508612.033169:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508612.033206:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8780 going to sleep for 11 seconds 00000100:00100000:0.0:1787508612.033274:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480057472 00000100:00100000:0.0:1787508612.033278:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480057472 00000100:00100000:0.0:1787508612.033319:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18096 00000100:00100000:0.0:1787508612.033328:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:230618:x1874324480057472:12345-0@lo:104: 00010000:00010000:0.0:1787508612.033340:0:229363:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f31d9f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f31da6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.033391:0:229363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787508612.033399:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:230618:x1874324480057472:12345-0@lo:104: Request processed in 72us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.033406:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18096 00010000:00010000:1.0:1787508612.033644:0:226765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787508612.033652:0:226765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f31d9f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f31da6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.033664:0:226765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247be00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:1.0:1787508612.033671:0:226765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f31d9f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f31da6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508612.033688:0:226765:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f31d9f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f31da6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.033733:0:226765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f31d9f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f31da6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.033740:0:226765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787508612.033800:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6ac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480057600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508612.033830:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787508612.033875:0:226765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f31d9f lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f31da6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.033883:0:226765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f31d9f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f31da6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.033898:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508612.033900:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508612.033901:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508612.033930:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480057472:0@lo:104: 00010000:00010000:1.0:1787508612.033979:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f31eef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508612.035066:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480057600 00000100:00100000:1.0:1787508612.035077:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480057600 00010000:00010000:1.0:1787508612.035118:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31da6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f31d9f expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508612.035152:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27739 00000100:00100000:1.0:1787508612.035161:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3617:x1874324480057600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508612.035172:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1787508612.038153:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944025 is committed 00010000:00010000:1.0:1787508612.038727:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f31da6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f31d9f expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.038747:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090cda8aa00) 00010000:00010000:1.0:1787508612.038752:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f31eef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.038763:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f31eef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.038774:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f31eef lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.038811:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508612.038869:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480057600:12345-0@lo:103:ldlm_bl.0 Request processed in 3708us (5036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508612.038878:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27739 00000100:00100000:1.0:1787508612.038933:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6ac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480057600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508612.053798:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.081362:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.097562:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508612.100558:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480057984 00000100:00100000:1.0:1787508612.100567:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480057984 00000100:00100000:1.0:1787508612.100621:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29543 00000100:00100000:1.0:1787508612.100630:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:202248:x1874324480057984:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787508612.101709:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509435136 00000100:00100000:0.0:1787508612.101716:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509435136 00000100:00100000:0.0:1787508612.101766:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93446 00000100:00100000:0.0:1787508612.101776:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:335998:x1874324509435136:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508612.101791:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.101811:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f31f43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad816 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.101871:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f31f4a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.101885:0:209004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec600/0xb126349c40f31f35 lrc: 2/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.101893:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f31f4a lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.101911:0:209004:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec600/0xb126349c40f31f35 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.101923:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f31f4a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.102411:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:202248:x1874324480057984:12345-0@lo:1000:osp_up1-0.0 Request processed in 1781us (1928us total) trans 8589961962 rc 0/0 00000100:00100000:0.0:1787508612.102421:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29543 00010000:00010000:0.0:1787508612.106808:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f31f4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.106817:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f31f4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508612.106866:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787508612.106870:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508612.106886:0:209004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f31f4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.106916:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f31f43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad816 expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.106932:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f31f4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad816 expref: 11 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.107550:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.107555:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508612.107558:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7e00, rc 0) 00000100:00100000:0.0:1787508612.107650:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:335998:x1874324509435136:12345-192.168.201.30@tcp:101:rm.0 Request processed in 5875us (6023us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.107658:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93446 00000100:00100000:1.0:1787508612.110469:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509435264 00000100:00100000:1.0:1787508612.110479:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509435264 00000100:00100000:1.0:1787508612.110551:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93447 00000100:00100000:1.0:1787508612.110561:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:335998:x1874324509435264:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508612.110583:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508612.110605:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f31f6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad81d expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.110669:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31f74 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.110682:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31f74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.110693:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31f74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.110702:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31f7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.110708:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31f7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.110714:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31f7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.110806:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f31f82 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1256:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.110815:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f31f82 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1256:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.110822:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f31f82 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1256:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508612.110897:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1256:0x0]: returning size 4096 00000004:00200000:1.0:1787508612.110902:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1787508612.110920:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f31f82 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1256:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.110933:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31f74 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.110970:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31f74 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.110976:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31f74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.110982:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31f74 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.110988:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.110991:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31f74 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.110999:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31f74 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.111010:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508612.111013:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508612.111017:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31f74 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.111023:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31f74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.111212:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31f7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.111218:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31f7b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.111224:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31f7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.111228:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.111231:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31f7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.111237:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31f7b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.111245:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090ccb87e00) 00010000:00010000:1.0:1787508612.111248:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508612.111251:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31f7b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.111256:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31f7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.111285:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f31f6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad81d expref: 13 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.111299:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f31f82 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1256:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad81d expref: 12 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.111307:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1256:0x0].0x0 (ffff9090ccb87700) 00010000:00010000:1.0:1787508612.111309:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508612.111312:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ac00, rc 0) 00000100:00100000:1.0:1787508612.111369:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:335998:x1874324509435264:12345-192.168.201.30@tcp:101:rm.0 Request processed in 808us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508612.111376:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93447 00000100:00100000:0.0:1787508612.122599:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509435520 00000100:00100000:0.0:1787508612.122609:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509435520 00000100:00100000:0.0:1787508612.122676:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93448 00000100:00100000:0.0:1787508612.122687:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:335999:x1874324509435520:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508612.122711:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.122731:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f31f89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad82b expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.122793:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31f90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.122806:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31f90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.122820:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31f90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508612.122863:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787508612.122867:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508612.122888:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31f90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.122911:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f31f89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad82b expref: 585 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.122928:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31f90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad82b expref: 584 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.122962:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.122966:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508612.122969:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6400, rc 0) 00000100:00100000:0.0:1787508612.123046:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:335999:x1874324509435520:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 360us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.123053:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93448 00000100:00100000:0.0:1787508612.123583:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509435392 00000100:00100000:0.0:1787508612.123589:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509435392 00000100:00100000:0.0:1787508612.123641:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93449 00000100:00100000:0.0:1787508612.123650:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6390a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:335998:x1874324509435392:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508612.123661:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.123673:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f31f97 lrc: 2/0,0 mode: --/CR res: [0x2000013a0:0x16c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad824 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.123713:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f31f9e lrc: 3/1,0 mode: --/PR res: [0x2000013a0:0x16c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.123723:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f31f9e lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.123733:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f31f9e lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508612.123765:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a0:0x16c:0x0]: returning size 4096 00000004:00200000:0.0:1787508612.123770:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508612.123810:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f31f97 lrc: 0/0,0 mode: --/CR res: [0x2000013a0:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad824 expref: 14 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.123824:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f31f9e lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad824 expref: 13 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.123832:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16c:0x0].0x0 (ffff9090ccb87200) 00010000:00010000:0.0:1787508612.123834:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508612.123837:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7c00, rc 0) 00000100:00100000:0.0:1787508612.123881:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6390a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:335998:x1874324509435392:12345-192.168.201.30@tcp:101:rm.0 Request processed in 232us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.123887:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93449 00000100:00100000:0.0:1787508612.127691:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509435648 00000100:00100000:0.0:1787508612.127701:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509435648 00000100:00100000:0.0:1787508612.127776:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509435776 00000100:00100000:0.0:1787508612.127789:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509435776 00000100:00100000:0.0:1787508612.127824:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93450 00000100:00100000:0.0:1787508612.127836:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:335998:x1874324509435648:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508612.127858:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.127889:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f31fa5 lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x164:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad832 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.127968:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f31fac lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x164:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.127983:0:202226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f31f66 lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x164:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f31f5f expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.127991:0:202226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f31fac lrc: 4/1,0 mode: --/PR res: [0x240000bd2:0x164:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.128026:0:202226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f31f66 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x164:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f31f5f expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.128042:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b26680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:202226:1874324480058240:0@lo:104: 00000100:00100000:0.0:1787508612.128088:0:202226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508612.128124:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9e8df00 going to sleep for 11 seconds 00000100:00100000:0.0:1787508612.128139:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480058240 00000100:00100000:0.0:1787508612.128142:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480058240 00000100:00100000:0.0:1787508612.128168:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18097 00000100:00100000:0.0:1787508612.128174:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:202226:x1874324480058240:12345-0@lo:104: 00010000:00010000:0.0:1787508612.128185:0:202209:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ed400/0xb126349c40f31f5f lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x164:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f31f66 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.128227:0:202209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787508612.128232:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:202226:x1874324480058240:12345-0@lo:104: Request processed in 59us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.128239:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18097 00010000:00010000:0.0:1787508612.128261:0:202215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508612.128267:0:202215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ed400/0xb126349c40f31f5f lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x164:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f31f66 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.128274:0:202215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ed400 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:0.0:1787508612.128279:0:202215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ed400/0xb126349c40f31f5f lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x164:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f31f66 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508612.128288:0:202215:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ed400/0xb126349c40f31f5f lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x164:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f31f66 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.128311:0:202215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ed400/0xb126349c40f31f5f lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x164:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f31f66 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.128318:0:202215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787508612.128335:0:202215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ed400/0xb126349c40f31f5f lrc: 1/0,0 mode: --/PW res: [0x240000bd2:0x164:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f31f66 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.128342:0:202215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ed400/0xb126349c40f31f5f lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x164:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f31f66 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.128359:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508612.128361:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508612.128363:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508612.128373:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480058368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508612.128398:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508612.128457:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b26680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:202226:1874324480058240:0@lo:104: 00010000:00010000:0.0:1787508612.128473:0:202226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f31fac lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x164:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.135995:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22eda00/0xb126349c40f31be6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.136008:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22eda00/0xb126349c40f31be6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.136017:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22eda00/0xb126349c40f31be6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.136023:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22eda00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.136028:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22eda00/0xb126349c40f31be6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.136036:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22eda00/0xb126349c40f31be6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.136055:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13ce:0x0].0x0 (ffff9090ccb87900) 00010000:00010000:1.0:1787508612.136059:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508612.136065:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22eda00/0xb126349c40f31be6 lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.136071:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22eda00/0xb126349c40f31be6 lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.136085:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ed800/0xb126349c40f31bed lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.136092:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ed800/0xb126349c40f31bed lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.136098:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ed800/0xb126349c40f31bed lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.136103:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ed800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.136105:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ed800/0xb126349c40f31bed lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.136111:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ed800/0xb126349c40f31bed lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.136119:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28d:0x0].0x0 (ffff9090ccb87d00) 00010000:00010000:1.0:1787508612.136121:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508612.136124:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ed800/0xb126349c40f31bed lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.136130:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ed800/0xb126349c40f31bed lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.136143:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f31cfe lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.136149:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f31cfe lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.136154:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f31cfe lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.136159:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.136162:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f31cfe lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.136167:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f31cfe lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.136175:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13ce:0x0].0x0 (ffff9090ccb87900) 00010000:00010000:1.0:1787508612.136177:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508612.136180:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f31cfe lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.136185:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f31cfe lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x13ce:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.137655:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f31d05 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.137669:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f31d05 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.137676:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f31d05 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.137680:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.137685:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f31d05 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.137691:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f31d05 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.137703:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28d:0x0].0x0 (ffff9090ccb87d00) 00010000:00010000:1.0:1787508612.137706:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508612.137709:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f31d05 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.137714:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f31d05 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.138440:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f31f66 lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x164:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f31f5f expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.138458:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x164:0x0].0x0 (ffff9090d36fd900) 00010000:00010000:0.0:1787508612.138463:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f31fac lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x164:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.138472:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f31fac lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x164:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.138479:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f31fac lrc: 4/1,0 mode: PR/PR res: [0x240000bd2:0x164:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.138578:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508612.138666:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480058368:12345-0@lo:103:ldlm_bl.0 Request processed in 10092us (10264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.138676:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27741 00000100:00100000:1.0:1787508612.141203:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480058368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508612.141716:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509435904 00000100:00100000:1.0:1787508612.141723:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509435904 00000100:00100000:1.0:1787508612.141783:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93452 00000100:00100000:1.0:1787508612.141792:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:335999:x1874324509435904:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508612.141811:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508612.141832:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31fc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad840 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.141894:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31fcf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.141908:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31fcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.141919:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31fcf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.141934:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f31fd6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.141976:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f31fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.141984:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f31fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.142179:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31fcf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.142188:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31fcf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.142194:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31fcf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.142201:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31fcf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.142208:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.142212:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31fcf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.142219:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31fcf lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.142231:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508612.142299:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508612.142304:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31fcf lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.142312:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f31fcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.142328:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f31fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.142334:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f31fd6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.142341:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f31fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.142346:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.142349:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f31fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.142356:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f31fd6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.142364:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090ce78a400) 00010000:00010000:1.0:1787508612.142366:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508612.142370:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f31fd6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.142376:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f31fd6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.142472:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31fc8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad840 expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.142497:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508612.142500:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508612.142504:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f31fc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad840 expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.142515:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b600, rc 0) 00000100:00100000:1.0:1787508612.142621:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:335999:x1874324509435904:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 829us (1017us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508612.142629:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93452 00000100:00100000:1.0:1787508612.152395:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.152887:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509436032 00000100:00100000:0.0:1787508612.152897:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509436032 00000100:00100000:0.0:1787508612.152981:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93453 00000100:00100000:0.0:1787508612.152992:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:335999:x1874324509436032:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508612.153012:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.153042:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f31fdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad847 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.153106:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f31fe4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.153121:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f31fe4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.153132:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f31fe4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.153148:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31feb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.153156:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31feb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.153163:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31feb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.153218:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f31fe4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.153225:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f31fe4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.153243:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f31fe4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.153250:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f31fe4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.153257:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7a00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.153262:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f31fe4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.153269:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f31fe4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.153282:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.153285:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.153289:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f31fe4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.153295:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f31fe4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.153308:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31feb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.153315:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31feb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.153321:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31feb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.153327:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.153330:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31feb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.153336:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31feb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.153343:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090e460f400) 00010000:00010000:0.0:1787508612.153346:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.153348:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31feb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.153354:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f31feb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.153386:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f31fdd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad847 expref: 585 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.153410:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.153414:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508612.153418:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f31fdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad847 expref: 585 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.153427:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7600, rc 0) 00000100:00100000:0.0:1787508612.153499:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:335999:x1874324509436032:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 509us (1115us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508612.153506:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93453 00000100:00100000:0.0:1787508612.156801:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508612.156909:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509436288 00000100:00100000:1.0:1787508612.156919:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509436288 00000100:00100000:1.0:1787508612.157010:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93454 00000100:00100000:1.0:1787508612.157021:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:335998:x1874324509436288:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508612.157043:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508612.157065:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f31ff2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad84e expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508612.157221:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1256:0x0]: returning size 4096 00010000:00010000:1.0:1787508612.157336:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f31ff2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad84e expref: 15 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.157350:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508612.157353:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508612.157358:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f31ff2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad84e expref: 15 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.157378:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a600, rc 0) 00000100:00100000:1.0:1787508612.157447:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:335998:x1874324509436288:12345-192.168.201.30@tcp:101:rm.0 Request processed in 427us (654us total) trans 12884944027 rc 301/301 00000100:00100000:1.0:1787508612.157454:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93454 00000100:00100000:1.0:1787508612.158100:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.177060:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508612.183226:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.185043:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.192271:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.195374:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93458 00000100:00100000:0.0:1787508612.195390:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:335999:x1874324509437184:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508612.195415:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.195435:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f3203f lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x164:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad86a expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.195513:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f32046 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x164:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.195525:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f32046 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x164:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.195536:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f32046 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x164:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508612.195583:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd2:0x164:0x0]: returning size 4096 00000004:00200000:0.0:1787508612.195587:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508612.195618:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f3203f lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x164:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad86a expref: 642 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.195635:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f32046 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x164:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad86a expref: 641 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.195643:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x164:0x0].0x0 (ffff9090d36fd900) 00010000:00010000:0.0:1787508612.195646:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508612.195650:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6c00, rc 0) 00000100:00100000:0.0:1787508612.195709:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+641:335999:x1874324509437184:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 322us (3449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.195716:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93458 00000100:00100000:0.0:1787508612.203716:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508612.203782:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509437440 00000100:00100000:1.0:1787508612.203793:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509437440 00000100:00100000:1.0:1787508612.203856:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93459 00000100:00100000:1.0:1787508612.203868:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:335999:x1874324509437440:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:1.0:1787508612.203923:0:202227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508612.203984:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3202a lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1256:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad85c expref: 586 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.204002:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1256:0x0].0x0 (ffff9090ccb87700) 00010000:00010000:1.0:1787508612.204007:0:202227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787508612.204029:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f3204d lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1256:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.204043:0:202227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f31f82 lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x1256:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad81d expref: 13 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.204051:0:202227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f3204d lrc: 4/0,1 mode: --/PW res: [0x2000013a4:0x1256:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.204081:0:202227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f31f82 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1256:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad81d expref: 13 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.204097:0:202227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f31f82 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1256:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad81d expref: 13 pid: 230618 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508612.204110:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:202227:1874324480058496:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508612.204179:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8540 going to sleep for 11 seconds 00000100:00100000:1.0:1787508612.207004:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:202227:1874324480058496:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508612.207034:0:202227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f3204d lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1256:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.209712:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.209755:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.211411:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:335998:x1874324509437824:12345-192.168.201.30@tcp:35:rm.0 Request processed in 1408us (1692us total) trans 12884944028 rc 0/0 00000100:00100000:0.0:1787508612.211425:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15382 00000100:00100000:0.0:1787508612.214867:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.218639:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.218683:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508612.218837:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509438080 00000100:00100000:1.0:1787508612.218846:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509438080 00010000:00010000:1.0:1787508612.218883:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec200/0xb126349c40f32038 lrc: 5/0,0 mode: PR/PR res: [0x2000013a0:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad863 expref: 586 pid: 209004 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508612.218921:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509438208 00000100:00100000:1.0:1787508612.218925:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509438208 00010000:00010000:1.0:1787508612.218966:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f31f9e lrc: 5/0,0 mode: PR/PR res: [0x2000013a0:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad824 expref: 16 pid: 205405 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508612.218986:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27743 00000100:00100000:1.0:1787508612.218994:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:2401:x1874324509438080:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508612.219009:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508612.219015:0:229383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec200/0xb126349c40f32038 lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad863 expref: 586 pid: 209004 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.219033:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec200/0xb126349c40f32038 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad863 expref: 586 pid: 209004 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.219070:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27744 00000100:00100000:0.0:1787508612.219080:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c1ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:2401:x1874324509438208:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508612.219088:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508612.219093:0:225839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f31f9e lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad824 expref: 16 pid: 205405 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.221367:0:225839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f31f9e lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad824 expref: 16 pid: 205405 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.221397:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f31f9e lrc: 0/0,0 mode: --/PR res: [0x2000013a0:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad824 expref: 16 pid: 205405 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.221414:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16c:0x0].0x0 (ffff9090ccb87200) 00010000:00010000:0.0:1787508612.221419:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f32054 lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.221428:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f32054 lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.221434:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508612.221570:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c1ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2401:x1874324509438208:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 2491us (2885us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.221579:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27744 00010000:00010000:1.0:1787508612.225089:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec200/0xb126349c40f32038 lrc: 0/0,0 mode: --/PR res: [0x2000013a0:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad863 expref: 586 pid: 209004 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.225115:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16c:0x0].0x0 (ffff9090ccb87200) 00010000:00010000:1.0:1787508612.225120:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f32054 lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.225130:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f32054 lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.225137:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f32054 lrc: 4/0,1 mode: PW/PW res: [0x2000013a0:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.228426:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508612.229573:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:2401:x1874324509438080:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 10577us (10943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.229583:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27743 00000100:00100000:0.0:1787508612.245414:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.245461:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508612.245772:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27746 00000100:00100000:1.0:1787508612.245782:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2403:x1874324509438464:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508612.245790:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508612.245795:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f31fac lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x164:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad832 expref: 6 pid: 202226 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.248394:0:202227:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589961962 gen 2 00000004:00080000:0.0:1787508612.248400:0:202227:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961953 committed transno 8589961962 00000020:00080000:0.0:1787508612.248405:0:202227:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9090d74d96c0 refcount 2 committed 0 result 0 batchid 8589961972 00000020:00080000:0.0:1787508612.248409:0:202227:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cbc97000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d74d9f00 00000020:00080000:0.0:1787508612.248412:0:202227:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd2:0x1:0x0].1773 00000020:00080000:0.0:1787508612.248414:0:202227:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cbc97b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9091e6a54e00 00000020:00080000:0.0:1787508612.248417:0:202227:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1:0x0].1767 00000004:00080000:0.0:1787508612.248442:0:202227:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961954 committed transno 8589961962 00000004:00080000:0.0:1787508612.248451:0:202227:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961956 committed transno 8589961962 00000004:00080000:0.0:1787508612.248474:0:202227:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961957 committed transno 8589961962 00000004:00080000:0.0:1787508612.248499:0:202227:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961962 committed transno 8589961962 00000100:00100000:0.0:1787508612.250327:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed437b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:202227:1874324480058880:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1787508612.250353:0:202227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22eda00/0xb126349c40f32077 lrc: 4/0,1 mode: --/PW res: [0x240000bd2:0x164:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3207e expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.250366:0:202227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22eda00/0xb126349c40f32077 lrc: 4/0,1 mode: --/PW res: [0x240000bd2:0x164:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3207e expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787508612.251003:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589961972 committed batchid 8589961971 00000020:00080000:0.0:1787508612.251070:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961971 00010000:00010000:1.0:1787508612.252393:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f31fac lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x164:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad832 expref: 6 pid: 202226 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.252426:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f31fac lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x164:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad832 expref: 6 pid: 202226 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.252450:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x164:0x0].0x0 (ffff9090d36fd900) 00010000:00010000:1.0:1787508612.252458:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa000/0xb126349c40f3207e lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x164:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32077 expref: 5 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.252470:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa000/0xb126349c40f3207e lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x164:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f32077 expref: 5 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.252479:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa000/0xb126349c40f3207e lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x164:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f32077 expref: 5 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.253401:0:202211:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa000/0xb126349c40f3207e lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x164:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32077 expref: 5 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.253422:0:202211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:202211:1874324480059264:0@lo:105: 00000100:00100000:0.0:1787508612.253711:0:202211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508612.253776:0:202211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9e8d840 going to sleep for 11 seconds 00010000:00010000:0.0:1787508612.254169:0:202227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22eda00/0xb126349c40f32077 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x164:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3207e expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.254178:0:202227:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22eda00/0xb126349c40f32077 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x164:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3207e expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787508612.254434:0:202227:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1:0x0].1769, 344 off1820632 00000040:00080000:0.0:1787508612.254674:0:202227:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x1:0x0].1775, 552 off2024784 00000004:00080000:0.0:1787508612.254680:0:202227:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d9e8dc00 with version 3433 00000100:00100000:0.0:1787508612.255853:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc875500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480059520:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1787508612.258360:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed800/0xb126349c40f32070 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1256:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.258373:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed800/0xb126349c40f32070 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1256:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508612.258475:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1256:0x0]: returning size 4096 00000004:00200000:0.0:1787508612.258480:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1787508612.258512:0:205405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed800/0xb126349c40f32070 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1256:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.258528:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f32062 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.258535:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f32062 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.258542:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f32062 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.258550:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f32062 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.258556:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ede00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.258560:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f32062 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.258567:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f32062 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.258583:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.258585:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.258590:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f32062 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.258597:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f32062 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.258613:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f32069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.258619:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f32069 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.258625:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f32069 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.258630:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ec800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.258633:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f32069 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.258639:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f32069 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.258650:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090ccb87e00) 00010000:00010000:0.0:1787508612.258653:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.258655:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f32069 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.258661:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f32069 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.258690:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f3205b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad871 expref: 15 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.258702:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed800/0xb126349c40f32070 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1256:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad871 expref: 14 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.258709:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1256:0x0].0x0 (ffff9090ccb87700) 00010000:00010000:0.0:1787508612.258711:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508612.258714:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d22ed800, rc 0) 00000100:00100000:0.0:1787508612.258762:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:335998:x1874324509437952:12345-192.168.201.30@tcp:101:rm.0 Request processed in 43506us (43903us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.258770:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93460 00000100:00100000:0.0:1787508612.270618:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508612.270705:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509438976 00000100:00100000:1.0:1787508612.270715:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509438976 00000100:00100000:1.0:1787508612.270774:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93462 00000100:00100000:1.0:1787508612.270785:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336001:x1874324509438976:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508612.270816:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508612.270837:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3208c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad878 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.270907:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32093 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.270922:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32093 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.270933:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32093 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.270969:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3209a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.270977:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3209a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.270984:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3209a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.271041:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32093 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.271048:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32093 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.271054:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32093 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.271060:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32093 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.271065:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247be00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.271069:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32093 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.271075:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32093 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.271086:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508612.271089:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508612.271093:0:202228:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f32085 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.271101:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32093 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.271108:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32093 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.271119:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3209a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.271124:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3209a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.271129:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3209a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.271134:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.271137:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3209a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.271142:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3209a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.271148:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xce5b6a33 (ffff9090ce78a400) 00010000:00010000:1.0:1787508612.271150:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508612.271153:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3209a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.271158:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3209a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.271187:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3208c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad878 expref: 587 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.271216:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508612.271218:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508612.271222:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3208c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad878 expref: 587 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.271231:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ae00, rc 0) 00000100:00100000:1.0:1787508612.271284:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336001:x1874324509438976:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 500us (676us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508612.271291:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93462 00000100:00100000:0.0:1787508612.280739:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.282688:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509439360 00000100:00100000:0.0:1787508612.282697:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509439360 00010000:00010000:0.0:1787508612.282727:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31f90 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad82b expref: 586 pid: 202226 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.282763:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27747 00000100:00100000:0.0:1787508612.282773:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc875f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:2400:x1874324509439360:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508612.282787:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508612.282793:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31f90 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad82b expref: 586 pid: 202226 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.282806:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31f90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad82b expref: 586 pid: 202226 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.282823:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f31f90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad82b expref: 586 pid: 202226 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.282836:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.282841:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f32085 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.282850:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f32085 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.282857:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f32085 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.282886:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508612.282931:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc875f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:2400:x1874324509439360:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 159us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.282990:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27747 00000100:00100000:1.0:1787508612.283336:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787508612.283352:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480059776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787508612.283404:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508612.283441:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480059776 00000100:00100000:1.0:1787508612.283446:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480059776 00000100:00100000:1.0:1787508612.283494:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1623 00000100:00100000:1.0:1787508612.283514:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480059776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787508612.283536:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16990784 pending 0 free 3910828032 avail 3679305728 00000100:00100000:1.0:1787508612.283573:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480059776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508612.283579:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1623 00000100:00080000:1.0:1787508612.283596:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508612.283627:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480059776:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787508612.284015:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480060032 00000100:00100000:1.0:1787508612.284019:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480060032 00000100:00100000:0.0:1787508612.284447:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480060160 00000100:00100000:0.0:1787508612.284452:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480060160 00000100:00100000:0.0:1787508612.284509:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1624 00000100:00100000:0.0:1787508612.284517:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480060160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787508612.284531:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16990784 pending 0 free 3910828032 avail 3679305728 00000100:00100000:0.0:1787508612.284577:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480060160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.284583:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1624 00000100:00100000:1.0:1787508612.284650:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18099 00000100:00100000:1.0:1787508612.284657:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed434e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:225829:x1874324480060032:12345-0@lo:104: 00010000:00010000:1.0:1787508612.284669:0:202209:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22eda00/0xb126349c40f32077 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x164:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f3207e expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.284721:0:202209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787508612.284728:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed434e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:225829:x1874324480060032:12345-0@lo:104: Request processed in 71us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508612.284734:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18099 00000100:00100000:1.0:1787508612.284982:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed435180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:230618:1874324480059904:0@lo:101:mdt00_006.0 00010000:00010000:1.0:1787508612.284997:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec200/0xb126349c40f320cb lrc: 4/0,1 mode: --/EX res: [0x240000bd2:0x164:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f320d2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.285006:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec200/0xb126349c40f320cb lrc: 4/0,1 mode: --/EX res: [0x240000bd2:0x164:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f320d2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.285253:0:202214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508612.285260:0:202214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22eda00/0xb126349c40f32077 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x164:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f3207e expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.285268:0:202214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22eda00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:0.0:1787508612.285274:0:202214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22eda00/0xb126349c40f32077 lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x164:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f3207e expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508612.285282:0:202214:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22eda00/0xb126349c40f32077 lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x164:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f3207e expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.285310:0:202214:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22eda00/0xb126349c40f32077 lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x164:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3207e expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.285316:0:202214:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787508612.285339:0:202214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22eda00/0xb126349c40f32077 lrc: 1/0,0 mode: --/PW res: [0x240000bd2:0x164:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3207e expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.285347:0:202214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22eda00/0xb126349c40f32077 lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x164:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3207e expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.285363:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508612.285365:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508612.285366:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508612.285373:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787508612.285382:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480060288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508612.285414:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508612.285514:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509439488 00000100:00100000:1.0:1787508612.285518:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509439488 00000100:00100000:1.0:1787508612.285553:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93464 00000100:00100000:1.0:1787508612.285560:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:336001:x1874324509439488:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508612.285572:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508612.285586:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f320d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad886 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.285639:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f320e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.285648:0:205405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f32085 lrc: 2/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.285655:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f320e0 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.285668:0:205405:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f32085 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.285676:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f320e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787508612.286845:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589961963 is committed 00000020:00080000:1.0:1787508612.287287:0:202955:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 4294998366 batchid updated 00010000:00010000:0.0:1787508612.287443:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa000/0xb126349c40f3207e lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x164:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f32077 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.287459:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x164:0x0].0x0 (ffff9090d36fd900) 00010000:00010000:0.0:1787508612.287464:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a3b400/0xb126349c40f320d2 lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x164:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f320cb expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.287473:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a3b400/0xb126349c40f320d2 lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x164:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f320cb expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.287481:0:202212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a3b400/0xb126349c40f320d2 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x164:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f320cb expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787508612.287519:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13578 rpc_version 13578 00000020:00100000:1.0:1787508612.287550:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787508612.287559:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090e4ba3b80 x1874324480060544/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787508612.287580:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba3b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480060544:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508612.287637:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508612.287670:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8900 going to sleep for 11 seconds 00010000:00010000:0.0:1787508612.288291:0:202212:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a3b400/0xb126349c40f320d2 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x164:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f320cb expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.288302:0:202212:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:202212:1874324480060672:0@lo:105: 00000100:00100000:0.0:1787508612.288332:0:202212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508612.288397:0:202212:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9e8d6c0 going to sleep for 11 seconds 00000020:00080000:0.0:1787508612.288434:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294998367 committed batchid 4294998366 00000020:00080000:0.0:1787508612.288463:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998366 00000100:00100000:1.0:1787508612.288581:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480060928 00000100:00100000:1.0:1787508612.288586:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480060928 00000100:00100000:1.0:1787508612.288621:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29549 00000100:00100000:1.0:1787508612.288629:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:202961:x1874324480060928:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508612.288713:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:202961:x1874324480060928:12345-0@lo:1000:osp_up0-1.0 Request processed in 85us (169us total) trans 12884944031 rc 0/0 00000100:00100000:1.0:1787508612.288720:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29549 00000100:00100000:0.0:1787508612.289327:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480060288:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508612.289365:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec200/0xb126349c40f320cb lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x164:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f320d2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.289379:0:230618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec200/0xb126349c40f320cb lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x164:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f320d2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.290536:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788c000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:230618:1874324480061056:0@lo:403:mdt00_006.0 00000100:00100000:0.0:1787508612.290590:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508612.290654:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9e8d180 going to sleep for 11 seconds 00000100:00100000:0.0:1787508612.293596:0:230618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589961963 gen 2 00000004:00080000:0.0:1787508612.293603:0:230618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961963 committed transno 8589961963 00000100:00100000:0.0:1787508612.293627:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788c000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:230618:1874324480061056:0@lo:403:mdt00_006.0 00000040:00080000:0.0:1787508612.294868:0:230618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1:0x0].1770, 664 off1821296 00000040:00080000:0.0:1787508612.295276:0:230618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x1:0x0].1776, 744 off2025528 00000004:00080000:0.0:1787508612.295284:0:230618:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d9e8d180 with version 3434 00000100:00100000:1.0:1787508612.295591:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480061312 00000100:00100000:1.0:1787508612.295600:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480061312 00000100:00100000:1.0:1787508612.295686:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29551 00000100:00100000:1.0:1787508612.295696:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:202248:x1874324480061312:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787508612.295909:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:202248:x1874324480061312:12345-0@lo:1000:osp_up1-0.0 Request processed in 213us (411us total) trans 8589961964 rc 0/0 00000100:00100000:1.0:1787508612.295917:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29551 00000100:00100000:0.0:1787508612.296032:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc874a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480061312:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1787508612.296058:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1256:0x0]: returning size 4096 00010000:00010000:0.0:1787508612.296077:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f320c4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a0:0x16c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296086:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f320c4 lrc: 2/0,0 mode: EX/EX res: [0x2000013a0:0x16c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296094:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f320c4 lrc: 3/0,0 mode: EX/EX res: [0x2000013a0:0x16c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296101:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ede00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.296106:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f320c4 lrc: 3/0,0 mode: EX/EX res: [0x2000013a0:0x16c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296113:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f320c4 lrc: 4/0,0 mode: EX/EX res: [0x2000013a0:0x16c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296129:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16c:0x0].0x0 (ffff9090ccb87200) 00010000:00010000:0.0:1787508612.296132:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787508612.296137:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f320c4 lrc: 2/0,0 mode: --/EX res: [0x2000013a0:0x16c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296144:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f320c4 lrc: 0/0,0 mode: --/EX res: [0x2000013a0:0x16c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296159:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec200/0xb126349c40f320cb lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x164:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f320d2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296167:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec200/0xb126349c40f320cb lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x164:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f320d2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296174:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec200/0xb126349c40f320cb lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x164:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f320d2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296189:0:230618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787508612.296198:0:230618:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd2:0x164:0x0] 00010000:00010000:0.0:1787508612.296204:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f320bd lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1256:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296210:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f320bd lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x1256:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296215:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f320bd lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1256:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296220:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ec800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.296223:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f320bd lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1256:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296228:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f320bd lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x1256:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296235:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1256:0x0].0x0 (ffff9090ccb87700) 00010000:00010000:0.0:1787508612.296238:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787508612.296241:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f320bd lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x1256:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296246:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f320bd lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x1256:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296260:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f32085 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296266:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f32085 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296272:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f32085 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296277:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f32085 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296283:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ed400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.296286:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f32085 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296291:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f32085 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296298:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.296300:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.296303:0:230618:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f320e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296312:0:230618:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f320e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296319:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f320e0 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296341:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f32085 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296348:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f32085 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508612.296359:0:230618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0b5ff12 reply state 00000000a326eef3 transno 12884944032 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f320b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296370:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f320b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296377:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090ccb87e00) 00010000:00010000:0.0:1787508612.296379:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787508612.296382:0:230618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787508612.296412:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f320e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296419:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f320e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508612.296456:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787508612.296459:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508612.296476:0:205405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f320e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296518:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f320d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad886 expref: 587 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296533:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f320e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad886 expref: 586 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.296545:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.296548:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508612.296550:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247be00, rc 0) 00000100:00100000:0.0:1787508612.296599:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336001:x1874324509439488:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 11038us (11272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.296606:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93464 00000100:00100000:0.0:1787508612.296640:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:335998:x1874324509438720:12345-192.168.201.30@tcp:36:rm.0 Request processed in 30951us (31154us total) trans 12884944032 rc 0/0 00000100:00100000:0.0:1787508612.296647:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93461 00000100:00100000:1.0:1787508612.300688:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.304664:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509439616 00000100:00100000:0.0:1787508612.304681:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509439616 00000100:00100000:0.0:1787508612.304752:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93465 00000100:00100000:0.0:1787508612.304761:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336001:x1874324509439616:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508612.304782:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.304803:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f320e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad88d expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.304871:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f320ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.304887:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f320ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.304898:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f320ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.304913:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f320f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.304920:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f320f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.304926:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f320f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.305015:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f320ee lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.305023:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f320ee lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.305029:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f320ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.305035:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f320ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.305041:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.305046:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f320ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.305053:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f320ee lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.305065:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.305068:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.305073:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f320ee lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.305079:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f320ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.305092:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f320f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.305098:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f320f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.305104:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f320f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.305109:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.305112:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f320f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.305118:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f320f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.305125:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090e460f400) 00010000:00010000:0.0:1787508612.305127:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.305130:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f320f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.305136:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f320f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.305166:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f320e7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad88d expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.305175:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.305177:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508612.305181:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f320e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad88d expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.305190:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6400, rc 0) 00000100:00100000:0.0:1787508612.305253:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336001:x1874324509439616:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 493us (4574us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508612.305260:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93465 00000100:00100000:0.0:1787508612.309553:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509439744 00000100:00100000:0.0:1787508612.309564:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509439744 00000100:00100000:0.0:1787508612.309636:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93466 00000100:00100000:0.0:1787508612.309646:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336001:x1874324509439744:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508612.309666:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.309688:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f320fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad894 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.309757:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32103 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.309772:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32103 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.309784:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32103 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.309800:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3210a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.309807:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3210a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.309818:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3210a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.309878:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32103 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.309885:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32103 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.309892:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32103 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.309897:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32103 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.309904:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.309908:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32103 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.309915:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32103 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.309926:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.309929:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.309933:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32103 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.309976:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32103 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.309991:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3210a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.309998:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3210a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.310003:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3210a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.310008:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.310011:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3210a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.310017:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3210a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.310024:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090e460f900) 00010000:00010000:0.0:1787508612.310027:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.310030:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3210a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.310036:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3210a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.310066:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f320fc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad894 expref: 587 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.310075:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.310077:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508612.310080:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f320fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad894 expref: 587 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.310092:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6200, rc 0) 00000100:00100000:0.0:1787508612.310146:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336001:x1874324509439744:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 501us (1034us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508612.310153:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93466 00000100:00100000:0.0:1787508612.311981:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509439872 00000100:00100000:0.0:1787508612.311989:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509439872 00000100:00100000:0.0:1787508612.312024:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93467 00000100:00100000:0.0:1787508612.312030:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336002:x1874324509439872:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508612.312047:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.312061:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f32111 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad89b expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.312105:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32118 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.312113:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32118 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.312120:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32118 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508612.312368:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787508612.312371:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508612.312389:0:203348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32118 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.312414:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f32111 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad89b expref: 16 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.312437:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32118 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad89b expref: 15 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.312445:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.312447:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508612.312450:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7800, rc 0) 00000100:00100000:0.0:1787508612.312582:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336002:x1874324509439872:12345-192.168.201.30@tcp:101:rm.0 Request processed in 550us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.312590:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93467 00000100:00100000:1.0:1787508612.313622:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.313698:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509440000 00000100:00100000:0.0:1787508612.313707:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509440000 00000100:00100000:0.0:1787508612.313759:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93468 00000100:00100000:0.0:1787508612.313768:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336001:x1874324509440000:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508612.313783:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.313799:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3211f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad8a2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.313848:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32126 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.313859:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32126 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.313868:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32126 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.313880:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3212d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.313887:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3212d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.313893:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3212d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.314566:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32126 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.314577:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32126 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.314583:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32126 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.314590:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32126 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.314596:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.314600:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32126 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.314608:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32126 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.314622:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.314624:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.314628:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32126 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.314634:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32126 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.314649:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3212d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.314655:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3212d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.314661:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3212d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.314666:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.314668:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3212d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.314673:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3212d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.314680:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090e460f300) 00010000:00010000:0.0:1787508612.314682:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.314685:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3212d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.314691:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3212d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.314725:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3211f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad8a2 expref: 587 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.314735:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.314737:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508612.314742:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3211f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad8a2 expref: 587 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.314752:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7e00, rc 0) 00000100:00100000:0.0:1787508612.314864:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336001:x1874324509440000:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1096us (1246us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508612.314872:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93468 00000100:00100000:1.0:1787508612.320986:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509440128 00000100:00100000:1.0:1787508612.321001:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509440128 00000100:00100000:1.0:1787508612.321069:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93469 00000100:00100000:1.0:1787508612.321080:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336002:x1874324509440128:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508612.321101:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508612.321131:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f32134 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad8a9 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.321198:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3213b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.321212:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3213b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.321233:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3213b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.321251:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32142 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.321258:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32142 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.321264:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32142 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.321323:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3213b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.321331:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3213b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.321337:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3213b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.321343:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3213b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.321348:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.321352:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3213b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.321358:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3213b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.321371:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508612.321373:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508612.321377:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3213b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.321383:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3213b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.321395:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32142 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.321401:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32142 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.321610:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32142 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.321617:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247bc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.321619:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32142 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.321626:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32142 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.321635:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090c5b9e700) 00010000:00010000:1.0:1787508612.321638:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508612.321641:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32142 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.321647:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32142 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.321683:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f32134 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad8a9 expref: 16 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.321698:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508612.321700:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508612.321704:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f32134 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad8a9 expref: 16 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.321712:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a200, rc 0) 00000100:00100000:1.0:1787508612.321781:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336002:x1874324509440128:12345-192.168.201.30@tcp:101:rm.0 Request processed in 702us (2050us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508612.321789:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93469 00000100:00100000:0.0:1787508612.330446:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508612.330519:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509440512 00000100:00100000:1.0:1787508612.330529:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509440512 00000100:00100000:1.0:1787508612.330594:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93471 00000100:00100000:1.0:1787508612.330604:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336001:x1874324509440512:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508612.330624:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508612.330645:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3215e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad8b7 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.330728:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32165 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.330741:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32165 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.330751:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32165 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.330765:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3216c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.330771:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3216c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.330777:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3216c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.330833:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32165 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.330841:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32165 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.330848:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32165 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.330854:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32165 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.330859:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247bc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.330863:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32165 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.330871:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32165 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.330883:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508612.330886:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508612.330889:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32165 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.330896:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32165 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.330908:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3216c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.330914:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3216c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.330919:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3216c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.330924:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.330927:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3216c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.330934:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3216c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.330975:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3e9f33b0 (ffff9090c5b9e700) 00010000:00010000:1.0:1787508612.330977:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508612.330980:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3216c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.330986:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3216c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.331016:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3215e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad8b7 expref: 587 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.331026:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508612.331029:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508612.331032:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3215e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad8b7 expref: 587 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.331040:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a200, rc 0) 00000100:00100000:1.0:1787508612.331097:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336001:x1874324509440512:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 495us (660us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508612.331104:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93471 00000100:00100000:0.0:1787508612.334244:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509440640 00000100:00100000:0.0:1787508612.334253:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509440640 00000100:00100000:0.0:1787508612.334310:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93472 00000100:00100000:0.0:1787508612.334319:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336002:x1874324509440640:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508612.334339:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.334360:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32173 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad8be expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.334434:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3217a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.334447:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3217a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.334457:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3217a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.334471:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32181 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.334479:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32181 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.334500:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32181 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.334691:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3217a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.334698:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3217a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.334706:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3217a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.334712:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3217a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.334718:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.334723:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3217a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.334730:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3217a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.334743:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.334746:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.334750:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3217a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.334761:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3217a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.334775:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32181 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.334781:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32181 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.334787:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32181 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.334792:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.334795:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32181 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.334802:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32181 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.334809:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090e460f300) 00010000:00010000:0.0:1787508612.334811:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.334814:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32181 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.334821:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32181 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.334861:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32173 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad8be expref: 16 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.334872:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.334874:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508612.334878:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32173 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad8be expref: 16 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.334892:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7e00, rc 0) 00000100:00100000:0.0:1787508612.335087:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336002:x1874324509440640:12345-192.168.201.30@tcp:101:rm.0 Request processed in 767us (969us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508612.335094:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93472 00000100:00100000:1.0:1787508612.339490:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509440896 00000100:00100000:1.0:1787508612.339735:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509440896 00000100:00100000:1.0:1787508612.339814:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93473 00000100:00100000:1.0:1787508612.339826:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336001:x1874324509440896:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508612.339849:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508612.339870:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32188 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad8c5 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.339977:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3218f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.339991:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3218f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.340002:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3218f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.340018:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32196 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.340025:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32196 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.340037:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32196 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.340093:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3218f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.340100:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3218f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.340107:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3218f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.340113:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3218f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.340120:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.340124:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3218f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.340132:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3218f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.340143:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508612.340146:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508612.340150:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3218f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.340157:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3218f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.340171:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32196 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.340178:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32196 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.340184:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32196 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.340189:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.340192:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32196 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.340214:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32196 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.340222:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ad43c78 (ffff9090c5b9e100) 00010000:00010000:1.0:1787508612.340224:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508612.340227:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32196 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.340477:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32196 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.340524:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32188 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad8c5 expref: 587 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.340535:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508612.340537:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508612.340540:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32188 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad8c5 expref: 587 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.340553:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247bc00, rc 0) 00000100:00100000:1.0:1787508612.340688:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336001:x1874324509440896:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 863us (2557us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508612.340695:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93473 00000100:00100000:0.0:1787508612.353021:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509441152 00000100:00100000:0.0:1787508612.353039:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509441152 00000100:00100000:0.0:1787508612.353109:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93474 00000100:00100000:0.0:1787508612.353120:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336002:x1874324509441152:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508612.353141:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.353163:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3219d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad8cc expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.353597:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f321a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.353611:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f321a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.353622:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f321a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.353637:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f321ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.353644:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f321ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.353650:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f321ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.353704:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f321a4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.353711:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f321a4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.353718:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f321a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.353725:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f321a4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.353730:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.353734:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f321a4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.353741:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f321a4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.353752:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.353755:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.353759:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f321a4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.353764:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f321a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.353777:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f321ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.353782:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f321ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.353788:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f321ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.353794:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.353796:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f321ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.353802:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f321ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.353808:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090e460f900) 00010000:00010000:0.0:1787508612.353810:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.353812:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f321ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.353816:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f321ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.353848:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3219d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad8cc expref: 16 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.353857:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.353860:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508612.353863:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3219d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad8cc expref: 16 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.353871:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7a00, rc 0) 00000100:00100000:0.0:1787508612.354024:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336002:x1874324509441152:12345-192.168.201.30@tcp:101:rm.0 Request processed in 904us (4423us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508612.354035:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93474 00000100:00100000:0.0:1787508612.377054:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509441664 00000100:00100000:0.0:1787508612.377069:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509441664 00000100:00100000:0.0:1787508612.377142:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93476 00000100:00100000:0.0:1787508612.377153:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce62e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336001:x1874324509441664:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508612.377175:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.377207:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f321c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad8da expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.377980:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f321ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.377998:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f321ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.378012:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f321ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.378030:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f321d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.378037:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f321d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.378044:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f321d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.378104:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f321ce lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.378116:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f321ce lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.378122:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f321ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.378128:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f321ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.378134:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.378138:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f321ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.378145:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f321ce lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.378158:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.378161:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.378166:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f321ce lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.378173:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f321ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.378189:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f321d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.378209:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f321d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.378215:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f321d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.378222:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.378225:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f321d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.379013:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f321d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.379026:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x594a0ca2 (ffff9090e460f300) 00010000:00010000:0.0:1787508612.379028:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.379032:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f321d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.379039:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f321d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.379087:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f321c7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad8da expref: 587 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.379098:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.379100:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508612.379104:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f321c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad8da expref: 587 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.379113:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7e00, rc 0) 00000100:00100000:0.0:1787508612.379179:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce62e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336001:x1874324509441664:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 2026us (6696us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508612.379188:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93476 00000100:00100000:1.0:1787508612.380247:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508612.397534:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.397661:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509442048 00000100:00100000:0.0:1787508612.397671:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509442048 00000100:00100000:0.0:1787508612.397734:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93478 00000100:00100000:0.0:1787508612.397744:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336001:x1874324509442048:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508612.397764:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.397783:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f321f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad8e8 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.397853:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f321f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.397865:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f321f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.397876:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f321f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.397890:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f321ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.397898:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f321ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.397904:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f321ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.397988:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f321f8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.397995:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f321f8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.398001:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f321f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.398007:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f321f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.398013:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.398016:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f321f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.398024:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f321f8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.398037:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.398040:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.398045:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f321f8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.398052:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f321f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.398065:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f321ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.398071:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f321ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.398076:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f321ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.398080:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.398083:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f321ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.398094:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f321ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.398100:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe67841 (ffff9090e460f300) 00010000:00010000:0.0:1787508612.398102:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.398105:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f321ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.398111:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f321ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.398142:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f321f1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad8e8 expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.398152:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.398155:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508612.398158:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f321f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad8e8 expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.398167:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7e00, rc 0) 00000100:00100000:0.0:1787508612.398290:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336001:x1874324509442048:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 545us (764us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508612.398298:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93478 00000100:00100000:0.0:1787508612.407721:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.417810:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509442560 00000100:00100000:0.0:1787508612.417821:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509442560 00000100:00100000:0.0:1787508612.417885:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93480 00000100:00100000:0.0:1787508612.417896:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce62f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336001:x1874324509442560:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508612.417917:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.417978:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3221b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad8f6 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.418064:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32222 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.418078:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32222 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.418089:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32222 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.418103:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32229 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.418109:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32229 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.418115:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32229 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.418168:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32222 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.418175:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32222 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.418181:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32222 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.418189:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32222 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.418208:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.418212:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32222 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.418220:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32222 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.418365:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.418368:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.418373:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32222 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.418379:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32222 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.418393:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32229 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.418399:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32229 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.418474:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32229 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.418479:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.418492:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32229 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.418499:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32229 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.418510:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x90ba0166 (ffff9090e460f300) 00010000:00010000:0.0:1787508612.418512:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.418515:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32229 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.418520:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32229 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.418553:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3221b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad8f6 expref: 587 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.418563:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.418565:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508612.418568:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3221b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad8f6 expref: 587 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.418577:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7e00, rc 0) 00000100:00100000:0.0:1787508612.418637:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce62f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336001:x1874324509442560:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 742us (957us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508612.418645:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93480 00000100:00100000:1.0:1787508612.427795:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.432391:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336001:x1874324509442816:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1913us (4597us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508612.432415:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93481 00000100:00100000:1.0:1787508612.453811:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.454113:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509442944 00000100:00100000:0.0:1787508612.454123:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509442944 00000100:00100000:0.0:1787508612.454188:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93482 00000100:00100000:0.0:1787508612.454208:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336001:x1874324509442944:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508612.454239:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.454261:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32245 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad904 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.454327:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3224c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.454342:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3224c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.454354:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3224c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.454365:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32253 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.454372:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32253 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.454378:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32253 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.454448:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3224c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.454456:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3224c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.454462:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3224c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.454469:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3224c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.454475:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.454491:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3224c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.454499:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3224c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.454510:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.454513:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.454518:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3224c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.454523:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3224c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.454537:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32253 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.454542:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32253 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.454547:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32253 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.454552:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.454554:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32253 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.454560:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32253 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.454570:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090ccb87e00) 00010000:00010000:0.0:1787508612.454573:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.454576:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32253 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.454582:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32253 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.454611:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32245 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad904 expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.454622:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.454624:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.454627:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32245 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad904 expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.454636:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7e00, rc 0) 00000100:00100000:0.0:1787508612.454699:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336001:x1874324509442944:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 494us (898us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508612.454707:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93482 00000100:00100000:1.0:1787508612.462626:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480061568 00000100:00100000:1.0:1787508612.462642:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480061568 00000100:00100000:1.0:1787508612.462721:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29552 00000100:00100000:1.0:1787508612.462732:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce62c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202227:x1874324480061568:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787508612.462890:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce62c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202227:x1874324480061568:12345-0@lo:1000:mdt00_001.0 Request processed in 159us (3061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508612.462898:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29552 00000100:00100000:0.0:1787508612.463361:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480061696 00000100:00100000:0.0:1787508612.463367:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480061696 00000100:00100000:0.0:1787508612.463398:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29553 00000100:00100000:0.0:1787508612.463416:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202227:x1874324480061696:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787508612.463509:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202227:x1874324480061696:12345-0@lo:1000:mdt00_001.0 Request processed in 104us (324us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787508612.463516:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29553 00000100:00100000:0.0:1787508612.463879:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480061824 00000100:00100000:0.0:1787508612.463883:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480061824 00000100:00100000:0.0:1787508612.463919:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29554 00000100:00100000:0.0:1787508612.463925:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202227:x1874324480061824:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1787508612.463935:0:202232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.463973:0:202232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f32261 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f3225a expref: -99 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.463998:0:202232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f320e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad886 expref: 585 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.464007:0:202232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32118 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad89b expref: 14 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.464016:0:202232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f32261 lrc: 5/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f3225a expref: 9 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.464052:0:202232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32118 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad89b expref: 14 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.464066:0:202232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32118 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad89b expref: 14 pid: 203348 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.464079:0:202232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788ea00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:202232:1874324480061952:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508612.464144:0:202232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f320e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad886 expref: 585 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.464154:0:202232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f320e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad886 expref: 585 pid: 205405 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.464163:0:202232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6ac7480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:202232:1874324480062080:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508612.464184:0:202232:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9e8df00 going to sleep for 11 seconds 00000100:00100000:1.0:1787508612.469739:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508612.469783:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:0.0:1787508612.470989:0:202232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32118 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad89b expref: 14 pid: 203348 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.471005:0:202232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788ea00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:202232:1874324480061952:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508612.471016:0:202232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f320e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad886 expref: 586 pid: 205405 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.471035:0:202232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6ac7480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:202232:1874324480062080:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508612.471063:0:202232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f32261 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3225a expref: 9 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.471072:0:202232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.471075:0:202232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.471078:0:202232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7a00, rc 0) 00000100:00100000:0.0:1787508612.471122:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:202227:x1874324480061824:12345-0@lo:101:mdt00_001.0 Request processed in 7197us (7324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.471129:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29554 00000100:00100000:1.0:1787508612.471491:0:202209:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787508612.471505:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480062208 00000100:00100000:1.0:1787508612.471511:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480062208 00000100:00100000:1.0:1787508612.471551:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18101 00000100:00100000:1.0:1787508612.471559:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d18af450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:229383:x1874324480062208:12345-0@lo:105: 00010000:00010000:1.0:1787508612.471570:0:202209:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec200/0xb126349c40f3225a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32261 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.471580:0:202209:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec200/0xb126349c40f3225a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32261 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.471589:0:202209:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec200/0xb126349c40f3225a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32261 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.471597:0:202209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec200/0xb126349c40f3225a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f32261 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.471604:0:202209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec200/0xb126349c40f3225a lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f32261 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.471613:0:202209:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec200/0xb126349c40f3225a lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f32261 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.471628:0:202209:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d22ec200) 00000100:00100000:1.0:1787508612.471666:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d18af450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:229383:x1874324480062208:12345-0@lo:105: Request processed in 108us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508612.471672:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18101 00000100:00100000:0.0:1787508612.472501:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480062336 00000100:00100000:0.0:1787508612.472506:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480062336 00000100:00100000:0.0:1787508612.472543:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29555 00000100:00100000:0.0:1787508612.472550:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:202227:x1874324480062336:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1787508612.472565:0:202231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.472579:0:202231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3226f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f32268 expref: -99 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.472598:0:202231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f31f3c lrc: 2/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.472605:0:202231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f320b6 lrc: 2/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.472612:0:202231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3226f lrc: 5/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f32268 expref: 10 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.472625:0:202231:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f320b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:0.0:1787508612.472651:0:202231:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:0.0:1787508612.472682:0:202231:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f31f3c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:0.0:1787508612.472694:0:202231:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:0.0:1787508612.472705:0:202231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3226f lrc: 3/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32268 expref: 10 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.472713:0:202231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090ccb87e00) 00010000:00010000:0.0:1787508612.472716:0:202231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.472719:0:202231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3226f lrc: 3/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32268 expref: 10 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.472726:0:202231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7e00, rc 0) 00000100:00100000:0.0:1787508612.472756:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:202227:x1874324480062336:12345-0@lo:101:mdt00_001.0 Request processed in 207us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.472762:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29555 00000100:00100000:1.0:1787508612.483786:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000001:00080000:0.0:1787508612.484660:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944032 is committed 00000001:00080000:0.0:1787508612.484676:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944031 is committed 00000001:00080000:0.0:1787508612.484692:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944029 is committed 00000020:00080000:0.0:1787508612.484697:0:202206:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9090d9e8dcc0 refcount 2 committed 0 result 0 batchid 8589961974 00000020:00080000:0.0:1787508612.484701:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9091f29b1600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d9e8dc00 00000020:00080000:0.0:1787508612.484705:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd2:0x1:0x0].1775 00000020:00080000:0.0:1787508612.484707:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9091f29b1800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090d7421800 00000020:00080000:0.0:1787508612.484709:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1:0x0].1769 00000020:00080000:0.0:1787508612.484721:0:202206:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8589961972 batchid updated 00000020:00080000:0.0:1787508612.484728:0:202206:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9090d1d88240 refcount 2 committed 0 result 0 batchid 8589961973 00000020:00080000:0.0:1787508612.484731:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9091d47d0800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d1d88a80 00000020:00080000:0.0:1787508612.484734:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd2:0x1:0x0].1774 00000020:00080000:0.0:1787508612.484737:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9091d47d0100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090d5ddb400 00000020:00080000:0.0:1787508612.484740:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1:0x0].1768 00000020:00080000:0.0:1787508612.484754:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589961974 committed batchid 8589961972 00000004:00080000:0.0:1787508612.484861:0:202262:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d9e8df00 with version 3435 00000020:00080000:0.0:1787508612.484871:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589961972 cancel update log [0x240000bd2:0x1:0x0].1773: rc = 0 00000020:00080000:0.0:1787508612.484913:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589961972 cancel update log [0x2000013a0:0x1:0x0].1767: rc = 0 00000020:00080000:0.0:1787508612.484921:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961972 00000004:00080000:0.0:1787508612.484929:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3435 rpc_version 3435 00000020:00100000:0.0:1787508612.484980:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787508612.484989:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091e6ac7480 x1874324480062592/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787508612.485011:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6ac7480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480062592:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787508612.485154:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787508612.485355:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f31f3c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485365:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f31f3c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485373:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f31f3c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485380:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ed200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.485385:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f31f3c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485411:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f31f3c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485430:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090ccb87e00) 00010000:00010000:1.0:1787508612.485433:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508612.485439:0:3602:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3226f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32268 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485455:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f31f3c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485463:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f31f3c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485497:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f31f51 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1256:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485504:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f31f51 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x1256:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485511:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f31f51 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1256:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485516:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ec000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.485519:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f31f51 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1256:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485524:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f31f51 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x1256:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485536:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1256:0x0].0x0 (ffff9090ccb87700) 00010000:00010000:1.0:1787508612.485539:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508612.485541:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f31f51 lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x1256:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485547:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f31f51 lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x1256:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485556:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f31f58 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485562:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f31f58 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a0:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485567:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f31f58 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485571:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ec400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.485574:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f31f58 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485580:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f31f58 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a0:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485587:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16c:0x0].0x0 (ffff9090ccb87200) 00010000:00010000:1.0:1787508612.485589:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508612.485591:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f31f58 lrc: 2/0,0 mode: --/TXN res: [0x2000013a0:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485597:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f31f58 lrc: 0/0,0 mode: --/TXN res: [0x2000013a0:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485615:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f3204d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1256:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485621:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f3204d lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x1256:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485626:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f3204d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1256:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485632:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.485634:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f3204d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1256:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485639:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f3204d lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x1256:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485647:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1256:0x0].0x0 (ffff9090ccb87700) 00010000:00010000:1.0:1787508612.485649:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508612.485652:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f3204d lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x1256:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485657:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f3204d lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x1256:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485671:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f32054 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485678:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f32054 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a0:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485683:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f32054 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485688:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ed600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.485691:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f32054 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485696:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f32054 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a0:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485703:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16c:0x0].0x0 (ffff9090ccb87200) 00010000:00010000:1.0:1787508612.485705:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508612.485707:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f32054 lrc: 2/0,0 mode: --/TXN res: [0x2000013a0:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.485713:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f32054 lrc: 0/0,0 mode: --/TXN res: [0x2000013a0:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.485885:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9e8d480 going to sleep for 11 seconds 00000100:00100000:1.0:1787508612.492253:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6ac7480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480062592:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787508612.492788:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480062720 00000100:00100000:0.0:1787508612.492798:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480062720 00000100:00100000:0.0:1787508612.492868:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18102 00000100:00100000:0.0:1787508612.492879:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce62dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:203348:x1874324480062720:12345-0@lo:104: 00010000:00010000:0.0:1787508612.492896:0:229363:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec200/0xb126349c40f3225a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f32261 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.493038:0:229363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787508612.493045:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce62dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:203348:x1874324480062720:12345-0@lo:104: Request processed in 168us (6867us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.493053:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18102 00010000:00010000:1.0:1787508612.493833:0:226765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787508612.493841:0:226765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec200/0xb126349c40f3225a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f32261 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.493852:0:226765:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9090d22ec200 is referenced, will be cancelled later 00010000:00010000:1.0:1787508612.493855:0:226765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec200/0xb126349c40f3225a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f32261 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.493864:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508612.493866:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508612.493868:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508612.494987:0:3603:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3226f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32268 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508612.495005:0:3603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3603:1874324480062848:0@lo:105: 00000100:00100000:1.0:1787508612.495087:0:3603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508612.495149:0:3603:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8600 going to sleep for 11 seconds 00000100:00100000:1.0:1787508612.496309:0:3603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3603:1874324480062848:0@lo:105: 00010000:00010000:1.0:1787508612.496329:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f320b6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.496337:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f320b6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.497811:0:202227:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944031 gen 2 00000004:00080000:0.0:1787508612.497818:0:202227:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944030 committed transno 12884944031 00000004:00080000:0.0:1787508612.497838:0:202227:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944031 committed transno 12884944031 00000100:00100000:0.0:1787508612.497851:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed437100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480062976:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787508612.497910:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480063104:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787508612.497966:0:202227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508612.497993:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9e8d480 going to sleep for 11 seconds 00000100:00100000:0.0:1787508612.498364:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480063104:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787508612.498457:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480063232:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787508612.498494:0:202227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508612.498519:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1787508612.512868:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7800/0xb126349c40f32284 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.512889:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7800/0xb126349c40f32284 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.512900:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7800/0xb126349c40f32284 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.512919:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f3228b lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x28e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.512926:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f3228b lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x28e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.512933:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f3228b lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x28e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.513015:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f32292 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.513022:0:202227:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f32292 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.513032:0:202227:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f32292 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.513053:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480064000:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1787508612.513108:0:202227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508612.518810:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9540 going to sleep for 11 seconds 00000100:00100000:1.0:1787508612.519713:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480064000 00000100:00100000:1.0:1787508612.519725:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480064000 00000100:00100000:1.0:1787508612.534432:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.534624:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509443712 00000100:00100000:0.0:1787508612.534634:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509443712 00000100:00100000:0.0:1787508612.534701:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93485 00000100:00100000:0.0:1787508612.534712:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336007:x1874324509443712:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508612.534733:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.534753:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f322a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad912 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.534834:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f322a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.534849:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f322a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.534860:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f322a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.534876:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f322ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.534881:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f322ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.534889:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f322ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.534965:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f322a7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.534973:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f322a7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.534979:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f322a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.534986:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f322a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.534993:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.534997:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f322a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.535004:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f322a7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.535016:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.535019:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.535023:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f322a7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.535029:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f322a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.535041:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f322ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.535048:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f322ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.535053:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f322ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.535058:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.535061:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f322ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.535066:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f322ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.535076:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090c5b0c800) 00010000:00010000:0.0:1787508612.535079:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.535082:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f322ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.535087:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f322ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.535117:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f322a0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad912 expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.535127:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.535129:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508612.535132:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f322a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad912 expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.535141:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6000, rc 0) 00000100:00100000:0.0:1787508612.535205:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336007:x1874324509443712:12345-192.168.201.30@tcp:101:rm.0 Request processed in 494us (782us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508612.535212:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93485 00000100:00100000:1.0:1787508612.557501:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508612.558506:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.565820:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508612.575266:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.585668:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.590996:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509444736 00000100:00100000:0.0:1787508612.591007:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509444736 00000100:00100000:0.0:1787508612.591090:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93492 00000100:00100000:0.0:1787508612.591102:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336007:x1874324509444736:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508612.591122:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.591143:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f3232c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad943 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.591225:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32333 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.591239:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32333 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.591250:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32333 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.591261:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f3233a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.591271:0:202226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3226f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32268 expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.591279:0:202226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f3233a lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.591312:0:202226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3226f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f32268 expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.591326:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480064256:0@lo:104: 00000100:00100000:0.0:1787508612.591372:0:202226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508612.591417:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9300 going to sleep for 11 seconds 00010000:00010000:0.0:1787508612.591796:0:202214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508612.591804:0:202214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed400/0xb126349c40f32268 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f3226f expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.591819:0:202214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ed400 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:0.0:1787508612.591824:0:202214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed400/0xb126349c40f32268 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f3226f expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508612.591832:0:202214:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed400/0xb126349c40f32268 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f3226f expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.591860:0:202214:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed400/0xb126349c40f32268 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3226f expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.591866:0:202214:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787508612.591895:0:202214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed400/0xb126349c40f32268 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3226f expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.591904:0:202214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed400/0xb126349c40f32268 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3226f expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.591928:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508612.591929:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508612.591931:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508612.591957:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787508612.591968:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1516a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480064384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508612.591999:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508612.592058:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480064256:0@lo:104: 00010000:00010000:0.0:1787508612.592081:0:202226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f3233a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787508612.603765:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944033 is committed 00000020:00080000:1.0:1787508612.603784:0:202206:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8589961974 batchid updated 00000020:00080000:0.0:1787508612.603876:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961974 00000004:00080000:0.0:1787508612.603977:0:202262:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d01c9300 with version 3436 00000020:00080000:0.0:1787508612.603986:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589961973 cancel update log [0x240000bd2:0x1:0x0].1774: rc = 0 00000020:00080000:0.0:1787508612.604080:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589961973 cancel update log [0x2000013a0:0x1:0x0].1768: rc = 0 00000004:00080000:0.0:1787508612.604105:0:202262:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d01c9f00 with version 3437 00000020:00080000:0.0:1787508612.604108:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589961974 cancel update log [0x240000bd2:0x1:0x0].1775: rc = 0 00000020:00080000:0.0:1787508612.604130:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589961974 cancel update log [0x2000013a0:0x1:0x0].1769: rc = 0 00000020:00080000:0.0:1787508612.604137:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961974 00000004:00080000:1.0:1787508612.604631:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3436 rpc_version 3436 00000020:00100000:1.0:1787508612.604663:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787508612.604672:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090c819ea00 x1874324480064640/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787508612.604692:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c819ea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480064640:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787508612.604737:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508612.604769:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8600 going to sleep for 11 seconds 00010000:00010000:0.0:1787508612.604903:0:202226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f3233a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.604912:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f3233a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.605056:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:202226:1874324480064768:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787508612.605084:0:202226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508612.605103:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787508612.607346:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:202226:1874324480064768:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1787508612.607412:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f32341 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.607425:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f32341 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.607437:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f32341 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508612.607462:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f32341 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.607475:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32333 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.607492:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32333 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.607499:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32333 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.607843:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32333 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.607849:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.607852:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32333 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.607860:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32333 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.607871:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.607874:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.607879:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32333 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.607885:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32333 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.607898:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f3233a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.607905:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f3233a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.607911:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f3233a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.607915:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.607918:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f3233a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.607924:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f3233a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.607932:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090ccb87e00) 00010000:00010000:0.0:1787508612.607934:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.607937:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f3233a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.607973:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f3233a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.608010:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f3232c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad943 expref: 13 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.608023:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f32341 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad943 expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.608030:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13cf:0x0].0x0 (ffff9090c5b0c800) 00010000:00010000:0.0:1787508612.608032:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508612.608035:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6000, rc 0) 00000100:00100000:0.0:1787508612.608094:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336007:x1874324509444736:12345-192.168.201.30@tcp:101:rm.0 Request processed in 16994us (17292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.608101:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93492 00000100:00100000:0.0:1787508612.610381:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509444864 00000100:00100000:0.0:1787508612.610390:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509444864 00000100:00100000:0.0:1787508612.610451:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93493 00000100:00100000:0.0:1787508612.610461:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336008:x1874324509444864:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508612.610491:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.610511:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f32348 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad94a expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.610576:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3234f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.610590:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3234f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.610599:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3234f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.610613:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32356 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.610620:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32356 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.610627:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32356 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.610680:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3234f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.610688:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3234f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.610695:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3234f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.610700:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3234f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.610706:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.610710:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3234f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.610717:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3234f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.610728:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.610731:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.610736:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3234f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.610742:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3234f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.610756:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32356 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.610762:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32356 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.610768:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32356 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.610773:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.610777:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32356 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.610782:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32356 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.610789:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090d00cdc00) 00010000:00010000:0.0:1787508612.610792:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.610794:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32356 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.610800:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32356 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.610831:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f32348 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad94a expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.610841:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.610843:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508612.610846:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f32348 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad94a expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.610855:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7a00, rc 0) 00000100:00100000:0.0:1787508612.611178:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336008:x1874324509444864:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 717us (1012us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508612.611187:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93493 00000100:00100000:1.0:1787508612.621147:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1787508612.621572:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec800/0xb126349c40f3235d lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad951 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.621643:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec200/0xb126349c40f32364 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.621658:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec200/0xb126349c40f32364 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.621670:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec200/0xb126349c40f32364 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508612.621781:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13cf:0x0]: returning size 4096 00000004:00200000:3.0:1787508612.621787:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787508612.621827:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec800/0xb126349c40f3235d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad951 expref: 7 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.621848:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec200/0xb126349c40f32364 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad951 expref: 6 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.621857:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13cf:0x0].0x0 (ffff9090c6987900) 00010000:00010000:3.0:1787508612.621860:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508612.621864:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d22ec200, rc 0) 00000100:00100000:3.0:1787508612.621935:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d5739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336007:x1874324509444992:12345-192.168.201.30@tcp:101:rm.0 Request processed in 407us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508612.621974:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93494 00000100:00100000:1.0:1787508612.622554:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508612.635575:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508612.635725:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509445376 00000100:00100000:1.0:1787508612.635734:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509445376 00000100:00100000:1.0:1787508612.635798:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93496 00000100:00100000:1.0:1787508612.635808:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336008:x1874324509445376:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508612.635828:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508612.635851:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f32380 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad95f expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.635913:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f32387 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.635926:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f32387 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.635973:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f32387 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.635990:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3238e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.635997:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3238e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.636004:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3238e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.636303:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32395 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.636312:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32395 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.636324:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32395 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508612.636346:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32395 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.636360:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f32387 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.636368:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f32387 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.636375:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f32387 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.636381:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f32387 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.636397:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.636402:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f32387 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.636410:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f32387 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.636422:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508612.636425:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508612.636430:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f32387 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.636437:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f32387 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.636452:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3238e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.636458:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3238e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.636465:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3238e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.636470:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.636474:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3238e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.636491:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3238e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.636499:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090cda8a300) 00010000:00010000:1.0:1787508612.636501:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508612.636504:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3238e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.636511:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3238e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.636540:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f32380 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad95f expref: 584 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.636553:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32395 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad95f expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.636565:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13cf:0x0].0x0 (ffff9090c5b0c800) 00010000:00010000:1.0:1787508612.636567:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508612.636570:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a600, rc 0) 00000100:00100000:1.0:1787508612.636640:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336008:x1874324509445376:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 833us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508612.636647:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93496 00000100:00100000:1.0:1787508612.638708:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508612.655607:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509445504 00000100:00100000:3.0:1787508612.655625:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509445504 00000100:00100000:3.0:1787508612.655689:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93498 00000100:00100000:3.0:1787508612.655701:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336007:x1874324509445504:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508612.655723:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508612.655745:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec800/0xb126349c40f323aa lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad966 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.655803:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec600/0xb126349c40f323b1 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.655815:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec600/0xb126349c40f323b1 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.655825:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec600/0xb126349c40f323b1 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508612.655875:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x28e:0x0]: returning size 4096 00000004:00200000:3.0:1787508612.655881:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787508612.655918:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec800/0xb126349c40f323aa lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad966 expref: 8 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.655983:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec600/0xb126349c40f323b1 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad966 expref: 7 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.655994:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28e:0x0].0x0 (ffff9090c6987700) 00010000:00010000:3.0:1787508612.655997:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508612.656002:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d22ec600, rc 0) 00000100:00100000:3.0:1787508612.660209:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:336007:x1874324509445504:12345-192.168.201.30@tcp:101:rm.0 Request processed in 4490us (7761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508612.660224:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93498 00000100:00100000:1.0:1787508612.662240:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508612.662515:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509445760 00000100:00100000:3.0:1787508612.662588:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509445760 00000100:00100000:3.0:1787508612.662654:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93499 00000100:00100000:3.0:1787508612.662664:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d5739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+643:336008:x1874324509445760:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1787508612.662683:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508612.662705:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ede00/0xb126349c40f323b8 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad974 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.662769:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ece00/0xb126349c40f323bf lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.662782:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ece00/0xb126349c40f323bf lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.662794:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ece00/0xb126349c40f323bf lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508612.662840:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x28e:0x0]: returning size 4096 00000004:00200000:3.0:1787508612.662845:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787508612.662883:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ede00/0xb126349c40f323b8 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad974 expref: 645 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.662902:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ece00/0xb126349c40f323bf lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad974 expref: 644 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.662909:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28e:0x0].0x0 (ffff9090c6987700) 00010000:00010000:3.0:1787508612.662911:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508612.662914:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d22ece00, rc 0) 00000100:00100000:3.0:1787508612.663002:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d5739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:336008:x1874324509445760:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 340us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508612.663009:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93499 00010000:00010000:3.0:1787508612.666312:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508612.677417:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508612.677527:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509445888 00000100:00100000:1.0:1787508612.677540:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509445888 00000100:00100000:1.0:1787508612.677615:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93500 00000100:00100000:1.0:1787508612.677626:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336007:x1874324509445888:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508612.677647:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508612.677669:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f323c6 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x284:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad97b expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.677729:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f323cd lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.677745:0:202226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f32299 lrc: 2/0,0 mode: PW/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32292 expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.677754:0:202226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f323cd lrc: 4/1,0 mode: --/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.677787:0:202226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f32299 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f32292 expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508612.677808:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d5738700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480065152:0@lo:104: 00000100:00100000:1.0:1787508612.677854:0:202226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508612.677909:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8780 going to sleep for 11 seconds 00000100:00100000:3.0:1787508612.678162:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480065152 00000100:00100000:3.0:1787508612.678167:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480065152 00000100:00100000:3.0:1787508612.678213:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18105 00000100:00100000:3.0:1787508612.678221:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d5739f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:202226:x1874324480065152:12345-0@lo:104: 00010000:00010000:3.0:1787508612.678235:0:202209:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f32292 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f32299 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.678298:0:202209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787508612.678304:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d5739f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:202226:x1874324480065152:12345-0@lo:104: Request processed in 86us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508612.678312:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18105 00000100:00100000:1.0:1787508612.678464:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d5738700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480065152:0@lo:104: 00010000:00010000:1.0:1787508612.678496:0:202226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f323cd lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508612.678718:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787508612.678730:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9c99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480065280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508612.678762:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787508612.682753:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f32299 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f32292 expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.682778:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x284:0x0].0x0 (ffff9090d36fd600) 00010000:00010000:3.0:1787508612.682783:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f323cd lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.682793:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f323cd lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.682800:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f323cd lrc: 4/1,0 mode: PR/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.682843:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508612.682934:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d5738700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480065280:12345-0@lo:103:ldlm_bl.0 Request processed in 4036us (4168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508612.682975:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27753 00010000:00010000:0.0:1787508612.687168:0:202226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f323cd lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.687180:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f323cd lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508612.687258:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a2:0x284:0x0]: returning size 4096 00000004:00200000:0.0:1787508612.687263:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508612.687313:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f323c6 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x284:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad97b expref: 14 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.687334:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f323cd lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad97b expref: 13 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.687342:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x284:0x0].0x0 (ffff9090d36fd600) 00010000:00010000:0.0:1787508612.687345:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508612.687349:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ae00, rc 0) 00000100:00100000:0.0:1787508612.687818:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336007:x1874324509445888:12345-192.168.201.30@tcp:101:rm.0 Request processed in 10190us (10408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.687828:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93500 00000100:00100000:1.0:1787508612.689957:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.690148:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509446016 00000100:00100000:0.0:1787508612.690160:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509446016 00000100:00100000:0.0:1787508612.690235:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93501 00000100:00100000:0.0:1787508612.690246:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d38d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336008:x1874324509446016:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508612.690267:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.690287:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f323d4 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x284:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad982 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.690353:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f323db lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.690369:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f323db lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.690381:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f323db lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508612.690574:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a2:0x284:0x0]: returning size 4096 00000004:00200000:0.0:1787508612.690580:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508612.690621:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f323d4 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x284:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad982 expref: 585 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.690638:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f323db lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad982 expref: 584 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.690646:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x284:0x0].0x0 (ffff9090d36fd600) 00010000:00010000:0.0:1787508612.690649:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508612.690653:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6400, rc 0) 00000100:00100000:0.0:1787508612.690705:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d38d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336008:x1874324509446016:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 462us (2318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.690712:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93501 00000100:00100000:0.0:1787508612.699626:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508612.699709:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509446272 00000100:00100000:3.0:1787508612.699720:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509446272 00000100:00100000:3.0:1787508612.699783:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93502 00000100:00100000:3.0:1787508612.699793:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:336008:x1874324509446272:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:3.0:1787508612.699848:0:203348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508612.699877:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f323a3 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad96d expref: 644 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.699895:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13cf:0x0].0x0 (ffff9090c6987900) 00010000:00010000:3.0:1787508612.699900:0:203348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508612.699924:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ede00/0xb126349c40f323e2 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.699936:0:203348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec200/0xb126349c40f32364 lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad951 expref: 6 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.700056:0:203348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ede00/0xb126349c40f323e2 lrc: 4/0,1 mode: --/PW res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.700095:0:203348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec200/0xb126349c40f32364 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad951 expref: 6 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.700110:0:203348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec200/0xb126349c40f32364 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad951 expref: 6 pid: 202228 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508612.700125:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:203348:1874324480065408:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508612.701077:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9106900 going to sleep for 11 seconds 00000100:00100000:1.0:1787508612.711560:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508612.712876:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:203348:1874324480065408:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508612.712989:0:203348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ede00/0xb126349c40f323e2 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508612.717458:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508612.717610:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509446656 00000100:00100000:3.0:1787508612.717620:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509446656 00010000:00010000:3.0:1787508612.717660:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec200/0xb126349c40f32364 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad951 expref: 8 pid: 202228 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508612.717708:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27754 00000100:00100000:3.0:1787508612.717718:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9685880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2401:x1874324509446656:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508612.717734:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508612.717741:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec200/0xb126349c40f32364 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad951 expref: 8 pid: 202228 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.717756:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec200/0xb126349c40f32364 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad951 expref: 8 pid: 202228 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.717780:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec200/0xb126349c40f32364 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad951 expref: 8 pid: 202228 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.717798:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13cf:0x0].0x0 (ffff9090c6987900) 00010000:00010000:3.0:1787508612.717804:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ede00/0xb126349c40f323e2 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.717813:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ede00/0xb126349c40f323e2 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.717821:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ede00/0xb126349c40f323e2 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.717857:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508612.717916:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9685880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2401:x1874324509446656:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 198us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508612.717924:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27754 00000100:00100000:1.0:1787508612.721815:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508612.721852:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.721980:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509446784 00000100:00100000:0.0:1787508612.721990:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509446784 00010000:00010000:0.0:1787508612.722049:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ece00/0xb126349c40f323bf lrc: 5/0,0 mode: PR/PR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad974 expref: 644 pid: 202227 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.722075:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509446912 00000100:00100000:0.0:1787508612.722078:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509446912 00010000:00010000:0.0:1787508612.722091:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec600/0xb126349c40f323b1 lrc: 5/0,0 mode: PR/PR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad966 expref: 7 pid: 203348 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.722113:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27755 00000100:00100000:0.0:1787508612.722122:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9687b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:2402:x1874324509446784:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508612.722136:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508612.722142:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ece00/0xb126349c40f323bf lrc: 5/0,0 mode: PR/PR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad974 expref: 644 pid: 202227 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.722155:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ece00/0xb126349c40f323bf lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad974 expref: 644 pid: 202227 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.722180:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28e:0x0].0x0 (ffff9090c6987700) 00010000:00010000:0.0:1787508612.722196:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f323f7 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.722206:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f323f7 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.722213:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508612.722262:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9687b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:2402:x1874324509446784:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 141us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.722271:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27755 00000100:00100000:0.0:1787508612.722290:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27756 00000100:00100000:0.0:1787508612.722296:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9687100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2402:x1874324509446912:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508612.722304:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508612.722310:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec600/0xb126349c40f323b1 lrc: 5/0,0 mode: PR/PR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad966 expref: 7 pid: 203348 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.722320:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec600/0xb126349c40f323b1 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad966 expref: 7 pid: 203348 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.722332:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28e:0x0].0x0 (ffff9090c6987700) 00010000:00010000:0.0:1787508612.722336:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f323f7 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.722345:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f323f7 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.722353:0:202212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f323f7 lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.722374:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508612.722390:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9687100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2402:x1874324509446912:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 95us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.722410:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27756 00000100:00100000:0.0:1787508612.725109:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480065792 00000100:00100000:0.0:1787508612.725124:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480065792 00000100:00100000:0.0:1787508612.725183:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29568 00000100:00100000:1.0:1787508612.725378:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508612.725425:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509447040 00000100:00100000:3.0:1787508612.725430:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509447040 00000100:00100000:3.0:1787508612.725485:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93504 00000100:00100000:3.0:1787508612.725496:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336007:x1874324509447040:12345-192.168.201.30@tcp:101:rm.0 00000100:00100000:0.0:1787508612.725518:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:203348:x1874324480065792:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1787508612.725519:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.725526:0:203182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508612.725540:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec200/0xb126349c40f32405 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad990 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.725540:0:203182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3240c lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f323fe expref: -99 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.725567:0:203182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f323cd lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad97b expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.725579:0:203182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f323db lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad982 expref: 583 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.725587:0:203182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3240c lrc: 5/0,0 mode: --/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f323fe expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.725618:0:203182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f323db lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad982 expref: 583 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.725622:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec800/0xb126349c40f32413 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.725630:0:202226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ede00/0xb126349c40f323e2 lrc: 2/0,1 mode: PW/PW res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.725633:0:203182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f323db lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad982 expref: 583 pid: 202228 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.725637:0:202226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec800/0xb126349c40f32413 lrc: 4/1,0 mode: --/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.725646:0:203182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b25180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480065920:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508612.725648:0:202226:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ede00/0xb126349c40f323e2 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.725659:0:202226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec800/0xb126349c40f32413 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.725788:0:203182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f323cd lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad97b expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.725798:0:203182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f323cd lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad97b expref: 12 pid: 202226 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.725808:0:203182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b26300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480066048:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508612.725834:0:203182:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787508612.739653:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.739676:0:203182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b25180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480065920:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508612.739690:0:203182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b26300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480066048:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508612.739694:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:0.0:1787508612.739729:0:203182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3240c lrc: 3/0,0 mode: --/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f323fe expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.739743:0:203182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x284:0x0].0x0 (ffff9090d36fd600) 00010000:00010000:0.0:1787508612.739745:0:203182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508612.739750:0:203182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3240c lrc: 3/0,0 mode: --/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f323fe expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.739760:0:203182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3240c lrc: 3/0,0 mode: --/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f323fe expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.739768:0:203182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7a00, rc 0) 00000100:00100000:0.0:1787508612.739837:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:203348:x1874324480065792:12345-0@lo:101:mdt00_003.0 Request processed in 14321us (16342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.739846:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29568 00000100:00100000:1.0:1787508612.739970:0:203348:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944033 gen 2 00000004:00080000:1.0:1787508612.739976:0:203348:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944033 committed transno 12884944033 00000100:00100000:1.0:1787508612.740001:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9c9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480065792:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787508612.740015:0:203348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abc00/0xb126349c40f323fe lrc: 4/0,1 mode: --/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3240c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.740026:0:203348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abc00/0xb126349c40f323fe lrc: 4/0,1 mode: --/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3240c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508612.740063:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27758 00000100:00100000:1.0:1787508612.740070:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9686a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2400:x1874324509447296:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508612.740076:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508612.740082:0:225839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f323cd lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad97b expref: 13 pid: 202226 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.740093:0:225839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f323cd lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad97b expref: 13 pid: 202226 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.744536:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f323cd lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad97b expref: 13 pid: 202226 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.744554:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x284:0x0].0x0 (ffff9090d36fd600) 00010000:00010000:1.0:1787508612.744561:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3240c lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f323fe expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.744571:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3240c lrc: 2/0,0 mode: PW/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f323fe expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.744580:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3240c lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f323fe expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.744623:0:225839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3240c lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f323fe expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508612.744642:0:225839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9685880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:225839:1874324480066176:0@lo:105: 00000100:00100000:1.0:1787508612.744696:0:225839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508612.744803:0:225839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8780 going to sleep for 11 seconds 00000100:00100000:0.0:1787508612.748313:0:229386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480066176 00000100:00100000:0.0:1787508612.748332:0:229386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480066176 00000100:00100000:0.0:1787508612.748401:0:229386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18106 00000100:00100000:0.0:1787508612.748412:0:229386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9687b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:225839:x1874324480066176:12345-0@lo:105: 00010000:00010000:0.0:1787508612.748429:0:229386:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abc00/0xb126349c40f323fe lrc: 5/0,1 mode: --/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3240c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.748441:0:229386:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abc00/0xb126349c40f323fe lrc: 5/0,1 mode: --/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3240c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.748450:0:229386:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abc00/0xb126349c40f323fe lrc: 5/0,1 mode: --/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3240c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.748459:0:229386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abc00/0xb126349c40f323fe lrc: 5/0,1 mode: PW/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f3240c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.748468:0:229386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abc00/0xb126349c40f323fe lrc: 6/0,1 mode: PW/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f3240c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.748487:0:229386:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abc00/0xb126349c40f323fe lrc: 6/0,1 mode: PW/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f3240c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.748557:0:229386:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090cd2abc00) 00000100:00100000:0.0:1787508612.748661:0:229386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9687b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:225839:x1874324480066176:12345-0@lo:105: Request processed in 249us (3963us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.748669:0:229386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18106 00010000:00010000:1.0:1787508612.756595:0:203348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abc00/0xb126349c40f323fe lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3240c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.756615:0:203348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abc00/0xb126349c40f323fe lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3240c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787508612.756866:0:203348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xf:0x0].34, 344 off68048 00000040:00080000:1.0:1787508612.756922:0:203348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x5:0x0].577, 552 off732440 00000004:00080000:1.0:1787508612.756927:0:203348:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d22c8780 with version 13581 00000100:00100000:0.0:1787508612.758638:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480066432 00000100:00100000:0.0:1787508612.758647:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480066432 00000100:00100000:0.0:1787508612.758712:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29569 00000100:00100000:0.0:1787508612.758722:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:202961:x1874324480066432:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787508612.758969:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202961:x1874324480066432:12345-0@lo:1000:osp_up0-1.0 Request processed in 247us (897us total) trans 12884944034 rc 0/0 00000100:00100000:0.0:1787508612.758976:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29569 00000004:00010000:3.0:1787508612.759176:0:203348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e80ee89 reply state 00000000f3781768 transno 8589961970 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f323f7 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.759216:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f323f7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.759234:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28e:0x0].0x0 (ffff9090c6987700) 00010000:00010000:3.0:1787508612.759237:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787508612.759241:0:203348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787508612.759248:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abc00/0xb126349c40f323fe lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3240c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.759257:0:203348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abc00/0xb126349c40f323fe lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3240c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787508612.759269:0:203348:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x284:0x0] 00000004:00010000:3.0:1787508612.759277:0:203348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e80ee89 reply state 00000000f3781768 transno 8589961970 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ede00/0xb126349c40f323e2 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.759286:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ede00/0xb126349c40f323e2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.759291:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13cf:0x0].0x0 (ffff9090c6987900) 00010000:00010000:3.0:1787508612.759294:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508612.759296:0:203348:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec800/0xb126349c40f32413 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.759305:0:203348:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec800/0xb126349c40f32413 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.759310:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec800/0xb126349c40f32413 lrc: 4/1,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508612.759347:0:203348:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787508612.759360:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13cf:0x0]: returning size 4096 00000100:00100000:3.0:1787508612.759449:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:336008:x1874324509446272:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 59656us (59831us total) trans 8589961970 rc 0/0 00000100:00100000:3.0:1787508612.759457:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93502 00010000:00010000:0.0:1787508612.759631:0:202226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec800/0xb126349c40f32413 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.759639:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec800/0xb126349c40f32413 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508612.759720:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13cf:0x0]: returning size 4096 00000004:00200000:0.0:1787508612.759725:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1787508612.759741:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec800/0xb126349c40f32413 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.759774:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec200/0xb126349c40f32405 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad990 expref: 8 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.759792:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec800/0xb126349c40f32413 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad990 expref: 7 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.759800:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13cf:0x0].0x0 (ffff9090c6987900) 00010000:00010000:0.0:1787508612.759802:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508612.759804:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d22ec800, rc 0) 00000100:00100000:0.0:1787508612.759840:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:336007:x1874324509447040:12345-192.168.201.30@tcp:101:rm.0 Request processed in 34347us (34464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.759846:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93504 00000100:00100000:0.0:1787508612.763739:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508612.763829:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509447424 00000100:00100000:3.0:1787508612.763839:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509447424 00000100:00100000:3.0:1787508612.763896:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93505 00000100:00100000:3.0:1787508612.763907:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:336007:x1874324509447424:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508612.763927:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508612.763988:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ed800/0xb126349c40f3241a lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad997 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.764059:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22edc00/0xb126349c40f32421 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.764073:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22edc00/0xb126349c40f32421 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.764084:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22edc00/0xb126349c40f32421 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508612.764127:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x28e:0x0]: returning size 4096 00000004:00200000:3.0:1787508612.764132:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787508612.764168:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ed800/0xb126349c40f3241a lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad997 expref: 9 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.764187:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22edc00/0xb126349c40f32421 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad997 expref: 8 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.764196:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28e:0x0].0x0 (ffff9090c6987700) 00010000:00010000:3.0:1787508612.764199:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508612.764203:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d22edc00, rc 0) 00000100:00100000:3.0:1787508612.764253:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336007:x1874324509447424:12345-192.168.201.30@tcp:101:rm.0 Request processed in 348us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508612.764259:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93505 00000100:00100000:1.0:1787508612.775300:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508612.776016:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480066560 00000100:00100000:3.0:1787508612.776021:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480066560 00000100:00100000:3.0:1787508612.776055:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18107 00000100:00100000:3.0:1787508612.776064:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc621f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:205405:x1874324480066560:12345-0@lo:104: 00010000:00010000:3.0:1787508612.776077:0:202209:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abc00/0xb126349c40f323fe lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f3240c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.776146:0:202209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787508612.776152:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc621f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:205405:x1874324480066560:12345-0@lo:104: Request processed in 91us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508612.776160:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18107 00010000:00010000:0.0:1787508612.776239:0:202215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508612.776245:0:202215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abc00/0xb126349c40f323fe lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f3240c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.776253:0:202215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abc00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:0.0:1787508612.776259:0:202215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abc00/0xb126349c40f323fe lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f3240c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508612.776267:0:202215:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abc00/0xb126349c40f323fe lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f3240c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.776294:0:202215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abc00/0xb126349c40f323fe lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3240c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.776304:0:202215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787508612.776340:0:202215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abc00/0xb126349c40f323fe lrc: 1/0,0 mode: --/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3240c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.776347:0:202215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abc00/0xb126349c40f323fe lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3240c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.776371:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508612.776373:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508612.776375:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508612.776489:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480066688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787508612.776522:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508612.778534:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508612.778719:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509447808 00000100:00100000:1.0:1787508612.778728:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509447808 00000100:00100000:1.0:1787508612.778828:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93507 00000100:00100000:1.0:1787508612.778841:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336009:x1874324509447808:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508612.778865:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508612.778892:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32436 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad9a5 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.779006:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3243d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.779021:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3243d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.779035:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3243d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.779051:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f32444 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.779061:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f32444 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.779067:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f32444 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787508612.779968:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944034 is committed 00010000:00010000:3.0:1787508612.786105:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3240c lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f323fe expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.786128:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x284:0x0].0x0 (ffff9090d36fd600) 00010000:00010000:3.0:1787508612.786133:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3242f lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.786148:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3242f lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.786156:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3242f lrc: 4/1,0 mode: PR/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.786203:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508612.786298:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480066688:12345-0@lo:103:ldlm_bl.0 Request processed in 9612us (9773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508612.786309:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27759 00000100:00100000:0.0:1787508612.786410:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480066688:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508612.786544:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3242f lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.786553:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3242f lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508612.786613:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a2:0x284:0x0]: returning size 4096 00000004:00200000:1.0:1787508612.786619:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787508612.786668:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32428 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x284:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad99e expref: 14 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.786686:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3242f lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad99e expref: 13 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.786693:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x284:0x0].0x0 (ffff9090d36fd600) 00010000:00010000:1.0:1787508612.786696:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508612.786699:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aac00, rc 0) 00000100:00100000:1.0:1787508612.786756:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336007:x1874324509447552:12345-192.168.201.30@tcp:101:rm.0 Request processed in 11124us (11467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508612.786764:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93506 00000100:00100000:0.0:1787508612.799922:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508612.806697:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.807985:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509448192 00000100:00100000:0.0:1787508612.807995:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509448192 00000100:00100000:0.0:1787508612.808150:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93508 00000100:00100000:0.0:1787508612.808161:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336009:x1874324509448192:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508612.808182:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.808202:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f3244b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad9ac expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.808273:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32452 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.808287:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32452 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.808301:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32452 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.808317:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32459 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.808324:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.808331:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.808392:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32452 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.808400:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32452 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.808405:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32452 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.808411:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32452 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.808417:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.808422:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32452 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.808429:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32452 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.808441:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.808445:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.808449:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32452 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.808455:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32452 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.808468:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.808485:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32459 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.808492:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32459 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.808498:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.808501:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32459 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.808507:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32459 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.808514:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaf7dd568 (ffff9090d00cdc00) 00010000:00010000:0.0:1787508612.808516:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.808519:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32459 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.808524:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32459 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.808555:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f3244b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad9ac expref: 584 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.808565:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.808568:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508612.808572:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f3244b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad9ac expref: 584 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.808580:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7c00, rc 0) 00000100:00100000:0.0:1787508612.808613:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336009:x1874324509448192:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 455us (1930us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508612.808620:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93508 00000100:00100000:1.0:1787508612.814844:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508612.814894:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508612.814978:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509448576 00000100:00100000:3.0:1787508612.814988:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509448576 00000100:00100000:3.0:1787508612.815047:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15384 00000100:00100000:3.0:1787508612.815057:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091cb8b0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336007:x1874324509448576:12345-192.168.201.30@tcp:37:rm.0 00000100:00100000:0.0:1787508612.815334:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509448448 00000100:00100000:0.0:1787508612.815338:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509448448 00000100:00100000:0.0:1787508612.815369:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93509 00000100:00100000:0.0:1787508612.815375:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce62ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336009:x1874324509448448:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508612.815384:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.815404:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32460 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad9b3 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.815467:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32467 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.815490:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32467 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.816293:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32467 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.816321:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3246e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.816331:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3246e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.816340:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3246e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.816387:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32467 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.816395:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32467 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.816400:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32467 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.816407:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32467 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.816412:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.816417:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32467 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.816423:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32467 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.816434:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.816437:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.816442:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32467 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.816448:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32467 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.816460:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3246e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.816465:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3246e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.816469:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3246e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.816484:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.816487:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3246e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.816492:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3246e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.816499:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3e9f33b0 (ffff9090d00cdc00) 00010000:00010000:0.0:1787508612.816570:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.816575:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3246e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.816581:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3246e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.816619:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32460 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad9b3 expref: 584 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.816629:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.816632:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508612.816636:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32460 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad9b3 expref: 584 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.816646:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7c00, rc 0) 00000100:00100000:0.0:1787508612.816701:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce62ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336009:x1874324509448448:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1324us (1867us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508612.816709:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93509 00000100:00100000:3.0:1787508612.819048:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091cb8b0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336007:x1874324509448576:12345-192.168.201.30@tcp:37:rm.0 Request processed in 3983us (4143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508612.819063:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15384 00000100:00100000:0.0:1787508612.825682:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509448832 00000100:00100000:0.0:1787508612.825693:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509448832 00000100:00100000:0.0:1787508612.825757:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15385 00000100:00100000:3.0:1787508612.825767:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509449088 00000100:00100000:0.0:1787508612.825768:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336007:x1874324509448832:12345-192.168.201.30@tcp:35:rm.0 00000100:00100000:3.0:1787508612.825771:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509449088 00000100:00100000:3.0:1787508612.825830:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93510 00000100:00100000:3.0:1787508612.825837:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336009:x1874324509449088:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508612.825848:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508612.825869:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed800/0xb126349c40f32475 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad9ba expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.825929:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f3247c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.825974:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f3247c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.825985:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f3247c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.825998:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32483 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.826004:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32483 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.826011:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32483 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.826013:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:336007:x1874324509448832:12345-192.168.201.30@tcp:35:rm.0 Request processed in 246us (435us total) trans 8589961971 rc 0/0 00000100:00100000:0.0:1787508612.826020:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15385 00010000:00010000:3.0:1787508612.826067:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f3247c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.826075:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f3247c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.826081:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f3247c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.826088:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f3247c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.826094:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ed600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508612.826099:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f3247c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.826106:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f3247c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.826119:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508612.826122:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508612.826127:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f3247c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.826133:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f3247c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.826146:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32483 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.826153:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32483 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.826159:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32483 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.826164:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ec400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508612.826167:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32483 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.826173:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32483 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.826180:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ad43c78 (ffff9090cc088200) 00010000:00010000:3.0:1787508612.826183:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508612.826185:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32483 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.826191:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32483 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.826235:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed800/0xb126349c40f32475 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad9ba expref: 584 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.826245:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508612.826248:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508612.826251:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed800/0xb126349c40f32475 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad9ba expref: 584 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.826260:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d22ed800, rc 0) 00000100:00100000:3.0:1787508612.826284:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336009:x1874324509449088:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 447us (641us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508612.826291:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93510 00000100:00100000:1.0:1787508612.830848:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508612.832542:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.833086:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509449344 00000100:00100000:0.0:1787508612.833099:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509449344 00000100:00100000:0.0:1787508612.833158:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509449472 00000100:00100000:0.0:1787508612.833162:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509449472 00000100:00100000:0.0:1787508612.833206:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93511 00000100:00100000:0.0:1787508612.833216:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336009:x1874324509449344:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508612.833238:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.833263:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f3248a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad9c1 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.833345:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32491 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.833360:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32491 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.833373:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32491 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.833402:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32498 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.833411:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32498 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.833418:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32498 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.833512:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32491 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.833519:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32491 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.833524:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32491 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.833530:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32491 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.833535:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.833539:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32491 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.833546:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32491 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.833557:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.833560:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.833565:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32491 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.833570:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32491 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.833583:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32498 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.833589:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32498 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.833594:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32498 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.833598:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.833601:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32498 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.833607:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32498 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.833613:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbfff8436 (ffff9090d00cdc00) 00010000:00010000:0.0:1787508612.833615:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.833618:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32498 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.833623:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32498 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.833655:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f3248a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad9c1 expref: 584 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.833666:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.833669:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508612.833672:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f3248a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad9c1 expref: 584 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.833681:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7c00, rc 0) 00000100:00100000:0.0:1787508612.833740:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336009:x1874324509449344:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 525us (2905us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508612.833747:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93511 00000100:00100000:1.0:1787508612.839688:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508612.839980:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509449728 00000100:00100000:3.0:1787508612.839992:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509449728 00000100:00100000:3.0:1787508612.841302:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508612.844119:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508612.844213:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509449984 00000100:00100000:1.0:1787508612.844231:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509449984 00000100:00100000:1.0:1787508612.844282:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93514 00000100:00100000:1.0:1787508612.844291:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:336007:x1874324509449984:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508612.844315:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508612.844333:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b800/0xb126349c40f324d0 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad9d6 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.844409:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f324d7 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.844423:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f324d7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.844434:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f324d7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508612.844540:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13cf:0x0]: returning size 4096 00000004:00200000:1.0:1787508612.844545:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787508612.844583:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b800/0xb126349c40f324d0 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad9d6 expref: 11 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.844606:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f324d7 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad9d6 expref: 10 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.844614:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13cf:0x0].0x0 (ffff9090c6987900) 00010000:00010000:1.0:1787508612.844617:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508612.844621:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ac00, rc 0) 00000100:00100000:1.0:1787508612.844664:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:336007:x1874324509449984:12345-192.168.201.30@tcp:101:rm.0 Request processed in 374us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508612.844672:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93514 00000100:00100000:1.0:1787508612.849515:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508612.849779:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509450240 00000100:00100000:3.0:1787508612.849788:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509450240 00000100:00100000:3.0:1787508612.849854:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93515 00000100:00100000:3.0:1787508612.849865:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336009:x1874324509450240:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508612.849887:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508612.849909:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed800/0xb126349c40f324de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad9dd expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.850018:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f324e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.850033:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f324e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.850043:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f324e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.850059:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f324ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.850066:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f324ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.850074:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f324ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.850129:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f324e5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.850137:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f324e5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.850143:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f324e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.850150:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f324e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.850156:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ec400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508612.850161:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f324e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.850168:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f324e5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.850181:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508612.850184:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508612.850188:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f324e5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.850195:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f324e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.850209:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f324ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.850215:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f324ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.850221:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f324ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.850227:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ed600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508612.850230:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f324ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.850236:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f324ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.850244:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe67841 (ffff9090cc088200) 00010000:00010000:3.0:1787508612.850246:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508612.850249:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f324ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.850255:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f324ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.850292:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed800/0xb126349c40f324de lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad9dd expref: 584 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.850302:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508612.850304:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508612.850308:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed800/0xb126349c40f324de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad9dd expref: 584 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.850316:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d22ed800, rc 0) 00000100:00100000:3.0:1787508612.850375:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336009:x1874324509450240:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 511us (879us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508612.850383:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93515 00000100:00100000:0.0:1787508612.853897:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.854045:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508612.854122:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509450624 00000100:00100000:1.0:1787508612.854132:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509450624 00000100:00100000:1.0:1787508612.854186:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93516 00000100:00100000:1.0:1787508612.854196:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:336007:x1874324509450624:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1787508612.854253:0:209004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787508612.854267:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f324d7 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad9d6 expref: 10 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.854281:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ec800/0xb126349c40f32413 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad990 expref: 9 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.854289:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13cf:0x0].0x0 (ffff9090c6987900) 00010000:00010000:1.0:1787508612.854292:0:209004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787508612.854337:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f324f3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.854349:0:209004:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f324f3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.854359:0:209004:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f324f3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508612.854382:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf0000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480066816:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1787508612.854430:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508612.854466:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8900 going to sleep for 11 seconds 00000100:00100000:1.0:1787508612.863490:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.863562:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509450752 00000100:00100000:0.0:1787508612.863570:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509450752 00010000:00010000:0.0:1787508612.863609:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f322e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad927 expref: 583 pid: 203348 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.863654:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27760 00000100:00100000:0.0:1787508612.863665:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:2400:x1874324509450752:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508612.863680:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508612.863687:0:229383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f322e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad927 expref: 583 pid: 203348 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.863701:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f322e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad927 expref: 583 pid: 203348 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.863728:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f322e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad927 expref: 583 pid: 203348 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.863746:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.863752:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f324fa lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f324f3 expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.863762:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508612.863833:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:2400:x1874324509450752:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 170us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.863840:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27760 00000100:00100000:1.0:1787508612.867501:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508612.867572:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.867666:0:202232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc621180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:202232:1874324480067072:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508612.867719:0:202232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f324fa lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f324f3 expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.867732:0:202232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.867735:0:202232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.867739:0:202232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f324fa lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f324f3 expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.867749:0:202232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abe00, rc 0) 00000100:00100000:0.0:1787508612.867831:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:209004:x1874324480066816:12345-0@lo:101:mdt00_005.0 Request processed in 10621us (13398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.867840:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29570 00000100:00100000:1.0:1787508612.867965:0:209004:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944034 gen 2 00000004:00080000:1.0:1787508612.867972:0:209004:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944034 committed transno 12884944034 00000100:00100000:1.0:1787508612.867997:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf0000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480066816:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1787508612.868014:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f324f3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f324fa expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.868025:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f324f3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f324fa expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508612.868909:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509451008 00000100:00100000:3.0:1787508612.868915:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509451008 00010000:00010000:3.0:1787508612.868985:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3227d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad90b expref: 12 pid: 203348 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508612.869014:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27761 00000100:00100000:3.0:1787508612.869023:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2401:x1874324509451008:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508612.869034:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508612.869041:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3227d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad90b expref: 12 pid: 203348 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.869056:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3227d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad90b expref: 12 pid: 203348 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.869081:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3227d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad90b expref: 12 pid: 203348 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.869096:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508612.869100:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f32508 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.869109:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f324fa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xb126349c40f324f3 expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.869119:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f324fa lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xb126349c40f324f3 expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.869127:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f324fa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xb126349c40f324f3 expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.869135:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f32508 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.869142:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f32508 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.869165:0:202213:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f324fa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xb126349c40f324f3 expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508612.869180:0:202213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9c8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:202213:1874324480067328:0@lo:105: 00000100:00100000:3.0:1787508612.869248:0:202213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508612.869291:0:202213:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9106540 going to sleep for 11 seconds 00000100:00100000:1.0:1787508612.869636:0:229363:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787508612.869651:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480067328 00000100:00100000:1.0:1787508612.869655:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480067328 00000100:00100000:1.0:1787508612.869696:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18108 00000100:00100000:1.0:1787508612.869704:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9a78050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:202213:x1874324480067328:12345-0@lo:105: 00010000:00010000:1.0:1787508612.869714:0:229363:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f324f3 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f324fa expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.869724:0:229363:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f324f3 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f324fa expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.869732:0:229363:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f324f3 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f324fa expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.869741:0:229363:0:(ldlm_lockd.c:2058:ldlm_handle_cp_callback()) ### completion AST includes blocking AST ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f324f3 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xb126349c40f324fa expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.869748:0:229363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f324f3 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xb126349c40f324fa expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.869755:0:229363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f324f3 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xb126349c40f324fa expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.869763:0:229363:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f324f3 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1480400000000 nid: local remote: 0xb126349c40f324fa expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.869804:0:229363:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d247b600) 00000100:00100000:1.0:1787508612.869848:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9a78050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:202213:x1874324480067328:12345-0@lo:105: Request processed in 144us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508612.869855:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18108 00000100:00100000:3.0:1787508612.870099:0:202213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9c8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:202213:1874324480067328:0@lo:105: 00010000:00010000:3.0:1787508612.870115:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508612.870167:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2401:x1874324509451008:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1145us (2594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508612.870176:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27761 00010000:00010000:3.0:1787508612.870204:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f324f3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f324fa expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.870214:0:209004:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f324f3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f324fa expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787508612.870248:0:209004:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1787508612.870280:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed800/0xb126349c40f3250f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.870288:0:209004:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed800/0xb126349c40f3250f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.870297:0:209004:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed800/0xb126349c40f3250f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508612.870313:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480067456:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1787508612.870344:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508612.870377:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9106540 going to sleep for 11 seconds 00000100:00100000:0.0:1787508612.870560:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480067456 00000100:00100000:0.0:1787508612.870566:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480067456 00000100:00100000:0.0:1787508612.870607:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29571 00000100:00100000:0.0:1787508612.870615:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:209004:x1874324480067456:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1787508612.870630:0:202231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.870645:0:202231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32516 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f3250f expref: -99 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.870663:0:202231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32516 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f3250f expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.870675:0:202231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32516 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3250f expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.870683:0:202231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d00cdc00) 00010000:00010000:0.0:1787508612.870686:0:202231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.870689:0:202231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6400, rc 0) 00000100:00100000:0.0:1787508612.870725:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:209004:x1874324480067456:12345-0@lo:101:mdt00_005.0 Request processed in 110us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.870731:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29571 00000100:00100000:3.0:1787508612.871469:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480067456:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1787508612.871501:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed800/0xb126349c40f3250f lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32516 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.871517:0:209004:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed800/0xb126349c40f3250f lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32516 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787508612.871534:0:209004:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1787508612.871574:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480067584:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787508612.871611:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508612.871742:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9106900 going to sleep for 11 seconds 00000100:00100000:0.0:1787508612.874006:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480067584 00000100:00100000:0.0:1787508612.874020:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480067584 00000100:00100000:0.0:1787508612.874169:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29572 00000100:00100000:0.0:1787508612.874180:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:209004:x1874324480067584:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787508612.874327:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:209004:x1874324480067584:12345-0@lo:1000:mdt00_005.0 Request processed in 147us (2714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.874335:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29572 00000100:00100000:3.0:1787508612.874418:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480067584:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787508612.874493:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480067712:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787508612.874530:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508612.874774:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9106900 going to sleep for 11 seconds 00000100:00100000:1.0:1787508612.874925:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480067712 00000100:00100000:1.0:1787508612.874931:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480067712 00000100:00100000:1.0:1787508612.875001:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29573 00000100:00100000:1.0:1787508612.875010:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed03f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:209004:x1874324480067712:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787508612.875111:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed03f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:209004:x1874324480067712:12345-0@lo:1000:mdt00_005.0 Request processed in 102us (580us total) trans 0 rc 1/1 00000100:00100000:1.0:1787508612.875118:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29573 00000100:00100000:3.0:1787508612.875336:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480067712:0@lo:1000:mdt00_005.0 00010000:00010000:3.0:1787508612.875486:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed600/0xb126349c40f3251d lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.875497:0:209004:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed600/0xb126349c40f3251d lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.875509:0:209004:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed600/0xb126349c40f3251d lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508612.875524:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480067840:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1787508612.875553:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508612.875572:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9106540 going to sleep for 11 seconds 00000100:00100000:3.0:1787508612.875588:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480067840 00000100:00100000:3.0:1787508612.875593:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480067840 00000100:00100000:3.0:1787508612.875614:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29574 00000100:00100000:3.0:1787508612.875620:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:209004:x1874324480067840:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1787508612.875630:0:225829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508612.875645:0:225829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32524 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f3251d expref: -99 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.875670:0:225829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32395 lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad95f expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.875679:0:225829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32524 lrc: 4/0,0 mode: --/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f3251d expref: 9 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.875702:0:225829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32395 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad95f expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.875715:0:225829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32395 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad95f expref: 583 pid: 202226 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508612.875726:0:225829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9ca680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480067968:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508612.876004:0:225829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9106900 going to sleep for 11 seconds 00000100:00100000:3.0:1787508612.879603:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.879664:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509451136 00000100:00100000:0.0:1787508612.879673:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509451136 00010000:00010000:0.0:1787508612.879716:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32395 lrc: 5/0,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad95f expref: 584 pid: 202226 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.879754:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27762 00000100:00100000:0.0:1787508612.879762:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c1ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:2400:x1874324509451136:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508612.879775:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508612.879796:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32395 lrc: 5/0,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad95f expref: 584 pid: 202226 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.879810:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32395 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad95f expref: 584 pid: 202226 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.879833:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13cf:0x0].0x0 (ffff9090c5b0c800) 00010000:00010000:0.0:1787508612.879840:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32524 lrc: 3/0,0 mode: --/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f3251d expref: 9 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.879851:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32524 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xb126349c40f3251d expref: 9 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.879861:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32524 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xb126349c40f3251d expref: 9 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.879891:0:202211:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32524 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3251d expref: 9 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.879903:0:202211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b25180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:202211:1874324480068096:0@lo:105: 00000100:00100000:0.0:1787508612.880066:0:202211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508612.880102:0:202211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787508612.880117:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480068096 00000100:00100000:0.0:1787508612.880120:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480068096 00000100:00100000:0.0:1787508612.880146:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18109 00000100:00100000:0.0:1787508612.880152:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:202211:x1874324480068096:12345-0@lo:105: 00010000:00010000:0.0:1787508612.880163:0:202210:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed600/0xb126349c40f3251d lrc: 4/0,1 mode: --/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32524 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.880173:0:202210:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed600/0xb126349c40f3251d lrc: 4/0,1 mode: --/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32524 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.880181:0:202210:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed600/0xb126349c40f3251d lrc: 4/0,1 mode: --/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32524 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.880188:0:202210:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed600/0xb126349c40f3251d lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f32524 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.880195:0:202210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed600/0xb126349c40f3251d lrc: 5/0,1 mode: EX/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f32524 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.880203:0:202210:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed600/0xb126349c40f3251d lrc: 5/0,1 mode: EX/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f32524 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.880216:0:202210:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d22ed600) 00000100:00100000:0.0:1787508612.880255:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:202211:x1874324480068096:12345-0@lo:105: Request processed in 103us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.880262:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18109 00000100:00100000:0.0:1787508612.880297:0:202211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b25180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:202211:1874324480068096:0@lo:105: 00010000:00010000:0.0:1787508612.880318:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508612.880352:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c1ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:2400:x1874324509451136:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 590us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.880359:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27762 00000100:00100000:0.0:1787508612.882103:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480067840:0@lo:101:mdt00_005.0 00010000:00010000:0.0:1787508612.882120:0:209004:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed600/0xb126349c40f3251d lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32524 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.882148:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f3252b lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.882159:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f3252b lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.882170:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f3252b lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.882188:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f32532 lrc: 3/0,1 mode: --/EX res: [0x240000bd1:0x28e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.882197:0:209004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22edc00/0xb126349c40f32421 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad997 expref: 8 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.882205:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f32532 lrc: 4/0,1 mode: --/EX res: [0x240000bd1:0x28e:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.882291:0:209004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22edc00/0xb126349c40f32421 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad997 expref: 8 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.882308:0:209004:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22edc00/0xb126349c40f32421 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad997 expref: 8 pid: 202228 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.882321:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9acdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:209004:1874324480068224:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508612.882488:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9e8d240 going to sleep for 11 seconds 00000100:00100000:0.0:1787508612.885680:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508612.885745:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509451264 00000100:00100000:1.0:1787508612.885753:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509451264 00010000:00010000:1.0:1787508612.886034:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22edc00/0xb126349c40f32421 lrc: 5/0,0 mode: PR/PR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad997 expref: 9 pid: 202228 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508612.886098:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27763 00000100:00100000:1.0:1787508612.886108:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2401:x1874324509451264:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508612.886122:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508612.886129:0:229383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22edc00/0xb126349c40f32421 lrc: 5/0,0 mode: PR/PR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad997 expref: 9 pid: 202228 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.886142:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22edc00/0xb126349c40f32421 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad997 expref: 9 pid: 202228 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.886163:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28e:0x0].0x0 (ffff9090c6987700) 00010000:00010000:1.0:1787508612.886168:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f32532 lrc: 3/0,1 mode: --/EX res: [0x240000bd1:0x28e:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.886177:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f32532 lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x28e:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.886184:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f32532 lrc: 4/0,1 mode: EX/EX res: [0x240000bd1:0x28e:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.886202:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508612.886259:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2401:x1874324509451264:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 153us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508612.886266:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27763 00010000:00010000:3.0:1787508612.886337:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22edc00/0xb126349c40f32421 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad997 expref: 8 pid: 202228 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508612.886352:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9acdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:209004:1874324480068224:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508612.886371:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f32532 lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x28e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.887063:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f32532 lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x28e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.887074:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f32532 lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x28e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.887121:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec000/0xb126349c40f32539 lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.887130:0:209004:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec000/0xb126349c40f32539 lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.887140:0:209004:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec000/0xb126349c40f32539 lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508612.887159:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480068352:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1787508612.887205:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508612.887246:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9106480 going to sleep for 11 seconds 00000100:00100000:0.0:1787508612.887375:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480068352 00000100:00100000:0.0:1787508612.887382:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480068352 00000100:00100000:0.0:1787508612.887441:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29575 00000100:00100000:0.0:1787508612.887450:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:209004:x1874324480068352:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1787508612.887466:0:203182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.887491:0:203182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32540 lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f32539 expref: -99 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.887511:0:203182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3242f lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad99e expref: 10 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.887519:0:203182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32540 lrc: 4/0,0 mode: --/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f32539 expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.887541:0:203182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3242f lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad99e expref: 10 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.887553:0:203182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3242f lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad99e expref: 10 pid: 205405 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.887564:0:203182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ace680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480068480:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508612.887617:0:203182:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9e8d480 going to sleep for 11 seconds 00000100:00100000:3.0:1787508612.891574:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480068352:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1787508612.891600:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec000/0xb126349c40f32539 lrc: 4/0,1 mode: --/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32540 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.891611:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec000/0xb126349c40f32539 lrc: 4/0,1 mode: --/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32540 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.893338:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508612.893428:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509451392 00000100:00100000:3.0:1787508612.893437:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509451392 00010000:00010000:3.0:1787508612.893490:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3242f lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad99e expref: 11 pid: 205405 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508612.893537:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27764 00000100:00100000:3.0:1787508612.893547:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2401:x1874324509451392:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508612.893562:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508612.893570:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3242f lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad99e expref: 11 pid: 205405 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.893583:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3242f lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad99e expref: 11 pid: 205405 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.893604:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3242f lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x284:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad99e expref: 11 pid: 205405 timeout: 13683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.893620:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x284:0x0].0x0 (ffff9090d36fd600) 00010000:00010000:3.0:1787508612.893626:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32540 lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32539 expref: 9 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.893637:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32540 lrc: 2/0,0 mode: EX/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f32539 expref: 9 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.893645:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32540 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f32539 expref: 9 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.893677:0:202213:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32540 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32539 expref: 9 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508612.893690:0:202213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9c9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:202213:1874324480068608:0@lo:105: 00000100:00100000:3.0:1787508612.893735:0:202213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508612.893780:0:202213:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9106480 going to sleep for 11 seconds 00000100:00100000:1.0:1787508612.894072:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480068608 00000100:00100000:1.0:1787508612.894077:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480068608 00000100:00100000:1.0:1787508612.894116:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18110 00000100:00100000:1.0:1787508612.894123:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:202213:x1874324480068608:12345-0@lo:105: 00010000:00010000:1.0:1787508612.894134:0:229363:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec000/0xb126349c40f32539 lrc: 5/0,1 mode: --/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32540 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.894144:0:229363:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec000/0xb126349c40f32539 lrc: 5/0,1 mode: --/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32540 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.894154:0:229363:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec000/0xb126349c40f32539 lrc: 5/0,1 mode: --/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32540 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.894161:0:229363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec000/0xb126349c40f32539 lrc: 5/0,1 mode: EX/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f32540 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.894169:0:229363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec000/0xb126349c40f32539 lrc: 6/0,1 mode: EX/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f32540 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.894178:0:229363:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec000/0xb126349c40f32539 lrc: 6/0,1 mode: EX/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f32540 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.894205:0:229363:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d22ec000) 00000100:00100000:1.0:1787508612.894252:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:202213:x1874324480068608:12345-0@lo:105: Request processed in 129us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508612.894264:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18110 00000100:00100000:1.0:1787508612.894298:0:202213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9c9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:202213:1874324480068608:0@lo:105: 00010000:00010000:1.0:1787508612.894316:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508612.894354:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2401:x1874324509451392:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 809us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508612.894362:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27764 00010000:00010000:3.0:1787508612.894433:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec000/0xb126349c40f32539 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32540 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.894444:0:209004:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec000/0xb126349c40f32539 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32540 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508612.895144:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480068736:0@lo:403:mdt00_005.0 00000100:00100000:3.0:1787508612.895194:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508612.895217:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9106e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787508612.895797:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480068736 00000100:00100000:1.0:1787508612.895804:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480068736 00000100:00100000:1.0:1787508612.895855:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29576 00000100:00100000:1.0:1787508612.895864:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:209004:x1874324480068736:12345-0@lo:403:mdt00_005.0 00000100:00100000:1.0:1787508612.899376:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:209004:x1874324480068736:12345-0@lo:403:mdt00_005.0 Request processed in 3504us (4173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508612.899391:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29576 00000100:00100000:3.0:1787508612.899703:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9c8700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480068736:0@lo:403:mdt00_005.0 00000040:00080000:3.0:1787508612.900691:0:209004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xf:0x0].35, 664 off68712 00000040:00080000:3.0:1787508612.900871:0:209004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x5:0x0].578, 744 off733184 00000004:00080000:3.0:1787508612.900877:0:209004:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d9106e40 with version 13582 00000100:00100000:3.0:1787508612.901577:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480068992 00000100:00100000:3.0:1787508612.901586:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480068992 00000100:00100000:3.0:1787508612.901684:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29577 00000100:00100000:3.0:1787508612.901694:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:202961:x1874324480068992:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508612.902140:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:202961:x1874324480068992:12345-0@lo:1000:osp_up0-1.0 Request processed in 446us (894us total) trans 12884944035 rc 0/0 00000100:00100000:3.0:1787508612.902148:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29577 00000100:00100000:1.0:1787508612.902565:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc622d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480068992:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1787508612.902887:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13cf:0x0]: returning size 4096 00010000:00010000:0.0:1787508612.902911:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f32532 lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x28e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.902921:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f32532 lrc: 2/0,0 mode: EX/EX res: [0x240000bd1:0x28e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.902929:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f32532 lrc: 3/0,0 mode: EX/EX res: [0x240000bd1:0x28e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.902935:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.902955:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f32532 lrc: 3/0,0 mode: EX/EX res: [0x240000bd1:0x28e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.902964:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f32532 lrc: 4/0,0 mode: EX/EX res: [0x240000bd1:0x28e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.902980:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28e:0x0].0x0 (ffff9090c6987700) 00010000:00010000:0.0:1787508612.902983:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787508612.902988:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f32532 lrc: 2/0,0 mode: --/EX res: [0x240000bd1:0x28e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.902995:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f32532 lrc: 0/0,0 mode: --/EX res: [0x240000bd1:0x28e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.903009:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec000/0xb126349c40f32539 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32540 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.903019:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec000/0xb126349c40f32539 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f32540 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.903032:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec000/0xb126349c40f32539 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f32540 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.903059:0:209004:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787508612.903068:0:209004:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x284:0x0] 00010000:00010000:0.0:1787508612.903076:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f3252b lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.903083:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f3252b lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.903089:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f3252b lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.903094:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.903096:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f3252b lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.903103:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f3252b lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.903112:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13cf:0x0].0x0 (ffff9090c6987900) 00010000:00010000:0.0:1787508612.903114:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.903117:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f3252b lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.903123:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f3252b lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.903132:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed600/0xb126349c40f3251d lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32524 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.903140:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed600/0xb126349c40f3251d lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f32524 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.903147:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed600/0xb126349c40f3251d lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f32524 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.903164:0:209004:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1787508612.903173:0:209004:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787508612.903178:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f324f3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f324fa expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.903186:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f324f3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xb126349c40f324fa expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.903193:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f324f3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xb126349c40f324fa expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.903213:0:209004:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000004:00080000:0.0:1787508612.903216:0:209004:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787508612.903230:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed800/0xb126349c40f3250f lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32516 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.903238:0:209004:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed800/0xb126349c40f3250f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32516 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.903311:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336007:x1874324509450624:12345-192.168.201.30@tcp:36:rm.0 Request processed in 49113us (49263us total) trans 8589961972 rc 0/0 00000100:00100000:0.0:1787508612.903323:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93516 00010000:00010000:1.0:1787508612.903852:0:202214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787508612.903859:0:202214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f324f3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f324fa expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.903867:0:202214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:1.0:1787508612.903872:0:202214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f324f3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f324fa expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508612.903880:0:202214:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f324f3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f324fa expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.903913:0:202214:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f324f3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f324fa expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.903920:0:202214:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787508612.903977:0:202214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f324f3 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f324fa expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.903985:0:202214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f324f3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f324fa expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.903999:0:202214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787508612.904003:0:202214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec000/0xb126349c40f32539 lrc: 2/0,0 mode: EX/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xb126349c40f32540 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.904010:0:202214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ec000 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:1.0:1787508612.904013:0:202214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec000/0xb126349c40f32539 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xb126349c40f32540 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508612.904021:0:202214:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec000/0xb126349c40f32539 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xb126349c40f32540 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.904039:0:202214:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec000/0xb126349c40f32539 lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f32540 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.904045:0:202214:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787508612.904062:0:202214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec000/0xb126349c40f32539 lrc: 1/0,0 mode: --/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f32540 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.904070:0:202214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ec000/0xb126349c40f32539 lrc: 0/0,0 mode: --/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f32540 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.904092:0:202214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787508612.904095:0:202214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed600/0xb126349c40f3251d lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xb126349c40f32524 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.904102:0:202214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ed600 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:1.0:1787508612.904106:0:202214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed600/0xb126349c40f3251d lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xb126349c40f32524 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508612.904114:0:202214:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed600/0xb126349c40f3251d lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xb126349c40f32524 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.904129:0:202214:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed600/0xb126349c40f3251d lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f32524 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.904135:0:202214:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787508612.904141:0:202214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed600/0xb126349c40f3251d lrc: 1/0,0 mode: --/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f32524 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.904148:0:202214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed600/0xb126349c40f3251d lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f32524 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.904160:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508612.904161:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508612.904163:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508612.904172:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787508612.904186:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480069120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508612.904247:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508612.904294:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480069120 00000100:00100000:1.0:1787508612.904301:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480069120 00010000:00010000:1.0:1787508612.904324:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f324fa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xb126349c40f324f3 expref: 11 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508612.904346:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27765 00000100:00100000:1.0:1787508612.904353:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:3618:x1874324480069120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508612.904364:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508612.904371:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f324fa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f324f3 expref: 11 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.904583:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f324fa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000020 nid: 0@lo remote: 0xb126349c40f324f3 expref: 11 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.904597:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508612.904602:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f32508 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.904610:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f32508 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.904617:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f32508 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.904678:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508612.904710:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:3618:x1874324480069120:12345-0@lo:103:ldlm_bl.0 Request processed in 357us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508612.904717:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27765 00000100:00100000:1.0:1787508612.904752:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480069120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508612.911203:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480069248 00000100:00100000:1.0:1787508612.911211:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480069248 00000100:00100000:1.0:1787508612.911277:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480069376 00000100:00100000:1.0:1787508612.911281:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480069376 00000100:00100000:1.0:1787508612.911302:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9767 00000100:00100000:1.0:1787508612.911311:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc622680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+11:3616:x1874324480069248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508612.911325:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508612.911352:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32540 lrc: 0/0,0 mode: --/EX res: [0x2000013a2:0x284:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f32539 expref: 11 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.911372:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x284:0x0].0x0 (ffff9090d36fd600) 00010000:00010000:1.0:1787508612.911394:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508612.911436:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc622680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+10:3616:x1874324480069248:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508612.911443:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9767 00000100:00100000:1.0:1787508612.911460:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9768 00000100:00100000:1.0:1787508612.911466:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc621880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3616:x1874324480069376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508612.911486:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508612.911498:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32524 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f3251d expref: 9 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.911510:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13cf:0x0].0x0 (ffff9090c5b0c800) 00010000:00010000:1.0:1787508612.911518:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508612.911541:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc621880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3616:x1874324480069376:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508612.911547:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9768 00010000:00010000:0.0:1787508612.914974:0:202227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f32508 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.914989:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f32508 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508612.915062:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787508612.915067:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508612.915091:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f32508 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.915131:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f32501 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad9e4 expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.915154:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f32508 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad9e4 expref: 582 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.915164:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.915166:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508612.915170:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab400, rc 0) 00000100:00100000:0.0:1787508612.915658:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336009:x1874324509450880:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 47362us (48166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508612.915668:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93517 00000100:00100000:1.0:1787508612.919607:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508612.919794:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.925450:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508612.927811:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509451776 00000100:00100000:3.0:1787508612.927829:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509451776 00000100:00100000:3.0:1787508612.927906:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93520 00000100:00100000:3.0:1787508612.927917:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336010:x1874324509451776:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508612.927968:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508612.927994:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f3256a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaad9f9 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.928061:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f32571 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.928076:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f32571 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.928088:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f32571 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.928105:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32578 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.928112:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.928120:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.928180:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f32571 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.928188:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f32571 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.928195:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f32571 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.928201:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f32571 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.928210:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ed200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508612.928215:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f32571 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.928233:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f32571 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.928246:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508612.928249:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508612.928254:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f32571 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.928260:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f32571 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.928276:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.928281:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32578 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.928286:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32578 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.928291:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ec400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508612.928294:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32578 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.928299:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32578 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.928310:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090cc088000) 00010000:00010000:3.0:1787508612.928312:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508612.928314:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32578 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.928319:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32578 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.928348:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f3256a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad9f9 expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.928357:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508612.928359:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508612.928362:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f3256a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad9f9 expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.928371:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d22edc00, rc 0) 00000100:00100000:0.0:1787508612.928689:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508612.929531:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336010:x1874324509451776:12345-192.168.201.30@tcp:101:rm.0 Request processed in 1614us (4087us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508612.929539:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93520 00000100:00100000:0.0:1787508612.935147:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.935197:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508612.935872:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93523 00000100:00100000:3.0:1787508612.935882:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336009:x1874324509452160:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508612.935891:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508612.935900:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f325a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaada0e expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.935926:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f325b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.935935:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f325b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.935958:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f325b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.935970:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f325b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.935976:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f325b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.935982:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f325b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.936020:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f325b0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.936027:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f325b0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.936034:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f325b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.936041:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f325b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.936047:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ec000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508612.936052:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f325b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.936059:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f325b0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.936072:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508612.936075:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508612.936080:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f325b0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.936087:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f325b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.936101:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f325b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.936107:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f325b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.936113:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f325b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.936118:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22eda00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508612.936121:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f325b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.936126:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f325b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.936133:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090cc088a00) 00010000:00010000:3.0:1787508612.936136:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508612.936138:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f325b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.936143:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f325b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.936176:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f325a9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada0e expref: 583 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.936186:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508612.936188:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508612.936192:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f325a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada0e expref: 583 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.936200:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d22ed600, rc 0) 00000100:00100000:3.0:1787508612.936273:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336009:x1874324509452160:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 393us (1075us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508612.936280:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93523 00000100:00100000:0.0:1787508612.941052:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.946908:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508612.947104:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509452544 00000100:00100000:3.0:1787508612.947117:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509452544 00000100:00100000:3.0:1787508612.947183:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93525 00000100:00100000:3.0:1787508612.947194:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d8783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336010:x1874324509452544:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508612.947218:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508612.947250:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f325d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaada1c expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.947314:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f325da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.947328:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f325da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.947339:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f325da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.947354:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f325e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.947361:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f325e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.947367:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f325e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.947437:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f325da lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.947445:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f325da lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.947451:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f325da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.947457:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f325da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.947462:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22eda00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508612.947467:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f325da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.947485:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f325da lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.947499:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508612.947502:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508612.947507:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f325da lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.947514:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f325da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.947527:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f325e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.947533:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f325e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.947538:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f325e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.947542:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ec000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508612.947545:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f325e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.947550:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f325e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.947556:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090cc088a00) 00010000:00010000:3.0:1787508612.947559:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508612.947562:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f325e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.947567:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f325e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.947595:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f325d3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada1c expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.947610:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508612.947612:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508612.947615:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f325d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada1c expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.947623:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d22ed600, rc 0) 00000100:00100000:3.0:1787508612.947690:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d8783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336010:x1874324509452544:12345-192.168.201.30@tcp:101:rm.0 Request processed in 497us (795us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508612.947697:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93525 00000100:00100000:0.0:1787508612.952569:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509452800 00000100:00100000:0.0:1787508612.952580:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509452800 00000100:00100000:0.0:1787508612.952649:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93526 00000100:00100000:0.0:1787508612.952661:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336009:x1874324509452800:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508612.952683:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.952705:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f325e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaada23 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.952797:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f325ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.952812:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f325ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.952822:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f325ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.952839:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f325f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.952846:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f325f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.952852:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f325f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.952910:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f325ef lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.952921:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f325ef lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.952926:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f325ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.952932:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f325ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.953094:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7a00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.953099:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f325ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.953107:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f325ef lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.953121:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.953124:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.953129:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f325ef lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.953136:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f325ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.953149:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f325f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.953155:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f325f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.953161:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f325f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.953166:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.953169:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f325f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.953174:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f325f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.953181:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x90ba0166 (ffff9090c6913900) 00010000:00010000:0.0:1787508612.953183:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.953186:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f325f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.953192:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f325f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.953340:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f325e8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada23 expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.953352:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.953355:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508612.953359:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f325e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada23 expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.953369:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6c00, rc 0) 00000100:00100000:0.0:1787508612.953556:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336009:x1874324509452800:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 896us (1431us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508612.953564:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93526 00000100:00100000:0.0:1787508612.959047:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508612.959296:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93527 00000100:00100000:0.0:1787508612.959310:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d8781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336009:x1874324509453056:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508612.959334:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508612.959355:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f325fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaada2a expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.959439:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32604 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.959453:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32604 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.959465:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32604 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.959490:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3260b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.959498:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3260b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.959504:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3260b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.959567:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32604 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.959574:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32604 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.959580:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32604 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.959587:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32604 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.959593:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.959597:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32604 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.959604:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32604 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.959617:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.959620:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.959624:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32604 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.959630:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32604 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.959643:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3260b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.959649:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3260b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.959654:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3260b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.959659:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7a00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508612.959662:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3260b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.959673:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3260b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.959681:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaf3dc4c9 (ffff9090c6913900) 00010000:00010000:0.0:1787508612.959683:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508612.959686:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3260b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.959692:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3260b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.959725:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f325fd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada2a expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.959736:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.959739:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508612.959743:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f325fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada2a expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.959751:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6c00, rc 0) 00000100:00100000:0.0:1787508612.959823:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d8781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336009:x1874324509453056:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 516us (788us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508612.959830:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93527 00000100:00100000:1.0:1787508612.968544:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509453312 00000100:00100000:1.0:1787508612.968556:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509453312 00000100:00100000:1.0:1787508612.968617:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509453440 00000100:00100000:1.0:1787508612.968620:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509453440 00000100:00100000:1.0:1787508612.968648:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93528 00000100:00100000:1.0:1787508612.968657:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336010:x1874324509453312:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508612.968679:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508612.968711:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32612 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaada31 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.968796:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32619 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.968810:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32619 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.968820:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32619 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.968835:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32620 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.968842:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32620 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.968848:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32620 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.968905:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32619 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.968912:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32619 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.968921:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32619 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.968927:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32619 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.968933:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.968937:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32619 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.968977:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32619 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.968990:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508612.968993:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508612.968998:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32619 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.969004:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32619 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.969016:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32620 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.969022:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32620 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.969027:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32620 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.969033:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247bc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.969036:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32620 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.969042:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32620 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.969048:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090cda8af00) 00010000:00010000:1.0:1787508612.969051:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508612.969053:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32620 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.969060:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32620 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.969091:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32612 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada31 expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.969102:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508612.969104:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508612.969108:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32612 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada31 expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.969117:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a000, rc 0) 00000100:00100000:1.0:1787508612.969178:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336010:x1874324509453312:12345-192.168.201.30@tcp:101:rm.0 Request processed in 520us (921us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508612.969185:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93528 00000100:00100000:1.0:1787508612.969205:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93529 00000100:00100000:1.0:1787508612.969212:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336009:x1874324509453440:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508612.969219:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508612.969229:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f32627 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaada38 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.969260:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3262e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.969267:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3262e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.969273:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3262e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.969281:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32635 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.969290:0:203348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32516 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3250f expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.969297:0:203348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32635 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.969325:0:203348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32516 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f3250f expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508612.969339:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b03b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:203348:1874324480069504:0@lo:104: 00000100:00100000:1.0:1787508612.969377:0:203348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508612.970910:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8780 going to sleep for 11 seconds 00010000:00010000:3.0:1787508612.971505:0:202215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787508612.971512:0:202215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed800/0xb126349c40f3250f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f32516 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.971521:0:202215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ed800 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:3.0:1787508612.971527:0:202215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed800/0xb126349c40f3250f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f32516 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508612.971536:0:202215:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed800/0xb126349c40f3250f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f32516 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.971572:0:202215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed800/0xb126349c40f3250f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f32516 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.971580:0:202215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787508612.971611:0:202215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed800/0xb126349c40f3250f lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f32516 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.971623:0:202215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d22ed800/0xb126349c40f3250f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f32516 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.971641:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508612.971643:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508612.971644:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508612.971713:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787508612.971728:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480069632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508612.971769:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508612.971908:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480069632 00000100:00100000:3.0:1787508612.971913:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480069632 00010000:00010000:3.0:1787508612.971936:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32516 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f3250f expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508612.971993:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27766 00000100:00100000:3.0:1787508612.972000:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3619:x1874324480069632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787508612.972010:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787508612.972571:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b03b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:203348:1874324480069504:0@lo:104: 00010000:00010000:1.0:1787508612.972595:0:203348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32635 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787508612.974968:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944035 is committed 00010000:00010000:3.0:1787508612.975093:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32516 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f3250f expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.975110:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d00cdc00) 00010000:00010000:3.0:1787508612.975116:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32635 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.975126:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32635 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.975133:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32635 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.975165:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508612.975344:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480069632:12345-0@lo:103:ldlm_bl.0 Request processed in 3342us (3571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508612.975354:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27766 00010000:00010000:1.0:1787508612.975417:0:203348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32635 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.975425:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32635 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.975487:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3262e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.975494:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3262e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.975500:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3262e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.975507:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3262e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.975513:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.975517:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3262e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.975524:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3262e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.975535:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508612.975537:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508612.975541:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3262e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.975552:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3262e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.975563:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32635 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.975569:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32635 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.975574:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32635 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.975578:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508612.975581:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32635 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.975586:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32635 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.975593:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d00cdc00) 00010000:00010000:1.0:1787508612.975595:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508612.975598:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32635 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.975604:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32635 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.975647:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f32627 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada38 expref: 583 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.975661:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508612.975663:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508612.975666:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f32627 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada38 expref: 583 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508612.975674:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b600, rc 0) 00000100:00100000:1.0:1787508612.975730:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336009:x1874324509453440:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 6518us (7417us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508612.975738:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93529 00000100:00100000:3.0:1787508612.980991:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509453568 00000100:00100000:3.0:1787508612.981002:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509453568 00000100:00100000:3.0:1787508612.981060:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93530 00000100:00100000:3.0:1787508612.981072:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336010:x1874324509453568:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508612.981093:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508612.981116:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f3263c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaada3f expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.981184:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f32643 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.981198:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f32643 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.981209:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f32643 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.981223:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f3264a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.981242:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f3264a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.981248:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f3264a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.981310:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f32643 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.981322:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f32643 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.981328:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f32643 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.981335:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f32643 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.981341:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ec000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508612.981346:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f32643 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.981354:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f32643 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.981366:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508612.981369:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508612.981373:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f32643 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.981379:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f32643 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.981853:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f3264a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.981864:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f3264a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.981871:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f3264a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.981877:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22eda00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508612.981880:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f3264a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.981886:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f3264a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.981895:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090cc088a00) 00010000:00010000:3.0:1787508612.981897:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508612.981900:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f3264a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.981906:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f3264a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.983290:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f3263c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada3f expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.983312:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508612.983314:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508612.983322:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f3263c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada3f expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508612.983338:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d22ed600, rc 0) 00000100:00100000:0.0:1787508612.988175:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480069632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508612.996401:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509453824 00000100:00100000:0.0:1787508612.996412:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509453824 00000100:00100000:0.0:1787508612.996487:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93531 00000100:00100000:0.0:1787508612.996499:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336009:x1874324509453824:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:0.0:1787508612.996558:0:202227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508612.996585:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f32508 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad9e4 expref: 582 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.996603:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508612.996609:0:202227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508612.996689:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32651 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.996703:0:202227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3254e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad9eb expref: 10 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.996711:0:202227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32651 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.996743:0:202227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3254e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad9eb expref: 10 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508612.996758:0:202227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3254e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad9eb expref: 10 pid: 230618 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508612.996773:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:202227:1874324480069760:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508612.997252:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787508613.003518:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:202227:1874324480069760:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508613.003557:0:202227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32651 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.004132:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509453952 00000100:00100000:1.0:1787508613.004141:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509453952 00010000:00010000:1.0:1787508613.004178:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3254e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad9eb expref: 11 pid: 230618 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.004209:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27767 00000100:00100000:1.0:1787508613.004224:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c1ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2400:x1874324509453952:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508613.004241:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508613.004248:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3254e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad9eb expref: 11 pid: 230618 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.004261:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3254e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad9eb expref: 11 pid: 230618 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.004282:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3254e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaad9eb expref: 11 pid: 230618 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.004304:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.004308:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32651 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.004318:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32651 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.004326:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32651 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.004349:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508613.004404:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c1ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2400:x1874324509453952:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 186us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.004412:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27767 00010000:00010000:3.0:1787508613.004566:0:202227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32651 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.004574:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32651 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.004602:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f32658 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.004612:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f32658 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.004620:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f32658 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787508613.005610:0:202227:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1:0x0].1771, 2168 off1823464 00000040:00080000:3.0:1787508613.005699:0:202227:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x1:0x0].1777, 2368 off2027896 00000004:00080000:3.0:1787508613.005707:0:202227:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d9106540 with version 3438 00000004:00080000:0.0:1787508613.006741:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3438 rpc_version 3438 00000100:00100000:3.0:1787508613.007368:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480070016 00000100:00100000:3.0:1787508613.007380:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480070016 00000100:00100000:3.0:1787508613.007448:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29578 00000100:00100000:3.0:1787508613.007460:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:202248:x1874324480070016:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787508613.008089:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:202248:x1874324480070016:12345-0@lo:1000:osp_up1-0.0 Request processed in 629us (951us total) trans 8589961973 rc 0/0 00000100:00100000:3.0:1787508613.008098:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29578 00000100:00100000:0.0:1787508613.008594:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea3480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480070016:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1787508613.008761:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f3265f lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1257:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.008790:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f3265f lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1257:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.008803:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f3265f lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1257:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.008822:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f32666 lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x16d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.008831:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f32666 lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x16d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.008837:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f32666 lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x16d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.008871:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ed800/0xb126349c40f3266d lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.008880:0:202227:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ed800/0xb126349c40f3266d lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.008890:0:202227:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ed800/0xb126349c40f3266d lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.008907:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:202227:1874324480070144:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1787508613.008963:0:202227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.008991:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88540 going to sleep for 11 seconds 00000100:00100000:1.0:1787508613.009522:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:202227:1874324480070144:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1787508613.009537:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ed800/0xb126349c40f3266d lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32674 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.009547:0:202227:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ed800/0xb126349c40f3266d lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32674 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508613.009570:0:202227:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be253688 reply state 00000000cf086d95 transno 12884944036 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f32666 lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x16d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.009583:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f32666 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x16d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.009590:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16d:0x0].0x0 (ffff9090cc088000) 00010000:00010000:1.0:1787508613.009592:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787508613.009595:0:202227:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787508613.009601:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ed800/0xb126349c40f3266d lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32674 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.009609:0:202227:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ed800/0xb126349c40f3266d lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32674 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787508613.009619:0:202227:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd2:0x165:0x0] 00000004:00010000:1.0:1787508613.009624:0:202227:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be253688 reply state 00000000cf086d95 transno 12884944036 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f3265f lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1257:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.009631:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f3265f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1257:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.009636:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1257:0x0].0x0 (ffff9090cc088200) 00010000:00010000:1.0:1787508613.009638:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787508613.009640:0:202227:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1787508613.011554:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1257:0x0]: returning size 4096 00010000:00010000:1.0:1787508613.011577:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32651 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.011589:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32651 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.011595:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32651 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.011602:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32651 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.011608:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.011612:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32651 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.011621:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32651 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.011638:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.011641:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.011646:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32651 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.011653:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32651 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508613.011673:0:202227:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be253688 reply state 00000000cf086d95 transno 12884944036 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f32658 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.011686:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f32658 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.011693:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090cc088a00) 00010000:00010000:1.0:1787508613.011695:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787508613.011698:0:202227:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1787508613.011828:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336009:x1874324509453824:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 15328us (15587us total) trans 12884944036 rc 0/0 00000100:00100000:1.0:1787508613.011839:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93531 00000100:00100000:3.0:1787508613.019184:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509454080 00000100:00100000:3.0:1787508613.019194:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509454080 00000100:00100000:3.0:1787508613.019265:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93532 00000100:00100000:3.0:1787508613.019276:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:336012:x1874324509454080:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508613.019297:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.019318:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f3267b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaada46 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.019391:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32682 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.019410:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.019420:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508613.019487:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508613.019492:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508613.019514:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.019542:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f3267b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada46 expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.019562:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32682 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada46 expref: 11 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.019573:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.019576:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508613.019579:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d22ec400, rc 0) 00000100:00100000:3.0:1787508613.019654:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336012:x1874324509454080:12345-192.168.201.30@tcp:101:rm.0 Request processed in 378us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.019661:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93532 00000100:00100000:0.0:1787508613.025551:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.025660:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509454208 00000100:00100000:1.0:1787508613.025676:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509454208 00000100:00100000:1.0:1787508613.025744:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93533 00000100:00100000:1.0:1787508613.025754:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336012:x1874324509454208:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508613.025774:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.025799:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32689 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaada4d expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.025862:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f32690 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.025877:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f32690 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.025887:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f32690 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.025904:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32697 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.025911:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.025917:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.026013:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f32690 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.026021:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f32690 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.026026:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f32690 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.026032:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f32690 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.026042:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.026046:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f32690 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.026053:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f32690 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.026065:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.026068:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.026072:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f32690 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.026078:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f32690 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.026092:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32697 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.026098:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32697 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.026104:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32697 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.026108:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.026111:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32697 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.026122:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32697 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.026132:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090cda8af00) 00010000:00010000:1.0:1787508613.026134:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.026137:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32697 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.026142:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32697 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.026170:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32689 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada4d expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.026180:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.026181:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508613.026185:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32689 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada4d expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.026193:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a600, rc 0) 00000100:00100000:1.0:1787508613.026260:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336012:x1874324509454208:12345-192.168.201.30@tcp:101:rm.0 Request processed in 507us (719us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508613.026267:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93533 00000100:00100000:1.0:1787508613.028648:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.033139:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509454464 00000100:00100000:1.0:1787508613.033154:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509454464 00000100:00100000:1.0:1787508613.033223:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93535 00000100:00100000:1.0:1787508613.033234:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336012:x1874324509454464:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508613.033253:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.033272:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f326b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaada5b expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.033340:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f326ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.033355:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f326ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.033365:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f326ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.033380:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f326c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.033387:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f326c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.033403:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f326c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.033456:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f326ba lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.033463:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f326ba lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.033469:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f326ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.033486:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f326ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.033492:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.033497:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f326ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.033514:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f326ba lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.033527:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.033529:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.033534:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f326ba lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.033540:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f326ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.033554:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f326c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.033560:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f326c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.033566:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f326c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.033571:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.033574:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f326c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.033580:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f326c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.033586:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090cda8af00) 00010000:00010000:1.0:1787508613.033588:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.033593:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f326c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.033599:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f326c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.033628:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f326b3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada5b expref: 12 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.033638:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.033640:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508613.033643:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f326b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada5b expref: 12 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.033651:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a600, rc 0) 00000100:00100000:1.0:1787508613.033722:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336012:x1874324509454464:12345-192.168.201.30@tcp:101:rm.0 Request processed in 489us (1439us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508613.033729:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93535 00000100:00100000:0.0:1787508613.040090:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.045190:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.045237:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.045265:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509454848 00000100:00100000:0.0:1787508613.045276:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509454848 00000100:00100000:0.0:1787508613.045337:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509454976 00000100:00100000:0.0:1787508613.045341:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509454976 00000100:00100000:0.0:1787508613.045363:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93537 00000100:00100000:0.0:1787508613.045372:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336012:x1874324509454848:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508613.045404:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1787508613.045413:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93538 00000100:00100000:1.0:1787508613.045422:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336013:x1874324509454976:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508613.045426:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f326d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaada69 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.045429:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.045436:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f326dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaada70 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.045496:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f326e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.045496:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f326eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.045511:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f326eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.045523:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f326eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.045720:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f326f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.045729:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f326f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.045738:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f326f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.045805:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f326eb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.048755:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f326e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.048782:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f326e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.048813:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f326f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.048821:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f326f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.048827:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f326f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.048882:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f326eb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.048887:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f326e4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.048891:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f326eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.048897:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f326eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.048898:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f326e4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.048905:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f326e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.048910:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f326e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.048910:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.048914:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.048915:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f326eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.048917:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f326e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.048924:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f326e4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.048924:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f326eb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.049111:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.049115:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.049120:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f326eb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.049127:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f326eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.049146:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f326f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.049154:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f326f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.049160:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f326f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.049165:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.049168:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f326f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.049174:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f326f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.049182:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090e460f600) 00010000:00010000:0.0:1787508613.049184:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.049187:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f326f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.049193:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f326f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.049311:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f326d6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada69 expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.049324:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.049326:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508613.049330:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f326d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada69 expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.049345:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6200, rc 0) 00000100:00100000:0.0:1787508613.049551:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336012:x1874324509454848:12345-192.168.201.30@tcp:101:rm.0 Request processed in 4178us (4369us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508613.049561:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93537 00010000:00010000:1.0:1787508613.049895:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.049899:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.049903:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f326e4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.049910:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f326e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.049921:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f326f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.049927:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f326f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.049932:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f326f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.049937:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247bc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.049959:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f326f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.049967:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f326f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.049976:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090cda8af00) 00010000:00010000:1.0:1787508613.049978:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.049981:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f326f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.049987:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f326f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.050021:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f326dd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada70 expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.051649:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.051653:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508613.051660:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f326dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada70 expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.051676:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a400, rc 0) 00000100:00100000:1.0:1787508613.051751:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336013:x1874324509454976:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 6329us (6511us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508613.051760:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93538 00000100:00100000:1.0:1787508613.055361:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.055554:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509455104 00000100:00100000:3.0:1787508613.055567:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509455104 00000100:00100000:3.0:1787508613.055639:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93539 00000100:00100000:3.0:1787508613.055650:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336013:x1874324509455104:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1787508613.055672:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.055698:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f32700 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaada77 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.055771:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f32707 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.055800:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f32707 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.055812:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f32707 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.055826:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f3270e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.055834:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f3270e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.055841:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f3270e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.055905:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f32707 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.055913:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f32707 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.055920:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f32707 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.055928:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f32707 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.059803:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ed200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.059820:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f32707 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.059834:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f32707 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.059854:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.059857:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.059862:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f32707 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.059869:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f32707 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.059890:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f3270e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.059898:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f3270e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.059905:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f3270e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.059911:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ec800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.059914:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f3270e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.059920:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f3270e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.059932:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090cc088f00) 00010000:00010000:3.0:1787508613.059934:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.059937:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f3270e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.059969:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f3270e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.060019:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f32700 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada77 expref: 585 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.060029:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.060032:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508613.060036:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f32700 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada77 expref: 585 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.060045:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d22edc00, rc 0) 00000100:00100000:3.0:1787508613.060124:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336013:x1874324509455104:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 4474us (4772us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508613.060133:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93539 00000100:00100000:3.0:1787508613.063791:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.063874:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509455232 00000100:00100000:1.0:1787508613.063885:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509455232 00000100:00100000:1.0:1787508613.063977:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93540 00000100:00100000:1.0:1787508613.063988:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336013:x1874324509455232:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508613.064009:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.064030:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32715 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaada7e expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.064094:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3271c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.064109:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3271c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.064124:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3271c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.064137:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32723 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.064143:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32723 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.064149:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32723 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.064204:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3271c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.064211:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3271c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.064217:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3271c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.064234:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3271c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.064240:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.064244:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3271c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.064252:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3271c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.064264:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.064268:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.064273:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3271c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.064279:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3271c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.064292:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32723 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.064298:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32723 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.064304:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32723 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.064309:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.064312:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32723 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.064318:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32723 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.064324:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090cda8aa00) 00010000:00010000:1.0:1787508613.064327:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.064330:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32723 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.064336:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32723 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.064367:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32715 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada7e expref: 585 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.064378:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.064380:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508613.064504:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32715 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada7e expref: 585 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.064515:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ae00, rc 0) 00000100:00100000:1.0:1787508613.064582:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336013:x1874324509455232:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 595us (815us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508613.064589:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93540 00000100:00100000:0.0:1787508613.070761:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.071201:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509455360 00000100:00100000:1.0:1787508613.071212:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509455360 00000100:00100000:1.0:1787508613.071272:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93541 00000100:00100000:1.0:1787508613.071282:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336012:x1874324509455360:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508613.071301:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.071320:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3272a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaada85 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.071387:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32731 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.071400:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32731 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.071412:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32731 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.071422:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32738 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.071430:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32738 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.071436:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32738 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.071536:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3273f lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1257:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.071544:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3273f lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1257:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.071550:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3273f lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1257:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508613.071626:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1257:0x0]: returning size 4096 00000004:00200000:1.0:1787508613.071631:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1787508613.071648:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3273f lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1257:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.071660:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32731 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.071667:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32731 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.071673:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32731 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.071680:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32731 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.071690:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.071695:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32731 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.071701:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32731 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.071713:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.071715:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.071719:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32731 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.071725:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32731 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.071736:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32738 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.071742:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32738 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.071748:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32738 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.071752:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.071755:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32738 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.071761:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32738 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.071771:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090cc088a00) 00010000:00010000:1.0:1787508613.071773:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.071776:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32738 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.071845:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32738 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.071870:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3272a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada85 expref: 13 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.071882:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3273f lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1257:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada85 expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.071889:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1257:0x0].0x0 (ffff9090cc088200) 00010000:00010000:1.0:1787508613.071891:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508613.071894:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a400, rc 0) 00000100:00100000:1.0:1787508613.072119:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336012:x1874324509455360:12345-192.168.201.30@tcp:101:rm.0 Request processed in 836us (1377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.072127:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93541 00000100:00100000:0.0:1787508613.083113:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.083164:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.083267:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509455488 00000100:00100000:1.0:1787508613.083277:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509455488 00000100:00100000:1.0:1787508613.083337:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509455744 00000100:00100000:1.0:1787508613.083341:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509455744 00000100:00100000:1.0:1787508613.083373:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93542 00000100:00100000:1.0:1787508613.083391:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336012:x1874324509455488:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508613.083414:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.083438:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32746 lrc: 2/0,0 mode: --/CR res: [0x2000013a0:0x16d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaada8c expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.083514:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3274d lrc: 3/1,0 mode: --/PR res: [0x2000013a0:0x16d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.083529:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3274d lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.083541:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3274d lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508613.083595:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a0:0x16d:0x0]: returning size 4096 00000004:00200000:1.0:1787508613.083601:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787508613.083639:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32746 lrc: 0/0,0 mode: --/CR res: [0x2000013a0:0x16d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada8c expref: 14 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.083659:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3274d lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada8c expref: 13 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.083669:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16d:0x0].0x0 (ffff9090cc088000) 00010000:00010000:1.0:1787508613.083672:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508613.083675:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ac00, rc 0) 00000100:00100000:1.0:1787508613.083734:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336012:x1874324509455488:12345-192.168.201.30@tcp:101:rm.0 Request processed in 353us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.083742:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93542 00000100:00100000:1.0:1787508613.083760:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93543 00000100:00100000:1.0:1787508613.083767:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336013:x1874324509455744:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508613.083776:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.083801:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32754 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaada93 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.083847:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3275b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.083857:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3275b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.083864:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3275b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.083877:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32762 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.083884:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32762 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.083892:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32762 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.083937:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3275b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.083986:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3275b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.083993:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3275b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.084000:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3275b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.084010:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247bc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.084015:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3275b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.084023:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3275b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.084033:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.084036:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.084039:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3275b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.084045:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3275b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.084056:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32762 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.084061:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32762 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.084066:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32762 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.084071:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.084073:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32762 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.084079:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32762 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.084089:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090cda8aa00) 00010000:00010000:1.0:1787508613.084091:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.084094:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32762 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.084099:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32762 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.084123:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32754 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada93 expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.084132:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.084134:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508613.084137:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32754 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada93 expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.084145:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b000, rc 0) 00000100:00100000:1.0:1787508613.084168:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336013:x1874324509455744:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 402us (1003us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508613.084175:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93543 00000100:00100000:3.0:1787508613.090670:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.090762:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.091155:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509455872 00000100:00100000:0.0:1787508613.091166:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509455872 00000100:00100000:1.0:1787508613.091539:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93545 00000100:00100000:1.0:1787508613.091549:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336012:x1874324509456000:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508613.091563:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.091573:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b800/0xb126349c40f32785 lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x165:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadaa1 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.091604:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f3278c lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x165:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.091616:0:202226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f32674 lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3266d expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.091625:0:202226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f3278c lrc: 4/1,0 mode: --/PR res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.091661:0:202226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f32674 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f3266d expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.091679:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9acfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:202226:1874324480070272:0@lo:104: 00000100:00100000:1.0:1787508613.091731:0:202226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.091779:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8600 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.092598:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480070272 00000100:00100000:3.0:1787508613.092606:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480070272 00000100:00100000:3.0:1787508613.092653:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18112 00000100:00100000:3.0:1787508613.092660:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:202226:x1874324480070272:12345-0@lo:104: 00010000:00010000:3.0:1787508613.092676:0:229363:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ed800/0xb126349c40f3266d lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f32674 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.092734:0:229363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787508613.092739:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:202226:x1874324480070272:12345-0@lo:104: Request processed in 80us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.092745:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18112 00010000:00010000:1.0:1787508613.093969:0:202214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787508613.093979:0:202214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ed800/0xb126349c40f3266d lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f32674 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.093989:0:202214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ed800 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:1.0:1787508613.093995:0:202214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ed800/0xb126349c40f3266d lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f32674 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508613.094004:0:202214:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ed800/0xb126349c40f3266d lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f32674 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.094050:0:202214:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ed800/0xb126349c40f3266d lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f32674 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.094057:0:202214:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787508613.094086:0:202214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ed800/0xb126349c40f3266d lrc: 1/0,0 mode: --/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f32674 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.094094:0:202214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ed800/0xb126349c40f3266d lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f32674 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.094112:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508613.094114:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508613.094115:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508613.094218:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787508613.094235:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9acfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480070400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787508613.094282:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.095816:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480070400 00000100:00100000:1.0:1787508613.095828:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480070400 00010000:00010000:1.0:1787508613.095863:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f32674 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f3266d expref: 11 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.095900:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27768 00000100:00100000:1.0:1787508613.095908:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+11:3618:x1874324480070400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508613.095921:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787508613.097751:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.097825:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509456128 00000100:00100000:1.0:1787508613.097833:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509456128 00000100:00100000:1.0:1787508613.097891:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93546 00000100:00100000:1.0:1787508613.097901:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:336013:x1874324509456128:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508613.097921:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.097967:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32793 lrc: 2/0,0 mode: --/CR res: [0x2000013a0:0x16d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadaa8 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.098097:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f3279a lrc: 3/1,0 mode: --/PR res: [0x2000013a0:0x16d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.098113:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f3279a lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.098129:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f3279a lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508613.098176:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a0:0x16d:0x0]: returning size 4096 00000004:00200000:1.0:1787508613.098181:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787508613.098218:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32793 lrc: 0/0,0 mode: --/CR res: [0x2000013a0:0x16d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadaa8 expref: 587 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.098236:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f3279a lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadaa8 expref: 586 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.098244:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16d:0x0].0x0 (ffff9090cc088000) 00010000:00010000:1.0:1787508613.098247:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508613.098252:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a800, rc 0) 00000100:00100000:1.0:1787508613.098312:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336013:x1874324509456128:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 412us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.098319:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93546 00000020:00080000:0.0:1787508613.100968:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998366 00010000:00010000:1.0:1787508613.101047:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7800/0xb126349c40f32284 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101060:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7800/0xb126349c40f32284 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101067:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7800/0xb126349c40f32284 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101073:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.101079:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7800/0xb126349c40f32284 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101086:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7800/0xb126349c40f32284 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101102:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13cf:0x0].0x0 (ffff9090c6987900) 00010000:00010000:1.0:1787508613.101106:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.101111:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7800/0xb126349c40f32284 lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101117:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7800/0xb126349c40f32284 lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101131:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f3228b lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x28e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101136:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f3228b lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x28e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101142:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f3228b lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x28e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101147:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.101149:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f3228b lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x28e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101154:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f3228b lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x28e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101159:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28e:0x0].0x0 (ffff9090c6987700) 00010000:00010000:1.0:1787508613.101161:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.101164:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f3228b lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x28e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101169:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f3228b lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x28e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101181:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ede00/0xb126349c40f323e2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101186:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ede00/0xb126349c40f323e2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101192:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ede00/0xb126349c40f323e2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101198:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ede00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.101200:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ede00/0xb126349c40f323e2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101207:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ede00/0xb126349c40f323e2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101213:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13cf:0x0].0x0 (ffff9090c6987900) 00010000:00010000:1.0:1787508613.101293:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508613.101297:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ede00/0xb126349c40f323e2 lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101302:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ede00/0xb126349c40f323e2 lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x13cf:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101321:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f323f7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101327:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f323f7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101333:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f323f7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101338:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.101340:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f323f7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101346:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f323f7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101354:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28e:0x0].0x0 (ffff9090c6987700) 00010000:00010000:1.0:1787508613.101357:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508613.101360:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f323f7 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101366:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f323f7 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x28e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787508613.101708:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294998369 committed batchid 4294998366 00000020:00080000:0.0:1787508613.101775:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998366 00010000:00010000:1.0:1787508613.101911:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f32674 lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f3266d expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101924:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x165:0x0].0x0 (ffff9090d36fda00) 00010000:00010000:1.0:1787508613.101928:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f3278c lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.101937:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f3278c lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.102036:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f3278c lrc: 4/1,0 mode: PR/PR res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.102101:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508613.102183:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480070400:12345-0@lo:103:ldlm_bl.0 Request processed in 6274us (7898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.102194:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27768 00000100:00100000:3.0:1787508613.103758:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9acfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480070400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787508613.108436:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.108549:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509456256 00000100:00100000:1.0:1787508613.108561:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509456256 00000100:00100000:1.0:1787508613.108632:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93547 00000100:00100000:1.0:1787508613.108644:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:336013:x1874324509456256:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508613.108671:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.108693:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f327a1 lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x165:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadaaf expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.108758:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a000/0xb126349c40f327a8 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x165:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.108772:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a000/0xb126349c40f327a8 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.108784:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a000/0xb126349c40f327a8 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508613.108833:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd2:0x165:0x0]: returning size 4096 00000004:00200000:1.0:1787508613.108838:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787508613.108880:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f327a1 lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x165:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadaaf expref: 642 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.108901:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a000/0xb126349c40f327a8 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadaaf expref: 641 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.108917:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x165:0x0].0x0 (ffff9090d36fda00) 00010000:00010000:1.0:1787508613.108920:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508613.108924:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a000, rc 0) 00000100:00100000:1.0:1787508613.109037:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+641:336013:x1874324509456256:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 395us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.109045:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93547 00000100:00100000:1.0:1787508613.113123:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.116183:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.117850:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509456768 00000100:00100000:0.0:1787508613.117855:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509456768 00000100:00100000:0.0:1787508613.117903:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93548 00000100:00100000:0.0:1787508613.117914:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336013:x1874324509456512:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:0.0:1787508613.117992:0:202228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508613.118021:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3277e lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1257:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada9a expref: 586 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.118042:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1257:0x0].0x0 (ffff9090cc088200) 00010000:00010000:0.0:1787508613.118047:0:202228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508613.118072:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f327af lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1257:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.118085:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3273f lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x1257:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada85 expref: 13 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.118094:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f327af lrc: 4/0,1 mode: --/PW res: [0x2000013a4:0x1257:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.118127:0:202228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3273f lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1257:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada85 expref: 13 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.118141:0:202228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3273f lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1257:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada85 expref: 13 pid: 202226 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.118155:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480070528:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508613.118252:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.119490:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93549 00000100:00100000:3.0:1787508613.119656:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336012:x1874324509456768:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508613.119683:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.119705:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f327b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadab6 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508613.119850:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1257:0x0]: returning size 4096 00010000:00010000:3.0:1787508613.119983:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f327b6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadab6 expref: 15 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.119995:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.119998:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508613.120003:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f327b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadab6 expref: 15 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.120017:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d22edc00, rc 0) 00000100:00100000:3.0:1787508613.120075:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336012:x1874324509456768:12345-192.168.201.30@tcp:101:rm.0 Request processed in 573us (3903us total) trans 12884944037 rc 301/301 00000100:00100000:3.0:1787508613.120082:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93549 00000100:00100000:0.0:1787508613.126245:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480070528:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508613.126281:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f327af lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1257:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.129128:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.129176:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.129253:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509456896 00000100:00100000:0.0:1787508613.129264:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509456896 00010000:00010000:0.0:1787508613.129310:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3273f lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1257:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada85 expref: 14 pid: 202226 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.129353:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27769 00000100:00100000:0.0:1787508613.129364:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0877b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2401:x1874324509456896:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508613.129395:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508613.129403:0:225839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3273f lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1257:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada85 expref: 14 pid: 202226 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.129423:0:225839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3273f lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1257:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada85 expref: 14 pid: 202226 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.129444:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3273f lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1257:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada85 expref: 14 pid: 202226 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.129459:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1257:0x0].0x0 (ffff9090cc088200) 00010000:00010000:0.0:1787508613.129465:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f327af lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1257:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.129486:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f327af lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1257:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.129495:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f327af lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x1257:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.129532:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508613.129548:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f327af lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1257:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.129556:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f327af lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1257:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.129588:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f327c4 lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x16d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.129599:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0877b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2401:x1874324509456896:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 237us (481us total) trans 0 rc 0/0 00010000:00010000:3.0:1787508613.129600:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3274d lrc: 2/0,0 mode: PR/PR res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada8c expref: 13 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.129606:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27769 00010000:00010000:3.0:1787508613.129608:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f3279a lrc: 2/0,0 mode: PR/PR res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadaa8 expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.129615:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f327c4 lrc: 5/0,1 mode: --/PW res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.129649:0:202228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f3279a lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadaa8 expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.129663:0:202228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f3279a lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadaa8 expref: 585 pid: 202227 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.129681:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1514000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480070656:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508613.129746:0:202228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3274d lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada8c expref: 12 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.129755:0:202228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3274d lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada8c expref: 12 pid: 202227 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.129764:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1515500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480070784:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508613.129786:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787508613.140541:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1514000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480070656:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508613.141550:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1515500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480070784:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508613.141585:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f327c4 lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.141719:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.142155:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509457152 00000100:00100000:1.0:1787508613.142164:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509457152 00010000:00010000:1.0:1787508613.142206:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f3279a lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadaa8 expref: 586 pid: 202227 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.142244:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27770 00000100:00100000:1.0:1787508613.142254:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1515c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:2400:x1874324509457152:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508613.142271:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508613.142278:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f3279a lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadaa8 expref: 586 pid: 202227 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.142291:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f3279a lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadaa8 expref: 586 pid: 202227 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.142313:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f3279a lrc: 0/0,0 mode: --/PR res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadaa8 expref: 586 pid: 202227 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.142335:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16d:0x0].0x0 (ffff9090cc088000) 00010000:00010000:1.0:1787508613.142340:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f327c4 lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.142349:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f327c4 lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.142355:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508613.142417:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1515c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:2400:x1874324509457152:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 164us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.142425:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27770 00000100:00100000:1.0:1787508613.146406:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.146452:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.146556:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509457280 00000100:00100000:0.0:1787508613.146565:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509457280 00000100:00100000:0.0:1787508613.146632:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15387 00000100:00100000:0.0:1787508613.146642:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336012:x1874324509457280:12345-192.168.201.30@tcp:37:rm.0 00010000:00010000:0.0:1787508613.148181:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f327c4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.148192:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f327c4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.148254:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f327cb lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.148263:0:202228:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f327cb lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x0 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.148273:0:202228:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f327cb lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.148293:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:202228:1874324480070912:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1787508613.148344:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.148382:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.154790:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.155098:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509457536 00000100:00100000:3.0:1787508613.155104:0:202228:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589961973 gen 2 00000100:00100000:1.0:1787508613.155105:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509457536 00000004:00080000:3.0:1787508613.155110:0:202228:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961964 committed transno 8589961973 00000020:00080000:3.0:1787508613.155115:0:202228:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9090d9e8dc00 refcount 2 committed 0 result 0 batchid 8589961975 00000020:00080000:3.0:1787508613.155119:0:202228:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9091f29b1900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d9e8d180 00000020:00080000:3.0:1787508613.155122:0:202228:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd2:0x1:0x0].1776 00000020:00080000:3.0:1787508613.155124:0:202228:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9091f29b1c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090d7420c00 00000020:00080000:3.0:1787508613.155127:0:202228:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1:0x0].1770 00010000:00010000:1.0:1787508613.155136:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a000/0xb126349c40f327a8 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadaaf expref: 641 pid: 203348 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787508613.155161:0:202228:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961965 committed transno 8589961973 00000100:00100000:1.0:1787508613.155164:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27772 00000100:00100000:1.0:1787508613.155172:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1515880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+641:2400:x1874324509457536:12345-192.168.201.30@tcp:103:ldlm_bl.0 00000004:00080000:3.0:1787508613.155174:0:202228:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961967 committed transno 8589961973 00000004:00080000:3.0:1787508613.155188:0:202228:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961968 committed transno 8589961973 00010000:00010000:1.0:1787508613.155188:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508613.155194:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a000/0xb126349c40f327a8 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadaaf expref: 641 pid: 203348 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787508613.155197:0:202228:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961973 committed transno 8589961973 00010000:00010000:1.0:1787508613.155206:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a000/0xb126349c40f327a8 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadaaf expref: 641 pid: 203348 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.155216:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:202228:1874324480070912:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1787508613.155231:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f327cb lrc: 4/0,1 mode: --/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f327d2 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.155239:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a000/0xb126349c40f327a8 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadaaf expref: 641 pid: 203348 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.155242:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f327cb lrc: 4/0,1 mode: --/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f327d2 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.155253:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x165:0x0].0x0 (ffff9090d36fda00) 00010000:00010000:1.0:1787508613.155257:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f327d2 lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f327cb expref: 5 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.155266:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f327d2 lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f327cb expref: 5 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.155272:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508613.155326:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1515880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2400:x1874324509457536:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 155us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.155333:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27772 00000100:00100000:0.0:1787508613.156295:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336012:x1874324509457280:12345-192.168.201.30@tcp:37:rm.0 Request processed in 9650us (9903us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.156304:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15387 00000100:00100000:3.0:1787508613.161990:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.162088:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509457792 00000100:00100000:1.0:1787508613.162100:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509457792 00000100:00100000:1.0:1787508613.162164:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15388 00000100:00100000:1.0:1787508613.162175:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336012:x1874324509457792:12345-192.168.201.30@tcp:35:rm.0 00000100:00100000:1.0:1787508613.162441:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336012:x1874324509457792:12345-192.168.201.30@tcp:35:rm.0 Request processed in 267us (513us total) trans 12884944038 rc 0/0 00000100:00100000:1.0:1787508613.162449:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15388 00000100:00100000:3.0:1787508613.169263:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.171352:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.171409:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509458048 00000100:00100000:1.0:1787508613.171421:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509458048 00010000:00010000:1.0:1787508613.171484:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f3278c lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadaa1 expref: 6 pid: 202226 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.171541:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27773 00000100:00100000:1.0:1787508613.171551:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1514000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509458048:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508613.171566:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508613.171573:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f3278c lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadaa1 expref: 6 pid: 202226 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.171588:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f3278c lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadaa1 expref: 6 pid: 202226 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.171608:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f3278c lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadaa1 expref: 6 pid: 202226 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.171624:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x165:0x0].0x0 (ffff9090d36fda00) 00010000:00010000:1.0:1787508613.171631:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f327d2 lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f327cb expref: 5 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.171641:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f327d2 lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f327cb expref: 5 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.171649:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f327d2 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f327cb expref: 5 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.171678:0:205406:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f327d2 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f327cb expref: 5 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.171692:0:205406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:205406:1874324480071296:0@lo:105: 00000100:00100000:1.0:1787508613.171739:0:205406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.171790:0:205406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8000 going to sleep for 11 seconds 00000100:00100000:0.0:1787508613.171860:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480071296 00000100:00100000:0.0:1787508613.171866:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480071296 00000100:00100000:0.0:1787508613.171900:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18113 00000100:00100000:0.0:1787508613.171908:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:205406:x1874324480071296:12345-0@lo:105: 00010000:00010000:0.0:1787508613.171919:0:202210:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f327cb lrc: 5/0,1 mode: --/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f327d2 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.171932:0:202210:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f327cb lrc: 5/0,1 mode: --/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f327d2 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.171973:0:202210:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f327cb lrc: 5/0,1 mode: --/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f327d2 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.171981:0:202210:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f327cb lrc: 5/0,1 mode: PW/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f327d2 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.171987:0:202210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f327cb lrc: 6/0,1 mode: PW/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f327d2 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.171994:0:202210:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f327cb lrc: 6/0,1 mode: PW/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f327d2 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.172019:0:202210:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d56f7600) 00000100:00100000:0.0:1787508613.172124:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:205406:x1874324480071296:12345-0@lo:105: Request processed in 217us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.172132:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18113 00010000:00010000:1.0:1787508613.172147:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f327cb lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f327d2 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.172157:0:202228:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f327cb lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f327d2 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787508613.172396:0:202228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1:0x0].1772, 344 off1823808 00000040:00080000:1.0:1787508613.172463:0:202228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x1:0x0].1778, 552 off2028448 00000004:00080000:1.0:1787508613.172480:0:202228:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d22c8600 with version 3439 00000004:00080000:0.0:1787508613.173167:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3439 rpc_version 3439 00000020:00100000:0.0:1787508613.173206:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787508613.173217:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091d4854000 x1874324480071552/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1528/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787508613.173242:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d4854000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480071552:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787508613.173298:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.173339:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.173414:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480071552 00000100:00100000:3.0:1787508613.173421:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480071552 00000100:00100000:3.0:1787508613.173479:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29581 00000100:00100000:3.0:1787508613.173489:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4855500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:202248:x1874324480071552:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787508613.173696:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4855500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:202248:x1874324480071552:12345-0@lo:1000:osp_up1-0.0 Request processed in 208us (397us total) trans 8589961974 rc 0/0 00000100:00100000:3.0:1787508613.173704:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29581 00000100:00100000:3.0:1787508613.173764:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d4854000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480071552:0@lo:1000:osp_up1-0.0 00000004:00010000:1.0:1787508613.174163:0:202228:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e9faa3f reply state 00000000a0661e33 transno 12884944039 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f327c4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.174183:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f327c4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.174192:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16d:0x0].0x0 (ffff9090cc088000) 00010000:00010000:1.0:1787508613.174194:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787508613.174198:0:202228:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787508613.174205:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f327cb lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f327d2 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.174214:0:202228:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f327cb lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f327d2 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787508613.174225:0:202228:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd2:0x165:0x0] 00000004:00010000:1.0:1787508613.174234:0:202228:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e9faa3f reply state 00000000a0661e33 transno 12884944039 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f327af lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1257:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.174246:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f327af lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1257:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.174251:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1257:0x0].0x0 (ffff9090cc088200) 00010000:00010000:1.0:1787508613.174254:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508613.174257:0:202228:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f327ee lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1257:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.174265:0:202228:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f327ee lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1257:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.174271:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f327ee lrc: 4/1,0 mode: PR/PR res: [0x2000013a4:0x1257:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.174289:0:202228:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1787508613.174298:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1257:0x0]: returning size 4096 00000100:00100000:1.0:1787508613.174366:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336013:x1874324509456512:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 56452us (61253us total) trans 12884944039 rc 0/0 00000100:00100000:1.0:1787508613.174374:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93548 00010000:00010000:3.0:1787508613.174607:0:202226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f327ee lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1257:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.174616:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f327ee lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1257:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508613.174695:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1257:0x0]: returning size 4096 00000004:00200000:3.0:1787508613.174700:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1787508613.174716:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f327ee lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1257:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.174729:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f327e0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.174740:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f327e0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.174747:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f327e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.174754:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f327e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.174761:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.174765:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f327e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.174773:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f327e0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.174785:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.174788:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.174791:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f327e0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.174797:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f327e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.174815:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f327e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.174821:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f327e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.174826:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f327e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.174832:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.174834:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f327e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.174839:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f327e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.174846:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090cc088a00) 00010000:00010000:3.0:1787508613.174849:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.174851:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f327e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.174856:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f327e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.174881:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f327d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadabd expref: 15 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.174894:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f327ee lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1257:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadabd expref: 14 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.174900:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1257:0x0].0x0 (ffff9090cc088200) 00010000:00010000:3.0:1787508613.174903:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508613.174905:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa600, rc 0) 00000100:00100000:3.0:1787508613.174931:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336012:x1874324509457920:12345-192.168.201.30@tcp:101:rm.0 Request processed in 5467us (5678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.174967:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93550 00000100:00100000:3.0:1787508613.188789:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.195766:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.197415:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.197551:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d5738700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480071680:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508613.197579:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f327f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.197697:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509458688 00000100:00100000:1.0:1787508613.197705:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509458688 00010000:00010000:1.0:1787508613.197738:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f326cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada62 expref: 586 pid: 205405 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.197778:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27774 00000100:00100000:1.0:1787508613.197788:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c1ac3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:2403:x1874324509458688:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508613.197803:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508613.197810:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f326cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada62 expref: 586 pid: 205405 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.197823:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f326cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada62 expref: 586 pid: 205405 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.197843:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f326cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaada62 expref: 586 pid: 205405 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.197859:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.197864:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f327f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.197873:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f327f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.197880:0:202212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f327f5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.197909:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508613.197988:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c1ac3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:2403:x1874324509458688:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 201us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.197995:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27774 00010000:00010000:3.0:1787508613.198398:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f327f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.198407:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f327f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.198431:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f327fc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.198442:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f327fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.198449:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f327fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.198740:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec200/0xb126349c40f32803 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x1257:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.198750:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec200/0xb126349c40f32803 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1257:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.198758:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec200/0xb126349c40f32803 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1257:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.198777:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f3280a lrc: 3/0,1 mode: --/EX res: [0x2000013a0:0x16d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.198785:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f3280a lrc: 3/0,1 mode: EX/EX res: [0x2000013a0:0x16d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.198792:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f3280a lrc: 3/0,1 mode: EX/EX res: [0x2000013a0:0x16d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.198826:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec600/0xb126349c40f32811 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.198834:0:209004:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec600/0xb126349c40f32811 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x0 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.198843:0:209004:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec600/0xb126349c40f32811 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.198863:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6ac7480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:209004:1874324480071808:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1787508613.198907:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.198977:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88480 going to sleep for 11 seconds 00000100:00100000:0.0:1787508613.199696:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480071808 00000100:00100000:0.0:1787508613.199704:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480071808 00000100:00100000:0.0:1787508613.199755:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29582 00000100:00100000:0.0:1787508613.199764:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:209004:x1874324480071808:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1787508613.199785:0:225829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508613.199803:0:225829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f32818 lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f32811 expref: -99 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.199825:0:225829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f327d2 lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f327cb expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.199835:0:225829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f32818 lrc: 4/0,0 mode: --/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f32811 expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.199858:0:225829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f327d2 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f327cb expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.199870:0:225829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d4855f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:225829:1874324480071936:0@lo:104: 00000100:00100000:0.0:1787508613.199909:0:225829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.199970:0:225829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9540 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.200320:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480071936 00000100:00100000:3.0:1787508613.200325:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480071936 00000100:00100000:3.0:1787508613.200365:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18114 00000100:00100000:3.0:1787508613.200373:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4857100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:225829:x1874324480071936:12345-0@lo:104: 00010000:00010000:3.0:1787508613.200385:0:229363:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f327cb lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f327d2 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.200441:0:229363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787508613.200447:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4857100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:225829:x1874324480071936:12345-0@lo:104: Request processed in 76us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.200454:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18114 00000100:00100000:0.0:1787508613.200778:0:225829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d4855f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:225829:1874324480071936:0@lo:104: 00010000:00010000:0.0:1787508613.200805:0:225829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f32818 lrc: 3/0,0 mode: --/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32811 expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.200820:0:225829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x165:0x0].0x0 (ffff9090d36fda00) 00010000:00010000:0.0:1787508613.200823:0:225829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787508613.200827:0:225829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f32818 lrc: 3/0,0 mode: --/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32811 expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.200837:0:225829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f32818 lrc: 3/0,0 mode: --/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32811 expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.200845:0:225829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6000, rc 0) 00000100:00100000:0.0:1787508613.200877:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:209004:x1874324480071808:12345-0@lo:101:mdt00_005.0 Request processed in 1114us (1970us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.200884:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29582 00000100:00100000:0.0:1787508613.201589:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d5739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480072064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508613.201627:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.201672:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480072064 00000100:00100000:0.0:1787508613.201676:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480072064 00010000:00010000:0.0:1787508613.201692:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f327d2 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f327cb expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.201714:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27775 00000100:00100000:0.0:1787508613.201720:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4855f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+8:3616:x1874324480072064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508613.201729:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787508613.202620:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6ac7480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:209004:1874324480071808:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1787508613.202636:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec600/0xb126349c40f32811 lrc: 4/0,1 mode: --/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32818 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.202645:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec600/0xb126349c40f32811 lrc: 4/0,1 mode: --/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32818 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787508613.205365:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589961974 is committed 00000020:00080000:0.0:1787508613.205474:0:202955:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 4294998369 batchid updated 00000004:00080000:0.0:1787508613.209495:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13583 rpc_version 13583 00000020:00100000:0.0:1787508613.209541:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787508613.209553:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091d4857800 x1874324480072320/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787508613.209578:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d4857800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480072320:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787508613.209649:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.209690:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9540 going to sleep for 11 seconds 00010000:00010000:1.0:1787508613.209730:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f327d2 lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x165:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f327cb expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.209748:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x165:0x0].0x0 (ffff9090d36fda00) 00010000:00010000:1.0:1787508613.209754:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f32818 lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32811 expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.209764:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f32818 lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f32811 expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.209773:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f32818 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f32811 expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.209800:0:202211:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f32818 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32811 expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.209811:0:202211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:202211:1874324480072448:0@lo:105: 00000100:00100000:1.0:1787508613.209841:0:202211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.209878:0:202211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9e8d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787508613.209978:0:202210:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787508613.209990:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480072448 00000100:00100000:0.0:1787508613.209996:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480072448 00000100:00100000:0.0:1787508613.210043:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18115 00000100:00100000:0.0:1787508613.210053:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9a79450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:202211:x1874324480072448:12345-0@lo:105: 00010000:00010000:0.0:1787508613.210064:0:202210:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec600/0xb126349c40f32811 lrc: 5/0,1 mode: --/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32818 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.210073:0:202210:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec600/0xb126349c40f32811 lrc: 5/0,1 mode: --/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32818 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.210082:0:202210:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec600/0xb126349c40f32811 lrc: 5/0,1 mode: --/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32818 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.210090:0:202210:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec600/0xb126349c40f32811 lrc: 5/0,1 mode: EX/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f32818 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.210097:0:202210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec600/0xb126349c40f32811 lrc: 6/0,1 mode: EX/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f32818 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.210104:0:202210:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec600/0xb126349c40f32811 lrc: 6/0,1 mode: EX/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f32818 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.210180:0:202210:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d22ec600) 00000100:00100000:0.0:1787508613.210238:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9a79450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:202211:x1874324480072448:12345-0@lo:105: Request processed in 186us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.210245:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18115 00000100:00100000:0.0:1787508613.210723:0:202961:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944035 gen 2 00000004:00080000:0.0:1787508613.210729:0:202961:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944035 committed transno 12884944035 00000020:00080000:0.0:1787508613.210734:0:202961:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9090d9106840 refcount 2 committed 0 result 0 batchid 4294998370 00000020:00080000:0.0:1787508613.210738:0:202961:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9091d47d0200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d9106e40 00000020:00080000:0.0:1787508613.210741:0:202961:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a2:0x5:0x0].578 00000020:00080000:0.0:1787508613.210743:0:202961:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9091d47d0b00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090e3c8e600 00000020:00080000:0.0:1787508613.210746:0:202961:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd1:0xf:0x0].35 00000100:00100000:0.0:1787508613.210795:0:202961:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9091d4857800 x1874324480072320/t12884944040(12884944040) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1787508629 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787508613.210812:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d4857800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480072320:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1787508613.210821:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13584 rpc_version 13584 00000020:00100000:0.0:1787508613.210836:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787508613.210841:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091d4857100 x1874324480072704/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787508613.210855:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d4857100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480072704:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787508613.210885:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.210906:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9540 going to sleep for 11 seconds 00010000:00010000:1.0:1787508613.213310:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec600/0xb126349c40f32811 lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32818 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.213323:0:209004:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec600/0xb126349c40f32811 lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32818 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.213371:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480072704 00000100:00100000:0.0:1787508613.213393:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d5739f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480072064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508613.213659:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480072704 00000100:00100000:1.0:1787508613.213714:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29584 00000100:00100000:1.0:1787508613.213723:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:202961:x1874324480072704:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508613.215891:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:202961:x1874324480072704:12345-0@lo:1000:osp_up0-1.0 Request processed in 2161us (4998us total) trans 12884944041 rc 0/0 00000100:00100000:1.0:1787508613.215906:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29584 00000100:00100000:0.0:1787508613.216053:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d4857100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480072704:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1787508613.216067:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13585 rpc_version 13585 00000020:00100000:0.0:1787508613.216091:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787508613.216097:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091d4856680 x1874324480072960/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787508613.216116:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d4856680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480072960:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787508613.216153:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.216179:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9540 going to sleep for 11 seconds 00000100:00100000:0.0:1787508613.216885:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d4857b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:209004:1874324480073088:0@lo:403:mdt00_005.0 00000100:00100000:0.0:1787508613.216919:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.219248:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787508613.226867:0:209004:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589961974 gen 2 00000004:00080000:1.0:1787508613.226879:0:209004:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961974 committed transno 8589961974 00000100:00100000:1.0:1787508613.226911:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d4857b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:209004:1874324480073088:0@lo:403:mdt00_005.0 00000040:00080000:1.0:1787508613.227918:0:209004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1:0x0].1773, 664 off1824472 00000040:00080000:1.0:1787508613.228121:0:209004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x1:0x0].1779, 744 off2029192 00000004:00080000:1.0:1787508613.228127:0:209004:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d9e8df00 with version 3440 00000004:00080000:3.0:1787508613.228442:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3440 rpc_version 3440 00000020:00100000:3.0:1787508613.228489:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787508613.228499:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091ed437480 x1874324480073344/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1448/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787508613.228523:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed437480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480073344:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787508613.228590:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.228620:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88480 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.228639:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480073344 00000100:00100000:3.0:1787508613.228646:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480073344 00000100:00100000:3.0:1787508613.228693:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29587 00000100:00100000:3.0:1787508613.228702:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:202248:x1874324480073344:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787508613.228901:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:202248:x1874324480073344:12345-0@lo:1000:osp_up1-0.0 Request processed in 198us (309us total) trans 8589961975 rc 0/0 00000100:00100000:3.0:1787508613.228909:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29587 00000100:00100000:3.0:1787508613.228995:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed437480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480073344:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787508613.229368:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509458816 00000100:00100000:3.0:1787508613.229429:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509458816 00000100:00100000:3.0:1787508613.229659:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93553 00000100:00100000:3.0:1787508613.229669:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d5739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:336014:x1874324509458816:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508613.229682:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.229704:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ece00/0xb126349c40f32834 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadacb expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508613.229757:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1257:0x0]: returning size 4096 00010000:00010000:3.0:1787508613.229767:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f3283b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.229776:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f3280a lrc: 3/0,1 mode: EX/EX res: [0x2000013a0:0x16d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.229780:0:203348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f327f5 lrc: 2/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.229784:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f3280a lrc: 2/0,0 mode: EX/EX res: [0x2000013a0:0x16d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.229787:0:203348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f3283b lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.229790:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f3280a lrc: 3/0,0 mode: EX/EX res: [0x2000013a0:0x16d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.229795:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22edc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.229799:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f3280a lrc: 3/0,0 mode: EX/EX res: [0x2000013a0:0x16d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.229801:0:203348:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f327f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.229807:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f3280a lrc: 4/0,0 mode: EX/EX res: [0x2000013a0:0x16d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.229809:0:203348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f3283b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.229821:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16d:0x0].0x0 (ffff9090cc088000) 00010000:00010000:1.0:1787508613.229824:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787508613.229828:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f3280a lrc: 2/0,0 mode: --/EX res: [0x2000013a0:0x16d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.229834:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22edc00/0xb126349c40f3280a lrc: 0/0,0 mode: --/EX res: [0x2000013a0:0x16d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.229849:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec600/0xb126349c40f32811 lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32818 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.229858:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec600/0xb126349c40f32811 lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f32818 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.229868:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec600/0xb126349c40f32811 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f32818 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.229894:0:209004:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787508613.229903:0:209004:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd2:0x165:0x0] 00010000:00010000:1.0:1787508613.229910:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec200/0xb126349c40f32803 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1257:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.229915:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec200/0xb126349c40f32803 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x1257:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.229920:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec200/0xb126349c40f32803 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1257:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.229924:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ec200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.229927:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec200/0xb126349c40f32803 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1257:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.229933:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec200/0xb126349c40f32803 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x1257:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.229969:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1257:0x0].0x0 (ffff9090cc088200) 00010000:00010000:1.0:1787508613.229972:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787508613.229975:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec200/0xb126349c40f32803 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x1257:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.229981:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec200/0xb126349c40f32803 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x1257:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.229995:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f327f5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.230001:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f327f5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.230006:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f327f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.230012:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f327f5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.230017:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.230019:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f327f5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.230025:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f327f5 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.230033:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.230035:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.230038:0:209004:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f3283b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.230045:0:209004:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f3283b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.230051:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f3283b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.230070:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f327f5 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.230076:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f327f5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508613.230088:0:209004:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c12f7fa reply state 00000000beace725 transno 12884944043 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f327fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.230097:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed200/0xb126349c40f327fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.230103:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090cc088a00) 00010000:00010000:1.0:1787508613.230105:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787508613.230108:0:209004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787508613.230172:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336012:x1874324509458304:12345-192.168.201.30@tcp:36:rm.0 Request processed in 41050us (41393us total) trans 12884944043 rc 0/0 00000100:00100000:1.0:1787508613.230180:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93551 00010000:00010000:0.0:1787508613.230254:0:203348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f3283b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.230262:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f3283b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508613.230302:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787508613.230305:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508613.230321:0:203348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f3283b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.230343:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ece00/0xb126349c40f32834 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadacb expref: 587 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.230357:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f3283b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadacb expref: 586 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.230364:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.230367:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508613.230370:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d22ed400, rc 0) 00000100:00100000:0.0:1787508613.230787:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d5739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336014:x1874324509458816:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1110us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.230794:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93553 00010000:00010000:3.0:1787508613.230993:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787508613.231001:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec600/0xb126349c40f32811 lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xb126349c40f32818 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.231008:0:204785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ec600 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:3.0:1787508613.231013:0:204785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec600/0xb126349c40f32811 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xb126349c40f32818 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508613.231022:0:204785:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec600/0xb126349c40f32811 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xb126349c40f32818 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.231974:0:204785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec600/0xb126349c40f32811 lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f32818 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.231981:0:204785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787508613.232018:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec600/0xb126349c40f32811 lrc: 1/0,0 mode: --/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f32818 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.232043:0:204785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d22ec600/0xb126349c40f32811 lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f32818 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.232066:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508613.232067:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508613.232069:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508613.232080:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787508613.232097:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480073472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787508613.232156:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.232202:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480073472 00000100:00100000:3.0:1787508613.232209:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480073472 00000100:00100000:3.0:1787508613.232254:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9769 00000100:00100000:3.0:1787508613.232262:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed435500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+7:3616:x1874324480073472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787508613.232274:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508613.232292:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f32818 lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x165:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f32811 expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.232306:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x165:0x0].0x0 (ffff9090d36fda00) 00010000:00010000:3.0:1787508613.232315:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508613.232344:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed435500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+6:3616:x1874324480073472:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.232351:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9769 00000100:00100000:3.0:1787508613.232404:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480073472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787508613.239901:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.240064:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.240090:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509458944 00000100:00100000:3.0:1787508613.240100:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509458944 00000100:00100000:3.0:1787508613.240143:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509459072 00000100:00100000:3.0:1787508613.240145:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509459072 00000100:00100000:3.0:1787508613.240167:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93554 00000100:00100000:3.0:1787508613.240177:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336015:x1874324509458944:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508613.240203:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.240806:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32842 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadad2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.240873:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f32849 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.240885:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f32849 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.240895:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f32849 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508613.240959:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508613.240963:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508613.240983:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f32849 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.240999:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93555 00010000:00010000:3.0:1787508613.241006:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec400/0xb126349c40f32842 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadad2 expref: 16 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.241011:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336014:x1874324509459072:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508613.241021:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.241030:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32850 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadad9 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.241040:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f32849 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadad2 expref: 15 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.241048:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.241052:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508613.241055:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d22ede00, rc 0) 00010000:00010000:1.0:1787508613.241060:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32857 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.241068:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32857 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.241075:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32857 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.241087:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3285e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.241093:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3285e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.241099:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3285e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.241107:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336015:x1874324509458944:12345-192.168.201.30@tcp:101:rm.0 Request processed in 931us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.241113:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93554 00010000:00010000:1.0:1787508613.241147:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32857 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.241154:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32857 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.241159:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32857 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.241165:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32857 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.241170:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.241174:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32857 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.241181:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32857 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.241190:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.241192:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.241195:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32857 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.241200:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32857 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.241211:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3285e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.241217:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3285e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.241223:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3285e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.241227:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.241230:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3285e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.241236:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3285e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.241242:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090cda8aa00) 00010000:00010000:1.0:1787508613.241244:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.241247:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3285e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.241253:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3285e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.241278:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32850 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadad9 expref: 587 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.241287:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.241289:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508613.241293:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32850 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadad9 expref: 587 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.241301:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a000, rc 0) 00000100:00100000:1.0:1787508613.241325:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336014:x1874324509459072:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 317us (1260us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508613.241331:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93555 00000100:00100000:1.0:1787508613.254836:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.254884:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.254970:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509459200 00000100:00100000:3.0:1787508613.254980:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509459200 00000100:00100000:3.0:1787508613.255046:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509459328 00000100:00100000:3.0:1787508613.255049:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509459328 00000100:00100000:3.0:1787508613.255075:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93556 00000100:00100000:3.0:1787508613.255084:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336014:x1874324509459200:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508613.255104:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.255125:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a3b400/0xb126349c40f32865 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadae0 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.255186:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f3286c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.255200:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f3286c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.255213:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f3286c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.255238:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f32873 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.255246:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f32873 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.255253:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f32873 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.255315:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f3286c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.255322:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f3286c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.255328:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f3286c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.255336:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f3286c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.255342:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d0ff0c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.255347:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f3286c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.255355:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f3286c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.255367:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.255370:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.255375:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f3286c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.255524:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93557 00000100:00100000:0.0:1787508613.255537:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336015:x1874324509459328:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508613.255548:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508613.255558:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3287a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadae7 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.255589:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32881 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.255598:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32881 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.255606:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32881 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.255618:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32888 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.255622:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f3286c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.255626:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32888 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.255632:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32888 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.255639:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f32873 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.255644:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f32873 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.255651:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f32873 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.255656:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d0ff1800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.255657:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32881 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.255660:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f32873 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.255664:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32881 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.255666:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f32873 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.255670:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32881 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.255674:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090ccb87100) 00010000:00010000:0.0:1787508613.255676:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32881 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.255677:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.255680:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f32873 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.255681:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.255684:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32881 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.255686:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f32873 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.255690:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32881 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.255696:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.255698:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.255700:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32881 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.255705:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32881 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.255712:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a3b400/0xb126349c40f32865 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadae0 expref: 587 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.255713:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32888 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.255719:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32888 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.255721:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.255723:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508613.255725:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32888 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.255727:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a3b400/0xb126349c40f32865 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadae0 expref: 587 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.255731:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.255734:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32888 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.255736:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c9a3b400, rc 0) 00010000:00010000:0.0:1787508613.255739:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32888 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.255744:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090e460f200) 00010000:00010000:0.0:1787508613.255746:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.255748:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32888 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.255753:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32888 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.255770:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3287a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadae7 expref: 16 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.255795:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.255797:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:3.0:1787508613.255800:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336014:x1874324509459200:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 717us (975us total) trans 0 rc 301/301 00010000:00010000:0.0:1787508613.255802:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3287a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadae7 expref: 16 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.255811:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6000, rc 0) 00000100:00100000:3.0:1787508613.255812:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93556 00000100:00100000:0.0:1787508613.255831:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336015:x1874324509459328:12345-192.168.201.30@tcp:101:rm.0 Request processed in 299us (947us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508613.255837:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93557 00000100:00100000:3.0:1787508613.274485:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.274532:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.274685:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509459456 00000100:00100000:0.0:1787508613.274696:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509459456 00000100:00100000:0.0:1787508613.274760:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93558 00000100:00100000:0.0:1787508613.274770:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336015:x1874324509459584:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508613.274792:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508613.274811:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3288f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadaf5 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.274875:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3289d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.274888:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3289d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.274899:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3289d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.274913:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f328ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.274921:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f328ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.274927:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f328ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.275013:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3289d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.283925:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.285559:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509459840 00000100:00100000:3.0:1787508613.285576:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509459840 00000100:00100000:3.0:1787508613.285684:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93560 00000100:00100000:3.0:1787508613.285695:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336014:x1874324509459840:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508613.285697:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3289d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.285707:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3289d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.285714:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3289d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.285716:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508613.285719:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.285724:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3289d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.285732:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3289d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.285734:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f328b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadafc expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.285750:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.285753:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.285756:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3289d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.285762:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3289d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.285801:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f328c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.285814:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f328c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.285824:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f328c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.285839:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a3b400/0xb126349c40f328c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.285846:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a3b400/0xb126349c40f328c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.285852:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a3b400/0xb126349c40f328c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.285906:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f328c0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.285914:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f328c0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.285920:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f328c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.285926:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f328c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.285932:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d0ff0c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.285935:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f328c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.285955:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f328c0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.285964:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.285966:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.285969:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f328c0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.285975:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f328c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.285985:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a3b400/0xb126349c40f328c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.285991:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a3b400/0xb126349c40f328c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.285998:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a3b400/0xb126349c40f328c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.286004:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c9a3b400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.286007:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a3b400/0xb126349c40f328c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.286014:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a3b400/0xb126349c40f328c7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.286020:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaf7dd568 (ffff9090ccb87100) 00010000:00010000:3.0:1787508613.286023:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.286099:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a3b400/0xb126349c40f328c7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.286107:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a3b400/0xb126349c40f328c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.286139:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f328b9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadafc expref: 587 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.286149:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.286151:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508613.286155:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f328b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadafc expref: 587 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.286163:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d0ff1800, rc 0) 00000100:00100000:3.0:1787508613.286296:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336014:x1874324509459840:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 602us (2381us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508613.286305:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93560 00010000:00010000:0.0:1787508613.286705:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f328ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.286714:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f328ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.286721:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f328ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.286726:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.286729:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f328ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.286739:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f328ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.286749:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090e460f200) 00010000:00010000:0.0:1787508613.286751:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.286755:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f328ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.286761:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f328ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.287314:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3288f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadaf5 expref: 16 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.287325:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.287328:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508613.287332:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3288f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadaf5 expref: 16 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.287342:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6000, rc 0) 00000100:00100000:0.0:1787508613.287383:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336015:x1874324509459584:12345-192.168.201.30@tcp:101:rm.0 Request processed in 12614us (12850us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508613.290761:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93558 00000100:00100000:1.0:1787508613.300960:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.301255:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.301349:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509460096 00000100:00100000:1.0:1787508613.301361:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509460096 00000100:00100000:1.0:1787508613.301417:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509460224 00000100:00100000:1.0:1787508613.301420:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509460224 00000100:00100000:1.0:1787508613.301445:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93561 00000100:00100000:1.0:1787508613.301456:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336014:x1874324509460096:12345-192.168.201.30@tcp:101:lfs.0 00000100:00100000:3.0:1787508613.301488:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93562 00010000:00010000:1.0:1787508613.301491:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1787508613.301501:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336015:x1874324509460224:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508613.301512:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.301517:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f328ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadb03 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.301526:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9cb3000/0xb126349c40f328d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadb0a expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.301592:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5473e00/0xb126349c40f328dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.301604:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f328e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.301607:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5473e00/0xb126349c40f328dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.301628:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5473e00/0xb126349c40f328dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.302111:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f328e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.302124:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f328e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.302143:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f328f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.302151:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f328f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.302158:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f328f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.302188:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f328e3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.302196:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f328e3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.302202:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f328e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.302211:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f328e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.302217:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.302222:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f328e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.302230:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f328e3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.302244:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.302248:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.302252:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f328e3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.302260:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f328e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.302273:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f328f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.302280:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f328f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.302286:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f328f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.302291:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.302294:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f328f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.302299:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f328f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.302306:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3e9f33b0 (ffff9090cda8aa00) 00010000:00010000:1.0:1787508613.302309:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.302312:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f328f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.302318:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f328f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.302351:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f328ce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb03 expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.302366:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.302368:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508613.302372:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f328ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb03 expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.302381:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a800, rc 0) 00000100:00100000:1.0:1787508613.302454:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336014:x1874324509460096:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 998us (1520us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508613.302462:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93561 00000100:00100000:0.0:1787508613.306114:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d4856a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480073600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787508613.306183:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.306348:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480073728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787508613.306359:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480073600 00000100:00100000:1.0:1787508613.306368:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480073600 00000100:00100000:3.0:1787508613.306394:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.312981:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480073728 00000100:00100000:1.0:1787508613.312996:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480073728 00000100:00100000:1.0:1787508613.313188:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29588 00000100:00100000:1.0:1787508613.313203:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3618:x1874324480073600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787508613.313248:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1441812480 avail 1295572992 00000100:00100000:1.0:1787508613.313337:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:3618:x1874324480073600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (7153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.313344:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29588 00000100:00100000:1.0:1787508613.313363:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29589 00000100:00100000:1.0:1787508613.313369:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1874324480073728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787508613.313388:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1442828288 avail 1296588800 00000100:00100000:1.0:1787508613.313423:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1874324480073728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (7043us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.313428:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29589 00000100:00100000:0.0:1787508613.313982:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d4856a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480073600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787508613.314628:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.316212:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.316508:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509460736 00000100:00100000:1.0:1787508613.316516:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509460736 00000100:00100000:1.0:1787508613.316621:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93564 00000100:00100000:1.0:1787508613.316631:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4857b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336015:x1874324509460736:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508613.316646:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.316660:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3290d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadb18 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.316714:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32914 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.316727:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32914 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.316737:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32914 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.316750:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3291b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.316756:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3291b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.316761:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3291b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.316925:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32914 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.316933:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32914 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.316988:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32914 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.316994:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32914 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.317000:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.317005:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32914 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.317011:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32914 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.317024:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.317026:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.317030:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32914 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.317035:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32914 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.317045:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3291b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.317051:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3291b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.317613:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3291b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.317623:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.317627:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3291b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.317633:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3291b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.317643:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090cda8af00) 00010000:00010000:1.0:1787508613.317646:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.317649:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3291b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.317655:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3291b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.317691:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3290d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb18 expref: 16 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.317701:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.317703:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508613.317707:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3290d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb18 expref: 16 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.317716:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b200, rc 0) 00000100:00100000:1.0:1787508613.317768:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4857b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336015:x1874324509460736:12345-192.168.201.30@tcp:101:rm.0 Request processed in 1138us (1558us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508613.317776:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93564 00000100:00100000:0.0:1787508613.326159:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.326210:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.326307:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509460992 00000100:00100000:3.0:1787508613.326319:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509460992 00000100:00100000:3.0:1787508613.326392:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509461120 00000100:00100000:3.0:1787508613.326396:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509461120 00000100:00100000:3.0:1787508613.326430:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93565 00000100:00100000:3.0:1787508613.326440:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336014:x1874324509460992:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508613.326462:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.326493:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5472400/0xb126349c40f32922 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadb1f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.326586:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5473e00/0xb126349c40f32929 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.326605:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5473e00/0xb126349c40f32929 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.326616:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5473e00/0xb126349c40f32929 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.326631:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a3b400/0xb126349c40f32930 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.326638:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a3b400/0xb126349c40f32930 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.326644:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a3b400/0xb126349c40f32930 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.326701:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5473e00/0xb126349c40f32929 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.326707:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5473e00/0xb126349c40f32929 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.326714:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5473e00/0xb126349c40f32929 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.326720:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5473e00/0xb126349c40f32929 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.326726:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d5473e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.326729:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5473e00/0xb126349c40f32929 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.326736:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5473e00/0xb126349c40f32929 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.326747:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.326749:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.326753:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5473e00/0xb126349c40f32929 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.326758:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5473e00/0xb126349c40f32929 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.326770:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a3b400/0xb126349c40f32930 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.326776:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a3b400/0xb126349c40f32930 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.327115:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a3b400/0xb126349c40f32930 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.327120:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c9a3b400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.327124:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a3b400/0xb126349c40f32930 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.327130:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a3b400/0xb126349c40f32930 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.327140:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbfff8436 (ffff9090ccb87100) 00010000:00010000:3.0:1787508613.327142:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.327145:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a3b400/0xb126349c40f32930 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.327150:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a3b400/0xb126349c40f32930 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.327188:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5472400/0xb126349c40f32922 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb1f expref: 587 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.327199:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.327202:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508613.327205:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5472400/0xb126349c40f32922 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb1f expref: 587 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.327213:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d5472400, rc 0) 00000100:00100000:3.0:1787508613.327274:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336014:x1874324509460992:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 834us (1125us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508613.327281:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93565 00000100:00100000:3.0:1787508613.327307:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93566 00000100:00100000:3.0:1787508613.327315:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336015:x1874324509461120:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508613.327324:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.327333:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f32937 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadb26 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.327367:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f3293e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.327390:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f3293e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.327398:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f3293e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.327415:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f32945 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.327422:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f32945 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.327428:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f32945 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.327459:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f3293e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.327476:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f3293e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.327482:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f3293e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.327973:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f3293e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.327980:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d0ff0c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.327983:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f3293e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.327989:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f3293e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.328000:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.328002:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.328005:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f3293e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.328011:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f3293e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.328023:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f32945 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.328029:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f32945 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.328034:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f32945 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.328038:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d34a3e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.328041:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f32945 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.328046:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f32945 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.328053:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090cc088a00) 00010000:00010000:3.0:1787508613.328056:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.328059:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f32945 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.328065:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f32945 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.328091:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f32937 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb26 expref: 16 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.328106:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.328108:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.328112:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f32937 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb26 expref: 16 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.328121:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d0ff1800, rc 0) 00000100:00100000:3.0:1787508613.328154:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336015:x1874324509461120:12345-192.168.201.30@tcp:101:rm.0 Request processed in 840us (1943us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508613.328162:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93566 00000100:00100000:0.0:1787508613.342233:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.342328:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509461376 00000100:00100000:3.0:1787508613.342341:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509461376 00000100:00100000:3.0:1787508613.342402:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93567 00000100:00100000:3.0:1787508613.342413:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336014:x1874324509461376:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508613.342436:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.342456:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3294c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadb2d expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.342561:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32953 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.342575:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32953 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.342586:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32953 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.342603:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3295a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.342611:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3295a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.342617:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3295a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.342674:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32953 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.342682:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32953 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.342688:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32953 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.342694:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32953 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.342700:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ea00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.342704:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32953 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.342711:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32953 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.342724:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.342727:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.342732:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32953 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.342737:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32953 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.342753:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3295a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.342759:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3295a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.342765:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3295a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.342770:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.342772:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3295a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.342778:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3295a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.342785:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x594a0ca2 (ffff9090ccb87800) 00010000:00010000:3.0:1787508613.342787:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.342790:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3295a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.342796:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3295a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.342827:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3294c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb2d expref: 587 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.342837:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.342840:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508613.342845:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3294c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb2d expref: 587 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.342853:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e600, rc 0) 00000100:00100000:3.0:1787508613.342916:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336014:x1874324509461376:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 505us (693us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508613.342923:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93567 00000100:00100000:0.0:1787508613.356889:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.369234:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.369447:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509461888 00000100:00100000:1.0:1787508613.369457:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509461888 00000100:00100000:1.0:1787508613.369524:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93569 00000100:00100000:1.0:1787508613.369534:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336014:x1874324509461888:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508613.369653:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.369676:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f32976 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadb3b expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.369747:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3297d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.369760:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3297d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.369771:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3297d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.369783:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32984 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.369857:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32984 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.369864:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32984 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.369912:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3297d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.369918:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3297d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.369924:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3297d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.369930:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3297d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.369936:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.369972:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3297d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.369989:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3297d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.370000:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.370003:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.370008:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3297d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.370013:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3297d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.370026:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32984 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.370032:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32984 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.370038:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32984 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.370043:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.370046:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32984 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.370052:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32984 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.370156:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090cda8af00) 00010000:00010000:1.0:1787508613.370159:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.370162:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32984 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.370168:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32984 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.370198:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f32976 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb3b expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.370208:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.370210:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508613.370214:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f32976 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb3b expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.370222:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b200, rc 0) 00000100:00100000:1.0:1787508613.370311:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336014:x1874324509461888:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 777us (1096us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508613.370319:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93569 00000100:00100000:0.0:1787508613.376160:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.385586:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.385678:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509462400 00000100:00100000:3.0:1787508613.385688:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509462400 00000100:00100000:3.0:1787508613.385750:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93571 00000100:00100000:3.0:1787508613.385761:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336014:x1874324509462400:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508613.385782:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.385803:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f329a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadb49 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.385877:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f329a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.385892:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f329a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.385903:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f329a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.385917:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f329ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.385925:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f329ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.385936:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f329ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.386038:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f329a7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.386046:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f329a7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.386053:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f329a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.386060:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f329a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.386066:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.386070:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f329a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.386078:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f329a7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.386090:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.386093:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.386097:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f329a7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.386103:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f329a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.386117:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f329ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.386124:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f329ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.386129:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f329ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.386134:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ea00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.386137:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f329ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.386142:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f329ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.386148:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaf3dc4c9 (ffff9090ccb87800) 00010000:00010000:3.0:1787508613.386150:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.386153:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f329ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.386158:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f329ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.386189:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f329a0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb49 expref: 587 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.386200:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.386201:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508613.386204:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f329a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb49 expref: 587 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.386217:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e600, rc 0) 00000100:00100000:3.0:1787508613.386274:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336014:x1874324509462400:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 514us (697us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508613.386281:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93571 00000100:00100000:0.0:1787508613.392455:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.400863:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.400994:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509462784 00000100:00100000:3.0:1787508613.401007:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509462784 00000100:00100000:3.0:1787508613.401074:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93573 00000100:00100000:3.0:1787508613.401084:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:336014:x1874324509462784:12345-192.168.201.30@tcp:36:lfs.0 00000100:00100000:3.0:1787508613.401201:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb61880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480073856:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787508613.401262:0:202226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.401301:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88540 going to sleep for 11 seconds 00000100:00100000:1.0:1787508613.401411:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480073856 00000100:00100000:1.0:1787508613.401416:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480073856 00000100:00100000:1.0:1787508613.401455:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29590 00000100:00100000:1.0:1787508613.401472:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:202226:x1874324480073856:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787508613.401544:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:202226:x1874324480073856:12345-0@lo:1000:mdt00_000.0 Request processed in 82us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.401561:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29590 00000100:00100000:0.0:1787508613.401903:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb61880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480073856:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787508613.402008:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480073984:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787508613.402042:0:202226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.402069:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787508613.402534:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480073984:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1787508613.402593:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f329ca lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.402604:0:202226:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f329ca lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.402614:0:202226:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f329ca lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.402626:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480074112:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1787508613.402650:0:202226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.402667:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9600 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.402763:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480074112 00000100:00100000:3.0:1787508613.402768:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480074112 00000100:00100000:3.0:1787508613.402802:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29592 00000100:00100000:3.0:1787508613.402809:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:202226:x1874324480074112:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1787508613.402818:0:202232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.402832:0:202232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f329d1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f329ca expref: -99 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.402857:0:202232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f3283b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadacb expref: 585 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.402867:0:202232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f32849 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadad2 expref: 14 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.402881:0:202232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f329d1 lrc: 5/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f329ca expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.402906:0:202232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f32849 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadad2 expref: 14 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.402921:0:202232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f32849 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadad2 expref: 14 pid: 230618 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.402933:0:202232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb61880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:202232:1874324480074240:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508613.403052:0:202232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f3283b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadacb expref: 585 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.403062:0:202232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f3283b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadacb expref: 585 pid: 203348 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.403072:0:202232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb63800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:202232:1874324480074368:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508613.403097:0:202232:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88780 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.407767:0:202232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb61880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:202232:1874324480074240:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508613.407784:0:202232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb63800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:202232:1874324480074368:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508613.407820:0:202232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f329d1 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f329ca expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.407834:0:202232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.407837:0:202232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.407842:0:202232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f329d1 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f329ca expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.407851:0:202232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e600, rc 0) 00000100:00100000:3.0:1787508613.407922:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:202226:x1874324480074112:12345-0@lo:101:mdt00_000.0 Request processed in 5112us (5270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.407930:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29592 00000100:00100000:0.0:1787508613.408084:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480074112:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1787508613.408109:0:202226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f329ca lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f329d1 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.408120:0:202226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f329ca lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f329d1 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.408732:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.408794:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509462912 00000100:00100000:0.0:1787508613.408802:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509462912 00010000:00010000:0.0:1787508613.408836:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f32849 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadad2 expref: 15 pid: 230618 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.408872:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27776 00000100:00100000:0.0:1787508613.408882:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2400:x1874324509462912:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508613.408897:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508613.408903:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f32849 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadad2 expref: 15 pid: 230618 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.408916:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f32849 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadad2 expref: 15 pid: 230618 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.408935:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ede00/0xb126349c40f32849 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadad2 expref: 15 pid: 230618 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.408988:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.408994:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f329d1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f329ca expref: 9 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.409002:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508613.409037:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2400:x1874324509462912:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 157us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.409044:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27776 00000100:00100000:1.0:1787508613.409462:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509463040 00000100:00100000:1.0:1787508613.409478:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509463040 00010000:00010000:1.0:1787508613.409501:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f3283b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadacb expref: 586 pid: 203348 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.409532:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27777 00000100:00100000:1.0:1787508613.409540:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d5738700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:2400:x1874324509463040:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508613.409549:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508613.409564:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f3283b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadacb expref: 586 pid: 203348 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.409576:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f3283b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadacb expref: 586 pid: 203348 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.409590:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed400/0xb126349c40f3283b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadacb expref: 586 pid: 203348 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.409602:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.409607:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f329d1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f329ca expref: 9 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.409616:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f329d1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f329ca expref: 9 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.409623:0:202212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f329d1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f329ca expref: 9 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.409657:0:202212:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f329d1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f329ca expref: 9 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.409672:0:202212:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9c8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:202212:1874324480074496:0@lo:105: 00000100:00100000:1.0:1787508613.409711:0:202212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.409743:0:202212:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cbe40300 going to sleep for 11 seconds 00000100:00100000:1.0:1787508613.409758:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480074496 00000100:00100000:1.0:1787508613.409761:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480074496 00000100:00100000:1.0:1787508613.409786:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18116 00000100:00100000:1.0:1787508613.409792:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:202212:x1874324480074496:12345-0@lo:105: 00010000:00010000:1.0:1787508613.409802:0:229363:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f329ca lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f329d1 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.409811:0:229363:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f329ca lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f329d1 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.409818:0:229363:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f329ca lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f329d1 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.409826:0:229363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f329ca lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f329d1 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.409832:0:229363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f329ca lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f329d1 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.409840:0:229363:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f329ca lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f329d1 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.409859:0:229363:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d56f6400) 00000100:00100000:1.0:1787508613.409888:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:202212:x1874324480074496:12345-0@lo:105: Request processed in 96us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.409895:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18116 00000100:00100000:1.0:1787508613.409923:0:202212:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9c8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:202212:1874324480074496:0@lo:105: 00010000:00010000:1.0:1787508613.409934:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508613.409998:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d5738700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:2400:x1874324509463040:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 459us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.410005:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27777 00010000:00010000:0.0:1787508613.410502:0:202226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f329ca lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f329d1 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.410517:0:202226:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f329ca lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f329d1 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787508613.410539:0:202226:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787508613.410581:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7a00/0xb126349c40f329d8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.410589:0:202226:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7a00/0xb126349c40f329d8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.410598:0:202226:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7a00/0xb126349c40f329d8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.410616:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480074624:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1787508613.410651:0:202226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.410670:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9600 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.413984:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480074624:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1787508613.414021:0:202226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7a00/0xb126349c40f329d8 lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f329df expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.414034:0:202226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7a00/0xb126349c40f329d8 lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f329df expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.419242:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509463168 00000100:00100000:1.0:1787508613.419254:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509463168 00000100:00100000:1.0:1787508613.419317:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93574 00000100:00100000:1.0:1787508613.419329:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336022:x1874324509463168:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508613.419350:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.419371:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f329e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadb57 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.419442:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f329ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.419458:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f329d1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f329ca expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.419478:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f329ed lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.419517:0:202228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f329d1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f329ca expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.419533:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480074752:0@lo:104: 00000100:00100000:1.0:1787508613.419582:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.419629:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cbe40300 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.419986:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480074752:0@lo:104: 00010000:00010000:3.0:1787508613.420008:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f329ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.420094:0:202215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508613.420102:0:202215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f329ca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f329d1 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.420113:0:202215:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9090d56f6400 is referenced, will be cancelled later 00010000:00010000:0.0:1787508613.420115:0:202215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f329ca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f329d1 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.420124:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508613.420126:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508613.420127:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787508613.420394:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944043 is committed 00000001:00080000:1.0:1787508613.420405:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944042 is committed 00000001:00080000:1.0:1787508613.420422:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944039 is committed 00000020:00080000:1.0:1787508613.420427:0:202206:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9090d22c8e40 refcount 2 committed 0 result 0 batchid 8589961977 00000020:00080000:1.0:1787508613.420431:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521400 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d22c8600 00000020:00080000:1.0:1787508613.420435:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd2:0x1:0x0].1778 00000020:00080000:1.0:1787508613.420437:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090ce62a800 00000020:00080000:1.0:1787508613.420441:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1:0x0].1772 00000020:00080000:0.0:1787508613.420491:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961974 00010000:00010000:3.0:1787508613.420538:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f32658 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420547:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f32658 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420554:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f32658 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420559:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ed600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.420563:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f32658 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420570:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f32658 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420584:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090cc088a00) 00010000:00010000:3.0:1787508613.420587:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.420592:0:3603:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f329df lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f329d8 expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420601:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f32658 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420608:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ed600/0xb126349c40f32658 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420623:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f3265f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1257:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420629:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f3265f lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x1257:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420635:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f3265f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1257:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420639:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22eda00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.420641:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f3265f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1257:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420646:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f3265f lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x1257:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420656:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1257:0x0].0x0 (ffff9090cc088200) 00010000:00010000:3.0:1787508613.420659:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.420661:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f3265f lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x1257:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420666:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eda00/0xb126349c40f3265f lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x1257:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420675:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f32666 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x16d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420681:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f32666 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a0:0x16d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420687:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f32666 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x16d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420691:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ec000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.420695:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f32666 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x16d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420701:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f32666 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a0:0x16d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420708:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16d:0x0].0x0 (ffff9090cc088000) 00010000:00010000:3.0:1787508613.420711:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.420713:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f32666 lrc: 2/0,0 mode: --/TXN res: [0x2000013a0:0x16d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420719:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec000/0xb126349c40f32666 lrc: 0/0,0 mode: --/TXN res: [0x2000013a0:0x16d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420734:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f327af lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1257:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420740:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f327af lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x1257:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420744:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f327af lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1257:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420750:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.420753:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f327af lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1257:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420759:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f327af lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x1257:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420766:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1257:0x0].0x0 (ffff9090cc088200) 00010000:00010000:3.0:1787508613.420768:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508613.420771:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f327af lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x1257:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420776:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f327af lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x1257:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420805:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f327c4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420811:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f327c4 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420817:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f327c4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420822:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d22ec800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.420825:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f327c4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420830:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f327c4 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420837:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16d:0x0].0x0 (ffff9090cc088000) 00010000:00010000:3.0:1787508613.420838:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508613.420841:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f327c4 lrc: 2/0,0 mode: --/TXN res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.420846:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ec800/0xb126349c40f327c4 lrc: 0/0,0 mode: --/TXN res: [0x2000013a0:0x16d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787508613.421777:0:202206:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8589961975 batchid updated 00000020:00080000:1.0:1787508613.421811:0:202206:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9090d1d88600 refcount 2 committed 0 result 0 batchid 8589961976 00000020:00080000:1.0:1787508613.421816:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9091d47d0800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d9106540 00000020:00080000:1.0:1787508613.421820:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd2:0x1:0x0].1777 00000020:00080000:1.0:1787508613.421822:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9091d47d0e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090e3c8e400 00000020:00080000:1.0:1787508613.421825:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1:0x0].1771 00000020:00080000:0.0:1787508613.421875:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589961977 committed batchid 8589961975 00000004:00080000:0.0:1787508613.422026:0:202262:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d01c9e40 with version 3441 00000020:00080000:0.0:1787508613.422044:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589961975 cancel update log [0x240000bd2:0x1:0x0].1776: rc = 0 00000020:00080000:0.0:1787508613.422094:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589961975 cancel update log [0x2000013a0:0x1:0x0].1770: rc = 0 00000020:00080000:0.0:1787508613.422103:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961975 00000100:00100000:3.0:1787508613.422184:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480074880 00000100:00100000:3.0:1787508613.422193:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480074880 00000100:00100000:3.0:1787508613.422248:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18118 00000100:00100000:3.0:1787508613.422257:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:3602:x1874324480074880:12345-0@lo:105: 00010000:00010000:3.0:1787508613.422270:0:229363:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7a00/0xb126349c40f329d8 lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f329df expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.422281:0:229363:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7a00/0xb126349c40f329d8 lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f329df expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.422291:0:229363:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7a00/0xb126349c40f329d8 lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f329df expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.422298:0:229363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7a00/0xb126349c40f329d8 lrc: 5/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f329df expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.422307:0:229363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7a00/0xb126349c40f329d8 lrc: 6/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f329df expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.422316:0:229363:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7a00/0xb126349c40f329d8 lrc: 6/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f329df expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.422338:0:229363:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d56f7a00) 00000100:00100000:3.0:1787508613.422395:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:3602:x1874324480074880:12345-0@lo:105: Request processed in 138us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.422401:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18118 00010000:00010000:3.0:1787508613.422429:0:202226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7a00/0xb126349c40f329d8 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f329df expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.422437:0:202226:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7a00/0xb126349c40f329d8 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f329df expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787508613.422461:0:202226:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1787508613.422505:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb63800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480075008:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787508613.422541:0:202226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.422570:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480075008 00000100:00100000:3.0:1787508613.422574:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480075008 00000100:00100000:3.0:1787508613.422602:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29594 00000100:00100000:3.0:1787508613.422608:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202226:x1874324480075008:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787508613.422670:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202226:x1874324480075008:12345-0@lo:1000:mdt00_000.0 Request processed in 62us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.422677:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29594 00000100:00100000:3.0:1787508613.422699:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88840 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.422717:0:202226:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944042 gen 2 00000004:00080000:3.0:1787508613.422721:0:202226:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944040 committed transno 12884944042 00000004:00080000:3.0:1787508613.422733:0:202226:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944041 committed transno 12884944042 00000004:00080000:3.0:1787508613.422740:0:202226:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944042 committed transno 12884944042 00000100:00100000:3.0:1787508613.422754:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb63800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480075008:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787508613.422791:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb63800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480075136:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787508613.422814:0:202226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.422828:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88840 going to sleep for 11 seconds 00000100:00100000:0.0:1787508613.423535:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29595 00000100:00100000:0.0:1787508613.423545:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202226:x1874324480075136:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787508613.423652:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202226:x1874324480075136:12345-0@lo:1000:mdt00_000.0 Request processed in 110us (836us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787508613.423660:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29595 00000100:00100000:0.0:1787508613.423675:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29596 00000100:00100000:0.0:1787508613.423682:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:202248:x1874324480075392:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787508613.423802:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:202248:x1874324480075392:12345-0@lo:1000:osp_up1-0.0 Request processed in 120us (685us total) trans 8589961976 rc 0/0 00000100:00100000:0.0:1787508613.423809:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29596 00000100:00100000:1.0:1787508613.423885:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb63800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480075136:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787508613.423992:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb63800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480075520:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787508613.424026:0:202226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.424057:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cbe40300 going to sleep for 11 seconds 00000100:00100000:0.0:1787508613.424132:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480075520 00000100:00100000:0.0:1787508613.424136:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480075520 00000100:00100000:0.0:1787508613.424176:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29597 00000100:00100000:0.0:1787508613.424182:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202226:x1874324480075520:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787508613.424253:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202226:x1874324480075520:12345-0@lo:1000:mdt00_000.0 Request processed in 70us (226us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787508613.424259:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29597 00000100:00100000:1.0:1787508613.424381:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb63800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480075520:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787508613.424434:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1515880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480075648:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787508613.424458:0:202226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.424485:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3f11c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787508613.424533:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480075648 00000100:00100000:0.0:1787508613.424538:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480075648 00000100:00100000:0.0:1787508613.424566:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29598 00000100:00100000:0.0:1787508613.424572:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202226:x1874324480075648:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787508613.424609:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202226:x1874324480075648:12345-0@lo:1000:mdt00_000.0 Request processed in 38us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.424613:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29598 00000100:00100000:1.0:1787508613.424671:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1515880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480075648:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787508613.424710:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1515880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480075776:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787508613.424732:0:202226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.424754:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3f11c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787508613.424804:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480075776 00000100:00100000:0.0:1787508613.424809:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480075776 00000100:00100000:0.0:1787508613.424838:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29599 00000100:00100000:0.0:1787508613.424844:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202226:x1874324480075776:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787508613.424898:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202226:x1874324480075776:12345-0@lo:1000:mdt00_000.0 Request processed in 54us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.424904:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29599 00000100:00100000:1.0:1787508613.424969:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1515880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480075776:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787508613.425005:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1515880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480075904:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787508613.425029:0:202226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.425052:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3f11c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787508613.425100:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480075904 00000100:00100000:0.0:1787508613.425103:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480075904 00000100:00100000:0.0:1787508613.425125:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29600 00000100:00100000:0.0:1787508613.425128:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6391c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202226:x1874324480075904:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787508613.425161:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6391c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202226:x1874324480075904:12345-0@lo:1000:mdt00_000.0 Request processed in 32us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.425165:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29600 00000100:00100000:1.0:1787508613.425222:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1515880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480075904:0@lo:1000:mdt00_000.0 00000040:00080000:1.0:1787508613.426171:0:202226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xf:0x0].36, 2168 off70880 00000040:00080000:1.0:1787508613.426282:0:202226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x5:0x0].579, 2368 off735552 00000004:00080000:1.0:1787508613.426287:0:202226:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d3f11900 with version 13586 00000100:00100000:1.0:1787508613.426459:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480076160 00000100:00100000:1.0:1787508613.426477:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480076160 00000100:00100000:1.0:1787508613.426509:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29601 00000100:00100000:1.0:1787508613.426517:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202961:x1874324480076160:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508613.427174:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:202961:x1874324480076160:12345-0@lo:1000:osp_up0-1.0 Request processed in 652us (748us total) trans 12884944044 rc 0/0 00000100:00100000:1.0:1787508613.427183:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29601 00010000:00010000:1.0:1787508613.427355:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f329f4 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.427371:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f329f4 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.427379:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f329f4 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.427391:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f329fb lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x28f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.427396:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f329fb lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x28f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.427400:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f329fb lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x28f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.427420:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f32a02 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.427424:0:202226:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f32a02 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.427431:0:202226:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f32a02 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.427440:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1515880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480076288:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1787508613.427459:0:202226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.427489:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3f11f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787508613.428434:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1515880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480076288:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1787508613.428449:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f32a02 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32a09 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.428475:0:202226:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f32a02 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32a09 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508613.428498:0:202226:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000dd5d557 reply state 000000001e823b22 transno 8589961977 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f329fb lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x28f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.428511:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f329fb lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x28f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.428515:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28f:0x0].0x0 (ffff9090cda8aa00) 00010000:00010000:1.0:1787508613.428516:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787508613.428518:0:202226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787508613.428524:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f32a02 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32a09 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.428529:0:202226:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f32a02 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32a09 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787508613.428537:0:202226:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x285:0x0] 00000004:00010000:1.0:1787508613.428541:0:202226:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000dd5d557 reply state 000000001e823b22 transno 8589961977 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f329f4 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.428546:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f329f4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.428549:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d0:0x0].0x0 (ffff9090cda8af00) 00010000:00010000:1.0:1787508613.428551:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787508613.428552:0:202226:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1787508613.428556:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d0:0x0]: returning size 4096 00000004:00080000:1.0:1787508613.428562:0:202226:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787508613.428566:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f329ca lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f329d1 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.428571:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f329ca lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xb126349c40f329d1 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.428575:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f329ca lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xb126349c40f329d1 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.428593:0:202226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000004:00080000:1.0:1787508613.428597:0:202226:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787508613.428602:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7a00/0xb126349c40f329d8 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f329df expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.428608:0:202226:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7a00/0xb126349c40f329d8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f329df expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.428780:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+642:336014:x1874324509462784:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 27695us (27926us total) trans 8589961977 rc 0/0 00000100:00100000:1.0:1787508613.428788:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93573 00000100:00100000:0.0:1787508613.428858:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480076416 00000100:00100000:0.0:1787508613.428863:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480076416 00010000:00010000:0.0:1787508613.428891:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f329d1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f329ca expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.428923:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27778 00000100:00100000:0.0:1787508613.428930:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+10:3617:x1874324480076416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508613.428965:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508613.428983:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f329d1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f329ca expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.428995:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.429000:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f329ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.429009:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f329ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.429015:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f329ed lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.429043:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508613.429091:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+9:3617:x1874324480076416:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.429098:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27778 00010000:00010000:1.0:1787508613.429146:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f329ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.429152:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f329ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508613.429191:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508613.429193:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508613.429221:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f329ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.429247:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f329e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb57 expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.429260:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f329ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb57 expref: 11 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.429267:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.429269:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508613.429272:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a000, rc 0) 00000100:00100000:1.0:1787508613.429298:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336022:x1874324509463168:12345-192.168.201.30@tcp:101:rm.0 Request processed in 9972us (10258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.429304:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93574 00000100:00100000:0.0:1787508613.433841:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.434043:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509463296 00000100:00100000:3.0:1787508613.434055:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509463296 00000100:00100000:3.0:1787508613.434158:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93575 00000100:00100000:3.0:1787508613.434174:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336022:x1874324509463296:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508613.434196:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.434228:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32a10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadb5e expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.434295:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32a17 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.434308:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32a17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.434319:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32a17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.434333:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32a1e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.434339:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32a1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.434346:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32a1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.434402:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32a17 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.434409:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32a17 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.434414:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32a17 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.434420:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32a17 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.434427:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.434431:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32a17 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.434438:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32a17 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.434450:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.434453:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.434456:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32a17 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.434474:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32a17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.434488:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32a1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.434495:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32a1e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.434501:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32a1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.434505:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.434508:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32a1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.434513:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32a1e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.434520:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090ccb87800) 00010000:00010000:3.0:1787508613.434522:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.434524:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32a1e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.434530:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32a1e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.434557:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32a10 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb5e expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.434567:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.434569:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508613.434572:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32a10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb5e expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.434585:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ea00, rc 0) 00000100:00100000:3.0:1787508613.434653:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336022:x1874324509463296:12345-192.168.201.30@tcp:101:rm.0 Request processed in 485us (876us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508613.434661:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93575 00000100:00100000:1.0:1787508613.437190:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.437223:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.437603:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93577 00000100:00100000:3.0:1787508613.437613:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+581:336023:x1874324509463552:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1787508613.437620:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.437627:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32a2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadb6c expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.437671:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f32a33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.437708:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f32a33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.437717:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f32a33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508613.437758:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508613.437761:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508613.437797:0:209004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f32a33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.437820:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32a2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb6c expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.437837:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f32a33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb6c expref: 582 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.437845:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.437848:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508613.437850:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e200, rc 0) 00000100:00100000:3.0:1787508613.437903:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336023:x1874324509463552:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 292us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.437910:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93577 00000100:00100000:3.0:1787508613.439907:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.440327:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509463680 00000100:00100000:1.0:1787508613.440335:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509463680 00000100:00100000:1.0:1787508613.440648:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93578 00000100:00100000:1.0:1787508613.440660:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336023:x1874324509463680:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508613.440678:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.440696:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32a48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadb73 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.440745:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32a4f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.440755:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32a4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.440766:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32a4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.440775:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32a56 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.440873:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32a56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.440878:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32a56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.440932:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32a4f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.440982:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32a4f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.440989:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32a4f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.440996:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32a4f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.441002:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.441005:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32a4f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.441010:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32a4f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.441019:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.441021:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.441023:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32a4f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.441028:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32a4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.441036:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32a56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.441040:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32a56 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.441044:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32a56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.441046:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247bc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.441048:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32a56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.441051:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32a56 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.441054:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090cda8ac00) 00010000:00010000:1.0:1787508613.441055:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.441057:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32a56 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.441060:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32a56 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.441081:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32a48 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb73 expref: 583 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.441088:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.441089:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508613.441091:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32a48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb73 expref: 583 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.441097:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a800, rc 0) 00000100:00100000:1.0:1787508613.441150:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336023:x1874324509463680:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 493us (1250us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508613.441156:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93578 00000100:00100000:0.0:1787508613.443567:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.444401:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.444448:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509463808 00000100:00100000:1.0:1787508613.444458:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509463808 00000100:00100000:1.0:1787508613.444528:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509463936 00000100:00100000:1.0:1787508613.444532:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509463936 00000100:00100000:1.0:1787508613.444572:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93579 00000100:00100000:1.0:1787508613.444583:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336022:x1874324509463808:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508613.444604:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.444624:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f32a5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadb7a expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.444674:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32a64 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.444683:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32a64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.444692:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32a64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.444703:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32a6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.444708:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32a6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.444711:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32a6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.444755:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32a64 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.444759:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32a64 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.444763:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32a64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.444767:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32a64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.444771:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.444774:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32a64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.444834:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93580 00000100:00100000:3.0:1787508613.444844:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336023:x1874324509463936:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1787508613.444853:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.444862:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32a72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadb81 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.444886:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32a79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.445136:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32a64 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.445197:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32a79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.445205:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32a79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.445217:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32a80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.445226:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32a80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.445237:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32a80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.445260:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32a79 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.445266:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32a79 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.445269:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32a79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.445272:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32a79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.445275:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fa00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.445277:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32a79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.445280:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32a79 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.445289:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.445291:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.445293:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32a79 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.445297:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32a79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.445307:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32a80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.445312:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32a80 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.445315:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32a80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.445318:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.445319:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32a80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.445322:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32a80 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.445326:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090ccb87100) 00010000:00010000:3.0:1787508613.445327:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.445329:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32a80 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.445332:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32a80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.445355:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32a72 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb81 expref: 583 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.445361:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.445362:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508613.445364:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32a72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb81 expref: 583 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.445373:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e800, rc 0) 00010000:00010000:1.0:1787508613.445432:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.445434:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.445436:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32a64 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.445440:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32a64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.445446:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32a6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.445450:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32a6b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.445453:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32a6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.445456:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247be00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.445457:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32a6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.445460:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32a6b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.445476:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090cda8a300) 00010000:00010000:1.0:1787508613.445477:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.445479:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32a6b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.445482:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32a6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.445497:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f32a5d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb7a expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.445505:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.445507:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508613.445509:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f32a5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb7a expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.445513:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b800, rc 0) 00000100:00100000:1.0:1787508613.445624:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336022:x1874324509463808:12345-192.168.201.30@tcp:101:rm.0 Request processed in 1044us (2065us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508613.445630:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93579 00000100:00100000:3.0:1787508613.445678:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336023:x1874324509463936:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 837us (1281us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508613.445682:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93580 00000100:00100000:0.0:1787508613.448668:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.448724:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.449028:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93581 00000100:00100000:3.0:1787508613.449040:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336022:x1874324509464192:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508613.449059:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.449077:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32a87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadb88 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.449149:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32a8e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.449164:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32a8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.449175:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32a8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.449189:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32a95 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.449196:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32a95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.449202:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32a95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.449349:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93582 00000100:00100000:1.0:1787508613.449359:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336023:x1874324509464320:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508613.449368:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.449389:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32a9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadb8f expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.449426:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32aa3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.449436:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32aa3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.449445:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32aa3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.449458:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f32aaa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.449477:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f32aaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.449484:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f32aaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.449532:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32aa3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.449539:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32aa3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.449544:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32aa3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.449550:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32aa3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.449555:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.449558:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32aa3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.449565:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32aa3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.449576:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.449579:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.449584:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32aa3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.449590:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32aa3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.449603:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f32aaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.449609:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f32aaa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.449615:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f32aaa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.449620:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.449623:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f32aaa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.449629:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f32aaa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.449636:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090cda8ad00) 00010000:00010000:1.0:1787508613.449639:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.449642:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f32aaa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.449648:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f32aaa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.449678:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32a9c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb8f expref: 583 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.449688:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.449690:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508613.449694:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32a9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb8f expref: 583 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.449703:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ae00, rc 0) 00000100:00100000:1.0:1787508613.449805:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336023:x1874324509464320:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 447us (1078us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508613.449812:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93582 00010000:00010000:3.0:1787508613.449927:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32a8e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.449934:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32a8e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.449964:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32a8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.449972:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32a8e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.449976:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.449979:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32a8e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.449985:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32a8e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.449994:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.449997:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.449999:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32a8e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.450005:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32a8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.450014:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32a95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.450020:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32a95 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.450026:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32a95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.450032:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.450034:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32a95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.450041:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32a95 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.450048:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090ccb87800) 00010000:00010000:3.0:1787508613.450050:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.450052:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32a95 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.450058:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32a95 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.450081:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32a87 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb88 expref: 12 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.450090:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.450092:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508613.450096:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32a87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb88 expref: 12 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.450105:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ea00, rc 0) 00000100:00100000:3.0:1787508613.450129:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336022:x1874324509464192:12345-192.168.201.30@tcp:101:rm.0 Request processed in 1093us (1469us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508613.450139:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93581 00000100:00100000:0.0:1787508613.455083:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509464576 00000100:00100000:0.0:1787508613.455094:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509464576 00000100:00100000:0.0:1787508613.455163:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93583 00000100:00100000:0.0:1787508613.455174:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336023:x1874324509464576:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508613.455196:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508613.455230:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32ab1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadb96 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.455305:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32ab8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.455320:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.455331:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.455346:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32abf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.455353:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32abf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.455360:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32abf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.455561:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32ab8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.455568:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32ab8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.455572:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.455576:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32ab8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.455582:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.455586:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32ab8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.455590:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32ab8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.455599:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.455601:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.455604:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32ab8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.455608:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32ab8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.455617:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32abf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.455620:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32abf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.455624:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32abf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.455626:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.455628:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32abf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.455631:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32abf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.455640:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090c6913200) 00010000:00010000:0.0:1787508613.455642:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.455645:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32abf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.455651:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32abf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.455681:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32ab1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb96 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.455692:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.455694:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508613.455696:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32ab1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb96 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.455702:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7800, rc 0) 00000100:00100000:0.0:1787508613.455760:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336023:x1874324509464576:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 588us (896us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508613.455767:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93583 00000100:00100000:0.0:1787508613.457871:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.461184:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509464704 00000100:00100000:3.0:1787508613.461200:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509464704 00000100:00100000:0.0:1787508613.461547:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.461611:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509464832 00000100:00100000:1.0:1787508613.461616:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509464832 00000100:00100000:1.0:1787508613.461669:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93584 00000100:00100000:1.0:1787508613.461680:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336023:x1874324509464832:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508613.461700:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.461719:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f32ac6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadba4 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.461793:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32acd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.461809:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32acd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.461820:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32acd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.461831:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32ad4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.461841:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f329df lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f329d8 expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.461854:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32ad4 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.461890:0:202228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f329df lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f329d8 expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.461907:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480076544:0@lo:104: 00000100:00100000:1.0:1787508613.461992:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.462032:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3f11f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787508613.462117:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480076544 00000100:00100000:0.0:1787508613.462120:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480076544 00000100:00100000:0.0:1787508613.462151:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18119 00000100:00100000:0.0:1787508613.462156:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:202228:x1874324480076544:12345-0@lo:104: 00010000:00010000:0.0:1787508613.462165:0:202210:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7a00/0xb126349c40f329d8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f329df expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.462210:0:202210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787508613.462216:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:202228:x1874324480076544:12345-0@lo:104: Request processed in 60us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.462222:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18119 00000100:00100000:1.0:1787508613.462672:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480076544:0@lo:104: 00010000:00010000:1.0:1787508613.462689:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32ad4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.462746:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787508613.462758:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480076672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508613.462801:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.462894:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480076672 00000100:00100000:3.0:1787508613.462899:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480076672 00010000:00010000:3.0:1787508613.462920:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f329df lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f329d8 expref: 9 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.462973:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27779 00000100:00100000:3.0:1787508613.462981:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3616:x1874324480076672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787508613.462991:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508613.464611:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f329df lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f329d8 expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.464626:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090cc088a00) 00010000:00010000:3.0:1787508613.464630:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32ad4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.464635:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.464642:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32ad4 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.464649:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32ae9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.464654:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.464664:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32ae9 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.464700:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508613.464750:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3616:x1874324480076672:12345-0@lo:103:ldlm_bl.0 Request processed in 1770us (1949us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.464757:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27779 00000100:00100000:3.0:1787508613.465106:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480076800 00000100:00100000:3.0:1787508613.465111:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480076800 00000100:00100000:3.0:1787508613.465144:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29603 00000100:00100000:3.0:1787508613.465150:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:203348:x1874324480076800:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787508613.465201:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:203348:x1874324480076800:12345-0@lo:1000:mdt00_003.0 Request processed in 52us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.465205:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29603 00010000:00010000:1.0:1787508613.465304:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.465309:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787508613.465524:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961977 00000004:00080000:0.0:1787508613.465574:0:202262:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d01c93c0 with version 3442 00000020:00080000:0.0:1787508613.465590:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589961976 cancel update log [0x240000bd2:0x1:0x0].1777: rc = 0 00000004:00080000:3.0:1787508613.465613:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3442 rpc_version 3442 00000020:00100000:3.0:1787508613.465629:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787508613.465636:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091d4857800 x1874324480077056/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787508613.465651:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d4857800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480077056:0@lo:1000:osp_up1-0.0 00000020:00080000:0.0:1787508613.465666:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589961976 cancel update log [0x2000013a0:0x1:0x0].1771: rc = 0 00000100:00100000:3.0:1787508613.465680:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787508613.465687:0:202262:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d01c9f00 with version 3443 00000020:00080000:0.0:1787508613.465690:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589961977 cancel update log [0x240000bd2:0x1:0x0].1778: rc = 0 00000100:00100000:3.0:1787508613.465699:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88d80 going to sleep for 11 seconds 00000020:00080000:0.0:1787508613.465710:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589961977 cancel update log [0x2000013a0:0x1:0x0].1772: rc = 0 00000100:00100000:3.0:1787508613.465712:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480077056 00000100:00100000:3.0:1787508613.465716:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480077056 00000020:00080000:0.0:1787508613.465719:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961977 00000100:00100000:0.0:1787508613.465744:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480076672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787508613.465745:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29604 00000100:00100000:3.0:1787508613.465752:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:202248:x1874324480077056:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787508613.465876:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:202248:x1874324480077056:12345-0@lo:1000:osp_up1-0.0 Request processed in 123us (194us total) trans 8589961978 rc 0/0 00000100:00100000:3.0:1787508613.465884:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29604 00010000:00010000:1.0:1787508613.466009:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32af7 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.466018:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32af7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.466027:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32af7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508613.466041:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32af7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.466055:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32acd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.466061:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32acd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.466067:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32acd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.466073:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32acd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.466078:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247be00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.466082:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32acd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.466090:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32acd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.466102:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.466104:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.466108:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32acd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.466114:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32acd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.466125:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.466131:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32ad4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.466136:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.466140:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.466143:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.466149:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32ad4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.466155:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090cc088a00) 00010000:00010000:1.0:1787508613.466157:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.466160:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32ad4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.466166:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32ad4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.466200:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f32ac6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadba4 expref: 584 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.466228:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32af7 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadba4 expref: 583 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.466235:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d0:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:1.0:1787508613.466237:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508613.466239:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ae00, rc 0) 00000100:00100000:1.0:1787508613.466291:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336023:x1874324509464832:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 4614us (4749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.466302:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93584 00000100:00100000:0.0:1787508613.466480:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d4857800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480077056:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787508613.466490:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3443 rpc_version 3443 00000020:00100000:0.0:1787508613.466503:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787508613.466508:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091f9a9a300 x1874324480077312/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787508613.466522:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9a300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480077312:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787508613.466552:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.466582:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9600 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.466869:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480077312 00000100:00100000:3.0:1787508613.466875:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480077312 00000100:00100000:3.0:1787508613.466910:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29605 00000100:00100000:3.0:1787508613.466919:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:202248:x1874324480077312:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787508613.467062:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:202248:x1874324480077312:12345-0@lo:1000:osp_up1-0.0 Request processed in 144us (507us total) trans 8589961979 rc 0/0 00000100:00100000:3.0:1787508613.467069:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29605 00000100:00100000:0.0:1787508613.467497:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9a300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480077312:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1787508613.467742:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32adb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb9d expref: 13 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.467756:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f32af0 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb9d expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.467762:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d0:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:2.0:1787508613.467765:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508613.467767:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab400, rc 0) 00000100:00100000:2.0:1787508613.467867:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336022:x1874324509464704:12345-192.168.201.30@tcp:101:rm.0 Request processed in 4880us (10003us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.467875:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93585 00000100:00100000:0.0:1787508613.471199:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.471246:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.471334:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509464960 00000100:00100000:3.0:1787508613.471342:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509464960 00000100:00100000:3.0:1787508613.471390:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509465088 00000100:00100000:3.0:1787508613.471392:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509465088 00000100:00100000:3.0:1787508613.471409:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93586 00000100:00100000:3.0:1787508613.471416:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+642:336023:x1874324509464960:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1787508613.471438:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.471454:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f32afe lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadbab expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.471521:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93587 00010000:00010000:3.0:1787508613.471528:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f32b05 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.471531:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:336022:x1874324509465088:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508613.471539:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.471542:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f32b05 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.471546:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f32b0c lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadbb2 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.471554:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f32b05 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.471570:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f32b13 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.471577:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f32b13 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.471585:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f32b13 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508613.471652:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d0:0x0]: returning size 4096 00000004:00200000:2.0:1787508613.471652:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d0:0x0]: returning size 4096 00000004:00200000:3.0:1787508613.471657:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00200000:2.0:1787508613.471657:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787508613.471690:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f32b0c lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbb2 expref: 7 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.471758:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f32afe lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbab expref: 644 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.471761:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f32b13 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbb2 expref: 6 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.471771:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d0:0x0].0x0 (ffff9090cda8af00) 00010000:00010000:2.0:1787508613.471774:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508613.471777:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aba00, rc 0) 00000100:00100000:2.0:1787508613.471834:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336022:x1874324509465088:12345-192.168.201.30@tcp:101:rm.0 Request processed in 304us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.471840:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93587 00010000:00010000:3.0:1787508613.471913:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f32b05 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbab expref: 643 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.471921:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d0:0x0].0x0 (ffff9090cda8af00) 00010000:00010000:3.0:1787508613.471923:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508613.471926:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f800, rc 0) 00000100:00100000:3.0:1787508613.473590:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+643:336023:x1874324509464960:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 2162us (2387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.473601:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93586 00000100:00100000:0.0:1787508613.474990:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508613.475081:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509465216 00000100:00100000:2.0:1787508613.475090:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509465216 00000100:00100000:2.0:1787508613.475179:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93588 00000100:00100000:2.0:1787508613.475190:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336022:x1874324509465216:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508613.475218:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.475239:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab800/0xb126349c40f32b1a lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadbb9 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.475296:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f32b21 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.475309:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f32b21 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.475320:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f32b21 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508613.475366:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x28f:0x0]: returning size 4096 00000004:00200000:2.0:1787508613.475372:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787508613.475404:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab800/0xb126349c40f32b1a lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbb9 expref: 8 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.475423:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f32b21 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbb9 expref: 7 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.475431:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28f:0x0].0x0 (ffff9090cda8aa00) 00010000:00010000:2.0:1787508613.475433:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508613.475437:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab000, rc 0) 00000100:00100000:2.0:1787508613.475550:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:336022:x1874324509465216:12345-192.168.201.30@tcp:101:rm.0 Request processed in 361us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.475557:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93588 00000100:00100000:2.0:1787508613.477364:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.477540:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.477877:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509465344 00000100:00100000:0.0:1787508613.477887:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509465344 00000100:00100000:2.0:1787508613.477909:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509465472 00000100:00100000:2.0:1787508613.477913:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509465472 00000100:00100000:0.0:1787508613.478016:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93589 00000100:00100000:0.0:1787508613.478028:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+643:336023:x1874324509465344:12345-192.168.201.30@tcp:101:chmod.0 00000100:00100000:2.0:1787508613.478042:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93590 00010000:00010000:0.0:1787508613.478046:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1787508613.478049:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336022:x1874324509465472:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508613.478055:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.478064:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32b2f lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x285:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadbc7 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.478064:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f32b28 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadbc0 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.478113:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32b3d lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.478113:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f32b36 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.478126:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f32b36 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.478127:0:205405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32a09 lrc: 2/0,0 mode: PW/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32a02 expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.478137:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f32b36 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.478140:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32b3d lrc: 4/1,0 mode: --/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.478170:0:205405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32a09 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f32a02 expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508613.478182:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x28f:0x0]: returning size 4096 00000100:00100000:2.0:1787508613.478184:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b60e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480077440:0@lo:104: 00000004:00200000:0.0:1787508613.478187:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508613.478283:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f32b28 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbc0 expref: 645 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.478285:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787508613.478299:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f32b36 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbc0 expref: 644 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.478311:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28f:0x0].0x0 (ffff9090cda8aa00) 00010000:00010000:0.0:1787508613.478314:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508613.478316:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7600, rc 0) 00000100:00100000:2.0:1787508613.478321:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9240 going to sleep for 11 seconds 00000100:00100000:2.0:1787508613.478338:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480077440 00000100:00100000:2.0:1787508613.478342:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480077440 00000100:00100000:0.0:1787508613.478358:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:336023:x1874324509465344:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 333us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.478365:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93589 00000100:00100000:2.0:1787508613.478372:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18120 00000100:00100000:2.0:1787508613.478377:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:205405:x1874324480077440:12345-0@lo:104: 00010000:00010000:2.0:1787508613.478401:0:229363:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f32a02 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f32a09 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.478445:0:229363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787508613.478451:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:205405:x1874324480077440:12345-0@lo:104: Request processed in 74us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.478458:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18120 00010000:00010000:2.0:1787508613.478485:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787508613.478491:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f32a02 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f32a09 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.478498:0:204785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:2.0:1787508613.478503:0:204785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f32a02 lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f32a09 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508613.478516:0:204785:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f32a02 lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f32a09 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.478541:0:204785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f32a02 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f32a09 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.478548:0:204785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787508613.478579:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f32a02 lrc: 1/0,0 mode: --/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f32a09 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.478587:0:204785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f32a02 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f32a09 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.478600:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508613.478602:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508613.478604:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508613.478611:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787508613.478622:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480077568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787508613.478657:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508613.478687:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480077568 00000100:00100000:2.0:1787508613.478692:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480077568 00010000:00010000:2.0:1787508613.478709:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32a09 lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f32a02 expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.478730:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27780 00000100:00100000:2.0:1787508613.478737:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c1ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+7:3619:x1874324480077568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508613.478746:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787508613.479082:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b60e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480077440:0@lo:104: 00010000:00010000:2.0:1787508613.479101:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32b3d lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.481361:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.481442:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509465600 00000100:00100000:3.0:1787508613.481451:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509465600 00000100:00100000:3.0:1787508613.481513:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93591 00000100:00100000:3.0:1787508613.481523:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336023:x1874324509465600:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1787508613.481541:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.481560:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32b44 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x285:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadbce expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.481617:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32b4b lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.481629:0:202227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32b4b lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.481710:0:202227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32b4b lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.481878:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32a09 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f32a02 expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.481890:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x285:0x0].0x0 (ffff9090d36fde00) 00010000:00010000:1.0:1787508613.481902:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32b3d lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.481908:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32b3d lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.481913:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32b3d lrc: 4/1,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.481917:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32b4b lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.481920:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32b4b lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.481924:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32b4b lrc: 4/1,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.481972:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508613.481980:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32b3d lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.481987:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32b3d lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508613.482032:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a2:0x285:0x0]: returning size 4096 00000100:00100000:1.0:1787508613.482033:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c1ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480077568:12345-0@lo:103:ldlm_bl.0 Request processed in 3295us (3374us total) trans 0 rc 0/0 00000004:00200000:2.0:1787508613.482037:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:1.0:1787508613.482042:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27780 00010000:00010000:2.0:1787508613.482074:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32b2f lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x285:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbc7 expref: 14 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.482088:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32b3d lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbc7 expref: 13 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.482095:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x285:0x0].0x0 (ffff9090d36fde00) 00010000:00010000:2.0:1787508613.482097:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508613.482100:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aac00, rc 0) 00000100:00100000:2.0:1787508613.482149:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336022:x1874324509465472:12345-192.168.201.30@tcp:101:rm.0 Request processed in 4099us (4609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.482156:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93590 00010000:00010000:3.0:1787508613.482186:0:202227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32b4b lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.482194:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32b4b lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508613.482225:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a2:0x285:0x0]: returning size 4096 00000004:00200000:3.0:1787508613.482228:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787508613.482250:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32b44 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x285:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbce expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.482263:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32b4b lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbce expref: 584 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.482270:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x285:0x0].0x0 (ffff9090d36fde00) 00010000:00010000:3.0:1787508613.482272:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508613.482274:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fc00, rc 0) 00000100:00100000:3.0:1787508613.482295:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336023:x1874324509465600:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 774us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.482299:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480077568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787508613.482300:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93591 00000100:00100000:0.0:1787508613.485360:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508613.485478:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509465856 00000100:00100000:2.0:1787508613.485488:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509465856 00000100:00100000:2.0:1787508613.485545:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93592 00000100:00100000:2.0:1787508613.485554:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:336023:x1874324509465856:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:2.0:1787508613.485609:0:230618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508613.485634:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f32b05 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbab expref: 644 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.485651:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d0:0x0].0x0 (ffff9090cda8af00) 00010000:00010000:2.0:1787508613.485655:0:230618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508613.485676:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f32b52 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.485689:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f32b13 lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbb2 expref: 6 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.485697:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f32b52 lrc: 4/0,1 mode: --/PW res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.485728:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f32b13 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbb2 expref: 6 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.485742:0:230618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f32b13 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbb2 expref: 6 pid: 205405 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.485757:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b60a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:230618:1874324480077696:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508613.485862:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9240 going to sleep for 11 seconds 00000100:00100000:2.0:1787508613.487916:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.488373:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509466112 00000100:00100000:0.0:1787508613.488433:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509466112 00000100:00100000:0.0:1787508613.488540:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93593 00000100:00100000:0.0:1787508613.488552:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:336022:x1874324509466112:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508613.488579:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508613.488605:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f32b59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadbd5 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508613.488768:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d0:0x0]: returning size 4096 00010000:00010000:0.0:1787508613.488929:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f32b59 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbd5 expref: 9 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.488976:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090c6913200) 00010000:00010000:0.0:1787508613.488980:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508613.488986:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f32b59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbd5 expref: 9 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.489009:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6800, rc 0) 00000100:00100000:0.0:1787508613.489069:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336022:x1874324509466112:12345-192.168.201.30@tcp:101:rm.0 Request processed in 519us (1161us total) trans 8589961980 rc 301/301 00000100:00100000:0.0:1787508613.489077:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93593 00000100:00100000:2.0:1787508613.492487:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508613.492538:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508613.492564:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509466368 00000100:00100000:2.0:1787508613.492572:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509466368 00000100:00100000:2.0:1787508613.492613:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93594 00000100:00100000:2.0:1787508613.492622:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d74ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336022:x1874324509466368:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508613.492647:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.492668:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa600/0xb126349c40f32b67 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadbdc expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.492734:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509466240 00000100:00100000:1.0:1787508613.492739:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509466240 00010000:00010000:1.0:1787508613.492761:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f32b13 lrc: 5/0,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbb2 expref: 10 pid: 205405 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.492765:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f32b6e lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.492793:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27781 00010000:00010000:2.0:1787508613.492794:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f32b52 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.492800:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d74b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2400:x1874324509466240:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508613.492803:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f32b6e lrc: 4/1,0 mode: --/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.492809:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508613.492814:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f32b13 lrc: 5/0,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbb2 expref: 10 pid: 205405 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.492819:0:202228:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f32b52 lrc: 4/0,1 mode: --/PW res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.492825:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f32b13 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbb2 expref: 10 pid: 205405 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.492925:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b60a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:230618:1874324480077696:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508613.493419:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f32b6e lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.494485:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f32b52 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.495052:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f32b13 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbb2 expref: 10 pid: 205405 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.495073:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d0:0x0].0x0 (ffff9090cda8af00) 00010000:00010000:1.0:1787508613.495078:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f32b52 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.495087:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f32b52 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.495094:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f32b52 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.495102:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f32b6e lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.495108:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f32b6e lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.495140:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508613.495166:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f32b52 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.495173:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f32b52 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.495201:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f32b75 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x28f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.495278:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d74b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2400:x1874324509466240:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 2476us (2798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.495287:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27781 00010000:00010000:2.0:1787508613.495409:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f32b21 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbb9 expref: 8 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.495420:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f32b36 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbc0 expref: 643 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.495428:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f32b75 lrc: 5/0,1 mode: --/PW res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.495475:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f32b36 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbc0 expref: 643 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.495492:0:230618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f32b36 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbc0 expref: 643 pid: 203348 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.495507:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d74b9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:230618:1874324480077824:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508613.496390:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f32b21 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbb9 expref: 8 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.496404:0:230618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f32b21 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbb9 expref: 8 pid: 230618 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.496416:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d74baa00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:230618:1874324480077952:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508613.496455:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9840 going to sleep for 11 seconds 00000100:00100000:2.0:1787508613.501654:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508613.501700:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.501774:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509466496 00000100:00100000:1.0:1787508613.501793:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509466496 00010000:00010000:1.0:1787508613.501832:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f32b21 lrc: 5/0,0 mode: PR/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbb9 expref: 9 pid: 230618 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.501867:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509466624 00000100:00100000:1.0:1787508613.501870:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509466624 00010000:00010000:1.0:1787508613.501884:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f32b36 lrc: 5/0,0 mode: PR/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbc0 expref: 644 pid: 203348 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.501917:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27782 00000100:00100000:1.0:1787508613.501927:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d74bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2401:x1874324509466496:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508613.501961:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508613.501969:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f32b21 lrc: 5/0,0 mode: PR/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbb9 expref: 9 pid: 230618 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.501983:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f32b21 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbb9 expref: 9 pid: 230618 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.502006:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28f:0x0].0x0 (ffff9090cda8aa00) 00010000:00010000:1.0:1787508613.502011:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f32b75 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.502025:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f32b75 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.502032:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508613.502080:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d74bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2401:x1874324509466496:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 154us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.502087:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27782 00000100:00100000:1.0:1787508613.502104:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27783 00000100:00100000:1.0:1787508613.502110:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d74b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:2400:x1874324509466624:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508613.502118:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508613.502123:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f32b36 lrc: 5/0,0 mode: PR/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbc0 expref: 644 pid: 203348 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.502135:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f32b36 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbc0 expref: 644 pid: 203348 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.502147:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28f:0x0].0x0 (ffff9090cda8aa00) 00010000:00010000:1.0:1787508613.502150:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f32b75 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.502159:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f32b75 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.502167:0:202212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f32b75 lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.502184:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508613.502204:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d74b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:2400:x1874324509466624:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 94us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.502223:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27783 00010000:00010000:0.0:1787508613.505044:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f32b21 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbb9 expref: 8 pid: 230618 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.505071:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d74baa00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:230618:1874324480077952:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508613.505092:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f32b36 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbc0 expref: 643 pid: 203348 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.505103:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d74b9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:230618:1874324480077824:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508613.505131:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f32b75 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.505142:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f32b75 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.505149:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f32b75 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.505215:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6800/0xb126349c40f32b7c lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.505225:0:230618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6800/0xb126349c40f32b7c lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x0 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.505242:0:230618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6800/0xb126349c40f32b7c lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.505263:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce783100 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480078080:0@lo:101:mdt00_006.0 00000100:00100000:0.0:1787508613.505324:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.505614:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090ca6db780 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.505715:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480078080 00000100:00100000:3.0:1787508613.505722:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480078080 00000100:00100000:3.0:1787508613.505826:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29606 00000100:00100000:3.0:1787508613.505837:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:230618:x1874324480078080:12345-0@lo:101:mdt00_006.0 00010000:00010000:3.0:1787508613.505853:0:202232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.505869:0:202232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32b83 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f32b7c expref: -99 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.505904:0:202232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32b3d lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbc7 expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.505915:0:202232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32b4b lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbce expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.505925:0:202232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32b83 lrc: 5/0,0 mode: --/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f32b7c expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.505978:0:202232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32b4b lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbce expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.505992:0:202232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32b4b lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbce expref: 583 pid: 202227 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.506003:0:202232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c993c700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:202232:1874324480078208:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508613.506075:0:202232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32b3d lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbc7 expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.506085:0:202232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32b3d lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbc7 expref: 12 pid: 205405 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.506098:0:202232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c993ea00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:202232:1874324480078336:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508613.506121:0:202232:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88240 going to sleep for 11 seconds 00000100:00100000:2.0:1787508613.509918:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508613.509993:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.510085:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509466752 00000100:00100000:0.0:1787508613.510095:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509466752 00010000:00010000:0.0:1787508613.510136:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32b4b lrc: 5/0,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbce expref: 584 pid: 202227 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.510170:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509466880 00000100:00100000:0.0:1787508613.510172:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509466880 00010000:00010000:0.0:1787508613.510184:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32b3d lrc: 5/0,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbc7 expref: 13 pid: 205405 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.510204:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27784 00000100:00100000:0.0:1787508613.510226:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d74bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:2401:x1874324509466752:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508613.510240:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508613.510247:0:229383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32b4b lrc: 5/0,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbce expref: 584 pid: 202227 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.510261:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32b4b lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbce expref: 584 pid: 202227 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.510284:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x285:0x0].0x0 (ffff9090d36fde00) 00010000:00010000:0.0:1787508613.510291:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32b83 lrc: 3/0,0 mode: --/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f32b7c expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.510302:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32b83 lrc: 3/0,0 mode: --/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f32b7c expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.510310:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508613.510360:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d74bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:2401:x1874324509466752:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 147us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.510367:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27784 00000100:00100000:0.0:1787508613.510403:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27785 00000100:00100000:0.0:1787508613.510410:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d74b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2401:x1874324509466880:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508613.510418:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508613.510423:0:229383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32b3d lrc: 5/0,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbc7 expref: 13 pid: 205405 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.510432:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32b3d lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbc7 expref: 13 pid: 205405 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.510444:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x285:0x0].0x0 (ffff9090d36fde00) 00010000:00010000:0.0:1787508613.510448:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32b83 lrc: 3/0,0 mode: --/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f32b7c expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.510457:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32b83 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xb126349c40f32b7c expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.510476:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32b83 lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xb126349c40f32b7c expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.510516:0:229383:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32b83 lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32b7c expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.510530:0:229383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce781880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:229383:1874324480078464:0@lo:105: 00000100:00100000:0.0:1787508613.510575:0:229383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.510617:0:229383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090ca6db480 going to sleep for 11 seconds 00000100:00100000:0.0:1787508613.510637:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480078464 00000100:00100000:0.0:1787508613.510641:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480078464 00000100:00100000:0.0:1787508613.510670:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18121 00000100:00100000:0.0:1787508613.510676:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce783480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:229383:x1874324480078464:12345-0@lo:105: 00010000:00010000:0.0:1787508613.510686:0:202210:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6800/0xb126349c40f32b7c lrc: 4/0,1 mode: --/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32b83 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.510696:0:202210:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6800/0xb126349c40f32b7c lrc: 4/0,1 mode: --/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32b83 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.510705:0:202210:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6800/0xb126349c40f32b7c lrc: 4/0,1 mode: --/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32b83 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.510713:0:202210:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6800/0xb126349c40f32b7c lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f32b83 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.510721:0:202210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6800/0xb126349c40f32b7c lrc: 5/0,1 mode: PW/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f32b83 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.510730:0:202210:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6800/0xb126349c40f32b7c lrc: 5/0,1 mode: PW/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f32b83 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.510745:0:202210:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d56f6800) 00000100:00100000:0.0:1787508613.510777:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce783480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:229383:x1874324480078464:12345-0@lo:105: Request processed in 101us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.511123:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18121 00000100:00100000:0.0:1787508613.511175:0:229383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce781880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:229383:1874324480078464:0@lo:105: 00010000:00010000:0.0:1787508613.511190:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508613.511522:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d74b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2401:x1874324509466880:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1111us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.511531:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27785 00010000:00010000:3.0:1787508613.511672:0:202232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32b4b lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbce expref: 583 pid: 202227 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.511689:0:202232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c993c700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:202232:1874324480078208:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508613.511702:0:202232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32b3d lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbc7 expref: 12 pid: 205405 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.511713:0:202232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c993ea00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:202232:1874324480078336:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508613.511734:0:202232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32b83 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32b7c expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.511743:0:202232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x285:0x0].0x0 (ffff9090d36fde00) 00010000:00010000:3.0:1787508613.511746:0:202232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508613.511749:0:202232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e800, rc 0) 00000100:00100000:3.0:1787508613.511966:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:230618:x1874324480078080:12345-0@lo:101:mdt00_006.0 Request processed in 6103us (6613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.511973:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29606 00000100:00100000:0.0:1787508613.512639:0:230618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944044 gen 2 00000004:00080000:0.0:1787508613.512645:0:230618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944044 committed transno 12884944044 00000100:00100000:0.0:1787508613.512670:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce783100 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480078080:0@lo:101:mdt00_006.0 00010000:00010000:0.0:1787508613.512688:0:230618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6800/0xb126349c40f32b7c lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32b83 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787508613.513051:0:230618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xf:0x0].37, 344 off71224 00000040:00080000:0.0:1787508613.513104:0:230618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x5:0x0].580, 552 off736104 00000004:00080000:0.0:1787508613.513108:0:230618:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090ca6db780 with version 13587 00000004:00080000:2.0:1787508613.513864:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13587 rpc_version 13587 00000020:00100000:2.0:1787508613.514021:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787508613.514032:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d74bb100 x1874324480078720/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1528/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787508613.514057:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d74bb100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480078720:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508613.514108:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508613.514138:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787508613.514155:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480078720 00000100:00100000:1.0:1787508613.514162:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480078720 00000100:00100000:1.0:1787508613.514206:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29607 00000100:00100000:1.0:1787508613.514215:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d74b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:202961:x1874324480078720:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508613.514379:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d74b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202961:x1874324480078720:12345-0@lo:1000:osp_up0-1.0 Request processed in 165us (268us total) trans 12884944045 rc 0/0 00000100:00100000:1.0:1787508613.514388:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29607 00000100:00100000:2.0:1787508613.514533:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d74bb100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480078720:0@lo:1000:osp_up0-1.0 00000004:00010000:0.0:1787508613.514573:0:230618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fdd8646c reply state 000000000b4cb184 transno 8589961981 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f32b75 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.514593:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f32b75 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.514600:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28f:0x0].0x0 (ffff9090cda8aa00) 00010000:00010000:0.0:1787508613.514602:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787508613.514605:0:230618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787508613.514611:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6800/0xb126349c40f32b7c lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32b83 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.514617:0:230618:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6800/0xb126349c40f32b7c lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32b83 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787508613.514624:0:230618:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x285:0x0] 00000004:00010000:0.0:1787508613.514630:0:230618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fdd8646c reply state 000000000b4cb184 transno 8589961981 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f32b52 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.514636:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f32b52 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.514642:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d0:0x0].0x0 (ffff9090cda8af00) 00010000:00010000:0.0:1787508613.514644:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508613.514647:0:230618:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f32b6e lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.514656:0:230618:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f32b6e lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.514661:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f32b6e lrc: 4/1,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.514689:0:230618:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1787508613.514699:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d0:0x0]: returning size 4096 00010000:00010000:2.0:1787508613.514713:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f32b6e lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.514720:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f32b6e lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508613.514800:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d0:0x0]: returning size 4096 00000004:00200000:2.0:1787508613.514807:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1787508613.514823:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f32b6e lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.514854:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa600/0xb126349c40f32b67 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbdc expref: 8 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.514874:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f32b6e lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbdc expref: 7 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.514881:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d0:0x0].0x0 (ffff9090cda8af00) 00010000:00010000:2.0:1787508613.514883:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508613.514885:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abe00, rc 0) 00000100:00100000:2.0:1787508613.514908:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d74ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:336022:x1874324509466368:12345-192.168.201.30@tcp:101:rm.0 Request processed in 22287us (22369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.514916:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93594 00000100:00100000:2.0:1787508613.517428:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.517531:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:336023:x1874324509465856:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 29226us (29428us total) trans 8589961981 rc 0/0 00000100:00100000:0.0:1787508613.517544:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93592 00000100:00100000:0.0:1787508613.517585:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509467008 00000100:00100000:0.0:1787508613.517594:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509467008 00000100:00100000:0.0:1787508613.517649:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93595 00000100:00100000:0.0:1787508613.517658:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d74baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:336022:x1874324509467008:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508613.517679:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508613.517703:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f32b8a lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadbe3 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.517765:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f32b91 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.517827:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f32b91 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.517841:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f32b91 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508613.518134:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x28f:0x0]: returning size 4096 00000004:00200000:0.0:1787508613.518141:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508613.518188:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f32b8a lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbe3 expref: 9 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.518204:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f32b91 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbe3 expref: 8 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.518285:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28f:0x0].0x0 (ffff9090cda8aa00) 00010000:00010000:0.0:1787508613.518288:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508613.518293:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7c00, rc 0) 00000100:00100000:0.0:1787508613.518367:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d74baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336022:x1874324509467008:12345-192.168.201.30@tcp:101:rm.0 Request processed in 709us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.518373:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93595 00000100:00100000:1.0:1787508613.523734:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.523823:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509467136 00000100:00100000:3.0:1787508613.523833:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509467136 00000100:00100000:3.0:1787508613.523890:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93596 00000100:00100000:3.0:1787508613.523900:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336022:x1874324509467136:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508613.523920:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.523977:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32b98 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x285:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadbea expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.524040:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32b9f lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.524056:0:209004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32b83 lrc: 2/0,0 mode: PW/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32b7c expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.524065:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32b9f lrc: 4/1,0 mode: --/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.524098:0:209004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32b83 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f32b7c expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.524114:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c993ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480078848:0@lo:104: 00000100:00100000:3.0:1787508613.524169:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.524205:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88240 going to sleep for 11 seconds 00000100:00100000:2.0:1787508613.525198:0:229363:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787508613.525218:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480078848 00000100:00100000:2.0:1787508613.525225:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480078848 00000100:00100000:2.0:1787508613.525262:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18122 00000100:00100000:2.0:1787508613.525271:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9bd4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:209004:x1874324480078848:12345-0@lo:104: 00010000:00010000:2.0:1787508613.525286:0:229363:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6800/0xb126349c40f32b7c lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f32b83 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.525360:0:229363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787508613.525367:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9bd4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:209004:x1874324480078848:12345-0@lo:104: Request processed in 98us (1198us total) trans 0 rc 0/0 00010000:00010000:0.0:1787508613.525368:0:202215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1787508613.525374:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18122 00010000:00010000:0.0:1787508613.525384:0:202215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6800/0xb126349c40f32b7c lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f32b83 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.525398:0:202215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6800 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:0.0:1787508613.525404:0:202215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6800/0xb126349c40f32b7c lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f32b83 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508613.525414:0:202215:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6800/0xb126349c40f32b7c lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f32b83 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.525444:0:202215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6800/0xb126349c40f32b7c lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f32b83 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.525452:0:202215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787508613.525495:0:202215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6800/0xb126349c40f32b7c lrc: 1/0,0 mode: --/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f32b83 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.525503:0:202215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6800/0xb126349c40f32b7c lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f32b83 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.525522:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508613.525524:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508613.525527:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508613.525630:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787508613.525646:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480078976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508613.525684:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.525848:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c993ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480078848:0@lo:104: 00010000:00010000:3.0:1787508613.525868:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32b9f lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.525927:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480078976 00000100:00100000:0.0:1787508613.525932:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480078976 00010000:00010000:0.0:1787508613.525992:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32b83 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f32b7c expref: 8 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.526023:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27786 00000100:00100000:0.0:1787508613.526031:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3618:x1874324480078976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508613.526042:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1787508613.529307:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944045 is committed 00010000:00010000:3.0:1787508613.530745:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32b83 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f32b7c expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.530766:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x285:0x0].0x0 (ffff9090d36fde00) 00010000:00010000:3.0:1787508613.530771:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32b9f lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.530789:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32b9f lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.530798:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32b9f lrc: 4/1,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.530832:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508613.531111:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480078976:12345-0@lo:103:ldlm_bl.0 Request processed in 5079us (5425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.531122:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27786 00000100:00100000:2.0:1787508613.531282:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.531385:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509467392 00000100:00100000:3.0:1787508613.531394:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509467392 00000100:00100000:3.0:1787508613.531442:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93597 00000100:00100000:3.0:1787508613.531452:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336024:x1874324509467392:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508613.531486:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.531504:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32ba6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadbf1 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.531579:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32bad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.531591:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32bad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.531599:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32bad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.531609:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32b9f lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.531613:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32bb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.531617:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32b9f lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.531620:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.531629:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508613.531663:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a2:0x285:0x0]: returning size 4096 00000004:00200000:1.0:1787508613.531668:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787508613.531694:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32bad lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.531701:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32bad lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.531704:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32b98 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x285:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbea expref: 14 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.531707:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32bad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.531714:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32bad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.531720:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fa00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.531720:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32b9f lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbea expref: 13 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.531724:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32bad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.531727:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x285:0x0].0x0 (ffff9090d36fde00) 00010000:00010000:1.0:1787508613.531730:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508613.531732:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32bad lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.531733:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ea00, rc 0) 00010000:00010000:3.0:1787508613.531740:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.531743:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.531746:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32bad lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.531751:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32bad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.531759:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.531764:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32bb4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.531770:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32bb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.531775:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f200 already unused, calling callback (ffffffffc19024f0) 00000100:00100000:1.0:1787508613.531792:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336022:x1874324509467136:12345-192.168.201.30@tcp:101:rm.0 Request processed in 7894us (8070us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.531800:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93596 00010000:00010000:3.0:1787508613.531885:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32bb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.531895:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32bb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.531904:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xce5b6a33 (ffff9090ccb87800) 00010000:00010000:3.0:1787508613.531906:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.531909:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32bb4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.531914:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32bb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.531965:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32ba6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbf1 expref: 584 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.531975:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.531977:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508613.531982:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32ba6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbf1 expref: 584 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.531996:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e400, rc 0) 00000100:00100000:3.0:1787508613.532019:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336024:x1874324509467392:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 569us (739us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508613.532025:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93597 00000100:00100000:0.0:1787508613.532163:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480078976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508613.535151:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508613.535275:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509467520 00000100:00100000:2.0:1787508613.535283:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509467520 00000100:00100000:2.0:1787508613.535331:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15389 00000100:00100000:2.0:1787508613.535341:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde30450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336022:x1874324509467520:12345-192.168.201.30@tcp:37:rm.0 00000100:00100000:2.0:1787508613.537845:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.538684:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde30450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336022:x1874324509467520:12345-192.168.201.30@tcp:37:rm.0 Request processed in 3340us (3535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.538696:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15389 00000100:00100000:0.0:1787508613.539066:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509467776 00000100:00100000:0.0:1787508613.539074:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509467776 00000100:00100000:0.0:1787508613.539129:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93598 00000100:00100000:0.0:1787508613.539139:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336024:x1874324509467776:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508613.539158:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508613.539177:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32bbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadbf8 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.539261:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32bc2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.539276:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32bc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.539287:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32bc2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.539302:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32bc9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.539316:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.539323:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.539390:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32bc2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.539398:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32bc2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.539405:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32bc2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.539411:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32bc2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.539417:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.539421:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32bc2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.539428:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32bc2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.539440:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.539443:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.539447:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32bc2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.539452:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32bc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.539474:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.539480:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32bc9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.539485:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.539490:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.539492:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.539497:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32bc9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.539503:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaf7dd568 (ffff9090c6913200) 00010000:00010000:0.0:1787508613.539505:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.539507:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32bc9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.539512:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32bc9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.539544:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32bbb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbf8 expref: 584 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.539554:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.539562:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508613.539566:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32bbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbf8 expref: 584 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.539575:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7600, rc 0) 00000100:00100000:0.0:1787508613.539606:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336024:x1874324509467776:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 468us (1768us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508613.539616:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93598 00000100:00100000:2.0:1787508613.544473:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.544871:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509468032 00000100:00100000:3.0:1787508613.544880:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509468032 00000100:00100000:2.0:1787508613.545268:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93599 00000100:00100000:2.0:1787508613.545281:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c92ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336024:x1874324509468032:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508613.545301:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.545323:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32bd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadbff expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.545426:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32bd7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.545441:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32bd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.545453:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32bd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.545480:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32bde lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.545487:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32bde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.545493:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32bde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.545552:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32bd7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.545561:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32bd7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.545567:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32bd7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.545573:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32bd7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.545579:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.545584:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32bd7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.545592:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32bd7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.545603:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.545606:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.545611:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32bd7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.545617:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32bd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.545630:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32bde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.545636:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32bde lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.545642:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32bde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.545647:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.545650:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32bde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.545655:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32bde lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.545662:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3e9f33b0 (ffff9090c98d9500) 00010000:00010000:2.0:1787508613.545664:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.545667:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32bde lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.545671:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32bde lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.545704:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32bd0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbff expref: 584 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.545713:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.545715:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508613.545719:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32bd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbff expref: 584 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.545727:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aac00, rc 0) 00000100:00100000:2.0:1787508613.546097:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c92ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336024:x1874324509468032:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 817us (1641us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508613.546105:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93599 00000100:00100000:3.0:1787508613.547834:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.547922:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509468160 00000100:00100000:1.0:1787508613.547932:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509468160 00000100:00100000:1.0:1787508613.547998:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15390 00000100:00100000:1.0:1787508613.548008:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336022:x1874324509468160:12345-192.168.201.30@tcp:37:rm.0 00000100:00100000:1.0:1787508613.549717:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508613.549781:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509468416 00000100:00100000:2.0:1787508613.549790:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509468416 00000100:00100000:2.0:1787508613.549871:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93600 00000100:00100000:2.0:1787508613.549881:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336024:x1874324509468416:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508613.549909:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.549931:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f32be5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadc06 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.550037:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32bec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.550055:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32bec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.550066:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32bec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.550079:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f32bf3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.550086:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f32bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.550092:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f32bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.550139:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32bec lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.550145:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32bec lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.550152:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32bec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.550158:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32bec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.550165:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.550169:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32bec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.550176:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32bec lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.550187:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.550190:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.550194:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32bec lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.550213:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32bec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.550227:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f32bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.550233:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f32bf3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.550238:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f32bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.550243:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.550246:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f32bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.550252:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f32bf3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.550260:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ad43c78 (ffff9090c98d9600) 00010000:00010000:2.0:1787508613.550262:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.550265:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f32bf3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.550270:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f32bf3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.550304:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f32be5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc06 expref: 584 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.550313:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.550316:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508613.550319:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f32be5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc06 expref: 584 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.550327:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab800, rc 0) 00000100:00100000:2.0:1787508613.550382:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336024:x1874324509468416:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 502us (672us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508613.550390:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93600 00000100:00100000:1.0:1787508613.555300:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336022:x1874324509468160:12345-192.168.201.30@tcp:37:rm.0 Request processed in 7284us (7464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.555311:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15390 00000100:00100000:2.0:1787508613.556366:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.556517:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509468672 00000100:00100000:0.0:1787508613.556527:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509468672 00000100:00100000:0.0:1787508613.556596:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93601 00000100:00100000:0.0:1787508613.556608:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c92cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336024:x1874324509468672:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508613.556630:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508613.556661:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32bfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadc0d expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.556738:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32c01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.556752:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32c01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.556763:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32c01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.556789:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32c08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.556796:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32c08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.556803:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32c08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.556862:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32c01 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.556874:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32c01 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.556880:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32c01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.556887:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32c01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.556903:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.556907:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32c01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.556915:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32c01 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.556927:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.556931:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.556935:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32c01 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.556960:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32c01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.556973:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32c08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.556980:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32c08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.556986:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32c08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.556991:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.556994:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32c08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.556997:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32c08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.557002:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbfff8436 (ffff9090c6913200) 00010000:00010000:0.0:1787508613.557004:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.557006:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32c08 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.557010:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32c08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.557034:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32bfa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc0d expref: 584 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.557040:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.557041:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508613.557043:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32bfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc0d expref: 584 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.557049:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7600, rc 0) 00000100:00100000:0.0:1787508613.557090:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c92cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336024:x1874324509468672:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 484us (728us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508613.557097:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93601 00000100:00100000:2.0:1787508613.560086:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.560162:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509468928 00000100:00100000:1.0:1787508613.560174:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509468928 00000100:00100000:1.0:1787508613.560238:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15391 00000100:00100000:1.0:1787508613.560249:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c92cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336022:x1874324509468928:12345-192.168.201.30@tcp:35:rm.0 00000100:00100000:1.0:1787508613.561197:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c92cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:336022:x1874324509468928:12345-192.168.201.30@tcp:35:rm.0 Request processed in 943us (1116us total) trans 8589961982 rc 0/0 00000100:00100000:1.0:1787508613.561215:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15391 00000100:00100000:3.0:1787508613.561854:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.562343:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509469184 00000100:00100000:1.0:1787508613.562352:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509469184 00000100:00100000:1.0:1787508613.563645:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93602 00000100:00100000:1.0:1787508613.563663:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336024:x1874324509469184:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508613.563684:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.563705:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32c0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadc14 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.563775:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32c16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.563801:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32c16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.563812:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32c16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.563828:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32c1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.563835:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32c1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.563841:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32c1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.563899:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32c16 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.563906:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32c16 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.563912:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32c16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.563922:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32c16 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.563927:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247bc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.563931:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32c16 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.564001:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32c16 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.564016:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.564019:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.564024:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32c16 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.564030:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32c16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.564043:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32c1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.564049:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32c1d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.564055:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32c1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.564060:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.564063:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32c1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.564073:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32c1d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.564080:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x594a0ca2 (ffff9090d3c50f00) 00010000:00010000:1.0:1787508613.564082:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.564085:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32c1d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.564091:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32c1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.564122:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32c0f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc14 expref: 584 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.564132:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.564134:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508613.564138:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32c0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc14 expref: 584 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.564146:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a600, rc 0) 00000100:00100000:1.0:1787508613.564307:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336024:x1874324509469184:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 648us (2452us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508613.564314:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93602 00000100:00100000:2.0:1787508613.565555:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.565649:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509469312 00000100:00100000:3.0:1787508613.565658:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509469312 00000100:00100000:3.0:1787508613.565748:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93603 00000100:00100000:3.0:1787508613.565759:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c92cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336022:x1874324509469312:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508613.565788:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.565807:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32c24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadc1b expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.565863:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32c2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.565876:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32c2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.565887:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32c2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.565901:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32c32 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.565913:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32c32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.565919:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32c32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.566159:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32c39 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.566170:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32c39 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.566178:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32c39 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508613.566199:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32c39 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.566328:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32c2b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.566338:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32c2b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.566345:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32c2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.566352:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32c2b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.566360:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.566363:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32c2b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.566380:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32c2b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.566521:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.566524:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.566528:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32c2b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.566535:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32c2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.566549:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32c32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.566555:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32c32 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.566560:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32c32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.566564:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fa00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.566567:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32c32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.566572:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32c32 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.566578:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090ccb87800) 00010000:00010000:3.0:1787508613.566581:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.566583:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32c32 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.566590:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32c32 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.566620:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32c24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc1b expref: 15 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.566633:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32c39 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc1b expref: 14 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.566639:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d0:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:3.0:1787508613.566641:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508613.566644:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e800, rc 0) 00000100:00100000:3.0:1787508613.566746:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c92cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336022:x1874324509469312:12345-192.168.201.30@tcp:101:rm.0 Request processed in 988us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.566753:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93603 00000100:00100000:0.0:1787508613.568340:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.570932:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.571100:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508613.571283:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509469568 00000100:00100000:2.0:1787508613.571294:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509469568 00000100:00100000:2.0:1787508613.571356:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509469696 00000100:00100000:2.0:1787508613.571360:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509469696 00000100:00100000:2.0:1787508613.571496:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93604 00000100:00100000:2.0:1787508613.571508:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336024:x1874324509469568:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508613.571529:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.571551:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f32c40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadc22 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.571628:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32c47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.571644:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32c47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.571655:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32c47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.571669:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32c4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.571677:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32c4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.571684:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32c4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.571744:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32c47 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.571752:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32c47 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.571759:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32c47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.571766:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32c47 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.571773:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.571789:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32c47 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.571797:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32c47 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.571811:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.571814:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.571819:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32c47 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.571826:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32c47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.571841:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32c4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.571848:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32c4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.571853:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32c4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.571858:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.571860:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32c4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.571865:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32c4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.571871:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe67841 (ffff9090c98d9600) 00010000:00010000:2.0:1787508613.571873:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.571876:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32c4e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.571881:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32c4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.571915:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f32c40 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc22 expref: 584 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.571924:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.571927:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508613.571930:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f32c40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc22 expref: 584 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.571963:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aae00, rc 0) 00000100:00100000:2.0:1787508613.572020:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336024:x1874324509469568:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 514us (3690us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508613.572028:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93604 00000100:00100000:2.0:1787508613.572048:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93605 00000100:00100000:2.0:1787508613.572057:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:336022:x1874324509469696:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508613.572070:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.572080:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f32c55 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadc29 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.572116:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa800/0xb126349c40f32c5c lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.572125:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa800/0xb126349c40f32c5c lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.572134:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa800/0xb126349c40f32c5c lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508613.572226:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d0:0x0]: returning size 4096 00000004:00200000:2.0:1787508613.572232:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787508613.572264:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f32c55 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc29 expref: 11 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.572277:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa800/0xb126349c40f32c5c lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc29 expref: 10 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.572284:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d0:0x0].0x0 (ffff9090cda8af00) 00010000:00010000:2.0:1787508613.572286:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508613.572288:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa800, rc 0) 00000100:00100000:2.0:1787508613.572310:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:336022:x1874324509469696:12345-192.168.201.30@tcp:101:rm.0 Request processed in 255us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.572316:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93605 00000100:00100000:3.0:1787508613.572587:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509469824 00000100:00100000:3.0:1787508613.572593:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509469824 00000100:00100000:3.0:1787508613.572634:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9770 00000100:00100000:3.0:1787508613.572642:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c1ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2401:x1874324509469824:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508613.572652:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508613.572666:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32c39 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc1b expref: 14 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.572678:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d0:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:3.0:1787508613.572682:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508613.572703:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c1ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2401:x1874324509469824:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 62us (1604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.572710:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9770 00000100:00100000:2.0:1787508613.576063:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508613.576101:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.576185:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509469952 00000100:00100000:1.0:1787508613.576195:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509469952 00000100:00100000:1.0:1787508613.576273:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9771 00000100:00100000:1.0:1787508613.576285:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2400:x1874324509469952:12345-192.168.201.30@tcp:103:rm.0 00010000:00010000:1.0:1787508613.576301:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508613.576326:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f32af0 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb9d expref: 13 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.576346:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d0:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:1.0:1787508613.576351:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508613.576413:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2400:x1874324509469952:12345-192.168.201.30@tcp:103:rm.0 Request processed in 129us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.576420:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9771 00000100:00100000:3.0:1787508613.577739:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509470208 00000100:00100000:3.0:1787508613.577750:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509470208 00000100:00100000:2.0:1787508613.577893:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.578215:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509470464 00000100:00100000:3.0:1787508613.578220:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509470464 00000100:00100000:3.0:1787508613.578256:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93606 00000100:00100000:3.0:1787508613.578265:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:336022:x1874324509470208:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:3.0:1787508613.578316:0:230618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787508613.578339:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa800/0xb126349c40f32c5c lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc29 expref: 10 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.578362:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f32b6e lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbdc expref: 9 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.578385:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d0:0x0].0x0 (ffff9090cda8af00) 00010000:00010000:3.0:1787508613.578390:0:230618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508613.578436:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f000/0xb126349c40f32c63 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.578444:0:230618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f000/0xb126349c40f32c63 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.578454:0:230618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f000/0xb126349c40f32c63 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.578487:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c993df80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480079104:0@lo:101:mdt00_006.0 00000100:00100000:3.0:1787508613.578538:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.578574:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480079104 00000100:00100000:3.0:1787508613.578578:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480079104 00000100:00100000:3.0:1787508613.578607:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29608 00000100:00100000:3.0:1787508613.578614:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:230618:x1874324480079104:12345-0@lo:101:mdt00_006.0 00010000:00010000:3.0:1787508613.578630:0:202231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.578644:0:202231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32c6a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f32c63 expref: -99 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.578665:0:202231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f329ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb57 expref: 11 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.578674:0:202231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f32a33 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb6c expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.578685:0:202231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32c6a lrc: 5/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f32c63 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.578708:0:202231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f32a33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb6c expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.578722:0:202231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f32a33 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb6c expref: 583 pid: 209004 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.578733:0:202231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c993f800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480079232:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508613.578812:0:202231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f329ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb57 expref: 11 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.578822:0:202231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f329ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb57 expref: 11 pid: 202228 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.578832:0:202231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c993d880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480079360:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508613.578855:0:202231:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88600 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.578872:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.578885:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93607 00000100:00100000:3.0:1787508613.578894:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336024:x1874324509470464:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508613.578903:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.578911:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32c71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadc30 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.578990:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32c78 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.579001:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32c78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.579010:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32c78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.579024:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32c7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.579033:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32c7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.579040:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32c7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.579102:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32c78 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.579111:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32c78 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.579118:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32c78 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.579125:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32c78 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.579131:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.579136:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32c78 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.579144:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32c78 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.579154:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.579157:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.579162:0:209004:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32c6a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f32c63 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.579171:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32c78 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.579178:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32c78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.579191:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32c7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.579197:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32c7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.579203:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32c7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.579208:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.579211:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32c7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.579217:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32c7f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.579225:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x90ba0166 (ffff9090ccb87100) 00010000:00010000:3.0:1787508613.579227:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.579230:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32c7f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.579236:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32c7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.579268:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32c71 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc30 expref: 584 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.579278:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.579281:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508613.579285:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32c71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc30 expref: 584 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.579294:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fc00, rc 0) 00000100:00100000:3.0:1787508613.579323:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336024:x1874324509470464:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 430us (1432us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508613.579333:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93607 00000100:00100000:3.0:1787508613.583344:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.583486:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.583567:0:202231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c993f800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480079232:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508613.583580:0:202231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c993d880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480079360:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508613.583617:0:202231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32c6a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32c63 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.583630:0:202231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.583633:0:202231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.583637:0:202231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32c6a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32c63 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.583648:0:202231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fe00, rc 0) 00000100:00100000:0.0:1787508613.583711:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:230618:x1874324480079104:12345-0@lo:101:mdt00_006.0 Request processed in 5096us (5171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.583720:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29608 00000100:00100000:0.0:1787508613.583774:0:230618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944045 gen 2 00000004:00080000:0.0:1787508613.583779:0:230618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944045 committed transno 12884944045 00000100:00100000:0.0:1787508613.583800:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c993df80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480079104:0@lo:101:mdt00_006.0 00010000:00010000:0.0:1787508613.583817:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f000/0xb126349c40f32c63 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32c6a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.583828:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f000/0xb126349c40f32c63 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32c6a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.585790:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509470592 00000100:00100000:2.0:1787508613.585804:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509470592 00010000:00010000:2.0:1787508613.585843:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f329ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb57 expref: 12 pid: 202228 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.585877:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509470720 00000100:00100000:2.0:1787508613.585881:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509470720 00010000:00010000:2.0:1787508613.585894:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f32a33 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb6c expref: 583 pid: 209004 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.585931:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27787 00000100:00100000:2.0:1787508613.585972:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d74b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2402:x1874324509470592:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508613.585988:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508613.585995:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f329ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb57 expref: 12 pid: 202228 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.586006:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f329ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb57 expref: 12 pid: 202228 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.586026:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f329ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb57 expref: 12 pid: 202228 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.586042:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.586048:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32c6a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32c63 expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.586058:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508613.586108:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d74b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2402:x1874324509470592:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 169us (2775us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.586115:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27787 00000100:00100000:2.0:1787508613.586134:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27788 00000100:00100000:2.0:1787508613.586141:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d74bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:2402:x1874324509470720:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508613.586148:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508613.586154:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f32a33 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb6c expref: 583 pid: 209004 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.586166:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f32a33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb6c expref: 583 pid: 209004 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.586178:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f32a33 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadb6c expref: 583 pid: 209004 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.586189:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.586193:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32c6a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32c63 expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.586202:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32c6a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f32c63 expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.586224:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32c6a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f32c63 expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.586257:0:202211:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32c6a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32c63 expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.586271:0:202211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9682300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:202211:1874324480079488:0@lo:105: 00000100:00100000:2.0:1787508613.586318:0:202211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508613.586353:0:202211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9300 going to sleep for 11 seconds 00000100:00100000:2.0:1787508613.586371:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480079488 00000100:00100000:2.0:1787508613.586375:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480079488 00000100:00100000:2.0:1787508613.586632:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18123 00000100:00100000:2.0:1787508613.586641:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9681c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:202211:x1874324480079488:12345-0@lo:105: 00010000:00010000:2.0:1787508613.586653:0:202210:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f000/0xb126349c40f32c63 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32c6a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.586663:0:202210:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f000/0xb126349c40f32c63 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32c6a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.586671:0:202210:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f000/0xb126349c40f32c63 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32c6a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.586679:0:202210:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f000/0xb126349c40f32c63 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f32c6a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.586686:0:202210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f000/0xb126349c40f32c63 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f32c6a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.586694:0:202210:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f000/0xb126349c40f32c63 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f32c6a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.586714:0:202210:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090e4c8f000) 00000100:00100000:2.0:1787508613.586749:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9681c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:202211:x1874324480079488:12345-0@lo:105: Request processed in 109us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.586756:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18123 00000100:00100000:2.0:1787508613.586866:0:202211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9682300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:202211:1874324480079488:0@lo:105: 00010000:00010000:2.0:1787508613.586881:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508613.586904:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d74bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:2402:x1874324509470720:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 764us (3419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.586911:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27788 00010000:00010000:2.0:1787508613.586933:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f000/0xb126349c40f32c63 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32c6a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.586970:0:230618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f000/0xb126349c40f32c63 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32c6a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787508613.586994:0:230618:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787508613.587033:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f32c86 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.587040:0:230618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f32c86 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.587049:0:230618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f32c86 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.587064:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9682300 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480079616:0@lo:101:mdt00_006.0 00000100:00100000:2.0:1787508613.587094:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508613.587121:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9300 going to sleep for 11 seconds 00000100:00100000:2.0:1787508613.587170:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.587305:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509470848 00000100:00100000:1.0:1787508613.587310:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509470848 00000100:00100000:1.0:1787508613.587343:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93608 00000100:00100000:1.0:1787508613.587351:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336024:x1874324509470848:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508613.587365:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.587390:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32c8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadc37 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.587445:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32c94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.587456:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32c6a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32c63 expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.587476:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32c94 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.587497:0:202228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32c6a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f32c63 expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.587507:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480079744:0@lo:104: 00000100:00100000:1.0:1787508613.587532:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.587556:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c740ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787508613.587568:0:229386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480079744 00000100:00100000:1.0:1787508613.587571:0:229386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480079744 00000100:00100000:1.0:1787508613.587599:0:229386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18124 00000100:00100000:1.0:1787508613.587604:0:229386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc620a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:202228:x1874324480079744:12345-0@lo:104: 00010000:00010000:1.0:1787508613.587613:0:229386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f000/0xb126349c40f32c63 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f32c6a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.587648:0:229386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787508613.587653:0:229386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc620a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:202228:x1874324480079744:12345-0@lo:104: Request processed in 49us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.587659:0:229386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18124 00000100:00100000:1.0:1787508613.587681:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480079744:0@lo:104: 00010000:00010000:1.0:1787508613.587694:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32c94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.587852:0:202214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787508613.587858:0:202214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f000/0xb126349c40f32c63 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f32c6a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.587865:0:202214:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9090e4c8f000 is referenced, will be cancelled later 00010000:00010000:2.0:1787508613.587868:0:202214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f000/0xb126349c40f32c63 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f32c6a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.587876:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508613.587877:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508613.587880:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508613.588684:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480079616 00000100:00100000:3.0:1787508613.588691:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480079616 00000100:00100000:3.0:1787508613.589193:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29609 00000100:00100000:3.0:1787508613.589205:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:230618:x1874324480079616:12345-0@lo:101:mdt00_006.0 00010000:00010000:3.0:1787508613.589229:0:203182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.589247:0:203182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32c9b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f32c86 expref: -99 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.589268:0:203182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32c9b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f32c86 expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.589282:0:203182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32c9b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32c86 expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.589290:0:203182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090ccb87800) 00010000:00010000:3.0:1787508613.589293:0:203182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.589296:0:203182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f200, rc 0) 00000100:00100000:3.0:1787508613.589355:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:230618:x1874324480079616:12345-0@lo:101:mdt00_006.0 Request processed in 153us (2260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.589362:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29609 00000100:00100000:2.0:1787508613.589525:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9682300 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480079616:0@lo:101:mdt00_006.0 00010000:00010000:2.0:1787508613.589541:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f32c86 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32c9b expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.589551:0:230618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f32c86 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32c9b expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787508613.589569:0:230618:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1787508613.589610:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9682300 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480079872:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1787508613.589646:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508613.589745:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787508613.589990:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480079872 00000100:00100000:1.0:1787508613.589996:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480079872 00000100:00100000:1.0:1787508613.590034:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29610 00000100:00100000:1.0:1787508613.590041:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:230618:x1874324480079872:12345-0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1787508613.590100:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:230618:x1874324480079872:12345-0@lo:1000:mdt00_006.0 Request processed in 59us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.590107:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29610 00000100:00100000:2.0:1787508613.590173:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9682300 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480079872:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1787508613.590223:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9682300 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480080000:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1787508613.590248:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508613.590269:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787508613.590309:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480080000 00000100:00100000:1.0:1787508613.590314:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480080000 00000100:00100000:1.0:1787508613.590331:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29611 00000100:00100000:1.0:1787508613.590337:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:230618:x1874324480080000:12345-0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1787508613.590438:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:230618:x1874324480080000:12345-0@lo:1000:mdt00_006.0 Request processed in 101us (189us total) trans 0 rc 1/1 00000100:00100000:1.0:1787508613.590445:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29611 00000100:00100000:2.0:1787508613.590611:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9682300 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480080000:0@lo:1000:mdt00_006.0 00010000:00010000:2.0:1787508613.590663:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f32ca2 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.590673:0:230618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f32ca2 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.590682:0:230618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f32ca2 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.590695:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9c380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480080128:0@lo:101:mdt00_006.0 00000100:00100000:2.0:1787508613.590718:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508613.590743:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9300 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.590802:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480080128 00000100:00100000:3.0:1787508613.590807:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480080128 00000100:00100000:3.0:1787508613.590831:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29612 00000100:00100000:3.0:1787508613.590838:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:230618:x1874324480080128:12345-0@lo:101:mdt00_006.0 00010000:00010000:3.0:1787508613.590851:0:203182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.590864:0:203182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32ca9 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f32ca2 expref: -99 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.590884:0:203182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32af7 lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadba4 expref: 583 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.590892:0:203182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32ca9 lrc: 4/0,0 mode: --/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f32ca2 expref: 9 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.590916:0:203182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32af7 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadba4 expref: 583 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.590928:0:203182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32af7 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadba4 expref: 583 pid: 202228 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.590970:0:203182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d74b9500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480080256:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508613.591031:0:203182:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88780 going to sleep for 11 seconds 00000100:00100000:2.0:1787508613.593301:0:203182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d74b9500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480080256:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508613.593335:0:203182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32ca9 lrc: 3/0,0 mode: --/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32ca2 expref: 9 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.593348:0:203182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d0:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:2.0:1787508613.593351:0:203182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508613.593355:0:203182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32ca9 lrc: 3/0,0 mode: --/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32ca2 expref: 9 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.593366:0:203182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fa00, rc 0) 00000100:00100000:2.0:1787508613.593552:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:230618:x1874324480080128:12345-0@lo:101:mdt00_006.0 Request processed in 2713us (2831us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.593562:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29612 00000100:00100000:0.0:1787508613.593627:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9c380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480080128:0@lo:101:mdt00_006.0 00010000:00010000:0.0:1787508613.593646:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f32ca2 lrc: 4/0,1 mode: --/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32ca9 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.593664:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f32ca2 lrc: 4/0,1 mode: --/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32ca9 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.594805:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.595612:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509470976 00000100:00100000:1.0:1787508613.595623:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509470976 00010000:00010000:1.0:1787508613.595661:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32af7 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadba4 expref: 584 pid: 202228 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.595703:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27789 00000100:00100000:1.0:1787508613.595713:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:2401:x1874324509470976:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508613.595729:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508613.595736:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32af7 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadba4 expref: 584 pid: 202228 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.595751:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32af7 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadba4 expref: 584 pid: 202228 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.595774:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32af7 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadba4 expref: 584 pid: 202228 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.595799:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d0:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:1.0:1787508613.595805:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32ca9 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32ca2 expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.595819:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32ca9 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f32ca2 expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.595828:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32ca9 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f32ca2 expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.595860:0:205406:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32ca9 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32ca2 expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.595873:0:205406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:205406:1874324480080384:0@lo:105: 00000100:00100000:1.0:1787508613.595920:0:205406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.596159:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480080384 00000100:00100000:0.0:1787508613.596164:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480080384 00000100:00100000:0.0:1787508613.596206:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18125 00000100:00100000:0.0:1787508613.596221:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:205406:x1874324480080384:12345-0@lo:105: 00010000:00010000:0.0:1787508613.596232:0:202210:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f32ca2 lrc: 5/0,1 mode: --/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32ca9 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.596242:0:202210:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f32ca2 lrc: 5/0,1 mode: --/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32ca9 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.596251:0:202210:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f32ca2 lrc: 5/0,1 mode: --/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32ca9 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.596257:0:202210:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f32ca2 lrc: 5/0,1 mode: EX/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f32ca9 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.596263:0:202210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f32ca2 lrc: 6/0,1 mode: EX/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f32ca9 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.596270:0:202210:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f32ca2 lrc: 6/0,1 mode: EX/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f32ca9 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.596291:0:202210:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090cd2ab800) 00000100:00100000:1.0:1787508613.596441:0:205406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c740ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787508613.596715:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:205406:x1874324480080384:12345-0@lo:105: Request processed in 494us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.596723:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18125 00010000:00010000:0.0:1787508613.596747:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f32ca2 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32ca9 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.596757:0:230618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f32ca2 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32ca9 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.596869:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f32cb0 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.596882:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f32cb0 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.596891:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f32cb0 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.596910:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f32cb7 lrc: 3/0,1 mode: --/EX res: [0x240000bd1:0x28f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.596921:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f32b91 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbe3 expref: 8 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.596929:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f32cb7 lrc: 4/0,1 mode: --/EX res: [0x240000bd1:0x28f:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.596974:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f32b91 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbe3 expref: 8 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.596988:0:230618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f32b91 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbe3 expref: 8 pid: 230618 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.597000:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce781880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:230618:1874324480080512:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508613.597105:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d21c4840 going to sleep for 11 seconds 00000100:00100000:1.0:1787508613.597180:0:205406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:205406:1874324480080384:0@lo:105: 00010000:00010000:1.0:1787508613.597193:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508613.597313:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:2401:x1874324509470976:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1600us (2512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.597321:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27789 00000100:00100000:1.0:1787508613.600023:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.600106:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509471104 00000100:00100000:3.0:1787508613.600116:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509471104 00010000:00010000:3.0:1787508613.600152:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f32b91 lrc: 5/0,0 mode: PR/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbe3 expref: 9 pid: 230618 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.600183:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27790 00000100:00100000:3.0:1787508613.600193:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2401:x1874324509471104:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508613.600218:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508613.600226:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f32b91 lrc: 5/0,0 mode: PR/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbe3 expref: 9 pid: 230618 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.600240:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f32b91 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbe3 expref: 9 pid: 230618 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.600261:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28f:0x0].0x0 (ffff9090cda8aa00) 00010000:00010000:3.0:1787508613.600267:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f32cb7 lrc: 3/0,1 mode: --/EX res: [0x240000bd1:0x28f:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.600277:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f32cb7 lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x28f:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.600284:0:202212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f32cb7 lrc: 4/0,1 mode: EX/EX res: [0x240000bd1:0x28f:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.600302:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508613.600345:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2401:x1874324509471104:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 153us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.600352:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27790 00010000:00010000:0.0:1787508613.601187:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f32b91 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbe3 expref: 8 pid: 230618 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.601204:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce781880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:230618:1874324480080512:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508613.601237:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f32cb7 lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x28f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.601247:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f32cb7 lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x28f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.601252:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f32cb7 lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x28f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.601295:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f32cbe lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.601302:0:230618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f32cbe lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.601312:0:230618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f32cbe lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.601331:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce781880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480080640:0@lo:101:mdt00_006.0 00000100:00100000:0.0:1787508613.601387:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.601411:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d21c4840 going to sleep for 11 seconds 00000100:00100000:2.0:1787508613.601601:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480080640 00000100:00100000:2.0:1787508613.601608:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480080640 00000100:00100000:2.0:1787508613.601653:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29613 00000100:00100000:2.0:1787508613.601662:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:230618:x1874324480080640:12345-0@lo:101:mdt00_006.0 00010000:00010000:2.0:1787508613.601678:0:225829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.601694:0:225829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32cc5 lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f32cbe expref: -99 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.601716:0:225829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32b9f lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbea expref: 10 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.601725:0:225829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32cc5 lrc: 4/0,0 mode: --/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f32cbe expref: 10 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.601755:0:225829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32b9f lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbea expref: 10 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.601768:0:225829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32b9f lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbea expref: 10 pid: 209004 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.601779:0:225829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9f100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480080768:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508613.601840:0:225829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787508613.607273:0:225829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9f100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480080768:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508613.607314:0:225829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32cc5 lrc: 3/0,0 mode: --/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32cbe expref: 10 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.607328:0:225829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x285:0x0].0x0 (ffff9090d36fde00) 00010000:00010000:2.0:1787508613.607331:0:225829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787508613.607335:0:225829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32cc5 lrc: 3/0,0 mode: --/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32cbe expref: 10 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.607346:0:225829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32cc5 lrc: 3/0,0 mode: --/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32cbe expref: 10 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.607354:0:225829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa000, rc 0) 00000100:00100000:2.0:1787508613.607486:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:230618:x1874324480080640:12345-0@lo:101:mdt00_006.0 Request processed in 5824us (6098us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.607496:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29613 00000100:00100000:2.0:1787508613.608343:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.608567:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509471232 00000100:00100000:3.0:1787508613.608576:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509471232 00010000:00010000:3.0:1787508613.608615:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32b9f lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbea expref: 11 pid: 209004 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.608700:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27791 00000100:00100000:3.0:1787508613.608710:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2400:x1874324509471232:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508613.608726:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508613.608734:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32b9f lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbea expref: 11 pid: 209004 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.608750:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32b9f lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbea expref: 11 pid: 209004 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.608771:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32b9f lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x285:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadbea expref: 11 pid: 209004 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.608788:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x285:0x0].0x0 (ffff9090d36fde00) 00010000:00010000:3.0:1787508613.608794:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32cc5 lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32cbe expref: 9 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.608805:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32cc5 lrc: 2/0,0 mode: EX/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f32cbe expref: 9 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.608813:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32cc5 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f32cbe expref: 9 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.608846:0:202211:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32cc5 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32cbe expref: 9 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.608860:0:202211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d74bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:202211:1874324480080896:0@lo:105: 00000100:00100000:3.0:1787508613.608904:0:202211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.608980:0:202211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88840 going to sleep for 11 seconds 00000100:00100000:2.0:1787508613.609372:0:229386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480080896 00000100:00100000:2.0:1787508613.609388:0:229386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480080896 00000100:00100000:2.0:1787508613.609427:0:229386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18126 00000100:00100000:2.0:1787508613.609435:0:229386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d74b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:202211:x1874324480080896:12345-0@lo:105: 00010000:00010000:2.0:1787508613.609446:0:229386:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f32cbe lrc: 4/0,1 mode: --/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32cc5 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.609457:0:229386:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f32cbe lrc: 4/0,1 mode: --/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32cc5 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.609477:0:229386:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f32cbe lrc: 4/0,1 mode: --/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32cc5 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.609484:0:229386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f32cbe lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f32cc5 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.609492:0:229386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f32cbe lrc: 5/0,1 mode: EX/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f32cc5 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.609499:0:229386:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f32cbe lrc: 5/0,1 mode: EX/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f32cc5 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.609514:0:229386:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d56f6c00) 00000100:00100000:2.0:1787508613.609558:0:229386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d74b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:202211:x1874324480080896:12345-0@lo:105: Request processed in 124us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.609564:0:229386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18126 00000100:00100000:2.0:1787508613.609597:0:202211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d74bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:202211:1874324480080896:0@lo:105: 00010000:00010000:2.0:1787508613.609612:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508613.609648:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2400:x1874324509471232:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 940us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.609655:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27791 00000100:00100000:0.0:1787508613.610080:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce781880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480080640:0@lo:101:mdt00_006.0 00010000:00010000:0.0:1787508613.610098:0:230618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f32cbe lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32cc5 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.610719:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce781880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480081024:0@lo:403:mdt00_006.0 00000100:00100000:0.0:1787508613.610755:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.610866:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d21c4840 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.611416:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480081024 00000100:00100000:3.0:1787508613.611423:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480081024 00000100:00100000:2.0:1787508613.611526:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29614 00000100:00100000:2.0:1787508613.611536:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:230618:x1874324480081024:12345-0@lo:403:mdt00_006.0 00000100:00100000:2.0:1787508613.613003:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:230618:x1874324480081024:12345-0@lo:403:mdt00_006.0 Request processed in 1464us (2241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.613013:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29614 00000100:00100000:0.0:1787508613.613045:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce781880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480081024:0@lo:403:mdt00_006.0 00000040:00080000:0.0:1787508613.614145:0:230618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xf:0x0].38, 664 off71888 00000040:00080000:0.0:1787508613.614309:0:230618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x5:0x0].581, 744 off736848 00000004:00080000:0.0:1787508613.614315:0:230618:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d21c4840 with version 13588 00000004:00080000:2.0:1787508613.614361:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13588 rpc_version 13588 00000020:00100000:2.0:1787508613.614402:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787508613.614409:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091f9a9f480 x1874324480081280/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1808/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787508613.614429:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9f480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480081280:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508613.614483:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508613.614507:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787508613.614520:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480081280 00000100:00100000:0.0:1787508613.614526:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480081280 00000100:00100000:0.0:1787508613.614574:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29615 00000100:00100000:0.0:1787508613.614583:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed03e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:202961:x1874324480081280:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787508613.614903:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed03e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:202961:x1874324480081280:12345-0@lo:1000:osp_up0-1.0 Request processed in 320us (417us total) trans 12884944046 rc 0/0 00000100:00100000:0.0:1787508613.614912:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29615 00000100:00100000:2.0:1787508613.615000:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9f480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480081280:0@lo:1000:osp_up0-1.0 00000004:00200000:3.0:1787508613.615153:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d0:0x0]: returning size 4096 00010000:00010000:3.0:1787508613.615176:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f32cb7 lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x28f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.615186:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f32cb7 lrc: 2/0,0 mode: EX/EX res: [0x240000bd1:0x28f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.615192:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f32cb7 lrc: 3/0,0 mode: EX/EX res: [0x240000bd1:0x28f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.615195:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.615199:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f32cb7 lrc: 3/0,0 mode: EX/EX res: [0x240000bd1:0x28f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.615206:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f32cb7 lrc: 4/0,0 mode: EX/EX res: [0x240000bd1:0x28f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.615222:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28f:0x0].0x0 (ffff9090cda8aa00) 00010000:00010000:3.0:1787508613.615225:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787508613.615229:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f32cb7 lrc: 2/0,0 mode: --/EX res: [0x240000bd1:0x28f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.615235:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f32cb7 lrc: 0/0,0 mode: --/EX res: [0x240000bd1:0x28f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.615248:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f32cbe lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32cc5 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.615257:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f32cbe lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f32cc5 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.615263:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f32cbe lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f32cc5 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.615294:0:230618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1787508613.615302:0:230618:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x285:0x0] 00010000:00010000:3.0:1787508613.615309:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f32cb0 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.615315:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f32cb0 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.615319:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f32cb0 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.615323:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.615324:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f32cb0 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.615328:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f32cb0 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.615333:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d0:0x0].0x0 (ffff9090cda8af00) 00010000:00010000:3.0:1787508613.615335:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.615336:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f32cb0 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.615340:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7600/0xb126349c40f32cb0 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.615346:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f32ca2 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32ca9 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.615351:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f32ca2 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f32ca9 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.615356:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f32ca2 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f32ca9 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.615370:0:230618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:3.0:1787508613.615378:0:230618:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1787508613.615382:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f000/0xb126349c40f32c63 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f32c6a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.615388:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f000/0xb126349c40f32c63 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xb126349c40f32c6a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.615395:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f000/0xb126349c40f32c63 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xb126349c40f32c6a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.615405:0:230618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000004:00080000:3.0:1787508613.615409:0:230618:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1787508613.615414:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f32c86 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32c9b expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.615422:0:230618:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f32c86 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32c9b expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.615500:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336022:x1874324509470208:12345-192.168.201.30@tcp:36:rm.0 Request processed in 37235us (39397us total) trans 8589961983 rc 0/0 00000100:00100000:3.0:1787508613.615508:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93606 00010000:00010000:0.0:1787508613.615509:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787508613.615515:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f000/0xb126349c40f32c63 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f32c6a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.615521:0:204785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f000 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:0.0:1787508613.615526:0:204785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f000/0xb126349c40f32c63 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f32c6a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508613.615532:0:204785:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f000/0xb126349c40f32c63 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f32c6a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.615559:0:204785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f000/0xb126349c40f32c63 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f32c6a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.615565:0:204785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787508613.615584:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f000/0xb126349c40f32c63 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f32c6a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.615590:0:204785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f000/0xb126349c40f32c63 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f32c6a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.615601:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787508613.615604:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f32cbe lrc: 2/0,0 mode: EX/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xb126349c40f32cc5 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.615610:0:204785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6c00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:0.0:1787508613.615613:0:204785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f32cbe lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xb126349c40f32cc5 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508613.615619:0:204785:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f32cbe lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xb126349c40f32cc5 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.615646:0:204785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f32cbe lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f32cc5 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.615656:0:204785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787508613.615663:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f32cbe lrc: 1/0,0 mode: --/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f32cc5 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.615673:0:226765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508613.615675:0:204785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f32cbe lrc: 0/0,0 mode: --/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f32cc5 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.615678:0:226765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f32ca2 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xb126349c40f32ca9 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.615684:0:226765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab800 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:2.0:1787508613.615689:0:226765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f32ca2 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xb126349c40f32ca9 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.615689:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508613.615691:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508613.615692:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1787508613.615696:0:226765:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f32ca2 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xb126349c40f32ca9 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.615698:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508613.615709:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480081408:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508613.615718:0:226765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f32ca2 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f32ca9 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.615724:0:226765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787508613.615741:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787508613.615748:0:226765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f32ca2 lrc: 1/0,0 mode: --/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f32ca9 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.615755:0:226765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f32ca2 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f32ca9 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.615762:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787508613.615767:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480081536:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508613.615768:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508613.615769:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508613.615771:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508613.615777:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787508613.615785:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480081664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508613.615787:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508613.615809:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.615829:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480081408 00000100:00100000:2.0:1787508613.615835:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480081536 00000100:00100000:0.0:1787508613.615835:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480081408 00000100:00100000:2.0:1787508613.615837:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480081536 00010000:00010000:0.0:1787508613.615854:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32c6a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f32c63 expref: 12 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.615862:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480081664 00000100:00100000:2.0:1787508613.615864:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480081664 00000100:00100000:0.0:1787508613.615875:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27792 00000100:00100000:2.0:1787508613.615879:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9772 00000100:00100000:0.0:1787508613.615881:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c1ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+13:3616:x1874324480081408:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787508613.615884:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce780e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+13:3616:x1874324480081536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508613.615891:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508613.615907:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32cc5 lrc: 0/0,0 mode: --/EX res: [0x2000013a2:0x285:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f32cbe expref: 13 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.615918:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x285:0x0].0x0 (ffff9090d36fde00) 00010000:00010000:2.0:1787508613.615925:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508613.615982:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce780e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+12:3616:x1874324480081536:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.615989:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9772 00000100:00100000:2.0:1787508613.616002:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9773 00010000:00010000:0.0:1787508613.616033:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508613.616045:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32c6a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f32c63 expref: 11 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.616057:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.616061:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32c94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.616074:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32c94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.616081:0:202212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32c94 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.616105:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508613.616129:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c1ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+10:3616:x1874324480081408:12345-0@lo:103:ldlm_bl.0 Request processed in 248us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.616229:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+10:3619:x1874324480081664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508613.616240:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508613.616251:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32ca9 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f32ca2 expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.616261:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d0:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:2.0:1787508613.616268:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508613.616296:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+9:3619:x1874324480081664:12345-0@lo:103:ldlm_bl.0 Request processed in 289us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.616303:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9773 00000100:00100000:0.0:1787508613.616323:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27792 00000100:00100000:2.0:1787508613.616335:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480081664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787508613.616356:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480081536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787508613.616364:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480081408:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508613.616369:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32c94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.616376:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32c94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508613.616418:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787508613.616422:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508613.616441:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32c94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.616479:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32c8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc37 expref: 583 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.616495:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32c94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc37 expref: 582 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.616503:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.616505:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508613.616508:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247bc00, rc 0) 00000100:00100000:0.0:1787508613.616546:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336024:x1874324509470848:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 29195us (29375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.616553:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93608 00000100:00100000:0.0:1787508613.623516:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.623648:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509471360 00000100:00100000:3.0:1787508613.623658:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509471360 00000100:00100000:3.0:1787508613.623719:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93609 00000100:00100000:3.0:1787508613.623734:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336024:x1874324509471360:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508613.623756:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.623776:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32ccc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadc3e expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.623837:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32cd3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.623851:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32cd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.623861:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32cd3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.623874:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32cda lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.623880:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32cda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.623886:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32cda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.623977:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32cd3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.623985:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32cd3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.623992:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32cd3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.624003:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32cd3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.624009:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.624013:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32cd3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.624020:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32cd3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.624033:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.624036:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.624040:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32cd3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.624046:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32cd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.624061:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32cda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.624067:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32cda lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.624073:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32cda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.624078:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.624081:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32cda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.624091:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32cda lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.624098:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090ccb87100) 00010000:00010000:3.0:1787508613.624101:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.624103:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32cda lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.624109:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32cda lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.624138:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32ccc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc3e expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.624148:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.624151:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508613.624154:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32ccc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc3e expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.624163:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ea00, rc 0) 00000100:00100000:2.0:1787508613.624342:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336024:x1874324509471360:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 612us (833us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508613.624349:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93609 00000100:00100000:2.0:1787508613.626547:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.626644:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509471488 00000100:00100000:0.0:1787508613.626654:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509471488 00000100:00100000:0.0:1787508613.626712:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93610 00000100:00100000:0.0:1787508613.626722:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4861c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336024:x1874324509471488:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508613.626742:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508613.626760:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32ce1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadc45 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.626825:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32ce8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.626837:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32ce8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.626848:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32ce8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.626863:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32cef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.626875:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32cef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.626882:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32cef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.626992:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32ce8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.627000:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32ce8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.627005:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32ce8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.627011:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32ce8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.627016:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.627020:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32ce8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.627027:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32ce8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.627038:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.627041:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.627045:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32ce8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.627051:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32ce8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.627062:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32cef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.627068:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32cef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.627074:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32cef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.627079:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.627082:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32cef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.627088:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32cef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.627096:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090c6913200) 00010000:00010000:0.0:1787508613.627098:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.627101:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32cef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.627106:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32cef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.627136:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32ce1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc45 expref: 583 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.627146:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.627148:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508613.627152:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32ce1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc45 expref: 583 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.627161:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6c00, rc 0) 00000100:00100000:0.0:1787508613.627218:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4861c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336024:x1874324509471488:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 497us (679us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508613.627229:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93610 00000100:00100000:3.0:1787508613.629608:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.629745:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509471616 00000100:00100000:1.0:1787508613.629754:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509471616 00000100:00100000:1.0:1787508613.629809:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93611 00000100:00100000:1.0:1787508613.629820:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d74ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:336025:x1874324509471616:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508613.629840:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.629862:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32cf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadc4c expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.629967:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32cfd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.629980:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32cfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.629991:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32cfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508613.630038:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508613.630042:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508613.630063:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32cfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.630088:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32cf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc4c expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.630105:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32cfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc4c expref: 11 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.630115:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.630117:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508613.630121:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ac00, rc 0) 00000100:00100000:1.0:1787508613.630182:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d74ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336025:x1874324509471616:12345-192.168.201.30@tcp:101:rm.0 Request processed in 363us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.630190:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93611 00000100:00100000:1.0:1787508613.633846:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.633889:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.633996:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509471744 00000100:00100000:0.0:1787508613.634005:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509471744 00000100:00100000:0.0:1787508613.634055:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509471872 00000100:00100000:0.0:1787508613.634058:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509471872 00000100:00100000:0.0:1787508613.634079:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93612 00000100:00100000:0.0:1787508613.634088:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336025:x1874324509471744:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508613.634107:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508613.634126:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32d04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadc53 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.634199:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f32d0b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.634213:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f32d0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.634225:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f32d0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.634239:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f32d12 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.634246:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f32d12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.634252:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f32d12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.634267:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93613 00000100:00100000:2.0:1787508613.634277:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336024:x1874324509471872:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508613.634285:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.634294:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f32d19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadc5a expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.634308:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f32d0b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.634316:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f32d0b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.634321:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f32d20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.634322:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f32d0b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.634329:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f32d0b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.634330:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f32d20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.634338:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f32d20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.634349:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32d27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.634356:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32d27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.634363:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32d27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.634393:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f32d20 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.634491:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7a00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.634497:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f32d0b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.634506:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f32d0b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.634518:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.634522:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.634527:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f32d0b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.634535:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f32d0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.634548:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f32d12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.634554:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f32d12 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.634561:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f32d12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.634567:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.634570:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f32d12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.634576:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f32d12 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.634776:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090c6913500) 00010000:00010000:0.0:1787508613.634780:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.634784:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f32d12 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.634791:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f32d12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.634824:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32d04 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc53 expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.634834:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.634836:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508613.634840:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32d04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc53 expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.634848:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7800, rc 0) 00010000:00010000:2.0:1787508613.635133:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f32d20 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.635142:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f32d20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.635147:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f32d20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.635157:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.635160:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f32d20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.635165:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336025:x1874324509471744:12345-192.168.201.30@tcp:101:rm.0 Request processed in 1076us (1328us total) trans 0 rc 301/301 00010000:00010000:2.0:1787508613.635166:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f32d20 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.635173:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93612 00010000:00010000:2.0:1787508613.635175:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.635177:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.635179:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f32d20 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.635184:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f32d20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.635195:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32d27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.635201:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32d27 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.635207:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32d27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.635271:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.635275:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32d27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.635281:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32d27 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.635293:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090c98d9b00) 00010000:00010000:2.0:1787508613.635296:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.635298:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32d27 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.635305:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32d27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.635329:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f32d19 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc5a expref: 583 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.635338:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.635340:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508613.635344:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f32d19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc5a expref: 583 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.635352:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab800, rc 0) 00000100:00100000:2.0:1787508613.635375:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336024:x1874324509471872:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1100us (1486us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508613.635381:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93613 00000100:00100000:2.0:1787508613.638358:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.638455:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509472128 00000100:00100000:1.0:1787508613.638474:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509472128 00000100:00100000:1.0:1787508613.638547:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93614 00000100:00100000:1.0:1787508613.638558:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336024:x1874324509472128:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508613.638580:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.638599:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f32d2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadc61 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.638687:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32d35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.638701:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32d35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.638712:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32d35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.638728:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32d3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.638735:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32d3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.638742:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32d3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.638801:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32d35 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.638809:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32d35 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.638818:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32d35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.638825:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32d35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.638831:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247be00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.638835:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32d35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.638842:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32d35 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.638853:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.638856:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.638860:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32d35 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.638866:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32d35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.638879:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32d3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.638885:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32d3c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.638901:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32d3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.638907:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.638910:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32d3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.638917:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32d3c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.638924:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaf3dc4c9 (ffff9090d3c50f00) 00010000:00010000:1.0:1787508613.638926:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.638929:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32d3c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.638935:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32d3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.638997:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f32d2e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc61 expref: 583 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.639008:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.639010:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508613.639014:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f32d2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc61 expref: 583 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.639023:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b200, rc 0) 00000100:00100000:1.0:1787508613.639094:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336024:x1874324509472128:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 538us (745us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508613.639101:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93614 00000100:00100000:3.0:1787508613.640289:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.640356:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509472256 00000100:00100000:0.0:1787508613.640365:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509472256 00000100:00100000:0.0:1787508613.640426:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93615 00000100:00100000:0.0:1787508613.640436:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d74baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336025:x1874324509472256:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508613.640451:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508613.640478:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32d43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadc68 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.640527:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32d4a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.640538:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32d4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.640549:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32d4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.640562:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32d51 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.640569:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32d51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.640575:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32d51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.640613:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32d4a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.640619:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32d4a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.640625:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32d4a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.640643:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32d4a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.640650:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.640654:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32d4a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.640661:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32d4a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.640673:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.640675:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.640679:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32d4a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.640684:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32d4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.640694:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32d51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.640698:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32d51 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.640703:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32d51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.640707:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.640710:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32d51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.640718:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32d51 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.640724:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090c6913200) 00010000:00010000:0.0:1787508613.640726:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.640728:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32d51 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.640733:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32d51 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.640761:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32d43 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc68 expref: 12 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.640769:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.640771:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508613.640774:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32d43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc68 expref: 12 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.640782:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6c00, rc 0) 00000100:00100000:0.0:1787508613.640840:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d74baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336025:x1874324509472256:12345-192.168.201.30@tcp:101:rm.0 Request processed in 406us (556us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508613.640847:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93615 00000100:00100000:2.0:1787508613.644665:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.644790:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509472384 00000100:00100000:3.0:1787508613.644800:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509472384 00000100:00100000:3.0:1787508613.644865:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93616 00000100:00100000:3.0:1787508613.644879:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336024:x1874324509472384:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508613.644910:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.644931:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32d58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadc6f expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.645036:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32d5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.645050:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32d5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.645060:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32d5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.645070:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32d66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.645079:0:202227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32c9b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32c86 expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.645086:0:202227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32d66 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.645116:0:202227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32c9b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f32c86 expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.645131:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d74b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:202227:1874324480081792:0@lo:104: 00000100:00100000:3.0:1787508613.645179:0:202227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.645222:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88180 going to sleep for 11 seconds 00000100:00100000:0.0:1787508613.645445:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480081792 00000100:00100000:0.0:1787508613.645450:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480081792 00000100:00100000:0.0:1787508613.645499:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18127 00000100:00100000:0.0:1787508613.645506:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d74bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:202227:x1874324480081792:12345-0@lo:104: 00010000:00010000:0.0:1787508613.645517:0:202209:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f32c86 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f32c9b expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.645584:0:202209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787508613.645590:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d74bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:202227:x1874324480081792:12345-0@lo:104: Request processed in 85us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.645597:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18127 00010000:00010000:1.0:1787508613.645684:0:202214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787508613.645691:0:202214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f32c86 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f32c9b expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.645702:0:202214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aaa00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:1.0:1787508613.645708:0:202214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f32c86 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f32c9b expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508613.645716:0:202214:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f32c86 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f32c9b expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.645743:0:202214:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f32c86 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f32c9b expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.645750:0:202214:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787508613.645782:0:202214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f32c86 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f32c9b expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.645789:0:202214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f32c86 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f32c9b expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.645808:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508613.645810:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508613.645812:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508613.645855:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480081920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787508613.645888:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.645985:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480081920 00000100:00100000:1.0:1787508613.645990:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480081920 00010000:00010000:1.0:1787508613.646008:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32c9b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f32c86 expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.646038:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27793 00000100:00100000:1.0:1787508613.646045:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3619:x1874324480081920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508613.646058:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787508613.648261:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d74b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:202227:1874324480081792:0@lo:104: 00010000:00010000:3.0:1787508613.648291:0:202227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32d66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.648696:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508613.652037:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509472512 00000100:00100000:2.0:1787508613.652052:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509472512 00000100:00100000:2.0:1787508613.652122:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93617 00000100:00100000:2.0:1787508613.652135:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336025:x1874324509472512:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508613.652156:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.652177:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32d6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadc76 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.652239:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f32d74 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.652255:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f32d74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.652266:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f32d74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.652282:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f32d7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.652290:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f32d7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.652296:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f32d7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.652347:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f32d74 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.652355:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f32d74 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.652362:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f32d74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.652387:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f32d74 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.652393:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.652398:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f32d74 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.652407:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f32d74 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.652418:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.652422:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.652426:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f32d74 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.652433:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f32d74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.652453:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f32d7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.652468:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f32d7b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.652474:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f32d7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.652478:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.652481:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f32d7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.652490:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f32d7b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.652497:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090c98d9b00) 00010000:00010000:2.0:1787508613.652499:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.652502:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f32d7b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.652508:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f32d7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.652539:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32d6d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc76 expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.652549:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.652552:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508613.652556:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32d6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc76 expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.652566:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa600, rc 0) 00000100:00100000:2.0:1787508613.652627:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336025:x1874324509472512:12345-192.168.201.30@tcp:101:rm.0 Request processed in 494us (3934us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508613.652635:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93617 00000001:00080000:1.0:1787508613.654144:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944046 is committed 00010000:00010000:2.0:1787508613.654255:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32c9b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f32c86 expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.654271:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090ccb87800) 00010000:00010000:2.0:1787508613.654277:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32d66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.654286:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32d66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.654292:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32d66 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.654327:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508613.654411:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480081920:12345-0@lo:103:ldlm_bl.0 Request processed in 8366us (8521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.654419:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27793 00000100:00100000:0.0:1787508613.654514:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480081920:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787508613.654585:0:202227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32d66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.654593:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32d66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.654639:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32d5f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.654647:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32d5f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.654653:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32d5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.654659:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32d5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.654664:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.654668:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32d5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.654674:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32d5f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.654683:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.654686:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.654688:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32d5f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.654693:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32d5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.654704:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32d66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.654709:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32d66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.654714:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32d66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.654719:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.654721:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32d66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.654726:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32d66 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.654731:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090ccb87800) 00010000:00010000:3.0:1787508613.654733:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.654736:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32d66 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.654740:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32d66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.654775:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32d58 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc6f expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.654784:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.654786:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.654790:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32d58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc6f expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.654799:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ea00, rc 0) 00000100:00100000:3.0:1787508613.654848:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336024:x1874324509472384:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 9971us (10250us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508613.654855:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93616 00000100:00100000:1.0:1787508613.655206:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.655341:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509472768 00000100:00100000:3.0:1787508613.655349:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509472768 00000100:00100000:3.0:1787508613.655404:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93618 00000100:00100000:3.0:1787508613.655416:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336025:x1874324509472768:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508613.655439:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.655455:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32d82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadc7d expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.656261:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32d89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.656277:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32d89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.656288:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32d89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.656310:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32d90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.656316:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32d90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.656323:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32d90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.656366:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32d89 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.656437:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32d89 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.656444:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32d89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.656452:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32d89 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.656467:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.656472:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32d89 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.656479:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32d89 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.656490:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.656494:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.656497:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32d89 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.656504:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32d89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.656516:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32d90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.656521:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32d90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.656526:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32d90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.656531:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.656534:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32d90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.656545:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32d90 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.656552:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090e460fe00) 00010000:00010000:0.0:1787508613.656555:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.656558:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32d90 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.656564:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32d90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.656595:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32d82 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc7d expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.656605:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.656607:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508613.656611:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32d82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc7d expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.656621:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f800, rc 0) 00000100:00100000:0.0:1787508613.656715:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336025:x1874324509472768:12345-192.168.201.30@tcp:101:rm.0 Request processed in 1302us (1508us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508613.656723:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93618 00000100:00100000:1.0:1787508613.661003:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.661051:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.661099:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509472896 00000100:00100000:3.0:1787508613.661111:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509472896 00000100:00100000:2.0:1787508613.661128:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509473152 00000100:00100000:2.0:1787508613.661133:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509473152 00000100:00100000:3.0:1787508613.661171:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93619 00000100:00100000:3.0:1787508613.661180:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336025:x1874324509472896:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508613.661201:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.661222:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32d97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadc84 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.661285:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32d9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.661299:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32d9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.661315:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32d9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.661331:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32da5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.661339:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32da5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.661346:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32da5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.661399:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32d9e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.661407:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32d9e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.661414:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32d9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.661420:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32d9e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.661427:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.661431:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32d9e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.661439:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32d9e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.661450:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.661454:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.661470:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32d9e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.661478:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32d9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.661491:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32da5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.661498:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32da5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.661504:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32da5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.661509:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.661512:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32da5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.661518:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32da5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.661526:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090ccb87800) 00010000:00010000:3.0:1787508613.661528:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.661531:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32da5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.661536:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32da5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.661566:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32d97 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc84 expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.661576:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.661578:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.661582:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32d97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc84 expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.661591:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ea00, rc 0) 00000100:00100000:3.0:1787508613.661648:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336025:x1874324509472896:12345-192.168.201.30@tcp:101:rm.0 Request processed in 469us (655us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508613.662971:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93620 00000100:00100000:2.0:1787508613.663009:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336024:x1874324509473152:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:2.0:1787508613.663062:0:209004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508613.663245:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32c94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc37 expref: 582 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.663262:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.663266:0:209004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508613.663324:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32dac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.663333:0:209004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32cfd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc4c expref: 11 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.663338:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32dac lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.663366:0:209004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32cfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc4c expref: 11 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.663381:0:209004:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32cfd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc4c expref: 11 pid: 202226 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.663395:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480082048:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508613.663476:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.663540:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93619 00000100:00100000:1.0:1787508613.666592:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480082048:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508613.666627:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32dac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.669770:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508613.669819:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509473280 00000100:00100000:2.0:1787508613.669829:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509473280 00010000:00010000:2.0:1787508613.669870:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32cfd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc4c expref: 11 pid: 202226 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.669915:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27794 00000100:00100000:2.0:1787508613.669925:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2400:x1874324509473280:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508613.669973:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508613.669981:0:225839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32cfd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc4c expref: 11 pid: 202226 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.669996:0:225839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32cfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc4c expref: 11 pid: 202226 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.670017:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32cfd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc4c expref: 11 pid: 202226 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.670032:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.670038:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32dac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.670049:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32dac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.670056:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32dac lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.670077:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508613.670136:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2400:x1874324509473280:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 212us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.670144:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27794 00010000:00010000:1.0:1787508613.670213:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32dac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.670221:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32dac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.670243:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32db3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.670253:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32db3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.670261:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32db3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787508613.671173:0:209004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1:0x0].1774, 2168 off1826640 00000040:00080000:1.0:1787508613.671250:0:209004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x1:0x0].1780, 2368 off2031560 00000004:00080000:1.0:1787508613.671256:0:209004:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090c740ff00 with version 3444 00000004:00080000:3.0:1787508613.671307:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3444 rpc_version 3444 00000020:00100000:3.0:1787508613.671339:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787508613.671349:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d74b9180 x1874324480082304/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3976/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787508613.671381:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d74b9180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480082304:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787508613.671504:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.671541:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88180 going to sleep for 11 seconds 00000100:00100000:2.0:1787508613.671557:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480082304 00000100:00100000:2.0:1787508613.671564:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480082304 00000100:00100000:2.0:1787508613.671610:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29616 00000100:00100000:2.0:1787508613.671618:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d74b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:202248:x1874324480082304:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787508613.672027:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d74b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:202248:x1874324480082304:12345-0@lo:1000:osp_up1-0.0 Request processed in 409us (522us total) trans 8589961984 rc 0/0 00000100:00100000:2.0:1787508613.672035:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29616 00000100:00100000:3.0:1787508613.672277:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d74b9180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480082304:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1787508613.672386:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32dba lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1258:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.672401:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32dba lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1258:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.672411:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32dba lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1258:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.672429:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32dc1 lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x16e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.672435:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32dc1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.672442:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32dc1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.672478:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b600/0xb126349c40f32dc8 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.672485:0:209004:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b600/0xb126349c40f32dc8 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.672494:0:209004:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b600/0xb126349c40f32dc8 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.672508:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b38380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:209004:1874324480082432:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1787508613.672539:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.672567:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c740f840 going to sleep for 11 seconds 00000100:00100000:2.0:1787508613.672618:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480082432 00000100:00100000:2.0:1787508613.672623:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480082432 00000100:00100000:2.0:1787508613.672660:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29617 00000100:00100000:2.0:1787508613.672669:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:209004:x1874324480082432:12345-0@lo:101:mdt00_005.0 00010000:00010000:2.0:1787508613.672682:0:225829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.672698:0:225829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab800/0xb126349c40f32dcf lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f32dc8 expref: -99 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.672717:0:225829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab800/0xb126349c40f32dcf lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f32dc8 expref: 11 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.672730:0:225829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab800/0xb126349c40f32dcf lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32dc8 expref: 11 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.672738:0:225829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x166:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:2.0:1787508613.672741:0:225829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.672745:0:225829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab800, rc 0) 00000100:00100000:2.0:1787508613.672793:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+11:209004:x1874324480082432:12345-0@lo:101:mdt00_005.0 Request processed in 124us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.672798:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29617 00000100:00100000:1.0:1787508613.672896:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b38380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:209004:1874324480082432:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1787508613.672909:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b600/0xb126349c40f32dc8 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32dcf expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.672923:0:209004:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b600/0xb126349c40f32dc8 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32dcf expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508613.672966:0:209004:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000dd5d557 reply state 000000002b0f312d transno 12884944047 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32dc1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.672978:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32dc1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.672984:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16e:0x0].0x0 (ffff9090d6c66400) 00010000:00010000:1.0:1787508613.672986:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787508613.672989:0:209004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787508613.672995:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b600/0xb126349c40f32dc8 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32dcf expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.673003:0:209004:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b600/0xb126349c40f32dc8 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32dcf expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787508613.673012:0:209004:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd2:0x166:0x0] 00000004:00010000:1.0:1787508613.673017:0:209004:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000dd5d557 reply state 000000002b0f312d transno 12884944047 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32dba lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1258:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.673024:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32dba lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1258:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.673030:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1258:0x0].0x0 (ffff9090d6c66200) 00010000:00010000:1.0:1787508613.673032:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787508613.673033:0:209004:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1787508613.673039:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1258:0x0]: returning size 4096 00010000:00010000:1.0:1787508613.673048:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32dac lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.673054:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32dac lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.673060:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32dac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.673066:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32dac lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.673072:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.673076:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32dac lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.673083:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32dac lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.673093:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.673096:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.673099:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32dac lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.673105:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32dac lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508613.673117:0:209004:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000dd5d557 reply state 000000002b0f312d transno 12884944047 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32db3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.673125:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32db3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.673135:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d3c50f00) 00010000:00010000:1.0:1787508613.673137:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787508613.673139:0:209004:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1787508613.673212:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336024:x1874324509473152:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 10228us (12159us total) trans 12884944047 rc 0/0 00000100:00100000:1.0:1787508613.673220:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93620 00000100:00100000:3.0:1787508613.673319:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.673548:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509473408 00000100:00100000:1.0:1787508613.673554:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509473408 00000100:00100000:1.0:1787508613.673592:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93621 00000100:00100000:1.0:1787508613.673600:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d74bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:336026:x1874324509473408:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508613.673610:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.673621:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f32dd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadc8b expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.673671:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32ddd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.673680:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32ddd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.673688:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32ddd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508613.673715:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508613.673719:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508613.673733:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32ddd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.673755:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f32dd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc8b expref: 12 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.673768:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32ddd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc8b expref: 11 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.673775:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.673867:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508613.673871:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247bc00, rc 0) 00000100:00100000:1.0:1787508613.673907:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d74bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336026:x1874324509473408:12345-192.168.201.30@tcp:101:rm.0 Request processed in 307us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.673913:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93621 00000100:00100000:2.0:1787508613.676863:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.676973:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509473536 00000100:00100000:0.0:1787508613.676984:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509473536 00000100:00100000:0.0:1787508613.677043:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93622 00000100:00100000:0.0:1787508613.677053:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336026:x1874324509473536:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508613.677076:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508613.677096:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32de4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadc92 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.677161:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32deb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.677174:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32deb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.677184:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32deb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.677198:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32df2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.677204:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32df2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.677210:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32df2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.677261:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32deb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.677268:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32deb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.677274:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32deb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.677281:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32deb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.677288:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.677292:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32deb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.677299:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32deb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.677312:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.677314:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.677319:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32deb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.677325:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32deb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.677338:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32df2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.677344:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32df2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.677349:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32df2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.677353:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.677355:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32df2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.677360:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32df2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.677370:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090e460fe00) 00010000:00010000:0.0:1787508613.677372:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.677375:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32df2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.677380:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32df2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.677409:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32de4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc92 expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.677419:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.677421:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508613.677425:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32de4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc92 expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.677434:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6c00, rc 0) 00000100:00100000:0.0:1787508613.677502:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336026:x1874324509473536:12345-192.168.201.30@tcp:101:rm.0 Request processed in 450us (648us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508613.677509:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93622 00000100:00100000:3.0:1787508613.680846:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508613.681031:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509473664 00000100:00100000:2.0:1787508613.681042:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509473664 00000100:00100000:2.0:1787508613.681099:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93623 00000100:00100000:2.0:1787508613.681109:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d74b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336026:x1874324509473664:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508613.681129:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.681149:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f32df9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadc99 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.681227:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32e00 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.681241:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32e00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.681252:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32e00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.681266:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32e07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.681274:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32e07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.681280:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32e07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.681340:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32e00 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.681346:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32e00 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.681352:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32e00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.681359:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32e00 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.681364:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.681368:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32e00 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.681494:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32e00 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.681507:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.681509:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.681513:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32e00 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.681520:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32e00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.681536:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32e07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.681542:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32e07 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.681548:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32e07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.681552:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.681555:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32e07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.681560:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32e07 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.681566:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090c98d9400) 00010000:00010000:2.0:1787508613.681568:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.681570:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32e07 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.681575:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32e07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.681603:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f32df9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc99 expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.681611:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.681614:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508613.681618:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f32df9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc99 expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.681627:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab600, rc 0) 00000100:00100000:2.0:1787508613.681697:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d74b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336026:x1874324509473664:12345-192.168.201.30@tcp:101:rm.0 Request processed in 589us (862us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508613.681704:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93623 00000100:00100000:2.0:1787508613.683677:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.683802:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509473792 00000100:00100000:1.0:1787508613.683812:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509473792 00000100:00100000:1.0:1787508613.683917:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93624 00000100:00100000:1.0:1787508613.683929:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336027:x1874324509473792:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508613.683995:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.684015:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f32e0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadca0 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.684076:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f32e15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.684090:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f32e15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.684102:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f32e15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508613.684146:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508613.684150:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508613.684175:0:209004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f32e15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.684199:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f32e0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadca0 expref: 585 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.684229:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f32e15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadca0 expref: 584 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.684238:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.684241:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508613.684244:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b200, rc 0) 00000100:00100000:1.0:1787508613.684492:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336027:x1874324509473792:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 564us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.684500:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93624 00000100:00100000:2.0:1787508613.685573:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.685886:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509473920 00000100:00100000:1.0:1787508613.685905:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509473920 00000100:00100000:1.0:1787508613.685976:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93625 00000100:00100000:1.0:1787508613.685986:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336026:x1874324509473920:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508613.686004:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.686022:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32e1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadca7 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.686075:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32e23 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.686087:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32e23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.686100:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32e23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.686116:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32e2a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.686122:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32e2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.686128:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32e2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.686187:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32e23 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.686194:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32e23 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.686200:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32e23 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.686217:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32e23 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.686223:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.686228:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32e23 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.686235:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32e23 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.686247:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.686250:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.686254:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32e23 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.686260:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f32e23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.686273:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32e2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.686279:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32e2a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.686285:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32e2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.686289:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.686291:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32e2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.686297:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32e2a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.686303:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090c5b0c800) 00010000:00010000:1.0:1787508613.686305:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.686308:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32e2a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.686312:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32e2a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.686340:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32e1c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadca7 expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.686351:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.686353:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508613.686356:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f32e1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadca7 expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.686364:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a800, rc 0) 00000100:00100000:1.0:1787508613.686428:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336026:x1874324509473920:12345-192.168.201.30@tcp:101:rm.0 Request processed in 444us (860us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508613.686436:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93625 00000100:00100000:2.0:1787508613.689285:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.689351:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509474048 00000100:00100000:1.0:1787508613.689360:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509474048 00000100:00100000:1.0:1787508613.689418:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93626 00000100:00100000:1.0:1787508613.689428:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336027:x1874324509474048:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508613.689447:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.689477:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32e31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadcae expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.689543:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f32e38 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.689557:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f32e38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.689567:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f32e38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.689581:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f32e3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.689588:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f32e3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.689595:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f32e3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.689650:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f32e38 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.689658:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f32e38 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.689665:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f32e38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.689673:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f32e38 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.689679:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cdb25e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.689684:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f32e38 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.689691:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f32e38 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.689703:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.689706:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.689710:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f32e38 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.689718:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f32e38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.689732:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f32e3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.689740:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f32e3f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.689746:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f32e3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.689752:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.689755:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f32e3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.689762:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f32e3f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.689769:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090d00cdc00) 00010000:00010000:1.0:1787508613.689771:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.689774:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f32e3f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.689780:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f32e3f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.689810:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32e31 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcae expref: 585 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.689820:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.689823:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508613.689827:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f32e31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcae expref: 585 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.689837:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ac00, rc 0) 00000100:00100000:1.0:1787508613.689911:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336027:x1874324509474048:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 483us (643us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508613.689919:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93626 00010000:00010000:0.0:1787508613.690631:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508613.693148:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.693275:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509474176 00000100:00100000:1.0:1787508613.693285:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509474176 00000100:00100000:1.0:1787508613.693336:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93627 00000100:00100000:1.0:1787508613.693347:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336027:x1874324509474176:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508613.693368:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.693389:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f32e46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadcb5 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.693467:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f32e4d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.693483:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f32e4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.693493:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f32e4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.693510:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f32e54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.693515:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f32e54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.693525:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f32e54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.693585:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f32e4d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.693592:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f32e4d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.693597:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f32e4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.693604:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f32e4d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.693610:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.693614:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f32e4d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.693622:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f32e4d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.693635:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.693638:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.693642:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f32e4d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.693647:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f32e4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.693661:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f32e54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.693667:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f32e54 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.693672:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f32e54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.693676:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.693679:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f32e54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.693684:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f32e54 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.693690:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090c5b0c800) 00010000:00010000:1.0:1787508613.693692:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.693694:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f32e54 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.693700:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f32e54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.693731:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f32e46 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcb5 expref: 585 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.693741:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.693743:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508613.693747:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f32e46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcb5 expref: 585 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.693761:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5600, rc 0) 00000100:00100000:1.0:1787508613.693829:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336027:x1874324509474176:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 482us (692us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508613.693836:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93627 00000100:00100000:2.0:1787508613.694898:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.695929:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509474432 00000100:00100000:1.0:1787508613.695956:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509474432 00000100:00100000:1.0:1787508613.696017:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93628 00000100:00100000:1.0:1787508613.696027:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336026:x1874324509474432:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508613.696044:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.696063:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f32e5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadcbc expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.696130:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f32e62 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.696145:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f32e62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.696155:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f32e62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.696171:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f32e69 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.696179:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f32e69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.696186:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f32e69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.696240:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f32e62 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.696249:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f32e62 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.696256:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f32e62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.696263:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f32e62 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.696270:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.696274:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f32e62 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.696282:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f32e62 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.696294:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.696297:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.696301:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f32e62 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.696307:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f32e62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.696320:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f32e69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.696327:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f32e69 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.696334:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f32e69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.696339:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.696342:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f32e69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.696350:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f32e69 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.696357:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090c6987900) 00010000:00010000:1.0:1787508613.696359:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.696362:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f32e69 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.696368:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f32e69 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.696413:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f32e5b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcbc expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.696424:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.696427:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508613.696430:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f32e5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcbc expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.696440:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4a00, rc 0) 00000100:00100000:1.0:1787508613.696518:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336026:x1874324509474432:12345-192.168.201.30@tcp:101:rm.0 Request processed in 492us (1625us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508613.696528:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93628 00000100:00100000:2.0:1787508613.699139:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.699238:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509474560 00000100:00100000:0.0:1787508613.699248:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509474560 00000100:00100000:0.0:1787508613.699308:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93629 00000100:00100000:0.0:1787508613.699318:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336027:x1874324509474560:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508613.699337:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508613.699356:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32e70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadcc3 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.699429:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32e77 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.699442:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32e77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.699453:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32e77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.699478:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32e7e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.699485:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32e7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.699492:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32e7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.699541:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32e77 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.699548:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32e77 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.699555:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32e77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.699561:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32e77 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.699568:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.699572:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32e77 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.699579:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32e77 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.699590:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.699593:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.699597:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32e77 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.699603:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32e77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.699614:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32e7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.699619:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32e7e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.699625:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32e7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.699631:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.699633:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32e7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.699639:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32e7e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.699646:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090e460fe00) 00010000:00010000:0.0:1787508613.699648:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.699651:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32e7e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.699658:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f32e7e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.699687:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32e70 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcc3 expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.699698:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.699700:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508613.699702:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32e70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcc3 expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.699710:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6c00, rc 0) 00000100:00100000:0.0:1787508613.699772:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336027:x1874324509474560:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 455us (642us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508613.699778:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93629 00000100:00100000:3.0:1787508613.701643:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508613.701740:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509474688 00000100:00100000:2.0:1787508613.701751:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509474688 00000100:00100000:2.0:1787508613.701817:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93630 00000100:00100000:2.0:1787508613.701827:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d74bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336026:x1874324509474688:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508613.701845:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.701862:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32e85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadcca expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.701920:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f32e8c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.701934:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f32e8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.701986:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f32e8c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.702003:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32e93 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.702011:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32e93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.702018:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32e93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.702112:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f32e9a lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1258:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.702121:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f32e9a lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1258:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.702128:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f32e9a lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1258:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508613.702225:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1258:0x0]: returning size 4096 00000004:00200000:2.0:1787508613.702230:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1787508613.702249:0:205405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f32e9a lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1258:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.702263:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f32e8c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.702269:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f32e8c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.702275:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f32e8c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.702285:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f32e8c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.702291:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.702294:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f32e8c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.702302:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f32e8c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.702315:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.702318:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.702322:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f32e8c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.702328:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f32e8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.702342:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32e93 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.702348:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32e93 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.702354:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32e93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.702360:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.702362:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32e93 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.702502:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32e93 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.702512:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d3c50f00) 00010000:00010000:2.0:1787508613.702514:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.702517:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32e93 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.702523:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32e93 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.702551:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32e85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcca expref: 13 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.702564:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f32e9a lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1258:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcca expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.702572:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1258:0x0].0x0 (ffff9090d6c66200) 00010000:00010000:2.0:1787508613.702574:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508613.702577:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa200, rc 0) 00000100:00100000:2.0:1787508613.702639:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d74bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336026:x1874324509474688:12345-192.168.201.30@tcp:101:rm.0 Request processed in 813us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.702647:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93630 00000100:00100000:2.0:1787508613.704240:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.704296:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509474944 00000100:00100000:0.0:1787508613.704305:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509474944 00000100:00100000:0.0:1787508613.704363:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93631 00000100:00100000:0.0:1787508613.704383:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336027:x1874324509474944:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508613.704402:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508613.704420:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f32ea1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadcd1 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.704502:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32ea8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.704519:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32ea8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.704530:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32ea8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.704545:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32eaf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.704553:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32eaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.704559:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32eaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.704613:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32ea8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.704621:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32ea8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.704627:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32ea8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.704633:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32ea8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.704639:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.704643:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32ea8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.704650:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32ea8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.704661:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.704664:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.704668:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32ea8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.704674:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32ea8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.704688:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32eaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.704694:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32eaf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.704700:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32eaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.704705:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.704708:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32eaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.704715:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32eaf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.704721:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090e460fc00) 00010000:00010000:0.0:1787508613.704724:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.704727:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32eaf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.704733:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32eaf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.704770:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f32ea1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcd1 expref: 585 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.704784:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.704787:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508613.704790:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f32ea1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcd1 expref: 585 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.704801:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7a00, rc 0) 00000100:00100000:0.0:1787508613.704915:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336027:x1874324509474944:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 541us (681us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508613.704922:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93631 00000100:00100000:3.0:1787508613.705740:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.706072:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509475072 00000100:00100000:1.0:1787508613.706079:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509475072 00000100:00100000:1.0:1787508613.706111:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93632 00000100:00100000:1.0:1787508613.706117:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336026:x1874324509475072:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508613.706130:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.706143:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f32eb6 lrc: 2/0,0 mode: --/CR res: [0x2000013a0:0x16e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadcd8 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.706182:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f32ebd lrc: 3/1,0 mode: --/PR res: [0x2000013a0:0x16e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.706190:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f32ebd lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.706196:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f32ebd lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508613.706242:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a0:0x16e:0x0]: returning size 4096 00000004:00200000:1.0:1787508613.706246:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787508613.706271:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f32eb6 lrc: 0/0,0 mode: --/CR res: [0x2000013a0:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcd8 expref: 14 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.706282:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f32ebd lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcd8 expref: 13 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.706287:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16e:0x0].0x0 (ffff9090d6c66400) 00010000:00010000:1.0:1787508613.706289:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508613.706292:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4e00, rc 0) 00000100:00100000:1.0:1787508613.706329:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336026:x1874324509475072:12345-192.168.201.30@tcp:101:rm.0 Request processed in 212us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.706333:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93632 00000100:00100000:3.0:1787508613.708753:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.708839:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509475200 00000100:00100000:1.0:1787508613.708849:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509475200 00000100:00100000:1.0:1787508613.708913:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93633 00000100:00100000:1.0:1787508613.708922:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336026:x1874324509475200:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508613.708983:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.709013:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cdb25e00/0xb126349c40f32ec4 lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x166:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadcdf expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.709077:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f32ecb lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x166:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.709091:0:202226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab800/0xb126349c40f32dcf lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32dc8 expref: 10 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.709099:0:202226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f32ecb lrc: 4/1,0 mode: --/PR res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.709130:0:202226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab800/0xb126349c40f32dcf lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f32dc8 expref: 10 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.709146:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:202226:1874324480082560:0@lo:104: 00000100:00100000:1.0:1787508613.709196:0:202226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.709232:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c740f840 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.709392:0:229386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480082560 00000100:00100000:3.0:1787508613.709397:0:229386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480082560 00000100:00100000:3.0:1787508613.709436:0:229386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18128 00000100:00100000:3.0:1787508613.709444:0:229386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:202226:x1874324480082560:12345-0@lo:104: 00010000:00010000:3.0:1787508613.709455:0:229386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b600/0xb126349c40f32dc8 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f32dcf expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.709527:0:229386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787508613.709534:0:229386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:202226:x1874324480082560:12345-0@lo:104: Request processed in 91us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.709541:0:229386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18128 00010000:00010000:3.0:1787508613.709567:0:202215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787508613.709573:0:202215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b600/0xb126349c40f32dc8 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f32dcf expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.709582:0:202215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:3.0:1787508613.709587:0:202215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b600/0xb126349c40f32dc8 lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f32dcf expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508613.709596:0:202215:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b600/0xb126349c40f32dc8 lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f32dcf expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.709621:0:202215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b600/0xb126349c40f32dc8 lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f32dcf expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.709628:0:202215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787508613.709649:0:202215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b600/0xb126349c40f32dc8 lrc: 1/0,0 mode: --/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f32dcf expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.709656:0:202215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b600/0xb126349c40f32dc8 lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f32dcf expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.709678:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508613.709680:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508613.709682:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508613.709694:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480082688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787508613.709724:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.709810:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:202226:1874324480082560:0@lo:104: 00010000:00010000:0.0:1787508613.709830:0:202226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f32ecb lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.709881:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480082688 00000100:00100000:2.0:1787508613.709885:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480082688 00010000:00010000:2.0:1787508613.709905:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab800/0xb126349c40f32dcf lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f32dc8 expref: 11 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.709963:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27795 00000100:00100000:2.0:1787508613.709970:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+11:3616:x1874324480082688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508613.709981:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1787508613.712436:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589961984 is committed 00000001:00080000:3.0:1787508613.712446:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589961983 is committed 00000001:00080000:3.0:1787508613.712514:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589961981 is committed 00000020:00080000:3.0:1787508613.712520:0:202955:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9090ca6db480 refcount 2 committed 0 result 0 batchid 4294998372 00000020:00080000:3.0:1787508613.712525:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9091f29b1300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9090ca6db780 00000020:00080000:3.0:1787508613.712528:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a2:0x5:0x0].580 00000020:00080000:3.0:1787508613.712531:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9091f29b1a00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090d7421000 00000020:00080000:3.0:1787508613.712533:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd1:0xf:0x0].37 00000020:00080000:2.0:1787508613.712553:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998369 00000020:00080000:3.0:1787508613.712555:0:202955:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9090d3f11cc0 refcount 2 committed 0 result 0 batchid 4294998371 00000020:00080000:3.0:1787508613.712558:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521c00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d3f11900 00000020:00080000:3.0:1787508613.712561:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a2:0x5:0x0].579 00000020:00080000:3.0:1787508613.712563:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090ce62a800 00000020:00080000:3.0:1787508613.712565:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd1:0xf:0x0].36 00000020:00080000:3.0:1787508613.712577:0:202955:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 4294998370 batchid updated 00000020:00080000:2.0:1787508613.712580:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294998372 committed batchid 4294998370 00010000:00010000:0.0:1787508613.712703:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f329f4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.712714:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f329f4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.712722:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f329f4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.712727:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.712731:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f329f4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.712738:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f329f4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.712754:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d0:0x0].0x0 (ffff9090cda8af00) 00010000:00010000:0.0:1787508613.712758:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.712763:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f329f4 lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.712768:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f329f4 lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.712782:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f329fb lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x28f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.712788:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f329fb lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x28f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.712794:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f329fb lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x28f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.712799:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.712801:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f329fb lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x28f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.712807:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f329fb lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x28f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.712814:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28f:0x0].0x0 (ffff9090cda8aa00) 00010000:00010000:0.0:1787508613.712816:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.712819:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f329fb lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x28f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.712824:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f329fb lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x28f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.712840:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f32b52 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.712846:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f32b52 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.712852:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f32b52 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.712857:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.712859:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f32b52 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.712865:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f32b52 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.712872:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d0:0x0].0x0 (ffff9090cda8af00) 00010000:00010000:0.0:1787508613.712875:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508613.712877:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f32b52 lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.712883:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f32b52 lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x13d0:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.712899:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f32b75 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.712905:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f32b75 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.712911:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f32b75 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.712915:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.712917:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f32b75 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.712923:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f32b75 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.712930:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x28f:0x0].0x0 (ffff9090cda8aa00) 00010000:00010000:0.0:1787508613.712933:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508613.712935:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f32b75 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787508613.713019:0:202975:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d74d9b40 with version 13589 00000020:00080000:2.0:1787508613.713029:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294998370 cancel update log [0x2000013a2:0x5:0x0].578: rc = 0 00000100:00100000:3.0:1787508613.713059:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000020:00080000:2.0:1787508613.713073:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294998370 cancel update log [0x240000bd1:0xf:0x0].35: rc = 0 00000020:00080000:2.0:1787508613.713083:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998370 00000100:00100000:3.0:1787508613.713087:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509475328 00000100:00100000:3.0:1787508613.713095:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509475328 00010000:00010000:2.0:1787508613.713125:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab800/0xb126349c40f32dcf lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f32dc8 expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.713136:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x166:0x0].0x0 (ffff9090c98d9b00) 00000100:00100000:3.0:1787508613.713137:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93634 00010000:00010000:2.0:1787508613.713140:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f32ecb lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.713145:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336027:x1874324509475328:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1787508613.713149:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f32ecb lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.713156:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f32ecb lrc: 4/1,0 mode: PR/PR res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.713167:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.713176:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508613.713183:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32ed2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadce6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.713239:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32ed9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.713252:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32ed9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.713260:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32ed9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.713270:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32ee0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.713277:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.713283:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.713338:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480082688:12345-0@lo:103:ldlm_bl.0 Request processed in 3368us (3612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.713347:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27795 00010000:00010000:3.0:1787508613.713361:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32ee7 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1258:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.713381:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32ee7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1258:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.713389:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32ee7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1258:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508613.713448:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1258:0x0]: returning size 4096 00000004:00200000:3.0:1787508613.713452:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1787508613.713478:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32ee7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1258:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.713488:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32ed9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.713492:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32ed9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.713495:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32ed9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.713499:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32ed9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.713501:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.713503:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32ed9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.713506:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32ed9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.713511:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.713513:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.713515:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32ed9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.713518:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32ed9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.713524:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.713531:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32ee0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.713534:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.713537:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.713538:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.713541:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32ee0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.713545:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d3c50f00) 00010000:00010000:3.0:1787508613.713546:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.713548:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32ee0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.713550:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32ee0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.713566:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f32ed2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadce6 expref: 586 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.713573:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32ee7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1258:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadce6 expref: 585 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.713577:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1258:0x0].0x0 (ffff9090d6c66200) 00010000:00010000:3.0:1787508613.713578:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508613.713580:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e800, rc 0) 00000100:00100000:3.0:1787508613.713618:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:336027:x1874324509475328:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 474us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.713625:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93634 00000100:00100000:3.0:1787508613.713674:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480082688:0@lo:103:ldlm_bl.0 00000004:00080000:1.0:1787508613.713739:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13589 rpc_version 13589 00000020:00100000:1.0:1787508613.713765:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787508613.713773:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090c788ed80 x1874324480082944/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787508613.713793:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788ed80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480082944:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508613.713834:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.713863:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c740f840 going to sleep for 11 seconds 00010000:00010000:0.0:1787508613.714305:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f32b75 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x28f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.714334:0:202226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f32ecb lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.714341:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f32ecb lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.714427:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480082944 00000100:00100000:3.0:1787508613.714433:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480082944 00000100:00100000:3.0:1787508613.714481:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29618 00000100:00100000:3.0:1787508613.714488:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:202961:x1874324480082944:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508613.714706:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:202961:x1874324480082944:12345-0@lo:1000:osp_up0-1.0 Request processed in 217us (870us total) trans 12884944048 rc 0/0 00000100:00100000:3.0:1787508613.714714:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29618 00000004:00200000:0.0:1787508613.714766:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd2:0x166:0x0]: returning size 4096 00000004:00200000:0.0:1787508613.714770:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508613.714804:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cdb25e00/0xb126349c40f32ec4 lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x166:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcdf expref: 7 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.714819:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f32ecb lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcdf expref: 6 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.714827:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x166:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:0.0:1787508613.714830:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508613.714832:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ac00, rc 0) 00000100:00100000:0.0:1787508613.714873:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336026:x1874324509475200:12345-192.168.201.30@tcp:101:rm.0 Request processed in 5951us (6128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.714879:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93633 00000100:00100000:3.0:1787508613.715876:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508613.715996:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509475456 00000100:00100000:2.0:1787508613.716005:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509475456 00000100:00100000:2.0:1787508613.716052:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93635 00000100:00100000:2.0:1787508613.716060:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:336027:x1874324509475456:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1787508613.716078:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.716095:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32eee lrc: 2/0,0 mode: --/CR res: [0x2000013a0:0x16e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadced expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.716142:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32ef5 lrc: 3/1,0 mode: --/PR res: [0x2000013a0:0x16e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.716155:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32ef5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.716166:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32ef5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508613.716197:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a0:0x16e:0x0]: returning size 4096 00000004:00200000:2.0:1787508613.716201:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787508613.716242:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f32eee lrc: 0/0,0 mode: --/CR res: [0x2000013a0:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadced expref: 587 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.716259:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32ef5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadced expref: 586 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.716267:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16e:0x0].0x0 (ffff9090d6c66400) 00010000:00010000:2.0:1787508613.716270:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508613.716273:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab000, rc 0) 00000100:00100000:2.0:1787508613.716319:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336027:x1874324509475456:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 259us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.716326:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93635 00000100:00100000:3.0:1787508613.717849:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.717919:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509475712 00000100:00100000:0.0:1787508613.717929:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509475712 00000100:00100000:0.0:1787508613.718011:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93636 00000100:00100000:0.0:1787508613.718021:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336026:x1874324509475712:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508613.718038:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508613.718055:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32efc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadcf4 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508613.718198:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1258:0x0]: returning size 4096 00010000:00010000:0.0:1787508613.718302:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32efc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcf4 expref: 15 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.718315:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.718317:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508613.718321:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f32efc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcf4 expref: 15 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.718331:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6e00, rc 0) 00000100:00100000:0.0:1787508613.718382:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336026:x1874324509475712:12345-192.168.201.30@tcp:101:rm.0 Request processed in 356us (533us total) trans 12884944049 rc 301/301 00000100:00100000:0.0:1787508613.718387:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93636 00000100:00100000:1.0:1787508613.718789:0:202961:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944046 gen 2 00000004:00080000:1.0:1787508613.718796:0:202961:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944046 committed transno 12884944046 00000020:00080000:1.0:1787508613.718802:0:202961:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9090d21c4480 refcount 2 committed 0 result 0 batchid 4294998373 00000020:00080000:1.0:1787508613.718807:0:202961:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9091f29b1800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d21c4840 00000020:00080000:1.0:1787508613.718811:0:202961:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a2:0x5:0x0].581 00000020:00080000:1.0:1787508613.718813:0:202961:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9091f29b1600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090d7421600 00000020:00080000:1.0:1787508613.718816:0:202961:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd1:0xf:0x0].38 00000100:00100000:1.0:1787508613.718853:0:202961:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9090c788ed80 x1874324480082944/t12884944048(12884944048) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1787508629 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787508613.718871:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788ed80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480082944:0@lo:1000:osp_up0-1.0 00000020:00080000:2.0:1787508613.719040:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294998373 committed batchid 4294998370 00000020:00080000:2.0:1787508613.719075:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998370 00000100:00100000:0.0:1787508613.719699:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.719779:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509475840 00000100:00100000:3.0:1787508613.719787:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509475840 00000100:00100000:3.0:1787508613.719863:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93637 00000100:00100000:3.0:1787508613.719873:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:336027:x1874324509475840:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1787508613.719894:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.719910:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f32f0a lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x166:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadcfb expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.720013:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f32f11 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x166:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.720028:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f32f11 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.720043:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f32f11 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508613.720083:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd2:0x166:0x0]: returning size 4096 00000004:00200000:3.0:1787508613.720088:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787508613.720123:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f32f0a lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x166:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcfb expref: 642 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.720140:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f32f11 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcfb expref: 641 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.720147:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x166:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:3.0:1787508613.720150:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508613.720153:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ea00, rc 0) 00000100:00100000:3.0:1787508613.720201:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+641:336027:x1874324509475840:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 328us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.720218:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93637 00000100:00100000:3.0:1787508613.723292:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.723359:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509476096 00000100:00100000:0.0:1787508613.723368:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509476096 00000100:00100000:0.0:1787508613.723436:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93638 00000100:00100000:0.0:1787508613.723447:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336027:x1874324509476096:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:0.0:1787508613.723512:0:230618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508613.723538:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32ee7 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1258:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadce6 expref: 586 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.723558:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1258:0x0].0x0 (ffff9090d6c66200) 00010000:00010000:0.0:1787508613.723563:0:230618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508613.723588:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32f18 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1258:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.723603:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f32e9a lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x1258:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcca expref: 13 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.723612:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32f18 lrc: 4/0,1 mode: --/PW res: [0x2000013a4:0x1258:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.723648:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f32e9a lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1258:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcca expref: 13 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.723662:0:230618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f32e9a lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1258:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcca expref: 13 pid: 205405 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.723681:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce781c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480083072:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508613.723984:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d21c4840 going to sleep for 11 seconds 00000100:00100000:2.0:1787508613.732638:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.732719:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce781c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480083072:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508613.732744:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32f18 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1258:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.732801:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.732914:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509476352 00000100:00100000:0.0:1787508613.732922:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509476352 00010000:00010000:0.0:1787508613.732989:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f32e9a lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1258:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcca expref: 14 pid: 205405 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.733018:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27796 00000100:00100000:0.0:1787508613.733025:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2401:x1874324509476352:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508613.733038:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508613.733043:0:229383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f32e9a lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1258:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcca expref: 14 pid: 205405 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.733052:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f32e9a lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1258:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcca expref: 14 pid: 205405 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.733071:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f32e9a lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1258:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcca expref: 14 pid: 205405 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.733084:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1258:0x0].0x0 (ffff9090d6c66200) 00010000:00010000:0.0:1787508613.733087:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32f18 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1258:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.733095:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32f18 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1258:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.733100:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32f18 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x1258:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.733113:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508613.733154:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2401:x1874324509476352:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 130us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.733158:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27796 00010000:00010000:1.0:1787508613.733265:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32f18 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1258:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.733271:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32f18 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1258:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.733298:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32f1f lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x16e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.733306:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f32ebd lrc: 2/0,0 mode: PR/PR res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcd8 expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.733315:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32ef5 lrc: 2/0,0 mode: PR/PR res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadced expref: 585 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.733320:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32f1f lrc: 5/0,1 mode: --/PW res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.733341:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32ef5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadced expref: 585 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.733350:0:230618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32ef5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadced expref: 585 pid: 209004 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.733359:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480083200:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508613.733418:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f32ebd lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcd8 expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.733427:0:230618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f32ebd lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcd8 expref: 12 pid: 203348 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.733436:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788c700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480083328:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508613.733453:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c740f840 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.733528:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509476224 00000100:00100000:3.0:1787508613.733533:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509476224 00000100:00100000:3.0:1787508613.733572:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15392 00000100:00100000:3.0:1787508613.733580:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336026:x1874324509476224:12345-192.168.201.30@tcp:37:rm.0 00000100:00100000:2.0:1787508613.739040:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.739130:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480083200:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508613.739138:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788c700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480083328:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508613.739160:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32f1f lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.739419:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509476480 00000100:00100000:0.0:1787508613.739427:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509476480 00010000:00010000:0.0:1787508613.739475:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32ef5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadced expref: 586 pid: 209004 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.739505:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27797 00000100:00100000:0.0:1787508613.739514:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c1ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:2400:x1874324509476480:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508613.739529:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508613.739536:0:225839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32ef5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadced expref: 586 pid: 209004 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.739548:0:225839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32ef5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadced expref: 586 pid: 209004 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.739570:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f32ef5 lrc: 0/0,0 mode: --/PR res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadced expref: 586 pid: 209004 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.739587:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16e:0x0].0x0 (ffff9090d6c66400) 00010000:00010000:0.0:1787508613.739590:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32f1f lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.739596:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32f1f lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.739600:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508613.739737:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c1ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:2400:x1874324509476480:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 224us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.739742:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27797 00000100:00100000:0.0:1787508613.741473:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336026:x1874324509476224:12345-192.168.201.30@tcp:37:rm.0 Request processed in 7879us (8834us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.741490:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15392 00000100:00100000:2.0:1787508613.744531:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.744603:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509476608 00000100:00100000:0.0:1787508613.744613:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509476608 00010000:00010000:0.0:1787508613.744659:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f32ebd lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcd8 expref: 13 pid: 203348 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.744698:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27798 00000100:00100000:0.0:1787508613.744706:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2402:x1874324509476608:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508613.744720:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508613.744726:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f32ebd lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcd8 expref: 13 pid: 203348 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.744740:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f32ebd lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcd8 expref: 13 pid: 203348 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.744760:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f32ebd lrc: 0/0,0 mode: --/PR res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcd8 expref: 13 pid: 203348 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.744776:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16e:0x0].0x0 (ffff9090d6c66400) 00010000:00010000:0.0:1787508613.744780:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32f1f lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.744789:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32f1f lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.744796:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32f1f lrc: 4/0,1 mode: PW/PW res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.744826:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508613.744876:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2402:x1874324509476608:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 170us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.744884:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27798 00010000:00010000:1.0:1787508613.744930:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32f1f lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.744956:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32f1f lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.745003:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b800/0xb126349c40f32f26 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.745011:0:230618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b800/0xb126349c40f32f26 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x0 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.745021:0:230618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b800/0xb126349c40f32f26 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.745042:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788c700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:230618:1874324480083456:0@lo:101:mdt00_006.0 00000100:00100000:1.0:1787508613.745082:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.745120:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c740f840 going to sleep for 11 seconds 00000100:00100000:0.0:1787508613.745200:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480083456 00000100:00100000:0.0:1787508613.745204:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480083456 00000100:00100000:0.0:1787508613.745243:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29619 00000100:00100000:0.0:1787508613.745251:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:230618:x1874324480083456:12345-0@lo:101:mdt00_006.0 00010000:00010000:0.0:1787508613.745265:0:225829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508613.745279:0:225829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f32f2d lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f32f26 expref: -99 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.745294:0:225829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f32ecb lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcdf expref: 5 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.745304:0:225829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f32f11 lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcfb expref: 640 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.745309:0:225829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f32f2d lrc: 5/0,0 mode: --/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f32f26 expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.745324:0:225829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f32f11 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcfb expref: 640 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.745333:0:225829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f32f11 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcfb expref: 640 pid: 202228 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.745341:0:225829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce780e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:225829:1874324480083584:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508613.745390:0:225829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f32ecb lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcdf expref: 5 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.745400:0:225829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f32ecb lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcdf expref: 5 pid: 202226 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.745409:0:225829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce781c00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:225829:1874324480083712:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508613.745441:0:225829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d21c40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.747304:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.747523:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509476736 00000100:00100000:1.0:1787508613.747534:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509476736 00000100:00100000:1.0:1787508613.747592:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15393 00000100:00100000:1.0:1787508613.747602:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336026:x1874324509476736:12345-192.168.201.30@tcp:37:rm.0 00000100:00100000:0.0:1787508613.748321:0:225829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce780e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:225829:1874324480083584:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508613.749177:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.749250:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509476864 00000100:00100000:0.0:1787508613.749257:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509476864 00010000:00010000:0.0:1787508613.749291:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f32f11 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcfb expref: 641 pid: 202228 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.749379:0:225829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce781c00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:225829:1874324480083712:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508613.749412:0:225829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f32f2d lrc: 3/0,0 mode: --/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32f26 expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.749423:0:225829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x166:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:1.0:1787508613.749426:0:225829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508613.749431:0:225829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f32f2d lrc: 3/0,0 mode: --/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32f26 expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.749440:0:225829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f32f2d lrc: 3/0,0 mode: --/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32f26 expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.749448:0:225829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6e00, rc 0) 00000100:00100000:1.0:1787508613.749514:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:230618:x1874324480083456:12345-0@lo:101:mdt00_006.0 Request processed in 4263us (4430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.749522:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29619 00000100:00100000:2.0:1787508613.749581:0:230618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589961984 gen 2 00000004:00080000:2.0:1787508613.749587:0:230618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961975 committed transno 8589961984 00000020:00080000:2.0:1787508613.749594:0:230618:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9090d9e8d6c0 refcount 2 committed 0 result 0 batchid 8589961978 00000020:00080000:2.0:1787508613.749598:0:230618:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521f00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d9e8df00 00000020:00080000:2.0:1787508613.749601:0:230618:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd2:0x1:0x0].1779 00000020:00080000:2.0:1787508613.749603:0:230618:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090ce62b200 00000020:00080000:2.0:1787508613.749605:0:230618:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1:0x0].1773 00000004:00080000:2.0:1787508613.749625:0:230618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961976 committed transno 8589961984 00000004:00080000:2.0:1787508613.749652:0:230618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961978 committed transno 8589961984 00000004:00080000:2.0:1787508613.749661:0:230618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961979 committed transno 8589961984 00000004:00080000:2.0:1787508613.749671:0:230618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961984 committed transno 8589961984 00000100:00100000:2.0:1787508613.749699:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788c700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:230618:1874324480083456:0@lo:101:mdt00_006.0 00010000:00010000:2.0:1787508613.749714:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b800/0xb126349c40f32f26 lrc: 4/0,1 mode: --/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32f2d expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.749724:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b800/0xb126349c40f32f26 lrc: 4/0,1 mode: --/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32f2d expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.749773:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27799 00000100:00100000:0.0:1787508613.749793:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+641:2400:x1874324509476864:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508613.749806:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508613.749813:0:229383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f32f11 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcfb expref: 641 pid: 202228 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.749825:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f32f11 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcfb expref: 641 pid: 202228 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.749844:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f32f11 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcfb expref: 641 pid: 202228 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.749859:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x166:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:0.0:1787508613.749864:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f32f2d lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32f26 expref: 5 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.749871:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f32f2d lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32f26 expref: 5 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.749877:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508613.749930:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2400:x1874324509476864:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 149us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.749937:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27799 00000020:00080000:1.0:1787508613.750682:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589961978 committed batchid 8589961977 00000020:00080000:1.0:1787508613.750748:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961977 00000100:00100000:1.0:1787508613.752023:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336026:x1874324509476736:12345-192.168.201.30@tcp:37:rm.0 Request processed in 4413us (4719us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.752033:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15393 00000100:00100000:2.0:1787508613.755354:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508613.755402:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.755497:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509477120 00000100:00100000:1.0:1787508613.755507:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509477120 00000100:00100000:1.0:1787508613.755603:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15394 00000100:00100000:1.0:1787508613.755613:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde31450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336026:x1874324509477120:12345-192.168.201.30@tcp:35:rm.0 00000100:00100000:1.0:1787508613.755851:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde31450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336026:x1874324509477120:12345-192.168.201.30@tcp:35:rm.0 Request processed in 239us (506us total) trans 12884944050 rc 0/0 00000100:00100000:1.0:1787508613.755861:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15394 00000100:00100000:0.0:1787508613.756433:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509477248 00000100:00100000:0.0:1787508613.756439:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509477248 00010000:00010000:0.0:1787508613.756478:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f32ecb lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcdf expref: 6 pid: 202226 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.756518:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27800 00000100:00100000:0.0:1787508613.756526:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2401:x1874324509477248:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508613.756538:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508613.756544:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f32ecb lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcdf expref: 6 pid: 202226 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.756557:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f32ecb lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcdf expref: 6 pid: 202226 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.756578:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f32ecb lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadcdf expref: 6 pid: 202226 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.756591:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x166:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:0.0:1787508613.756598:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f32f2d lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32f26 expref: 5 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.756607:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f32f2d lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f32f26 expref: 5 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.756615:0:202212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f32f2d lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f32f26 expref: 5 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.756645:0:202212:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f32f2d lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32f26 expref: 5 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.756664:0:202212:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce780a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:202212:1874324480083840:0@lo:105: 00000100:00100000:0.0:1787508613.756709:0:202212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.756751:0:202212:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d21c40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508613.756962:0:202209:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787508613.756974:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480083840 00000100:00100000:1.0:1787508613.756977:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480083840 00000100:00100000:1.0:1787508613.757008:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18129 00000100:00100000:1.0:1787508613.757014:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9605c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:202212:x1874324480083840:12345-0@lo:105: 00010000:00010000:1.0:1787508613.757026:0:202209:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b800/0xb126349c40f32f26 lrc: 5/0,1 mode: --/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32f2d expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.757036:0:202209:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b800/0xb126349c40f32f26 lrc: 5/0,1 mode: --/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32f2d expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.757044:0:202209:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b800/0xb126349c40f32f26 lrc: 5/0,1 mode: --/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32f2d expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.757051:0:202209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b800/0xb126349c40f32f26 lrc: 5/0,1 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f32f2d expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.757058:0:202209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b800/0xb126349c40f32f26 lrc: 6/0,1 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f32f2d expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.757066:0:202209:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b800/0xb126349c40f32f26 lrc: 6/0,1 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f32f2d expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.757084:0:202209:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d247b800) 00010000:00010000:3.0:1787508613.757125:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b800/0xb126349c40f32f26 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32f2d expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.757125:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9605c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:202212:x1874324480083840:12345-0@lo:105: Request processed in 111us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.757132:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18129 00010000:00010000:3.0:1787508613.757140:0:230618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b800/0xb126349c40f32f26 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32f2d expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787508613.757376:0:230618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1:0x0].1775, 344 off1826984 00000040:00080000:3.0:1787508613.757449:0:230618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x1:0x0].1782, 552 off2032168 00000004:00080000:3.0:1787508613.757455:0:230618:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d1d88180 with version 3445 00000100:00100000:0.0:1787508613.757672:0:202212:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce780a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:202212:1874324480083840:0@lo:105: 00010000:00010000:0.0:1787508613.757688:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508613.757736:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2401:x1874324509477248:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1209us (2331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.757743:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27800 00000004:00080000:2.0:1787508613.757975:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3445 rpc_version 3445 00000020:00100000:2.0:1787508613.758000:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787508613.758008:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091f9a9c380 x1874324480084096/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1648/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787508613.758028:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9c380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480084096:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787508613.758066:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508613.758091:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9000 going to sleep for 11 seconds 00000100:00100000:0.0:1787508613.758234:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480084096 00000100:00100000:0.0:1787508613.758240:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480084096 00000100:00100000:0.0:1787508613.758279:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29620 00000100:00100000:0.0:1787508613.758286:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:202248:x1874324480084096:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787508613.758624:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:202248:x1874324480084096:12345-0@lo:1000:osp_up1-0.0 Request processed in 338us (556us total) trans 8589961985 rc 0/0 00000100:00100000:0.0:1787508613.758633:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29620 00000100:00100000:2.0:1787508613.758817:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9c380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480084096:0@lo:1000:osp_up1-0.0 00000004:00010000:3.0:1787508613.759021:0:230618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000043552f0 reply state 00000000d6212064 transno 12884944051 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32f1f lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759039:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32f1f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759048:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16e:0x0].0x0 (ffff9090d6c66400) 00010000:00010000:3.0:1787508613.759051:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787508613.759055:0:230618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787508613.759061:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b800/0xb126349c40f32f26 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32f2d expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759070:0:230618:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b800/0xb126349c40f32f26 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32f2d expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787508613.759082:0:230618:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd2:0x166:0x0] 00000004:00010000:3.0:1787508613.759091:0:230618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000043552f0 reply state 00000000d6212064 transno 12884944051 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32f18 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1258:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759111:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32f18 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1258:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759117:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1258:0x0].0x0 (ffff9090d6c66200) 00010000:00010000:3.0:1787508613.759120:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787508613.759122:0:230618:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787508613.759131:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1258:0x0]: returning size 4096 00000100:00100000:2.0:1787508613.759135:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.759201:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336027:x1874324509476096:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 35756us (35917us total) trans 12884944051 rc 0/0 00000100:00100000:3.0:1787508613.759209:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93638 00000100:00100000:3.0:1787508613.759229:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509477376 00000100:00100000:3.0:1787508613.759234:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509477376 00000100:00100000:3.0:1787508613.759263:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93639 00000100:00100000:3.0:1787508613.759270:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336026:x1874324509477376:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508613.759284:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.759298:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32f34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadd02 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759349:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32f3b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759360:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32f3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759374:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32f3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759386:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32f42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759406:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32f42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759413:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32f42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759547:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32f49 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1258:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759556:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32f49 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1258:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759563:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32f49 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1258:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508613.759629:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1258:0x0]: returning size 4096 00000004:00200000:3.0:1787508613.759634:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1787508613.759650:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32f49 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1258:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759661:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32f3b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759667:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32f3b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759673:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32f3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759679:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32f3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759685:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.759690:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32f3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759697:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32f3b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759707:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.759709:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.759713:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32f3b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759719:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32f3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759732:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32f42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759737:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32f42 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759743:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32f42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759747:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.759750:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32f42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759756:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32f42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759763:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d3c50f00) 00010000:00010000:3.0:1787508613.759765:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.759767:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32f42 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759773:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32f42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759800:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32f34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd02 expref: 15 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759812:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32f49 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1258:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd02 expref: 14 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.759819:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1258:0x0].0x0 (ffff9090d6c66200) 00010000:00010000:3.0:1787508613.759821:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508613.759823:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f200, rc 0) 00000100:00100000:3.0:1787508613.759865:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336026:x1874324509477376:12345-192.168.201.30@tcp:101:rm.0 Request processed in 594us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.759872:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93639 00000100:00100000:2.0:1787508613.761862:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.762042:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509477632 00000100:00100000:3.0:1787508613.762051:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509477632 00000100:00100000:3.0:1787508613.762110:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93640 00000100:00100000:3.0:1787508613.762119:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d74b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336026:x1874324509477632:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:3.0:1787508613.762166:0:205405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787508613.762190:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32f49 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1258:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd02 expref: 14 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.762206:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1258:0x0].0x0 (ffff9090d6c66200) 00010000:00010000:3.0:1787508613.762216:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f32ddd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadc8b expref: 13 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.762225:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.762229:0:205405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508613.762248:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32f50 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.762260:0:205405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f32e15 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadca0 expref: 585 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.762268:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32f50 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.762298:0:205405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f32e15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadca0 expref: 585 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.762311:0:205405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f32e15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadca0 expref: 585 pid: 209004 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.762324:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbc380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480084224:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508613.762517:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787508613.766470:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.766555:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509477760 00000100:00100000:0.0:1787508613.766565:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509477760 00010000:00010000:0.0:1787508613.766606:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f32e15 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadca0 expref: 586 pid: 209004 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.766649:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27801 00000100:00100000:0.0:1787508613.766660:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d74bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:2402:x1874324509477760:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508613.766676:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508613.766683:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f32e15 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadca0 expref: 586 pid: 209004 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.766698:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f32e15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadca0 expref: 586 pid: 209004 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.766721:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.766727:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32f50 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.766738:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32f50 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.766746:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32f50 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.766768:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508613.766844:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d74bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:2402:x1874324509477760:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 186us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.766853:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27801 00010000:00010000:3.0:1787508613.767391:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f32e15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadca0 expref: 585 pid: 209004 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.767411:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbc380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480084224:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508613.767430:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32f50 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.767439:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32f50 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.767445:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32f50 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.767475:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32f57 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.767486:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32f57 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.767494:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32f57 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.767599:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32f5e lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x1258:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.767609:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32f5e lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1258:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.767616:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32f5e lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1258:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.767632:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32f65 lrc: 3/0,1 mode: --/EX res: [0x2000013a0:0x16e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.767640:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32f65 lrc: 3/0,1 mode: EX/EX res: [0x2000013a0:0x16e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.767647:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32f65 lrc: 3/0,1 mode: EX/EX res: [0x2000013a0:0x16e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.767677:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f32f6c lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.767685:0:205405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f32f6c lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x0 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.767695:0:205405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f32f6c lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.767713:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbc380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:205405:1874324480084352:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1787508613.767758:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.767802:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787508613.767879:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480084352 00000100:00100000:0.0:1787508613.767884:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480084352 00000100:00100000:0.0:1787508613.767925:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29621 00000100:00100000:0.0:1787508613.767934:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:205405:x1874324480084352:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1787508613.767975:0:202231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508613.767991:0:202231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f32f73 lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f32f6c expref: -99 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.768011:0:202231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f32f2d lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32f26 expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.768026:0:202231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f32f73 lrc: 4/0,0 mode: --/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f32f6c expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.768047:0:202231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f32f2d lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f32f26 expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.768058:0:202231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce780a80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:202231:1874324480084480:0@lo:104: 00000100:00100000:0.0:1787508613.768085:0:202231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.768114:0:202231:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c886c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.769155:0:229386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480084480 00000100:00100000:3.0:1787508613.769164:0:229386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480084480 00000100:00100000:3.0:1787508613.769217:0:229386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18130 00000100:00100000:3.0:1787508613.769225:0:229386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce780380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:202231:x1874324480084480:12345-0@lo:104: 00010000:00010000:3.0:1787508613.769237:0:229386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b800/0xb126349c40f32f26 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f32f2d expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.769297:0:229386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787508613.769302:0:229386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce780380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:202231:x1874324480084480:12345-0@lo:104: Request processed in 79us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.769308:0:229386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18130 00010000:00010000:2.0:1787508613.769395:0:226765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787508613.769401:0:226765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b800/0xb126349c40f32f26 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f32f2d expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.769409:0:226765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b800 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:2.0:1787508613.769414:0:226765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b800/0xb126349c40f32f26 lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f32f2d expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508613.769423:0:226765:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b800/0xb126349c40f32f26 lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f32f2d expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.769449:0:226765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b800/0xb126349c40f32f26 lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f32f2d expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.769454:0:226765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787508613.769486:0:226765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b800/0xb126349c40f32f26 lrc: 1/0,0 mode: --/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f32f2d expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.769494:0:226765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d247b800/0xb126349c40f32f26 lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f32f2d expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.769507:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508613.769508:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508613.769510:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508613.769517:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787508613.769528:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d74b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480084608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787508613.769558:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.769758:0:202231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce780a80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:202231:1874324480084480:0@lo:104: 00010000:00010000:0.0:1787508613.769788:0:202231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f32f73 lrc: 3/0,0 mode: --/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32f6c expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.769795:0:202231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x166:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:0.0:1787508613.769797:0:202231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787508613.769800:0:202231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f32f73 lrc: 3/0,0 mode: --/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32f6c expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.769806:0:202231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f32f73 lrc: 3/0,0 mode: --/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32f6c expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.769810:0:202231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6c00, rc 0) 00000100:00100000:0.0:1787508613.769841:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:205405:x1874324480084352:12345-0@lo:101:mdt00_004.0 Request processed in 1910us (2084us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.769846:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29621 00000100:00100000:0.0:1787508613.769866:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480084608 00000100:00100000:0.0:1787508613.769868:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480084608 00010000:00010000:0.0:1787508613.769880:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f32f2d lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f32f26 expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.769900:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27802 00000100:00100000:0.0:1787508613.769905:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9681c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+8:3616:x1874324480084608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508613.769912:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787508613.770588:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbc380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:205405:1874324480084352:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1787508613.770604:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f32f6c lrc: 4/0,1 mode: --/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32f73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.770614:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f32f6c lrc: 4/0,1 mode: --/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32f73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787508613.774335:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589961985 is committed 00000020:00080000:0.0:1787508613.774351:0:202955:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 4294998373 batchid updated 00000020:00080000:0.0:1787508613.774355:0:202955:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 4294998372 batchid updated 00000020:00080000:2.0:1787508613.774391:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998373 00000004:00080000:2.0:1787508613.774447:0:202975:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d74d9000 with version 13590 00000020:00080000:2.0:1787508613.774468:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294998371 cancel update log [0x2000013a2:0x5:0x0].579: rc = 0 00000020:00080000:2.0:1787508613.774536:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294998371 cancel update log [0x240000bd1:0xf:0x0].36: rc = 0 00000004:00080000:2.0:1787508613.774558:0:202975:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d74d9780 with version 13591 00000020:00080000:2.0:1787508613.774561:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294998372 cancel update log [0x2000013a2:0x5:0x0].580: rc = 0 00000020:00080000:2.0:1787508613.774576:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294998372 cancel update log [0x240000bd1:0xf:0x0].37: rc = 0 00000004:00080000:2.0:1787508613.774593:0:202975:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d74d9180 with version 13592 00000020:00080000:2.0:1787508613.774595:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294998373 cancel update log [0x2000013a2:0x5:0x0].581: rc = 0 00000020:00080000:2.0:1787508613.774607:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294998373 cancel update log [0x240000bd1:0xf:0x0].38: rc = 0 00000020:00080000:2.0:1787508613.774613:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998373 00000004:00080000:1.0:1787508613.774655:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13590 rpc_version 13590 00000020:00100000:1.0:1787508613.774686:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787508613.774696:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090c788c000 x1874324480084864/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787508613.774718:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788c000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480084864:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508613.774783:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.774823:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c740ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787508613.774875:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480084864 00000100:00100000:2.0:1787508613.774882:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480084864 00000100:00100000:2.0:1787508613.774929:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29622 00000100:00100000:2.0:1787508613.774937:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:202961:x1874324480084864:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508613.775091:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202961:x1874324480084864:12345-0@lo:1000:osp_up0-1.0 Request processed in 153us (307us total) trans 12884944052 rc 0/0 00000100:00100000:2.0:1787508613.775098:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29622 00000100:00100000:1.0:1787508613.775167:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788c000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480084864:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1787508613.775175:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13591 rpc_version 13591 00000020:00100000:1.0:1787508613.775184:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787508613.775188:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090c788ea00 x1874324480085120/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787508613.775196:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788ea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480085120:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508613.775216:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.775238:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c740ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787508613.775277:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480085120 00000100:00100000:2.0:1787508613.775280:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480085120 00000100:00100000:2.0:1787508613.775306:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29623 00000100:00100000:2.0:1787508613.775310:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202961:x1874324480085120:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508613.775370:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:202961:x1874324480085120:12345-0@lo:1000:osp_up0-1.0 Request processed in 59us (152us total) trans 12884944053 rc 0/0 00000100:00100000:2.0:1787508613.775376:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29623 00000100:00100000:3.0:1787508613.775407:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788ea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480085120:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1787508613.775415:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13592 rpc_version 13592 00000020:00100000:3.0:1787508613.775427:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787508613.775432:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091dabbc000 x1874324480085376/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787508613.775444:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbc000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480085376:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508613.775485:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508613.775557:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480085376 00000100:00100000:2.0:1787508613.775561:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480085376 00000100:00100000:2.0:1787508613.775590:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29624 00000100:00100000:2.0:1787508613.775596:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:202961:x1874324480085376:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508613.775632:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787508613.775674:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:202961:x1874324480085376:12345-0@lo:1000:osp_up0-1.0 Request processed in 78us (188us total) trans 12884944054 rc 0/0 00000100:00100000:2.0:1787508613.775681:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29624 00000100:00100000:2.0:1787508613.775731:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.775733:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbc000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480085376:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508613.775749:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509477888 00000100:00100000:3.0:1787508613.775752:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509477888 00000100:00100000:3.0:1787508613.775805:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93641 00000100:00100000:3.0:1787508613.775813:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:336028:x1874324509477888:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508613.775825:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.775845:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32f7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadd09 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.775915:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32f81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.775928:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32f50 lrc: 2/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.775952:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32f81 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.775967:0:202228:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32f50 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.775977:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32f81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.776077:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f32f2d lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x166:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f32f26 expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.776092:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x166:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:1.0:1787508613.776097:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f32f73 lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32f6c expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.776106:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f32f73 lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f32f6c expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.776113:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f32f73 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f32f6c expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.776136:0:229383:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f32f73 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f32f6c expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.776145:0:229383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:229383:1874324480085504:0@lo:105: 00000100:00100000:1.0:1787508613.776180:0:229383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.776248:0:229383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c740fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787508613.776283:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480085504 00000100:00100000:0.0:1787508613.776288:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480085504 00000100:00100000:0.0:1787508613.776353:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18131 00000100:00100000:0.0:1787508613.776361:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:229383:x1874324480085504:12345-0@lo:105: 00010000:00010000:0.0:1787508613.776381:0:202210:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f32f6c lrc: 5/0,1 mode: --/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32f73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.776391:0:202210:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f32f6c lrc: 5/0,1 mode: --/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32f73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.776399:0:202210:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f32f6c lrc: 5/0,1 mode: --/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f32f73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.776406:0:202210:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f32f6c lrc: 5/0,1 mode: EX/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f32f73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.776413:0:202210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f32f6c lrc: 6/0,1 mode: EX/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f32f73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.776425:0:202210:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f32f6c lrc: 6/0,1 mode: EX/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f32f73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.776448:0:202210:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090e4c8f800) 00000100:00100000:0.0:1787508613.776494:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:229383:x1874324480085504:12345-0@lo:105: Request processed in 135us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.776500:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18131 00010000:00010000:3.0:1787508613.776548:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f32f6c lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32f73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.776548:0:229383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:229383:1874324480085504:0@lo:105: 00010000:00010000:3.0:1787508613.776557:0:205405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f32f6c lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32f73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.776562:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508613.776596:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9681c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+6:3616:x1874324480084608:12345-0@lo:103:ldlm_bl.0 Request processed in 6691us (7038us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.776604:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27802 00000100:00100000:2.0:1787508613.776638:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d74b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480084608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787508613.777180:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbc380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:205405:1874324480085632:0@lo:403:mdt00_004.0 00000100:00100000:3.0:1787508613.777218:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.777244:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787508613.777299:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480085632 00000100:00100000:2.0:1787508613.777305:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480085632 00000100:00100000:2.0:1787508613.777348:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29625 00000100:00100000:2.0:1787508613.777355:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:205405:x1874324480085632:12345-0@lo:403:mdt00_004.0 00000100:00100000:2.0:1787508613.779136:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:205405:x1874324480085632:12345-0@lo:403:mdt00_004.0 Request processed in 1775us (1910us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.779149:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29625 00000100:00100000:3.0:1787508613.779162:0:205405:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589961985 gen 2 00000004:00080000:3.0:1787508613.779167:0:205405:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961985 committed transno 8589961985 00000100:00100000:3.0:1787508613.779201:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbc380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:205405:1874324480085632:0@lo:403:mdt00_004.0 00000040:00080000:3.0:1787508613.780065:0:205405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1:0x0].1776, 664 off1827648 00000040:00080000:3.0:1787508613.780229:0:205405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x1:0x0].1783, 744 off2032912 00000004:00080000:3.0:1787508613.780235:0:205405:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d1d88e40 with version 3446 00000004:00080000:2.0:1787508613.780309:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3446 rpc_version 3446 00000020:00100000:2.0:1787508613.780338:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787508613.780346:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090c9680380 x1874324480085888/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1448/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787508613.780368:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9680380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480085888:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787508613.780416:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508613.780448:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9240 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.780581:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480085888 00000100:00100000:3.0:1787508613.780589:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480085888 00000100:00100000:3.0:1787508613.780658:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29626 00000100:00100000:3.0:1787508613.780665:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:202248:x1874324480085888:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787508613.780842:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:202248:x1874324480085888:12345-0@lo:1000:osp_up1-0.0 Request processed in 177us (425us total) trans 8589961986 rc 0/0 00000100:00100000:3.0:1787508613.780849:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29626 00000100:00100000:2.0:1787508613.780909:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9680380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480085888:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1787508613.780973:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1258:0x0]: returning size 4096 00010000:00010000:0.0:1787508613.780993:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32f65 lrc: 3/0,1 mode: EX/EX res: [0x2000013a0:0x16e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.781000:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32f65 lrc: 2/0,0 mode: EX/EX res: [0x2000013a0:0x16e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.781006:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32f65 lrc: 3/0,0 mode: EX/EX res: [0x2000013a0:0x16e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.781009:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.781013:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32f65 lrc: 3/0,0 mode: EX/EX res: [0x2000013a0:0x16e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.781017:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32f65 lrc: 4/0,0 mode: EX/EX res: [0x2000013a0:0x16e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.781029:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16e:0x0].0x0 (ffff9090d6c66400) 00010000:00010000:0.0:1787508613.781031:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787508613.781034:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32f65 lrc: 2/0,0 mode: --/EX res: [0x2000013a0:0x16e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.781041:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f32f65 lrc: 0/0,0 mode: --/EX res: [0x2000013a0:0x16e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.781050:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f32f6c lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f32f73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.781055:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f32f6c lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f32f73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.781059:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f32f6c lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f32f73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.781075:0:205405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787508613.781082:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd2:0x166:0x0] 00010000:00010000:0.0:1787508613.781088:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32f5e lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1258:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.781094:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32f5e lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x1258:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.781099:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32f5e lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1258:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.781101:0:202214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508613.781105:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.781107:0:202214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f32f6c lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xb126349c40f32f73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.781108:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32f5e lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1258:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.781114:0:202214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:0.0:1787508613.781115:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32f5e lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x1258:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.781119:0:202214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f32f6c lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xb126349c40f32f73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508613.781126:0:202214:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f32f6c lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xb126349c40f32f73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.781127:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1258:0x0].0x0 (ffff9090d6c66200) 00010000:00010000:0.0:1787508613.781130:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787508613.781133:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32f5e lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x1258:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.781138:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f32f5e lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x1258:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.781152:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32f50 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.781154:0:202214:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f32f6c lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f32f73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.781159:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32f50 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.781166:0:202214:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787508613.781166:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32f50 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.781170:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32f50 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.781174:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.781177:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32f50 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.781183:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32f50 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.781186:0:202214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f32f6c lrc: 1/0,0 mode: --/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f32f73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.781191:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.781192:0:202214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f32f6c lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f32f73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.781193:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.781196:0:205405:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32f81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.781209:0:205405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32f81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.781216:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32f81 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.781239:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32f50 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.781245:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f32f50 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.781329:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:0.0:1787508613.781330:0:205405:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006317fb16 reply state 00000000a4125908 transno 12884944055 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32f57 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.781332:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508613.781333:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508613.781342:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32f57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.781345:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480086016:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508613.781349:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d3c50f00) 00010000:00010000:0.0:1787508613.781351:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787508613.781354:0:205405:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787508613.781375:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508613.781413:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480086016 00000100:00100000:2.0:1787508613.781417:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480086016 00000100:00100000:0.0:1787508613.781422:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d74b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336026:x1874324509477632:12345-192.168.201.30@tcp:36:rm.0 Request processed in 19303us (19565us total) trans 12884944055 rc 0/0 00000100:00100000:0.0:1787508613.781429:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93640 00000100:00100000:2.0:1787508613.781445:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9774 00000100:00100000:2.0:1787508613.781451:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3618:x1874324480086016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508613.781474:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508613.781491:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f32f73 lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x166:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f32f6c expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.781504:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x166:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:2.0:1787508613.781511:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508613.781545:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3618:x1874324480086016:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (169us total) trans 0 rc 0/0 00010000:00010000:3.0:1787508613.781550:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32f81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.781551:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9774 00010000:00010000:3.0:1787508613.781558:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32f81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508613.781597:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508613.781602:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508613.781617:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32f81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.781641:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f32f7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd09 expref: 587 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.781655:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32f81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd09 expref: 586 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.781662:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.781664:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508613.781666:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fe00, rc 0) 00000100:00100000:3.0:1787508613.781696:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509477888:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 5884us (5966us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.781702:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93641 00000100:00100000:0.0:1787508613.782064:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480086016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787508613.784154:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.784229:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509478016 00000100:00100000:3.0:1787508613.784238:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509478016 00000100:00100000:3.0:1787508613.784294:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93642 00000100:00100000:3.0:1787508613.784304:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509478016:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508613.784321:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.784340:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32f88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadd10 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.784409:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f32f8f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.784426:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f32f8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.784436:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f32f8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.784451:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f32f96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.784467:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f32f96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.784474:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f32f96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.784535:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f32f8f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.784544:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f32f8f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.784550:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f32f8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.784556:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f32f8f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.784563:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.784568:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f32f8f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.784574:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f32f8f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.784586:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.784589:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.784593:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f32f8f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.784600:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f32f8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.784613:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f32f96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.784619:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f32f96 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.784626:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f32f96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.784630:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.784633:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f32f96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.784638:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f32f96 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.784644:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090cc088700) 00010000:00010000:3.0:1787508613.784646:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.784648:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f32f96 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.784653:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f32f96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.784686:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32f88 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd10 expref: 587 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.784695:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.784697:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508613.784700:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f32f88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd10 expref: 587 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.784708:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fa00, rc 0) 00000100:00100000:3.0:1787508613.784777:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509478016:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 473us (631us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508613.784794:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93642 00000100:00100000:2.0:1787508613.788744:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.788844:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509478144 00000100:00100000:0.0:1787508613.788855:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509478144 00000100:00100000:0.0:1787508613.788924:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93643 00000100:00100000:0.0:1787508613.788935:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509478144:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508613.789003:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508613.789023:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32f9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadd17 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.789085:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32fa4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.789099:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32fa4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.789109:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32fa4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.789123:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32fab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.789129:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32fab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.789135:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32fab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.789192:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32fa4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.789200:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32fa4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.789218:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32fa4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.789225:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32fa4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.789230:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.789234:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32fa4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.789241:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32fa4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.789252:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.789255:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.789260:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32fa4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.789266:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f32fa4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.789279:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32fab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.789284:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32fab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.789290:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32fab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.789295:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.789298:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32fab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.789304:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32fab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.789315:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090e460fa00) 00010000:00010000:0.0:1787508613.789318:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.789320:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32fab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.789326:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f32fab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.789356:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32f9d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd17 expref: 587 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.789366:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.789368:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508613.789371:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f32f9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd17 expref: 587 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.789379:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7800, rc 0) 00000100:00100000:0.0:1787508613.789438:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509478144:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 505us (702us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508613.789445:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93643 00000100:00100000:0.0:1787508613.795253:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508613.795396:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509478272 00000100:00100000:2.0:1787508613.795406:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509478272 00000100:00100000:2.0:1787508613.795477:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93644 00000100:00100000:2.0:1787508613.795488:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336029:x1874324509478272:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508613.795512:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.795533:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f32fb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadd1e expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.795593:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f32fb9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.795607:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f32fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.795620:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f32fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508613.795667:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508613.795671:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508613.795689:0:209004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f32fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.795714:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f32fb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd1e expref: 16 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.795732:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f32fb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd1e expref: 15 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.795741:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.795744:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508613.795748:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abe00, rc 0) 00000100:00100000:2.0:1787508613.795821:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336029:x1874324509478272:12345-192.168.201.30@tcp:101:rm.0 Request processed in 335us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.795828:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93644 00000100:00100000:3.0:1787508613.798339:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.798386:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508613.798471:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509478400 00000100:00100000:2.0:1787508613.798483:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509478400 00000100:00100000:2.0:1787508613.798533:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509478528 00000100:00100000:2.0:1787508613.798536:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509478528 00000100:00100000:2.0:1787508613.798558:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93645 00000100:00100000:2.0:1787508613.798566:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336029:x1874324509478400:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508613.798583:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.798604:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32fc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadd2c expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.798680:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f32fc7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.798693:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f32fc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.798704:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f32fc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.798718:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f32fce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.798725:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f32fce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.798732:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f32fce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.798803:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f32fc7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.798811:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f32fc7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.798817:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f32fc7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.798823:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f32fc7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.798829:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.798834:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f32fc7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.798841:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f32fc7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.798853:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.798856:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.798864:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f32fc7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.798873:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f32fc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.798906:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93646 00000100:00100000:0.0:1787508613.798919:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509478528:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508613.798927:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508613.798936:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32fd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadd25 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.798997:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f32fdc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.799005:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f32fdc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.799016:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f32fdc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.799027:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32fe3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.799033:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.799039:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.799058:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f32fdc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.799063:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f32fdc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.799072:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f32fdc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.799077:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f32fdc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.799081:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.799085:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f32fdc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.799090:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f32fdc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.799097:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.799099:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.799101:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f32fdc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.799107:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f32fdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.799118:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.799124:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32fe3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.799129:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32fe3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.799133:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.799135:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32fe3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.799139:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32fe3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.799145:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090e460f500) 00010000:00010000:0.0:1787508613.799147:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.799149:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32fe3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.799154:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f32fe3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.799177:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32fd5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd25 expref: 587 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.799183:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.799185:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508613.799187:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f32fd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd25 expref: 587 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.799193:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6800, rc 0) 00000100:00100000:0.0:1787508613.799248:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509478528:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 334us (861us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508613.799256:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93646 00010000:00010000:2.0:1787508613.799414:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f32fce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.799421:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f32fce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.799428:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f32fce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.799433:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.799435:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f32fce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.799442:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f32fce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.799450:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090c98d9b00) 00010000:00010000:2.0:1787508613.799453:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.799455:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f32fce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.799471:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f32fce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.799494:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32fc0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd2c expref: 16 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.799503:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.799505:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508613.799509:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f32fc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd2c expref: 16 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.799517:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aac00, rc 0) 00000100:00100000:2.0:1787508613.799554:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336029:x1874324509478400:12345-192.168.201.30@tcp:101:rm.0 Request processed in 988us (1222us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508613.799563:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93645 00000100:00100000:3.0:1787508613.803871:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508613.804025:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509478784 00000100:00100000:2.0:1787508613.804036:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509478784 00000100:00100000:2.0:1787508613.804098:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93647 00000100:00100000:2.0:1787508613.804108:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509478784:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508613.804128:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.804147:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f32fea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadd33 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.804222:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32ff1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.804237:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32ff1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.804248:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32ff1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.804263:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32ff8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.804270:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.804277:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.804336:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32ff1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.804348:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32ff1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.804354:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32ff1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.804360:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32ff1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.804365:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.804370:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32ff1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.804377:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32ff1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.804388:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.804391:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.804396:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32ff1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.804402:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f32ff1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.804415:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.804420:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32ff8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.804426:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32ff8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.804431:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.804434:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32ff8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.804439:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32ff8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.804446:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xce5b6a33 (ffff9090c98d9400) 00010000:00010000:2.0:1787508613.804449:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.804452:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32ff8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.804469:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f32ff8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.804503:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f32fea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd33 expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.804513:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.804515:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508613.804519:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f32fea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd33 expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.804528:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab200, rc 0) 00000100:00100000:2.0:1787508613.804595:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509478784:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 488us (732us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508613.804604:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93647 00000100:00100000:0.0:1787508613.808752:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.808805:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.808856:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509478912 00000100:00100000:1.0:1787508613.808865:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509478912 00000100:00100000:3.0:1787508613.808869:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509479168 00000100:00100000:3.0:1787508613.808872:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509479168 00000100:00100000:1.0:1787508613.808925:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93648 00000100:00100000:3.0:1787508613.808931:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93649 00000100:00100000:1.0:1787508613.808935:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509479168:12345-192.168.201.30@tcp:101:lfs.0 00000100:00100000:3.0:1787508613.808937:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336029:x1874324509478912:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508613.808979:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.808979:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.808999:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32fff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadd3a expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.808999:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33006 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadd41 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.809055:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33014 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.809055:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3300d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.809069:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33014 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.809080:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33014 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.809096:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3301b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.809103:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3301b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.809110:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3301b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.809178:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33014 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.810541:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3300d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.810558:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3300d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.810560:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33014 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.810567:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33014 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.810573:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33014 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.810579:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.810579:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33022 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.810583:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33014 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.810585:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33022 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.810592:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33014 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.810592:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33022 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.810605:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.810609:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.810613:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33014 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.810619:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33014 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.810634:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3301b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.810641:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3301b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.810646:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3301b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.810648:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3300d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.810652:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fa00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.810655:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3301b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.810659:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3300d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.810661:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3301b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.810665:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3300d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.810668:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090cc088700) 00010000:00010000:1.0:1787508613.810670:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3300d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.810671:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.810673:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3301b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.810675:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.810678:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3300d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.810679:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3301b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.810684:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3300d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.810690:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.810692:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.810694:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3300d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.810698:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3300d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.810707:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33022 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.810712:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33022 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.810716:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32fff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd3a expref: 16 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.810717:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33022 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.810723:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.810726:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33022 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.810727:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.810729:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508613.810732:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33022 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.810733:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f32fff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd3a expref: 16 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.810738:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaf7dd568 (ffff9090c6987700) 00010000:00010000:3.0:1787508613.810741:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f800, rc 0) 00010000:00010000:1.0:1787508613.810741:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.810743:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33022 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.810747:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33022 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.810768:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33006 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd41 expref: 587 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.810776:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.810788:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508613.810796:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33006 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd41 expref: 587 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.810805:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a400, rc 0) 00000100:00100000:1.0:1787508613.810868:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509479168:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1933us (2061us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508613.810876:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93648 00000100:00100000:2.0:1787508613.814166:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336029:x1874324509478912:12345-192.168.201.30@tcp:101:rm.0 Request processed in 5218us (5413us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508613.814177:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93649 00000100:00100000:0.0:1787508613.816713:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.817268:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508613.817443:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509479424 00000100:00100000:2.0:1787508613.817452:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509479424 00000100:00100000:2.0:1787508613.817504:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509479552 00000100:00100000:2.0:1787508613.817508:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509479552 00000100:00100000:2.0:1787508613.817538:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93650 00000100:00100000:3.0:1787508613.817548:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93651 00000100:00100000:2.0:1787508613.817550:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509479424:12345-192.168.201.30@tcp:101:lfs.0 00000100:00100000:3.0:1787508613.817556:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336029:x1874324509479552:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508613.817568:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.817569:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.817588:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f33029 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadd48 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.817589:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33030 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadd4f expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.817718:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3303e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.817718:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33037 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.817733:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3303e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.817743:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33037 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.817744:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3303e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.817752:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33037 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.817757:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33045 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.817762:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3304c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.817764:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33045 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.817769:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3304c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.817771:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33045 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.817775:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3304c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.817834:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3303e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.817842:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3303e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.817848:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3303e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.817853:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3303e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.817859:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fa00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.817860:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33037 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.817863:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3303e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.817867:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33037 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.817872:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33037 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.817877:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33037 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.817879:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3303e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.817883:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.817890:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.817890:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33037 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.817893:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.817896:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33037 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.817898:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3303e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.817904:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3303e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.817904:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.817907:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.817909:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33037 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.817914:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33037 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.817917:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33045 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.817923:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33045 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.817923:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3304c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.817930:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33045 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.817930:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3304c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.817936:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.817937:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3304c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.817966:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33045 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.817973:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33045 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.817981:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090cc088700) 00010000:00010000:3.0:1787508613.817983:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.817986:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33045 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.817991:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33045 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.818020:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33030 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd4f expref: 16 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.818029:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.818031:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508613.818035:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33030 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd4f expref: 16 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.818043:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f800, rc 0) 00000100:00100000:3.0:1787508613.818073:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480086400:0@lo:400:kworker.0 00000100:00100000:3.0:1787508613.818122:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.818146:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480086528:0@lo:400:kworker.0 00000100:00100000:3.0:1787508613.818157:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c8fb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480086912:0@lo:400:kworker.0 00000100:00100000:3.0:1787508613.818173:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.818192:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480087424:0@lo:400:kworker.0 00000100:00100000:0.0:1787508613.818202:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480086912 00000100:00100000:0.0:1787508613.818215:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480086912 00000100:00100000:3.0:1787508613.818225:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.818241:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787508613.818241:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480087424 00000100:00100000:0.0:1787508613.818244:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480087424 00000100:00100000:3.0:1787508613.818246:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480086272:0@lo:400:kworker.0 00000100:00100000:3.0:1787508613.818267:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.818268:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2855 00000100:00100000:0.0:1787508613.818274:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480086912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508613.818282:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c8fbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480086784:0@lo:400:kworker.0 00000100:00100000:3.0:1787508613.818300:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.818310:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480086912:12345-0@lo:400:kworker.0 Request processed in 36us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.818314:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c8fb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480087296:0@lo:400:kworker.0 00000100:00100000:0.0:1787508613.818317:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2855 00000100:00100000:3.0:1787508613.818331:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.818333:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2856 00000100:00100000:0.0:1787508613.818339:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480087424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508613.818357:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c8fb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480086912:0@lo:400:kworker.0 00000100:00100000:0.0:1787508613.818363:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480087424:12345-0@lo:400:kworker.0 Request processed in 25us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.818368:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480087424:0@lo:400:kworker.0 00000100:00100000:0.0:1787508613.818380:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2856 00000100:00100000:0.0:1787508613.818391:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480087296 00000100:00100000:3.0:1787508613.818393:0:203996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480086400 00000100:00100000:0.0:1787508613.818394:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480087296 00000100:00100000:3.0:1787508613.818396:0:203996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480086400 00000100:00100000:0.0:1787508613.818410:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2857 00000100:00100000:0.0:1787508613.818415:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480087296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508613.818420:0:203996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480086272 00000100:00100000:3.0:1787508613.818422:0:203996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480086272 00000100:00100000:3.0:1787508613.818436:0:203996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480086784 00000100:00100000:3.0:1787508613.818439:0:203996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480086784 00000100:00100000:0.0:1787508613.818447:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480087296:12345-0@lo:400:kworker.0 Request processed in 32us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.818453:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2857 00000100:00100000:3.0:1787508613.818470:0:203996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2264 00000100:00100000:3.0:1787508613.818476:0:203996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480086400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508613.818506:0:203996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480086400:12345-0@lo:400:kworker.0 Request processed in 31us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.818513:0:203996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2264 00000100:00100000:3.0:1787508613.818529:0:203996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2265 00000100:00100000:3.0:1787508613.818534:0:203996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480086272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508613.818560:0:203996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480086272:12345-0@lo:400:kworker.0 Request processed in 26us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.818566:0:203996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2265 00000100:00100000:3.0:1787508613.818576:0:203996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2266 00000100:00100000:3.0:1787508613.818581:0:203996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480086784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508613.818606:0:203996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480086784:12345-0@lo:400:kworker.0 Request processed in 25us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.818612:0:203996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2266 00010000:00010000:2.0:1787508613.818701:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.818705:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3304c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.818711:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3304c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.818721:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3e9f33b0 (ffff9090c98d9400) 00010000:00010000:2.0:1787508613.818723:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.818726:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3304c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.818731:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3304c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.818763:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f33029 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd48 expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.818771:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.818774:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508613.818847:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f33029 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd48 expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.818860:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab200, rc 0) 00000100:00100000:2.0:1787508613.818876:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79de3f65-4bad-42d0-a46f-842a654b33a0:3619:1874324480086144:0@lo:400:kworker.0 00000100:00100000:2.0:1787508613.818912:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508613.818962:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480086656:0@lo:400:kworker.0 00000100:00100000:0.0:1787508613.819001:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480086144 00000100:00100000:0.0:1787508613.819005:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480086144 00000100:00100000:0.0:1787508613.819029:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:0.0:1787508613.819034:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091cbbc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3619:x1874324480086144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508613.819062:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091cbbc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3619:x1874324480086144:12345-0@lo:400:kworker.0 Request processed in 27us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.819067:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00100000:2.0:1787508613.819123:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508613.819145:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c8fbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480087168:0@lo:400:kworker.0 00000100:00100000:2.0:1787508613.819161:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508613.819181:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79de3f65-4bad-42d0-a46f-842a654b33a0:3619:1874324480086144:0@lo:400:kworker.0 00000100:00100000:3.0:1787508613.819312:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.819318:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480087168 00000100:00100000:1.0:1787508613.819323:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480087168 00000100:00100000:3.0:1787508613.819331:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c8fb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874324480087040:0@lo:400:kworker.0 00000100:00100000:1.0:1787508613.819344:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480086528 00000100:00100000:1.0:1787508613.819347:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480086528 00000100:00100000:3.0:1787508613.819352:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.819357:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480087040 00000100:00100000:1.0:1787508613.819359:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480087040 00000100:00100000:3.0:1787508613.819374:0:225838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480086656 00000100:00100000:3.0:1787508613.819377:0:225838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480086656 00000100:00100000:3.0:1787508613.819399:0:225838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2267 00000100:00100000:3.0:1787508613.819406:0:225838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480086656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508613.819442:0:225838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480086656:12345-0@lo:400:kworker.0 Request processed in 36us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.819448:0:225838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2267 00000100:00100000:0.0:1787508613.819453:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2858 00000100:00100000:0.0:1787508613.819472:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d74b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480087168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508613.819495:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480086656:0@lo:400:kworker.0 00000100:00100000:3.0:1787508613.819503:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c8fbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480087168:0@lo:400:kworker.0 00000100:00100000:0.0:1787508613.819504:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d74b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480087168:12345-0@lo:400:kworker.0 Request processed in 35us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.819510:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2858 00000100:00100000:0.0:1787508613.819523:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2859 00000100:00100000:3.0:1787508613.819525:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480086272:0@lo:400:kworker.0 00000100:00100000:0.0:1787508613.819529:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480086528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508613.819533:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c8fbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480086784:0@lo:400:kworker.0 00000100:00100000:3.0:1787508613.819543:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c8fb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480087296:0@lo:400:kworker.0 00000100:00100000:3.0:1787508613.819552:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480086400:0@lo:400:kworker.0 00000100:00100000:0.0:1787508613.819557:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480086528:12345-0@lo:400:kworker.0 Request processed in 30us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.819563:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2859 00000100:00100000:0.0:1787508613.819573:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2860 00000100:00100000:3.0:1787508613.819577:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480086528:0@lo:400:kworker.0 00000100:00100000:0.0:1787508613.819579:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874324480087040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508613.819621:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336029:x1874324509479552:12345-192.168.201.30@tcp:101:rm.0 Request processed in 2065us (2353us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508613.819698:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93651 00000100:00080000:2.0:1787508613.819709:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787508613.819714:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787508613.819716:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787508613.819894:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874324480087040:12345-0@lo:400:kworker.0 Request processed in 314us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.819900:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2860 00000100:00100000:1.0:1787508613.820314:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c8fb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874324480087040:0@lo:400:kworker.0 00000100:00100000:2.0:1787508613.820568:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509479424:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 3016us (3861us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508613.820576:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93650 00000100:00100000:0.0:1787508613.823773:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.823820:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508613.823865:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509479808 00000100:00100000:2.0:1787508613.823875:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509479808 00000100:00100000:1.0:1787508613.824060:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509480064 00000100:00100000:1.0:1787508613.824066:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509480064 00000100:00100000:2.0:1787508613.824090:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93652 00000100:00100000:2.0:1787508613.824100:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336029:x1874324509479808:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508613.824120:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.824140:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f33053 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadd56 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.824165:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93653 00000100:00100000:1.0:1787508613.824173:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509480064:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508613.824181:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.824189:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3305a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadd5d expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.824225:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33061 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.824226:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33068 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.824240:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33061 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.824251:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33061 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.824265:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3306f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.824273:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3306f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.824279:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3306f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.824340:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33061 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.824343:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33068 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.824353:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33068 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.824355:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33061 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.824361:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33061 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.824367:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33076 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.824368:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33061 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.824374:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.824378:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33061 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.824381:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33076 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.824386:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33061 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.824388:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33076 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.824398:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.824401:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.824405:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33061 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.824411:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33061 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.824414:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33068 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.824420:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33068 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.824424:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3306f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.824425:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33068 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.824431:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3306f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.824432:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33068 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.824437:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3306f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.824438:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.824441:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33068 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.824442:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.824444:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3306f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.824447:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33068 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.824450:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3306f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.824454:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.824468:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090c98d9400) 00010000:00010000:1.0:1787508613.824468:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.824470:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.824471:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33068 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.824473:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3306f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.824477:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33068 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.824478:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3306f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.824487:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33076 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.824492:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33076 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.824498:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33076 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.824502:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.824505:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33076 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.824507:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f33053 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd56 expref: 16 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.824512:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33076 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.824517:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.824518:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ad43c78 (ffff9090c6987700) 00010000:00010000:2.0:1787508613.824520:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508613.824520:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.824522:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33076 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.824524:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f33053 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd56 expref: 16 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.824529:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33076 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.824533:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab200, rc 0) 00010000:00010000:1.0:1787508613.824546:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3305a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd5d expref: 587 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.824553:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.824555:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508613.824557:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3305a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd5d expref: 587 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.824564:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a400, rc 0) 00000100:00100000:2.0:1787508613.824596:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336029:x1874324509479808:12345-192.168.201.30@tcp:101:rm.0 Request processed in 496us (831us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508613.824603:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93652 00000100:00100000:1.0:1787508613.824720:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509480064:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 547us (898us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508613.824730:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93653 00000100:00100000:3.0:1787508613.827769:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.827861:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509480192 00000100:00100000:0.0:1787508613.827871:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509480192 00000100:00100000:0.0:1787508613.828023:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93654 00000100:00100000:0.0:1787508613.828035:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336029:x1874324509480192:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508613.828056:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508613.828080:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3307d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadd64 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.828142:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f33084 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.828157:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f33084 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.828174:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f33084 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.828185:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3308b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.828206:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3308b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.828215:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3308b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.828278:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f33084 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.828286:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f33084 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.828292:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f33084 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.828298:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f33084 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.828303:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.828307:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f33084 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.828314:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f33084 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.828325:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.828329:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.828334:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f33084 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.828339:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f33084 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.828353:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3308b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.828360:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3308b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.828366:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3308b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.828384:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.828388:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3308b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.828393:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3308b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.828401:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d3c50f00) 00010000:00010000:0.0:1787508613.828403:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.828406:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3308b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.828411:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3308b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.828442:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3307d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd64 expref: 16 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.828453:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.828467:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.828472:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3307d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd64 expref: 16 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.828482:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7600, rc 0) 00000100:00100000:0.0:1787508613.828549:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336029:x1874324509480192:12345-192.168.201.30@tcp:101:rm.0 Request processed in 516us (789us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508613.828556:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93654 00000100:00100000:2.0:1787508613.829406:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.829517:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509480448 00000100:00100000:3.0:1787508613.829526:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509480448 00000100:00100000:3.0:1787508613.829577:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93655 00000100:00100000:3.0:1787508613.829587:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509480448:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508613.829601:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.829616:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33092 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadd6b expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.829677:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33099 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.829689:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33099 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.829698:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33099 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.829712:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f330a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.829723:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f330a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.829730:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f330a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.829775:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33099 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.829792:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33099 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.829799:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33099 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.829806:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33099 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.829812:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fa00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.829815:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33099 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.829822:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33099 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.829834:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.829836:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.829840:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33099 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.829846:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33099 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.829860:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f330a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.829867:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f330a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.829873:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f330a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.829879:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.829881:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f330a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.829886:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f330a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.829893:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbfff8436 (ffff9090cc088700) 00010000:00010000:3.0:1787508613.829895:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.829897:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f330a0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.829902:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f330a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.829932:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33092 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd6b expref: 587 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.829980:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.829984:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508613.829988:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33092 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd6b expref: 587 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.829998:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f200, rc 0) 00000100:00100000:3.0:1787508613.830041:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509480448:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 456us (639us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508613.830048:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93655 00000100:00100000:3.0:1787508613.833930:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508613.834421:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509480704 00000100:00100000:2.0:1787508613.834431:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509480704 00000100:00100000:2.0:1787508613.834511:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93656 00000100:00100000:2.0:1787508613.834522:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509480704:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508613.834543:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.834564:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f330a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadd72 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.834763:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f330ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.834894:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f330ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.834909:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f330ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.834928:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f330b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.834935:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f330b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.835067:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f330b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.835133:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f330ae lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.835141:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f330ae lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.835148:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f330ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.835153:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f330ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.835159:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.835163:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f330ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.835170:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f330ae lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.835181:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.835184:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.835188:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f330ae lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.835889:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f330ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.835910:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f330b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.835916:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f330b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.835922:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f330b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.835927:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.835931:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f330b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.835937:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f330b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.836051:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x594a0ca2 (ffff9090c98d9400) 00010000:00010000:2.0:1787508613.836053:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.836057:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f330b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.836062:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f330b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.836105:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f330a7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd72 expref: 587 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.836115:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.836118:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508613.836122:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f330a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd72 expref: 587 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.836136:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab200, rc 0) 00000100:00100000:2.0:1787508613.836306:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509480704:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1784us (2384us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508613.836315:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93656 00000100:00100000:3.0:1787508613.840509:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.840596:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509480960 00000100:00100000:1.0:1787508613.840607:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509480960 00000100:00100000:1.0:1787508613.840686:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93657 00000100:00100000:1.0:1787508613.840696:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509480960:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508613.840716:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.840738:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f330bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadd79 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.840811:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f330c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.840824:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f330c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.840835:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f330c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.840849:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f330ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.840856:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f330ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.840863:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f330ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.840918:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f330c3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.840930:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f330c3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.840936:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f330c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.840986:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f330c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.840993:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.840997:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f330c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.841006:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f330c3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.841019:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.841022:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.841026:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f330c3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.841032:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f330c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.841046:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f330ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.841053:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f330ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.841058:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f330ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.841064:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508613.841066:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f330ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.841072:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f330ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.841079:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe67841 (ffff9090c6987700) 00010000:00010000:1.0:1787508613.841081:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.841083:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f330ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.841089:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f330ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.841120:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f330bc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd79 expref: 587 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.841131:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.841133:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508613.841137:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f330bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd79 expref: 587 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.841147:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a400, rc 0) 00000100:00100000:1.0:1787508613.841210:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509480960:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 514us (711us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508613.841223:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93657 00000100:00100000:0.0:1787508613.847143:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.847243:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509481216 00000100:00100000:3.0:1787508613.847253:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509481216 00000100:00100000:3.0:1787508613.847316:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93658 00000100:00100000:3.0:1787508613.847326:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509481216:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508613.847348:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.847373:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f330d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadd80 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.847444:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f330d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.847486:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f330d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.847497:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f330d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.847512:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f330df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.847519:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f330df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.847526:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f330df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.847581:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f330d8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.847588:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f330d8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.847593:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f330d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.847599:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f330d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.847605:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.847610:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f330d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.847617:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f330d8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.847639:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.847643:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.847647:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f330d8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.847653:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f330d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.847665:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f330df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.847671:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f330df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.847677:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f330df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.847682:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fa00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.847684:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f330df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.847689:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f330df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.847696:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090cc088700) 00010000:00010000:3.0:1787508613.847699:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.847702:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f330df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.847708:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f330df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.847738:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f330d1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd80 expref: 587 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.847747:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.847750:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508613.847753:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f330d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd80 expref: 587 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.847767:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f200, rc 0) 00000100:00100000:3.0:1787508613.847833:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509481216:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 509us (700us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508613.847841:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93658 00000100:00100000:0.0:1787508613.855614:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508613.855726:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509481472 00000100:00100000:2.0:1787508613.855737:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509481472 00000100:00100000:2.0:1787508613.855800:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93659 00000100:00100000:2.0:1787508613.855810:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509481472:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508613.855832:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.855853:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f330e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadd87 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.855928:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f330ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.855984:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f330ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.855997:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f330ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.856013:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f330f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.856020:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f330f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.856026:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f330f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.856091:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f330ed lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.856099:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f330ed lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.856106:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f330ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.856113:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f330ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.856119:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.856123:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f330ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.856131:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f330ed lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.856143:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.856145:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.856150:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f330ed lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.856157:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f330ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.856170:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f330f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.856177:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f330f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.856184:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f330f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.856189:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.856192:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f330f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.856199:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f330f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.856206:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x90ba0166 (ffff9090c98d9400) 00010000:00010000:2.0:1787508613.856209:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.856212:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f330f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.856218:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f330f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.856248:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f330e6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd87 expref: 587 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.856259:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.856262:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508613.856265:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f330e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd87 expref: 587 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.856275:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab200, rc 0) 00000100:00100000:2.0:1787508613.856335:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509481472:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 526us (728us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508613.856346:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93659 00000100:00100000:0.0:1787508613.862927:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508613.863098:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509481728 00000100:00100000:2.0:1787508613.863108:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509481728 00000100:00100000:2.0:1787508613.863173:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93660 00000100:00100000:2.0:1787508613.863184:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509481728:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508613.863216:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.863235:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f330fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadd8e expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.863312:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33102 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.863326:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33102 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.863337:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33102 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.863351:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33109 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.863358:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33109 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.863364:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33109 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.863415:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33102 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.863428:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33102 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.863434:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33102 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.863440:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33102 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.863446:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.863450:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33102 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.863467:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33102 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.863480:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.863483:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.863488:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33102 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.863494:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33102 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.863507:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33109 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.863514:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33109 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.863519:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33109 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.863525:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.863528:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33109 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.863533:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33109 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.863540:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaf3dc4c9 (ffff9090c98d9400) 00010000:00010000:2.0:1787508613.863542:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.863545:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33109 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.863551:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33109 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.863583:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f330fb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd8e expref: 587 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.863592:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.863594:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508613.863598:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f330fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd8e expref: 587 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.863605:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab200, rc 0) 00000100:00100000:2.0:1787508613.863679:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509481728:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 497us (761us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508613.863686:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93660 00000100:00100000:0.0:1787508613.869516:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508613.869617:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509481856 00000100:00100000:2.0:1787508613.869640:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509481856 00000100:00100000:2.0:1787508613.869743:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93661 00000100:00100000:2.0:1787508613.869754:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509481856:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508613.869776:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.869810:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f33110 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadd95 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.869879:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33117 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.869894:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33117 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.869907:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33117 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.869918:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3311e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.869926:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3311e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.869934:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3311e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.870027:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33117 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.870035:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33117 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.870040:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33117 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.870047:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33117 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.870052:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.870056:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33117 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.870063:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33117 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.870075:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.870078:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.870082:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33117 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.870088:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33117 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.870101:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3311e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.870107:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3311e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.870112:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3311e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.870117:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.870120:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3311e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.870129:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3311e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.870136:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d3c50f00) 00010000:00010000:2.0:1787508613.870138:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.870141:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3311e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.870146:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3311e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.870171:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f33110 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd95 expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.870181:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.870184:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.870187:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f33110 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd95 expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.870210:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab200, rc 0) 00000100:00100000:2.0:1787508613.870264:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336028:x1874324509481856:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 511us (757us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508613.870271:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93661 00000100:00100000:0.0:1787508613.873522:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.873626:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509482112 00000100:00100000:1.0:1787508613.873637:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509482112 00000100:00100000:1.0:1787508613.873702:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93662 00000100:00100000:1.0:1787508613.873712:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:336028:x1874324509482112:12345-192.168.201.30@tcp:36:lfs.0 00000100:00100000:1.0:1787508613.873822:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480087552:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787508613.873872:0:202227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.873908:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c740f300 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.873923:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480087552 00000100:00100000:3.0:1787508613.873927:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480087552 00000100:00100000:3.0:1787508613.874069:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29627 00000100:00100000:3.0:1787508613.874077:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:202227:x1874324480087552:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787508613.874158:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:202227:x1874324480087552:12345-0@lo:1000:mdt00_001.0 Request processed in 81us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.874164:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29627 00000100:00100000:1.0:1787508613.874617:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480087552:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787508613.874667:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480087680:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787508613.874695:0:202227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.876230:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c740f300 going to sleep for 11 seconds 00000100:00100000:2.0:1787508613.876370:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480087680 00000100:00100000:2.0:1787508613.876380:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480087680 00000100:00100000:0.0:1787508613.881920:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29628 00000100:00100000:0.0:1787508613.881974:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:202227:x1874324480087680:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787508613.882149:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:202227:x1874324480087680:12345-0@lo:1000:mdt00_001.0 Request processed in 215us (7452us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787508613.882157:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29628 00000100:00100000:1.0:1787508613.882617:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480087680:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787508613.882699:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f33125 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.882710:0:202227:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f33125 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.882720:0:202227:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f33125 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.882739:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b39c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480087808:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1787508613.882788:0:202227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.882815:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c740ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787508613.883175:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480087808 00000100:00100000:2.0:1787508613.883183:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480087808 00000100:00100000:2.0:1787508613.883216:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29629 00000100:00100000:2.0:1787508613.883224:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:202227:x1874324480087808:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1787508613.883237:0:225829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.883253:0:225829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3312c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f33125 expref: -99 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.883279:0:225829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32f81 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd09 expref: 585 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.883288:0:225829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f32fb9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd1e expref: 14 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.883298:0:225829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3312c lrc: 5/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f33125 expref: 11 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.883323:0:225829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f32fb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd1e expref: 14 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.883336:0:225829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f32fb9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd1e expref: 14 pid: 209004 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.883347:0:225829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce782680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480087936:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508613.883421:0:225829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32f81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd09 expref: 585 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.883431:0:225829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32f81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd09 expref: 585 pid: 202228 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.883445:0:225829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce782a00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480088064:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508613.883479:0:225829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9240 going to sleep for 11 seconds 00000100:00100000:2.0:1787508613.889283:0:225829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce782680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480087936:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508613.889301:0:225829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce782a00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480088064:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508613.889333:0:225829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3312c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33125 expref: 11 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.889345:0:225829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.889348:0:225829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.889352:0:225829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3312c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33125 expref: 11 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.889362:0:225829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aac00, rc 0) 00000100:00100000:2.0:1787508613.889426:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:202227:x1874324480087808:12345-0@lo:101:mdt00_001.0 Request processed in 6201us (6646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.889436:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29629 00000100:00100000:1.0:1787508613.889536:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b39c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480087808:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1787508613.889556:0:202227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f33125 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3312c expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.889571:0:202227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f33125 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3312c expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.893241:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.893286:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.893319:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.893398:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509482496 00000100:00100000:3.0:1787508613.893408:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509482496 00000100:00100000:3.0:1787508613.893473:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93663 00000100:00100000:3.0:1787508613.893483:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336034:x1874324509482496:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508613.893506:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.893529:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33133 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadd9c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.893589:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3313a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.893603:0:203348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3312c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33125 expref: 10 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.893611:0:203348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3313a lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.893652:0:203348:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3312c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xb126349c40f33125 expref: 10 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.893663:0:203348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3313a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.893759:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509482240 00000100:00100000:1.0:1787508613.893763:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509482240 00010000:00010000:1.0:1787508613.893782:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f32fb9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd1e expref: 17 pid: 209004 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.893810:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509482368 00000100:00100000:1.0:1787508613.893813:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509482368 00010000:00010000:1.0:1787508613.893824:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32f81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd09 expref: 586 pid: 202228 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.893848:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27803 00000100:00100000:1.0:1787508613.893854:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c1ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:2401:x1874324509482240:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508613.893863:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508613.893869:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f32fb9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd1e expref: 17 pid: 209004 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.893882:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f32fb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd1e expref: 17 pid: 209004 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.893899:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f32fb9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd1e expref: 17 pid: 209004 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.893913:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.893918:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3313a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.893926:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3312c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xb126349c40f33125 expref: 10 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.893933:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3313a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.893974:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508613.894016:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c1ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:2401:x1874324509482240:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 162us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.894023:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27803 00000100:00100000:1.0:1787508613.894068:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27804 00000100:00100000:1.0:1787508613.894073:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:2401:x1874324509482368:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508613.894080:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508613.894084:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32f81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd09 expref: 586 pid: 202228 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.894094:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32f81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd09 expref: 586 pid: 202228 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.894106:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f32f81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd09 expref: 586 pid: 202228 timeout: 13684 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.894116:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.894119:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3313a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.894130:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3312c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xb126349c40f33125 expref: 10 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.894139:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3312c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xb126349c40f33125 expref: 10 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.894146:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3312c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xb126349c40f33125 expref: 10 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.894155:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3313a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.894161:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3313a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.894177:0:202213:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3312c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xb126349c40f33125 expref: 10 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.894191:0:202213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbe680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:202213:1874324480088320:0@lo:105: 00000100:00100000:1.0:1787508613.894242:0:202213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.894275:0:202213:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c740f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787508613.894291:0:229386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480088320 00000100:00100000:1.0:1787508613.894294:0:229386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480088320 00000100:00100000:1.0:1787508613.894316:0:229386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18132 00000100:00100000:1.0:1787508613.894322:0:229386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:202213:x1874324480088320:12345-0@lo:105: 00010000:00010000:1.0:1787508613.894330:0:229386:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f33125 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3312c expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.894344:0:229386:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f33125 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3312c expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.894352:0:229386:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f33125 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3312c expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.894360:0:229386:0:(ldlm_lockd.c:2058:ldlm_handle_cp_callback()) ### completion AST includes blocking AST ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f33125 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xb126349c40f3312c expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.894367:0:229386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f33125 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xb126349c40f3312c expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.894374:0:229386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f33125 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xb126349c40f3312c expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.894382:0:229386:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f33125 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1480400000000 nid: local remote: 0xb126349c40f3312c expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.894395:0:229386:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d247a400) 00000100:00100000:1.0:1787508613.894418:0:229386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:202213:x1874324480088320:12345-0@lo:105: Request processed in 97us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.894424:0:229386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18132 00000100:00100000:1.0:1787508613.894452:0:202213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbe680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:202213:1874324480088320:0@lo:105: 00010000:00010000:1.0:1787508613.894477:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508613.894493:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:2401:x1874324509482368:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 419us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.894503:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27804 00010000:00010000:1.0:1787508613.894530:0:202227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f33125 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f3312c expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.894539:0:202227:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f33125 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f3312c expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787508613.894559:0:202227:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787508613.894584:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f33141 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.894590:0:202227:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f33141 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.894600:0:202227:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f33141 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.894612:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480088448:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1787508613.894635:0:202227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.894651:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c740f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787508613.894662:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480088448 00000100:00100000:1.0:1787508613.894665:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480088448 00000100:00100000:1.0:1787508613.894685:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29630 00000100:00100000:1.0:1787508613.894690:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:202227:x1874324480088448:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1787508613.894699:0:202232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.894709:0:202232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33148 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f33141 expref: -99 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.894727:0:202232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32db3 lrc: 2/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.894735:0:202232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32f57 lrc: 2/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.894742:0:202232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33148 lrc: 5/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f33141 expref: 12 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.894752:0:202232:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32f57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:1.0:1787508613.894776:0:202232:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:1.0:1787508613.894806:0:202232:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32db3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:1.0:1787508613.895083:0:202232:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:1.0:1787508613.895101:0:202232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33148 lrc: 3/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33141 expref: 12 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.895109:0:202232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d3c50f00) 00010000:00010000:1.0:1787508613.895112:0:202232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.895115:0:202232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33148 lrc: 3/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33141 expref: 12 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.895122:0:202232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a200, rc 0) 00000100:00100000:1.0:1787508613.895151:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:202227:x1874324480088448:12345-0@lo:101:mdt00_001.0 Request processed in 461us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.895160:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29630 00000100:00100000:1.0:1787508613.895184:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480088448:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1787508613.895194:0:202227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f33141 lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33148 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.895203:0:202227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f33141 lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33148 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787508613.897023:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944055 is committed 00000001:00080000:1.0:1787508613.897041:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944054 is committed 00000001:00080000:1.0:1787508613.897052:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944051 is committed 00000020:00080000:1.0:1787508613.897056:0:202206:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9090d1d88d80 refcount 2 committed 0 result 0 batchid 8589961980 00000020:00080000:1.0:1787508613.897061:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9091d47d0d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d1d88180 00000020:00080000:1.0:1787508613.897065:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd2:0x1:0x0].1782 00000020:00080000:1.0:1787508613.897068:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9091d47d0500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090e3c8e800 00000020:00080000:1.0:1787508613.897071:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1:0x0].1775 00000020:00080000:1.0:1787508613.897095:0:202206:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8589961978 batchid updated 00000020:00080000:1.0:1787508613.897104:0:202206:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9090c740f180 refcount 2 committed 0 result 0 batchid 8589961979 00000020:00080000:1.0:1787508613.897107:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9090c740ff00 00000020:00080000:1.0:1787508613.897110:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd2:0x1:0x0].1780 00000020:00080000:1.0:1787508613.897111:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090ce62a400 00000020:00080000:1.0:1787508613.897114:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1:0x0].1774 00010000:00010000:3.0:1787508613.897179:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32f57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.897191:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32f57 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.897198:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32f57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.897204:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.897208:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32f57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.897217:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32f57 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.897232:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d3c50f00) 00010000:00010000:3.0:1787508613.897236:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.897241:0:3603:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33148 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33141 expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.897252:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32f57 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.897263:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f32f57 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.897337:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32db3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.897345:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32db3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.897351:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32db3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.897355:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.897358:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32db3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.897364:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32db3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.897385:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d3c50f00) 00010000:00010000:0.0:1787508613.897387:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.897391:0:3602:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33148 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33141 expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.897400:0:3602:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33148 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f33141 expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.897407:0:3602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33148 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f33141 expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.897448:0:3602:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33148 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33141 expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.897471:0:3602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3602:1874324480088576:0@lo:105: 00000100:00100000:0.0:1787508613.897530:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.897579:0:3602:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88540 going to sleep for 11 seconds 00000020:00080000:2.0:1787508613.897704:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589961980 committed batchid 8589961978 00000004:00080000:2.0:1787508613.897828:0:202262:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d74d9240 with version 3447 00000020:00080000:2.0:1787508613.897845:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589961978 cancel update log [0x240000bd2:0x1:0x0].1779: rc = 0 00000020:00080000:2.0:1787508613.897891:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589961978 cancel update log [0x2000013a0:0x1:0x0].1773: rc = 0 00000020:00080000:2.0:1787508613.897899:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961978 00000004:00080000:3.0:1787508613.897972:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3447 rpc_version 3447 00000020:00100000:3.0:1787508613.897994:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787508613.898003:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091e6a5ca80 x1874324480088832/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787508613.898021:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5ca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480088832:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787508613.898059:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.898087:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88780 going to sleep for 11 seconds 00000100:00100000:2.0:1787508613.898149:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480088832 00000100:00100000:2.0:1787508613.898158:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480088832 00000100:00100000:2.0:1787508613.898210:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29631 00000100:00100000:2.0:1787508613.898222:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:202248:x1874324480088832:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787508613.898377:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:202248:x1874324480088832:12345-0@lo:1000:osp_up1-0.0 Request processed in 146us (306us total) trans 8589961987 rc 0/0 00000100:00100000:2.0:1787508613.898385:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29631 00000100:00100000:0.0:1787508613.898546:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5ca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480088832:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787508613.899057:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480088576 00000100:00100000:1.0:1787508613.899064:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480088576 00000100:00100000:1.0:1787508613.899141:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18133 00000100:00100000:1.0:1787508613.899151:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3602:x1874324480088576:12345-0@lo:105: 00010000:00010000:1.0:1787508613.899165:0:202209:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f33141 lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33148 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.899177:0:202209:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f33141 lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33148 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.899187:0:202209:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f33141 lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33148 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.899197:0:202209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f33141 lrc: 5/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f33148 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.899205:0:202209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f33141 lrc: 6/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f33148 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.899214:0:202209:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f33141 lrc: 6/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f33148 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.899244:0:202209:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d247b600) 00000100:00100000:1.0:1787508613.899294:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3602:x1874324480088576:12345-0@lo:105: Request processed in 145us (1764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.899302:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18133 00010000:00010000:3.0:1787508613.899348:0:202227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f33141 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33148 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.899359:0:202227:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f33141 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33148 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787508613.899397:0:202227:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1787508613.899438:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480088960:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787508613.899486:0:202227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.899507:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88780 going to sleep for 11 seconds 00000100:00100000:0.0:1787508613.899663:0:3602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3602:1874324480088576:0@lo:105: 00010000:00010000:0.0:1787508613.899682:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32db3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899691:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f32db3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899705:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32dba lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1258:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899712:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32dba lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x1258:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899719:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32dba lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1258:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899725:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247be00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.899729:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32dba lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1258:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899736:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32dba lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x1258:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899749:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1258:0x0].0x0 (ffff9090d6c66200) 00010000:00010000:0.0:1787508613.899752:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.899755:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32dba lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x1258:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899761:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f32dba lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x1258:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899775:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32dc1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899781:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32dc1 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a0:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899787:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32dc1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899792:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.899795:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32dc1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899801:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32dc1 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a0:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899807:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16e:0x0].0x0 (ffff9090d6c66400) 00010000:00010000:0.0:1787508613.899810:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.899812:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32dc1 lrc: 2/0,0 mode: --/TXN res: [0x2000013a0:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899818:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f32dc1 lrc: 0/0,0 mode: --/TXN res: [0x2000013a0:0x16e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899831:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32f18 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1258:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899837:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32f18 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x1258:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899843:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32f18 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1258:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899848:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.899851:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32f18 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1258:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899857:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32f18 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x1258:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899863:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1258:0x0].0x0 (ffff9090d6c66200) 00010000:00010000:0.0:1787508613.899865:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508613.899868:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32f18 lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x1258:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899873:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f32f18 lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x1258:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899887:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32f1f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899894:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32f1f lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899900:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32f1f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899905:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.899908:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32f1f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899914:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32f1f lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899925:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16e:0x0].0x0 (ffff9090d6c66400) 00010000:00010000:0.0:1787508613.899927:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508613.899930:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32f1f lrc: 2/0,0 mode: --/TXN res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.899935:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f32f1f lrc: 0/0,0 mode: --/TXN res: [0x2000013a0:0x16e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.900056:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480088960 00000100:00100000:1.0:1787508613.900061:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480088960 00000100:00100000:1.0:1787508613.900188:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29632 00000100:00100000:1.0:1787508613.900197:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202227:x1874324480088960:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787508613.900309:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202227:x1874324480088960:12345-0@lo:1000:mdt00_001.0 Request processed in 113us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.900318:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29632 00000100:00100000:3.0:1787508613.900449:0:202227:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944054 gen 2 00000004:00080000:3.0:1787508613.900466:0:202227:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944048 committed transno 12884944054 00000004:00080000:3.0:1787508613.900485:0:202227:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944052 committed transno 12884944054 00000004:00080000:3.0:1787508613.900494:0:202227:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944053 committed transno 12884944054 00000004:00080000:3.0:1787508613.900503:0:202227:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944054 committed transno 12884944054 00000100:00100000:3.0:1787508613.900515:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480088960:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787508613.900562:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480089088:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787508613.900592:0:202227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.900661:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88780 going to sleep for 11 seconds 00000100:00100000:1.0:1787508613.900694:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480089088 00000100:00100000:1.0:1787508613.900698:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480089088 00000100:00100000:1.0:1787508613.900729:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29633 00000100:00100000:1.0:1787508613.900735:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8fb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202227:x1874324480089088:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787508613.900830:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8fb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202227:x1874324480089088:12345-0@lo:1000:mdt00_001.0 Request processed in 94us (236us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787508613.900837:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29633 00000100:00100000:0.0:1787508613.900920:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480089088:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787508613.901025:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480089216:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787508613.901054:0:202227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.901076:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88900 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.901129:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480089216 00000100:00100000:3.0:1787508613.901134:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480089216 00000100:00100000:3.0:1787508613.901160:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29634 00000100:00100000:3.0:1787508613.901167:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:202227:x1874324480089216:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787508613.901232:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:202227:x1874324480089216:12345-0@lo:1000:mdt00_001.0 Request processed in 65us (177us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787508613.901240:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29634 00000100:00100000:0.0:1787508613.901297:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480089216:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787508613.901344:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480089344:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787508613.901448:0:202227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.901479:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88900 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.901521:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480089344 00000100:00100000:3.0:1787508613.901526:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480089344 00000100:00100000:3.0:1787508613.901556:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29635 00000100:00100000:3.0:1787508613.901563:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202227:x1874324480089344:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787508613.901614:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202227:x1874324480089344:12345-0@lo:1000:mdt00_001.0 Request processed in 52us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.901621:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29635 00000100:00100000:0.0:1787508613.901681:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480089344:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787508613.901724:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480089472:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787508613.901745:0:202227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.901798:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88900 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.901899:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480089472 00000100:00100000:3.0:1787508613.901904:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480089472 00000100:00100000:3.0:1787508613.901932:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29636 00000100:00100000:3.0:1787508613.901937:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202227:x1874324480089472:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787508613.902017:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202227:x1874324480089472:12345-0@lo:1000:mdt00_001.0 Request processed in 79us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.902024:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29636 00000100:00100000:0.0:1787508613.902097:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480089472:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787508613.902135:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480089600:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787508613.902159:0:202227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.902184:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88900 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.902223:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480089600 00000100:00100000:3.0:1787508613.902227:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480089600 00000100:00100000:3.0:1787508613.902259:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29637 00000100:00100000:3.0:1787508613.902265:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202227:x1874324480089600:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787508613.902311:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202227:x1874324480089600:12345-0@lo:1000:mdt00_001.0 Request processed in 45us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.902318:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29637 00000100:00100000:0.0:1787508613.902387:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480089600:0@lo:1000:mdt00_001.0 00000040:00080000:0.0:1787508613.903219:0:202227:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xf:0x0].39, 2168 off74056 00000040:00080000:0.0:1787508613.903296:0:202227:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x5:0x0].582, 2368 off739216 00000004:00080000:0.0:1787508613.903302:0:202227:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d1c88540 with version 13593 00000004:00080000:3.0:1787508613.903447:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13593 rpc_version 13593 00000020:00100000:3.0:1787508613.903489:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787508613.903499:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090c8fb9500 x1874324480089856/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787508613.903517:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c8fb9500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480089856:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508613.903567:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.903599:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787508613.903671:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480089856 00000100:00100000:1.0:1787508613.903677:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480089856 00000100:00100000:1.0:1787508613.903730:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29638 00000100:00100000:1.0:1787508613.903738:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202961:x1874324480089856:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508613.904340:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:202961:x1874324480089856:12345-0@lo:1000:osp_up0-1.0 Request processed in 601us (771us total) trans 12884944056 rc 0/0 00000100:00100000:1.0:1787508613.904347:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29638 00000100:00100000:3.0:1787508613.904594:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c8fb9500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480089856:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1787508613.904725:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6200/0xb126349c40f3314f lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.904741:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6200/0xb126349c40f3314f lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.904751:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6200/0xb126349c40f3314f lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.904769:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f33156 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x290:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.904776:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f33156 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x290:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.904783:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f33156 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x290:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.904810:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f3315d lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.904818:0:202227:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f3315d lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.904827:0:202227:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f3315d lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.904842:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480089984:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1787508613.904876:0:202227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.904900:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88240 going to sleep for 11 seconds 00000100:00100000:1.0:1787508613.905018:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480089984 00000100:00100000:1.0:1787508613.905023:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480089984 00000100:00100000:1.0:1787508613.905056:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29639 00000100:00100000:1.0:1787508613.905064:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:202227:x1874324480089984:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1787508613.905079:0:202232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.905095:0:202232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33164 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f3315d expref: -99 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.905113:0:202232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33164 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f3315d expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.905125:0:202232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33164 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3315d expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.905135:0:202232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x286:0x0].0x0 (ffff9090c5b9ef00) 00010000:00010000:1.0:1787508613.905138:0:202232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508613.905142:0:202232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b800, rc 0) 00000100:00100000:1.0:1787508613.905215:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:202227:x1874324480089984:12345-0@lo:101:mdt00_001.0 Request processed in 151us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.905222:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29639 00000100:00100000:3.0:1787508613.905500:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480089984:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1787508613.905516:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f3315d lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33164 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.905527:0:202227:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f3315d lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33164 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508613.905548:0:202227:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006ead037 reply state 0000000095611004 transno 8589961988 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f33156 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x290:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.905561:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f33156 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x290:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.905569:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x290:0x0].0x0 (ffff9090e460fa00) 00010000:00010000:3.0:1787508613.905572:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508613.905575:0:202227:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787508613.905581:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f3315d lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33164 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.905589:0:202227:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f3315d lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33164 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787508613.905599:0:202227:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x286:0x0] 00000004:00010000:3.0:1787508613.905604:0:202227:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006ead037 reply state 0000000095611004 transno 8589961988 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6200/0xb126349c40f3314f lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.905613:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6200/0xb126349c40f3314f lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.905619:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d1:0x0].0x0 (ffff9090e460f500) 00010000:00010000:3.0:1787508613.905621:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508613.905623:0:202227:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787508613.905628:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d1:0x0]: returning size 4096 00000004:00080000:3.0:1787508613.905635:0:202227:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1787508613.905642:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f33125 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f3312c expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.905649:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f33125 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xb126349c40f3312c expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.905655:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f33125 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xb126349c40f3312c expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.905710:0:202227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000004:00080000:3.0:1787508613.905717:0:202227:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1787508613.905722:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f33141 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33148 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.905730:0:202227:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f33141 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33148 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.905809:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+642:336028:x1874324509482112:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 32096us (32292us total) trans 8589961988 rc 0/0 00000100:00100000:3.0:1787508613.905817:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93662 00010000:00010000:0.0:1787508613.907191:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508613.907258:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f33125 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f3312c expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.907269:0:204785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a400 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:0.0:1787508613.907275:0:204785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f33125 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f3312c expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508613.907284:0:204785:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f33125 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f3312c expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.907321:0:204785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f33125 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3312c expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.907328:0:204785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787508613.907356:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f33125 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3312c expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.907365:0:204785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f33125 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3312c expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.907451:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480090112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508613.907517:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508613.907614:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480090112 00000100:00100000:2.0:1787508613.907623:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480090112 00010000:00010000:2.0:1787508613.907652:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3312c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xb126349c40f33125 expref: 10 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.907690:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27805 00000100:00100000:2.0:1787508613.907698:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+10:3618:x1874324480090112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508613.907709:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508613.907717:0:225839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3312c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f33125 expref: 10 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.907733:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3312c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000020 nid: 0@lo remote: 0xb126349c40f33125 expref: 10 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.907748:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.907753:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3313a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.907761:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3313a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.907768:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3313a lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.907803:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508613.907841:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3618:x1874324480090112:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.907847:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27805 00000100:00100000:2.0:1787508613.907887:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480090112:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508613.907908:0:203348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3313a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.907916:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3313a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508613.907987:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508613.907991:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508613.908010:0:203348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3313a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.908037:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33133 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd9c expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.908051:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3313a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd9c expref: 11 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.908058:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.908060:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508613.908063:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fa00, rc 0) 00000100:00100000:2.0:1787508613.908100:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336034:x1874324509482496:12345-192.168.201.30@tcp:101:rm.0 Request processed in 14618us (14780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.908107:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93663 00010000:00010000:0.0:1787508613.908448:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508613.908450:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508613.908452:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508613.910921:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.911049:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509482624 00000100:00100000:3.0:1787508613.911060:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509482624 00000100:00100000:3.0:1787508613.911119:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93664 00000100:00100000:3.0:1787508613.911130:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336034:x1874324509482624:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508613.911150:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.911170:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f3316b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadda3 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.911337:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33172 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.911352:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33172 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.911363:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33172 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.911386:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33179 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.911396:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33148 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33141 expref: 8 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.911406:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33179 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.911438:0:202228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33148 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f33141 expref: 8 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.911465:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c8fbb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480090240:0@lo:104: 00000100:00100000:3.0:1787508613.911511:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.911593:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88000 going to sleep for 11 seconds 00000100:00100000:0.0:1787508613.911746:0:229386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480090240 00000100:00100000:0.0:1787508613.911752:0:229386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480090240 00000100:00100000:0.0:1787508613.912096:0:229386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18134 00000100:00100000:0.0:1787508613.912105:0:229386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:202228:x1874324480090240:12345-0@lo:104: 00010000:00010000:0.0:1787508613.912119:0:229386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f33141 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f33148 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.912184:0:229386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787508613.912191:0:229386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:202228:x1874324480090240:12345-0@lo:104: Request processed in 88us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.912198:0:229386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18134 00010000:00010000:2.0:1787508613.912284:0:202215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787508613.912292:0:202215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f33141 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f33148 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.912301:0:202215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:2.0:1787508613.912308:0:202215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f33141 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f33148 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508613.912318:0:202215:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f33141 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f33148 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.912346:0:202215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f33141 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33148 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.912354:0:202215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787508613.912383:0:202215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f33141 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33148 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.912392:0:202215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f33141 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33148 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.912411:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508613.912413:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508613.912415:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508613.912422:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787508613.912434:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480090368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787508613.912481:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.912783:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c8fbb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480090240:0@lo:104: 00010000:00010000:3.0:1787508613.912805:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33179 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.912910:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480090368 00000100:00100000:1.0:1787508613.912916:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480090368 00010000:00010000:1.0:1787508613.912937:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33148 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f33141 expref: 9 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.913079:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27806 00000100:00100000:1.0:1787508613.913087:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce780e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3618:x1874324480090368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508613.913099:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:2.0:1787508613.915404:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944056 is committed 00000020:00080000:2.0:1787508613.915419:0:202206:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8589961980 batchid updated 00000020:00080000:3.0:1787508613.915530:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961980 00000004:00080000:3.0:1787508613.915588:0:202262:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d1d88000 with version 3448 00000020:00080000:3.0:1787508613.915643:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589961979 cancel update log [0x240000bd2:0x1:0x0].1780: rc = 0 00000020:00080000:3.0:1787508613.915715:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589961979 cancel update log [0x2000013a0:0x1:0x0].1774: rc = 0 00000004:00080000:3.0:1787508613.915741:0:202262:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d1d88600 with version 3449 00010000:00010000:1.0:1787508613.915837:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33148 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f33141 expref: 8 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.915854:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d3c50f00) 00010000:00010000:1.0:1787508613.915860:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33179 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.915875:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33179 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.915883:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33179 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.915930:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508613.916021:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce780e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3618:x1874324480090368:12345-0@lo:103:ldlm_bl.0 Request processed in 2934us (3538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.916031:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27806 00000100:00100000:2.0:1787508613.916137:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480090368:0@lo:103:ldlm_bl.0 00000004:00080000:0.0:1787508613.916383:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3448 rpc_version 3448 00000020:00100000:0.0:1787508613.916419:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787508613.916429:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d1cbf800 x1874324480090624/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787508613.916450:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbf800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480090624:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787508613.916510:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.916546:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c886c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787508613.916647:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480090624 00000100:00100000:2.0:1787508613.916654:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480090624 00000100:00100000:2.0:1787508613.916703:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29640 00000100:00100000:2.0:1787508613.916712:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:202248:x1874324480090624:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787508613.916862:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:202248:x1874324480090624:12345-0@lo:1000:osp_up1-0.0 Request processed in 151us (351us total) trans 8589961989 rc 0/0 00000100:00100000:2.0:1787508613.916870:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29640 00000100:00100000:0.0:1787508613.917075:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbf800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480090624:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787508613.917085:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3449 rpc_version 3449 00010000:00010000:2.0:1787508613.917199:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33179 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.917219:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33179 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.917321:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce782680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:202228:1874324480090752:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787508613.917357:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508613.917393:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508613.917438:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480090752 00000100:00100000:1.0:1787508613.917444:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480090752 00000100:00100000:1.0:1787508613.917492:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29641 00000100:00100000:1.0:1787508613.917501:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:202228:x1874324480090752:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787508613.917560:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:202228:x1874324480090752:12345-0@lo:1000:mdt00_002.0 Request processed in 60us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.917568:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29641 00000100:00100000:2.0:1787508613.917745:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce782680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:202228:1874324480090752:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787508613.917793:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33180 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.917808:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33180 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.917819:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33180 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508613.917839:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33180 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.917856:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33172 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.917863:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33172 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.917869:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33172 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.917876:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33172 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.917882:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.917886:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33172 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.917893:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33172 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.917905:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.917908:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.917913:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33172 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.917919:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33172 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.917931:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33179 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.917937:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33179 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.917974:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33179 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.917979:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.917982:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33179 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.917988:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33179 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.917996:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d3c50f00) 00010000:00010000:2.0:1787508613.917998:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.918001:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33179 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.918006:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33179 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.918043:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f3316b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadda3 expref: 13 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.918056:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33180 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadda3 expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.918063:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d1:0x0].0x0 (ffff9090c98d9400) 00010000:00010000:2.0:1787508613.918066:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508613.918068:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aac00, rc 0) 00000100:00100000:2.0:1787508613.918114:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336034:x1874324509482624:12345-192.168.201.30@tcp:101:rm.0 Request processed in 6987us (7202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.918125:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93664 00000020:00080000:3.0:1787508613.919881:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589961980 cancel update log [0x240000bd2:0x1:0x0].1782: rc = 0 00000020:00080000:1.0:1787508613.920092:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589961980 cancel update log [0x2000013a0:0x1:0x0].1775: rc = 0 00000020:00080000:1.0:1787508613.920103:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961980 00000020:00100000:0.0:1787508613.920254:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787508613.920266:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d1cbdf80 x1874324480091008/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787508613.920287:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbdf80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480091008:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787508613.920349:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.920524:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c886c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.920593:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480091008 00000100:00100000:3.0:1787508613.920600:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480091008 00000100:00100000:3.0:1787508613.920653:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29642 00000100:00100000:3.0:1787508613.920664:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:202248:x1874324480091008:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787508613.920795:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:202248:x1874324480091008:12345-0@lo:1000:osp_up1-0.0 Request processed in 132us (445us total) trans 8589961990 rc 0/0 00000100:00100000:3.0:1787508613.920806:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29642 00000100:00100000:0.0:1787508613.920934:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbdf80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480091008:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787508613.921987:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.922029:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.922114:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509482752 00000100:00100000:1.0:1787508613.922122:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509482752 00000100:00100000:1.0:1787508613.922156:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509482880 00000100:00100000:1.0:1787508613.922159:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509482880 00000100:00100000:1.0:1787508613.922177:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93665 00000100:00100000:1.0:1787508613.922185:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:336034:x1874324509482752:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508613.922200:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.922230:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f33187 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaddaa expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.922288:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247bc00/0xb126349c40f3318e lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.922302:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247bc00/0xb126349c40f3318e lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.922313:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247bc00/0xb126349c40f3318e lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508613.922418:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d1:0x0]: returning size 4096 00000004:00200000:1.0:1787508613.922423:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787508613.922473:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f33187 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddaa expref: 7 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.922492:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247bc00/0xb126349c40f3318e lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddaa expref: 6 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.922500:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d1:0x0].0x0 (ffff9090e460f500) 00010000:00010000:1.0:1787508613.922502:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508613.922506:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247bc00, rc 0) 00000100:00100000:1.0:1787508613.922563:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336034:x1874324509482752:12345-192.168.201.30@tcp:101:rm.0 Request processed in 378us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.922571:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93665 00000100:00100000:1.0:1787508613.922589:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93666 00000100:00100000:1.0:1787508613.922596:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+581:336035:x1874324509482880:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508613.922604:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.922614:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33195 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaddb1 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.922648:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3319c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.922657:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3319c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.922664:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3319c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508613.922689:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508613.922692:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508613.922707:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3319c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.922724:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33195 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddb1 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.922736:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3319c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddb1 expref: 582 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.922743:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.922745:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508613.922747:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b200, rc 0) 00000100:00100000:1.0:1787508613.922771:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336035:x1874324509482880:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 175us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.922777:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93666 00000100:00100000:1.0:1787508613.925043:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.925120:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509483008 00000100:00100000:3.0:1787508613.925129:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509483008 00000100:00100000:3.0:1787508613.925193:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93667 00000100:00100000:3.0:1787508613.925211:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336035:x1874324509483008:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1787508613.925231:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.925251:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f331a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaddb8 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.925312:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f331aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.925325:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f331aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.925335:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f331aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.925348:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f331b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.925355:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f331b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.925362:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f331b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.925428:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f331aa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.925441:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f331aa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.925448:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f331aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.925465:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f331aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.925472:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.925476:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f331aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.925484:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f331aa lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.925498:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.925501:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.925506:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f331aa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.925512:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f331aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.925528:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f331b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.925535:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f331b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.925540:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f331b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.925546:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.925549:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f331b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.925555:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f331b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.925563:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090ccb87e00) 00010000:00010000:3.0:1787508613.925565:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.925568:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f331b1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.925573:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f331b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.925602:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f331a3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddb8 expref: 583 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.925611:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.925613:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508613.925618:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f331a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddb8 expref: 583 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.925626:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fc00, rc 0) 00000100:00100000:3.0:1787508613.925689:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336035:x1874324509483008:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 488us (653us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508613.925696:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93667 00000100:00100000:3.0:1787508613.927139:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.927226:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509483136 00000100:00100000:0.0:1787508613.927235:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509483136 00000100:00100000:0.0:1787508613.927285:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93668 00000100:00100000:0.0:1787508613.927295:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8fbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336034:x1874324509483136:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508613.927311:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508613.927328:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6400/0xb126349c40f331b8 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x290:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaddbf expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.927479:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f331bf lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x290:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.927492:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f331bf lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.927504:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f331bf lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508613.927558:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x290:0x0]: returning size 4096 00000004:00200000:0.0:1787508613.927563:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508613.927607:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6400/0xb126349c40f331b8 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x290:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddbf expref: 8 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.927625:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f331bf lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddbf expref: 7 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.927634:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x290:0x0].0x0 (ffff9090e460fa00) 00010000:00010000:0.0:1787508613.927637:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508613.927640:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7a00, rc 0) 00000100:00100000:0.0:1787508613.927728:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8fbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:336034:x1874324509483136:12345-192.168.201.30@tcp:101:rm.0 Request processed in 434us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.927737:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93668 00000100:00100000:1.0:1787508613.929483:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508613.931046:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509483264 00000100:00100000:2.0:1787508613.931060:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509483264 00000100:00100000:2.0:1787508613.931320:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93669 00000100:00100000:2.0:1787508613.931333:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d74bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336035:x1874324509483264:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1787508613.931352:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.931436:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f331c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaddc6 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.931512:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f331cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.931527:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f331cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.931538:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f331cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.931554:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f331d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.931562:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f331d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.931569:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f331d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.931622:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f331cd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.931634:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f331cd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.931641:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f331cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.931647:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f331cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.931653:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.931658:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f331cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.931665:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f331cd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.931677:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.931681:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.931685:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f331cd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.931690:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f331cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.931705:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f331d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.931711:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f331d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.931718:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f331d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.931723:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.931726:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f331d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.931732:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f331d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.931739:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090c98d9b00) 00010000:00010000:2.0:1787508613.931741:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.931744:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f331d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.931750:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f331d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.931779:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f331c6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddc6 expref: 583 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.931789:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.931791:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508613.931795:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f331c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddc6 expref: 583 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.931805:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa600, rc 0) 00000100:00100000:2.0:1787508613.931871:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d74bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336035:x1874324509483264:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 540us (2394us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508613.931879:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93669 00000100:00100000:3.0:1787508613.933029:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.933356:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509483392 00000100:00100000:0.0:1787508613.933365:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509483392 00000100:00100000:2.0:1787508613.933497:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93670 00000100:00100000:2.0:1787508613.933509:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336034:x1874324509483392:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508613.933529:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.933546:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f331db lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x286:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaddcd expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.933600:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f331e2 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x286:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.933614:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33164 lrc: 2/0,0 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3315d expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.933623:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f331e2 lrc: 4/1,0 mode: --/PR res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.933658:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33164 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f3315d expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.933674:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480091136:0@lo:104: 00000100:00100000:2.0:1787508613.933720:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508613.933766:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9300 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.933840:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480091136 00000100:00100000:3.0:1787508613.933845:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480091136 00000100:00100000:3.0:1787508613.933880:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18135 00000100:00100000:3.0:1787508613.933887:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:230618:x1874324480091136:12345-0@lo:104: 00010000:00010000:3.0:1787508613.933899:0:202210:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f3315d lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f33164 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.933979:0:202210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787508613.933986:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:230618:x1874324480091136:12345-0@lo:104: Request processed in 100us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.933993:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18135 00010000:00010000:2.0:1787508613.934127:0:226765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787508613.934134:0:226765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f3315d lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f33164 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.934143:0:226765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6000 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:2.0:1787508613.934148:0:226765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f3315d lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f33164 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508613.934156:0:226765:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f3315d lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f33164 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.934181:0:226765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f3315d lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33164 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.934189:0:226765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787508613.934474:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1787508613.934523:0:226765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f3315d lrc: 1/0,0 mode: --/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33164 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.934532:0:226765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f3315d lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33164 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.934551:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508613.934553:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508613.934555:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508613.934580:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480091136:0@lo:104: 00010000:00010000:2.0:1787508613.934597:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f331e2 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.934724:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480091264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508613.934763:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.934849:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480091264 00000100:00100000:3.0:1787508613.934854:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480091264 00010000:00010000:3.0:1787508613.934875:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33164 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f3315d expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.934937:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27807 00000100:00100000:3.0:1787508613.934974:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9681c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+7:3617:x1874324480091264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787508613.934985:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787508613.936733:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508613.936883:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509483520 00000100:00100000:2.0:1787508613.936892:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509483520 00000100:00100000:2.0:1787508613.937044:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93671 00000100:00100000:2.0:1787508613.937054:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336035:x1874324509483520:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1787508613.937072:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.937090:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f331e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaddd4 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.937153:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f331f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.937170:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f331f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.937180:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f331f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.937194:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f331f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.937201:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f331f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.937207:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f331f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.937251:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f331f0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.937263:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f331f0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.937269:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f331f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.937276:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f331f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.937281:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.937286:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f331f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.937293:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f331f0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.937304:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.937306:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.937310:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f331f0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.937315:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f331f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.937327:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33164 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f3315d expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.937327:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f331f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.937334:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f331f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.937339:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x286:0x0].0x0 (ffff9090c5b9ef00) 00010000:00010000:2.0:1787508613.937339:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f331f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.937343:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f331e2 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.937344:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508613.937347:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f331f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.937352:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f331e2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.937352:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f331f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.937359:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090c98d9600) 00010000:00010000:3.0:1787508613.937360:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f331e2 lrc: 4/1,0 mode: PR/PR res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.937361:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508613.937364:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f331f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.937369:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f331f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.937402:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f331e9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddd4 expref: 583 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.937412:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508613.937415:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508613.937419:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f331e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddd4 expref: 583 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.937427:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab200, rc 0) 00010000:00010000:3.0:1787508613.937491:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508613.937493:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336035:x1874324509483520:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 441us (768us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508613.937500:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93671 00000100:00100000:3.0:1787508613.937542:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9681c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480091264:12345-0@lo:103:ldlm_bl.0 Request processed in 2569us (2778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.937551:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27807 00000100:00100000:1.0:1787508613.937570:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480091264:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508613.937594:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f331e2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.937602:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f331e2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508613.937647:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a2:0x286:0x0]: returning size 4096 00000004:00200000:0.0:1787508613.937651:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508613.937684:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f331db lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x286:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddcd expref: 14 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.937698:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f331e2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddcd expref: 13 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.937704:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x286:0x0].0x0 (ffff9090c5b9ef00) 00010000:00010000:0.0:1787508613.937707:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508613.937709:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aaa00, rc 0) 00000100:00100000:0.0:1787508613.937730:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336034:x1874324509483392:12345-192.168.201.30@tcp:101:rm.0 Request processed in 4225us (4707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.937736:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93670 00000100:00100000:3.0:1787508613.940256:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.940299:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509483776 00000100:00100000:0.0:1787508613.940308:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509483776 00000100:00100000:0.0:1787508613.940420:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93672 00000100:00100000:0.0:1787508613.940431:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336035:x1874324509483776:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508613.940451:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508613.940482:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f331fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadddb expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.940559:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33205 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.940574:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33205 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.940585:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33205 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.940599:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3320c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.940605:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3320c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.940612:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3320c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.940680:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33205 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.940689:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33205 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.940695:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33205 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.940701:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33205 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.940711:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.940714:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33205 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.940722:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33205 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.940734:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.940737:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.940741:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33205 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.940747:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33205 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.940759:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3320c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.940765:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3320c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.940771:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3320c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.940776:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508613.940791:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3320c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.940798:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3320c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.940809:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090e460f000) 00010000:00010000:0.0:1787508613.940811:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508613.940814:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3320c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.940820:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3320c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.940850:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f331fe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadddb expref: 583 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.940860:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508613.940862:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508613.940866:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f331fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadddb expref: 583 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.940875:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6400, rc 0) 00000100:00100000:0.0:1787508613.940936:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336035:x1874324509483776:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 506us (685us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508613.940970:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93672 00000100:00100000:3.0:1787508613.941693:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.941774:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509484032 00000100:00100000:0.0:1787508613.941786:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509484032 00000100:00100000:0.0:1787508613.941859:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93673 00000100:00100000:0.0:1787508613.941869:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:336034:x1874324509484032:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508613.941885:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508613.941903:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7800/0xb126349c40f33213 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadde2 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508613.942057:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d1:0x0]: returning size 4096 00010000:00010000:0.0:1787508613.942143:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7800/0xb126349c40f33213 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadde2 expref: 9 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.942154:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090e460f100) 00010000:00010000:0.0:1787508613.942157:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508613.942162:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7800/0xb126349c40f33213 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadde2 expref: 9 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.942177:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7800, rc 0) 00000100:00100000:0.0:1787508613.942228:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336034:x1874324509484032:12345-192.168.201.30@tcp:101:rm.0 Request processed in 361us (538us total) trans 8589961991 rc 301/301 00000100:00100000:0.0:1787508613.942234:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93673 00000100:00100000:2.0:1787508613.945416:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.945547:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509484160 00000100:00100000:1.0:1787508613.945558:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509484160 00000100:00100000:1.0:1787508613.945655:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15395 00000100:00100000:1.0:1787508613.945666:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336034:x1874324509484160:12345-192.168.201.30@tcp:37:rm.0 00000100:00100000:0.0:1787508613.949313:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.949436:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509484288 00000100:00100000:3.0:1787508613.949446:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509484288 00000100:00100000:3.0:1787508613.949515:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93674 00000100:00100000:3.0:1787508613.949524:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336035:x1874324509484288:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1787508613.949543:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.949562:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33221 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadde9 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.949626:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33228 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.949640:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33228 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.949651:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33228 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.949664:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3322f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.949674:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3322f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.949679:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3322f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.949738:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33236 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.949745:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33236 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.949751:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33236 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508613.949772:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33236 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.949786:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33228 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.949793:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33228 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.949799:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33228 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.949805:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33228 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.949810:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.949814:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33228 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.949822:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33228 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.949834:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.949836:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.949841:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33228 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.949847:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33228 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.949860:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3322f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.949865:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3322f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.949869:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3322f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.949873:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508613.949875:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3322f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.949879:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3322f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.949884:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090ccb87e00) 00010000:00010000:3.0:1787508613.949887:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.949889:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3322f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.949894:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3322f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.949919:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33221 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadde9 expref: 584 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.949929:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33236 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadde9 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.949936:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d1:0x0].0x0 (ffff9090c98d9400) 00010000:00010000:3.0:1787508613.949961:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508613.949964:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e600, rc 0) 00000100:00100000:3.0:1787508613.950023:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336035:x1874324509484288:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 500us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.950029:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93674 00000100:00100000:2.0:1787508613.950069:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336034:x1874324509484160:12345-192.168.201.30@tcp:37:rm.0 Request processed in 4405us (4663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.950078:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15395 00000100:00100000:0.0:1787508613.952185:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508613.952654:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509484416 00000100:00100000:2.0:1787508613.952663:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509484416 00000100:00100000:2.0:1787508613.952774:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93675 00000100:00100000:2.0:1787508613.952795:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+642:336035:x1874324509484416:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1787508613.952820:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508613.952842:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f3323d lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaddf0 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.952903:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aae00/0xb126349c40f33244 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.952918:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aae00/0xb126349c40f33244 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.952930:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aae00/0xb126349c40f33244 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508613.953063:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d1:0x0]: returning size 4096 00000004:00200000:2.0:1787508613.953069:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787508613.953104:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f3323d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddf0 expref: 644 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.953122:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aae00/0xb126349c40f33244 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddf0 expref: 643 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.953130:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d1:0x0].0x0 (ffff9090e460f500) 00010000:00010000:2.0:1787508613.953133:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508613.953138:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aae00, rc 0) 00000100:00100000:2.0:1787508613.953198:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+643:336035:x1874324509484416:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 406us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.953210:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93675 00000100:00100000:3.0:1787508613.953586:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.954282:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509484544 00000100:00100000:0.0:1787508613.954291:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509484544 00000100:00100000:0.0:1787508613.954347:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15396 00000100:00100000:0.0:1787508613.954356:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336034:x1874324509484544:12345-192.168.201.30@tcp:37:rm.0 00000100:00100000:2.0:1787508613.958222:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336034:x1874324509484544:12345-192.168.201.30@tcp:37:rm.0 Request processed in 3856us (4626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.958237:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15396 00000100:00100000:0.0:1787508613.961128:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.961239:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509484800 00000100:00100000:1.0:1787508613.961249:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509484800 00000100:00100000:1.0:1787508613.961341:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15397 00000100:00100000:1.0:1787508613.961352:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336034:x1874324509484800:12345-192.168.201.30@tcp:35:rm.0 00000100:00100000:1.0:1787508613.961622:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:336034:x1874324509484800:12345-192.168.201.30@tcp:35:rm.0 Request processed in 270us (504us total) trans 8589961992 rc 0/0 00000100:00100000:1.0:1787508613.961639:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15397 00000100:00100000:2.0:1787508613.963180:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.963292:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509484928 00000100:00100000:0.0:1787508613.963301:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509484928 00000100:00100000:0.0:1787508613.963360:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93676 00000100:00100000:0.0:1787508613.963371:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+643:336035:x1874324509484928:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508613.963391:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508613.963417:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6400/0xb126349c40f3324b lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x290:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaddf7 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.963488:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f33252 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x290:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.963582:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f33252 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.963599:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f33252 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508613.963721:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x290:0x0]: returning size 4096 00000004:00200000:0.0:1787508613.963726:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508613.963764:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6400/0xb126349c40f3324b lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x290:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddf7 expref: 645 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.963781:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f33252 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddf7 expref: 644 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.963790:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x290:0x0].0x0 (ffff9090e460fa00) 00010000:00010000:0.0:1787508613.963793:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508613.963797:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6800, rc 0) 00000100:00100000:0.0:1787508613.963889:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:336035:x1874324509484928:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 519us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.963896:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93676 00000100:00100000:0.0:1787508613.965985:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.966113:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.966149:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.966578:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509485312 00000100:00100000:1.0:1787508613.966591:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509485312 00000100:00100000:1.0:1787508613.966650:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509485440 00000100:00100000:1.0:1787508613.966654:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509485440 00000100:00100000:1.0:1787508613.966682:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93677 00000100:00100000:1.0:1787508613.966691:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:336034:x1874324509485312:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:1.0:1787508613.966747:0:202226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508613.966775:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247bc00/0xb126349c40f3318e lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddaa expref: 9 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.966809:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d1:0x0].0x0 (ffff9090e460f500) 00010000:00010000:1.0:1787508613.966814:0:202226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787508613.966862:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f33259 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.966870:0:202226:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f33259 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.966880:0:202226:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f33259 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.966902:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480091392:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1787508613.966979:0:202226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.967016:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480091392 00000100:00100000:1.0:1787508613.967019:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480091392 00000100:00100000:1.0:1787508613.967049:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29643 00000100:00100000:1.0:1787508613.967055:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:202226:x1874324480091392:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1787508613.967066:0:225829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.967079:0:225829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33260 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f33259 expref: -99 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.967099:0:225829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3313a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd9c expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.967107:0:225829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3319c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddb1 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.967119:0:225829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33260 lrc: 5/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f33259 expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.967140:0:225829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3319c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddb1 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.967152:0:225829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3319c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddb1 expref: 583 pid: 202226 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.967162:0:225829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788ed80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480091520:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508613.967246:0:225829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3313a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd9c expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.967255:0:225829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3313a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd9c expref: 12 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.967265:0:225829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788e300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480091648:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508613.967290:0:225829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c740fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508613.967310:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93678 00000100:00100000:1.0:1787508613.967318:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091c945a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336035:x1874324509485440:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508613.967326:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.967336:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f33267 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x286:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaddfe expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.967646:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3326e lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x286:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.967657:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3326e lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.967669:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3326e lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508613.967711:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a2:0x286:0x0]: returning size 4096 00000004:00200000:1.0:1787508613.967716:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787508613.967752:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f33267 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x286:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddfe expref: 585 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.967768:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3326e lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddfe expref: 584 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.967776:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x286:0x0].0x0 (ffff9090c5b9ef00) 00010000:00010000:1.0:1787508613.967790:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508613.967793:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b000, rc 0) 00000100:00100000:1.0:1787508613.967822:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091c945a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336035:x1874324509485440:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 505us (1672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.967829:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93678 00000100:00100000:1.0:1787508613.967854:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c740f300 going to sleep for 11 seconds 00000100:00100000:2.0:1787508613.973178:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509485056 00000100:00100000:2.0:1787508613.973194:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509485056 00000100:00100000:0.0:1787508613.973467:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9775 00000100:00100000:0.0:1787508613.973480:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2401:x1874324509485056:12345-192.168.201.30@tcp:103:rm.0 00010000:00010000:0.0:1787508613.973498:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508613.973524:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33180 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadda3 expref: 13 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.973545:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d1:0x0].0x0 (ffff9090c98d9400) 00010000:00010000:0.0:1787508613.973551:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508613.973622:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2401:x1874324509485056:12345-192.168.201.30@tcp:103:rm.0 Request processed in 144us (7680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.973629:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9775 00000100:00100000:0.0:1787508613.976773:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.976911:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.976968:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.977020:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509485824 00000100:00100000:3.0:1787508613.977028:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509485824 00010000:00010000:3.0:1787508613.977067:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3319c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddb1 expref: 584 pid: 202226 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.977105:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509485952 00000100:00100000:3.0:1787508613.977108:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509485952 00010000:00010000:3.0:1787508613.977118:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3313a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd9c expref: 12 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.977134:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27808 00000100:00100000:3.0:1787508613.977142:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091c9459c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:2400:x1874324509485824:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508613.977153:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508613.977158:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3319c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddb1 expref: 584 pid: 202226 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.977168:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3319c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddb1 expref: 584 pid: 202226 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.977186:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.977191:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33260 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f33259 expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.977200:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508613.977247:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091c9459c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:2400:x1874324509485824:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 106us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.977252:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27808 00000100:00100000:3.0:1787508613.977268:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27809 00000100:00100000:3.0:1787508613.977272:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c1ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2403:x1874324509485952:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508613.977278:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508613.977281:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3313a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd9c expref: 12 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.977288:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3313a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd9c expref: 12 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.977295:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508613.977299:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33260 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f33259 expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.977306:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33260 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xb126349c40f33259 expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.977312:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33260 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xb126349c40f33259 expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.977335:0:205406:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33260 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33259 expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.977344:0:205406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b51500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:205406:1874324480091776:0@lo:105: 00000100:00100000:3.0:1787508613.977387:0:205406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.977417:0:205406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.977436:0:229363:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787508613.977443:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480091776 00000100:00100000:3.0:1787508613.977445:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480091776 00000100:00100000:3.0:1787508613.977479:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18136 00000100:00100000:3.0:1787508613.977487:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d18ad450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:205406:x1874324480091776:12345-0@lo:105: 00010000:00010000:3.0:1787508613.977502:0:229363:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f33259 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33260 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.977511:0:229363:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f33259 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33260 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.977520:0:229363:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f33259 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33260 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.977532:0:229363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f33259 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f33260 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.977539:0:229363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f33259 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f33260 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.977585:0:225829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3319c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddb1 expref: 583 pid: 202226 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.977602:0:225829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788ed80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480091520:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508613.977615:0:225829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3313a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadd9c expref: 12 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.977618:0:229363:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f33259 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f33260 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.977626:0:225829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788e300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480091648:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508613.977633:0:229363:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d247ac00) 00010000:00010000:1.0:1787508613.977654:0:225829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33260 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33259 expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.977661:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d18ad450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:205406:x1874324480091776:12345-0@lo:105: Request processed in 176us (274us total) trans 0 rc 0/0 00010000:00010000:1.0:1787508613.977663:0:225829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508613.977665:0:225829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508613.977668:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18136 00010000:00010000:1.0:1787508613.977668:0:225829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a200, rc 0) 00000100:00100000:1.0:1787508613.977703:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:202226:x1874324480091392:12345-0@lo:101:mdt00_000.0 Request processed in 10648us (10724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.977710:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29643 00000100:00100000:3.0:1787508613.977723:0:205406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b51500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:205406:1874324480091776:0@lo:105: 00010000:00010000:3.0:1787508613.977733:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508613.977740:0:202226:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944056 gen 2 00000004:00080000:1.0:1787508613.977745:0:202226:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944056 committed transno 12884944056 00000100:00100000:3.0:1787508613.977749:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c1ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2403:x1874324509485952:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 477us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.977755:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27809 00000100:00100000:1.0:1787508613.977767:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480091392:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1787508613.977793:0:202226:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f33259 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33260 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787508613.977812:0:202226:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787508613.977857:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f33275 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.977865:0:202226:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f33275 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.977873:0:202226:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f33275 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.977891:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480091904:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1787508613.977917:0:202226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.978042:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480091904 00000100:00100000:3.0:1787508613.978046:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480091904 00000100:00100000:3.0:1787508613.978111:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29644 00000100:00100000:3.0:1787508613.978119:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:202226:x1874324480091904:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1787508613.978137:0:203182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508613.978153:0:203182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f3327c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f33275 expref: -99 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.978174:0:203182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f3327c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f33275 expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.978184:0:203182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f3327c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33275 expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.978190:0:203182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090ccb87e00) 00010000:00010000:3.0:1787508613.978192:0:203182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508613.978194:0:203182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ea00, rc 0) 00000100:00100000:3.0:1787508613.978231:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:202226:x1874324480091904:12345-0@lo:101:mdt00_000.0 Request processed in 113us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.978236:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29644 00000100:00100000:1.0:1787508613.978598:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c740f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787508613.978615:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480091904:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1787508613.978624:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f33275 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3327c expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.978630:0:202226:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f33275 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3327c expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787508613.978640:0:202226:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1787508613.978666:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480092032:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787508613.978686:0:202226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.978704:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c740fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.978890:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480092032 00000100:00100000:3.0:1787508613.978894:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480092032 00000100:00100000:3.0:1787508613.978966:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29645 00000100:00100000:3.0:1787508613.978971:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:202226:x1874324480092032:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787508613.979025:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:202226:x1874324480092032:12345-0@lo:1000:mdt00_000.0 Request processed in 54us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508613.979029:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29645 00000100:00100000:2.0:1787508613.979091:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509485696 00000100:00100000:2.0:1787508613.979096:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509485696 00000100:00100000:2.0:1787508613.979131:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93679 00000100:00100000:2.0:1787508613.979138:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091c945b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:336035:x1874324509485696:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:2.0:1787508613.979172:0:230618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508613.979187:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aae00/0xb126349c40f33244 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddf0 expref: 644 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.979198:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d1:0x0].0x0 (ffff9090e460f500) 00010000:00010000:2.0:1787508613.979211:0:230618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508613.979226:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f33283 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.979233:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f33283 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.979238:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f33283 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.979249:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f3328a lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x290:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.979254:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f331bf lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddbf expref: 8 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.979260:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f33252 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddf7 expref: 643 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.979264:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f3328a lrc: 5/0,1 mode: --/PW res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.979282:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f33252 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddf7 expref: 643 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.979293:0:230618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f33252 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddf7 expref: 643 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.979300:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:230618:1874324480092160:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508613.979346:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f331bf lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddbf expref: 8 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.979352:0:230618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f331bf lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddbf expref: 8 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.979357:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0bca80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:230618:1874324480092288:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508613.979375:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9300 going to sleep for 11 seconds 00000100:00100000:0.0:1787508613.979485:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480092032:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787508613.979528:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091c9458700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480092416:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787508613.979569:0:202226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508613.980331:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88240 going to sleep for 11 seconds 00000100:00100000:1.0:1787508613.980395:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480092416 00000100:00100000:1.0:1787508613.980402:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480092416 00000100:00100000:1.0:1787508613.980447:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29646 00000100:00100000:1.0:1787508613.980464:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091c945b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202226:x1874324480092416:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787508613.981962:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091c945b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202226:x1874324480092416:12345-0@lo:1000:mdt00_000.0 Request processed in 1487us (2372us total) trans 0 rc 1/1 00000100:00100000:1.0:1787508613.981974:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29646 00000100:00100000:1.0:1787508613.982048:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091c9458700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480092416:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787508613.982135:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f33291 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.982146:0:202226:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f33291 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.982158:0:202226:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f33291 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.982178:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480092544:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1787508613.982324:0:202226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508613.982351:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480092544 00000100:00100000:1.0:1787508613.982355:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480092544 00000100:00100000:1.0:1787508613.982434:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29647 00000100:00100000:1.0:1787508613.982439:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202226:x1874324480092544:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1787508613.982451:0:225829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508613.982476:0:225829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33298 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f33291 expref: -99 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.982504:0:225829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33236 lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadde9 expref: 582 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.982513:0:225829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33298 lrc: 4/0,0 mode: --/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f33291 expref: 9 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.982537:0:225829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33236 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadde9 expref: 582 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.982611:0:225829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33236 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadde9 expref: 582 pid: 202226 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.982623:0:225829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9acb100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480092672:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508613.982682:0:225829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c740f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787508613.982693:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c740fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787508613.986444:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.986484:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508613.986510:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.986510:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509486080 00000100:00100000:0.0:1787508613.986520:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509486080 00000100:00100000:1.0:1787508613.986528:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509486208 00000100:00100000:1.0:1787508613.986531:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509486208 00010000:00010000:1.0:1787508613.986561:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33236 lrc: 5/0,0 mode: PR/PR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadde9 expref: 583 pid: 202226 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.986561:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f33252 lrc: 5/0,0 mode: PR/PR res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddf7 expref: 644 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.986591:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509486336 00000100:00100000:0.0:1787508613.986594:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509486336 00010000:00010000:0.0:1787508613.986605:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f331bf lrc: 5/0,0 mode: PR/PR res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddbf expref: 9 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.986653:0:225829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9acb100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480092672:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508613.986684:0:225829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33298 lrc: 3/0,0 mode: --/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33291 expref: 9 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.986693:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27810 00010000:00010000:3.0:1787508613.986694:0:225829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d1:0x0].0x0 (ffff9090c98d9400) 00010000:00010000:3.0:1787508613.986697:0:225829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508613.986702:0:225829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33298 lrc: 3/0,0 mode: --/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33291 expref: 9 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.986703:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:2401:x1874324509486080:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508613.986713:0:225829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247bc00, rc 0) 00010000:00010000:1.0:1787508613.986719:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508613.986725:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f33252 lrc: 5/0,0 mode: PR/PR res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddf7 expref: 644 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.986738:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f33252 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddf7 expref: 644 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.986757:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x290:0x0].0x0 (ffff9090e460fa00) 00010000:00010000:1.0:1787508613.986762:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f3328a lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.986769:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f3328a lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508613.986771:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:202226:x1874324480092544:12345-0@lo:101:mdt00_000.0 Request processed in 4331us (4446us total) trans 0 rc 0/0 00010000:00010000:1.0:1787508613.986775:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508613.986794:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29647 00000100:00100000:1.0:1787508613.986811:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:2401:x1874324509486080:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 110us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.986817:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27810 00000100:00100000:3.0:1787508613.986825:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27811 00000100:00100000:1.0:1787508613.986830:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27812 00000100:00100000:3.0:1787508613.986832:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:2401:x1874324509486208:12345-192.168.201.30@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787508613.986835:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9aca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2401:x1874324509486336:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508613.986841:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508613.986847:0:229383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33236 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadde9 expref: 583 pid: 202226 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.986853:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508613.986856:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33236 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadde9 expref: 583 pid: 202226 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.986857:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f331bf lrc: 5/0,0 mode: PR/PR res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddbf expref: 9 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.986867:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f331bf lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddbf expref: 9 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.986870:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33236 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadde9 expref: 583 pid: 202226 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.986879:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x290:0x0].0x0 (ffff9090e460fa00) 00010000:00010000:1.0:1787508613.986882:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f3328a lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.986885:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d1:0x0].0x0 (ffff9090c98d9400) 00010000:00010000:3.0:1787508613.986889:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33298 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33291 expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.986890:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f3328a lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.986898:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f3328a lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.986899:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33298 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f33291 expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.986905:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33298 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f33291 expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.986912:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508613.986928:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9aca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2401:x1874324509486336:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 93us (418us total) trans 0 rc 0/0 00010000:00010000:3.0:1787508613.986930:0:229383:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33298 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33291 expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.986935:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27812 00000100:00100000:3.0:1787508613.986973:0:229383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b51500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:229383:1874324480092800:0@lo:105: 00000100:00100000:3.0:1787508613.987007:0:229383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.987050:0:229383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cbe40e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.987065:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480092800 00000100:00100000:3.0:1787508613.987069:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480092800 00000100:00100000:3.0:1787508613.987100:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18137 00000100:00100000:3.0:1787508613.987106:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:229383:x1874324480092800:12345-0@lo:105: 00010000:00010000:3.0:1787508613.987116:0:202210:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f33291 lrc: 4/0,1 mode: --/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33298 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.987125:0:202210:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f33291 lrc: 4/0,1 mode: --/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33298 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.987471:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f33252 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddf7 expref: 643 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.987485:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:230618:1874324480092160:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508613.987498:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f331bf lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddbf expref: 8 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.987507:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0bca80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:230618:1874324480092288:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508613.987522:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f3328a lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.987531:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f3328a lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.987536:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f3328a lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.987573:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aae00/0xb126349c40f3329f lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.987580:0:230618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aae00/0xb126349c40f3329f lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x0 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.987586:0:202210:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f33291 lrc: 4/0,1 mode: --/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33298 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.987589:0:230618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aae00/0xb126349c40f3329f lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.987595:0:202210:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f33291 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f33298 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.987602:0:202210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f33291 lrc: 5/0,1 mode: EX/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f33298 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.987603:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0bca80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480092928:0@lo:101:mdt00_006.0 00010000:00010000:3.0:1787508613.987611:0:202210:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f33291 lrc: 5/0,1 mode: EX/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f33298 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.987623:0:202210:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d247be00) 00000100:00100000:2.0:1787508613.987630:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508613.987659:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:229383:x1874324480092800:12345-0@lo:105: Request processed in 552us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.987659:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9300 going to sleep for 11 seconds 00000100:00100000:3.0:1787508613.987666:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18137 00000100:00100000:3.0:1787508613.987708:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480092544:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1787508613.987722:0:202226:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f33291 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33298 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.987745:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f332a6 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.987754:0:202226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f33283 lrc: 2/0,1 mode: PW/PW res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.987759:0:202226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f332a6 lrc: 4/0,1 mode: --/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.987770:0:202226:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f33283 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.987978:0:229383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b51500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:229383:1874324480092800:0@lo:105: 00010000:00010000:1.0:1787508613.987990:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508613.987991:0:202226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f332a6 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508613.988027:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:2401:x1874324509486208:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1195us (1542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508613.988035:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27811 00000100:00100000:0.0:1787508613.988101:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480092928 00000100:00100000:0.0:1787508613.988107:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480092928 00000100:00100000:0.0:1787508613.988147:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29648 00000100:00100000:0.0:1787508613.988154:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:230618:x1874324480092928:12345-0@lo:101:mdt00_006.0 00010000:00010000:0.0:1787508613.988167:0:202231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508613.988179:0:202231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f332ad lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f3329f expref: -99 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.988196:0:202231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f331e2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddcd expref: 10 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.988614:0:202231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3326e lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddfe expref: 581 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.988625:0:202231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f332ad lrc: 5/0,0 mode: --/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f3329f expref: 10 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.988652:0:202231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3326e lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddfe expref: 581 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.988666:0:202231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3326e lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddfe expref: 581 pid: 209004 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.988679:0:202231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091c9459f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480093056:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508613.989295:0:202231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f331e2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddcd expref: 10 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.989309:0:202231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f331e2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddcd expref: 10 pid: 230618 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508613.989319:0:202231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091c9459500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480093184:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508613.989353:0:202231:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88000 going to sleep for 11 seconds 00000100:00100000:0.0:1787508613.997170:0:202231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091c9459f80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480093056:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508613.997768:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508613.997883:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508613.997999:0:202231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091c9459500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480093184:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508613.998039:0:202231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f332ad lrc: 3/0,0 mode: --/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3329f expref: 10 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.998053:0:202231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x286:0x0].0x0 (ffff9090c5b9ef00) 00010000:00010000:0.0:1787508613.998055:0:202231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508613.998060:0:202231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f332ad lrc: 3/0,0 mode: --/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3329f expref: 10 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.998070:0:202231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f332ad lrc: 3/0,0 mode: --/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3329f expref: 10 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508613.998078:0:202231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6400, rc 0) 00000100:00100000:0.0:1787508613.998140:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:230618:x1874324480092928:12345-0@lo:101:mdt00_006.0 Request processed in 9987us (10508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508613.998149:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29648 00000100:00100000:3.0:1787508613.998228:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0bca80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480092928:0@lo:101:mdt00_006.0 00010000:00010000:3.0:1787508613.998246:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aae00/0xb126349c40f3329f lrc: 4/0,1 mode: --/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f332ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.998258:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aae00/0xb126349c40f3329f lrc: 4/0,1 mode: --/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f332ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.998332:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509486464 00000100:00100000:2.0:1787508613.998340:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509486464 00000100:00100000:1.0:1787508613.998368:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509486592 00000100:00100000:1.0:1787508613.998373:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509486592 00010000:00010000:2.0:1787508613.998379:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3326e lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddfe expref: 582 pid: 209004 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508613.998388:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f331e2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddcd expref: 11 pid: 230618 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.998410:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27813 00000100:00100000:2.0:1787508613.998419:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:2401:x1874324509486464:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508613.998432:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508613.998438:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3326e lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddfe expref: 582 pid: 209004 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.998464:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3326e lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddfe expref: 582 pid: 209004 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.998484:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3326e lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddfe expref: 582 pid: 209004 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.998497:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x286:0x0].0x0 (ffff9090c5b9ef00) 00010000:00010000:2.0:1787508613.998502:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f332ad lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3329f expref: 9 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.998510:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f332ad lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3329f expref: 9 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.998517:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508613.998789:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+581:2401:x1874324509486464:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 370us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.998797:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27813 00000100:00100000:2.0:1787508613.998814:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27814 00000100:00100000:2.0:1787508613.998821:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2400:x1874324509486592:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508613.998830:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508613.998835:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f331e2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddcd expref: 11 pid: 230618 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.998847:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f331e2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddcd expref: 11 pid: 230618 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.998866:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f331e2 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaddcd expref: 11 pid: 230618 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.998877:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x286:0x0].0x0 (ffff9090c5b9ef00) 00010000:00010000:2.0:1787508613.998882:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f332ad lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3329f expref: 9 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.998891:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f332ad lrc: 2/0,0 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f3329f expref: 9 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.998900:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f332ad lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f3329f expref: 9 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.998930:0:202211:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f332ad lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3329f expref: 9 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508613.998982:0:202211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0bce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:202211:1874324480093312:0@lo:105: 00000100:00100000:2.0:1787508613.999020:0:202211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508613.999134:0:202211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787508613.999153:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480093312 00000100:00100000:2.0:1787508613.999157:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480093312 00000100:00100000:2.0:1787508613.999186:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18138 00000100:00100000:2.0:1787508613.999192:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:202211:x1874324480093312:12345-0@lo:105: 00010000:00010000:2.0:1787508613.999202:0:229363:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aae00/0xb126349c40f3329f lrc: 5/0,1 mode: --/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f332ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.999219:0:229363:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aae00/0xb126349c40f3329f lrc: 5/0,1 mode: --/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f332ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.999228:0:229363:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aae00/0xb126349c40f3329f lrc: 5/0,1 mode: --/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f332ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.999237:0:229363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aae00/0xb126349c40f3329f lrc: 5/0,1 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f332ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.999243:0:229363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aae00/0xb126349c40f3329f lrc: 6/0,1 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f332ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.999250:0:229363:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aae00/0xb126349c40f3329f lrc: 6/0,1 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f332ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508613.999264:0:229363:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090cd2aae00) 00000100:00100000:2.0:1787508613.999295:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:202211:x1874324480093312:12345-0@lo:105: Request processed in 103us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.999302:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18138 00000100:00100000:2.0:1787508613.999332:0:202211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0bce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:202211:1874324480093312:0@lo:105: 00010000:00010000:2.0:1787508613.999344:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508613.999496:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2400:x1874324509486592:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 542us (1480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508613.999506:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27814 00010000:00010000:3.0:1787508613.999660:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aae00/0xb126349c40f3329f lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f332ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508613.999671:0:230618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aae00/0xb126349c40f3329f lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f332ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787508613.999890:0:230618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xf:0x0].40, 344 off74400 00000040:00080000:3.0:1787508613.999975:0:230618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x5:0x0].583, 552 off739768 00000004:00080000:3.0:1787508613.999980:0:230618:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090cbe40300 with version 13594 00000004:00080000:3.0:1787508613.999993:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13594 rpc_version 13594 00000020:00100000:3.0:1787508614.000014:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787508614.000022:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d0b51500 x1874324480093568/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1528/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787508614.000055:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b51500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480093568:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508614.000095:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508614.000116:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9300 going to sleep for 11 seconds 00000100:00100000:0.0:1787508614.002174:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480093568 00000100:00100000:0.0:1787508614.002187:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480093568 00000100:00100000:0.0:1787508614.002291:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29649 00000100:00100000:0.0:1787508614.002303:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:202961:x1874324480093568:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787508614.002556:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:202961:x1874324480093568:12345-0@lo:1000:osp_up0-1.0 Request processed in 254us (2460us total) trans 12884944057 rc 0/0 00000100:00100000:0.0:1787508614.002563:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29649 00000100:00100000:2.0:1787508614.002600:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b51500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480093568:0@lo:1000:osp_up0-1.0 00000004:00010000:1.0:1787508614.002650:0:230618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b05d2056 reply state 000000003270ce37 transno 8589961993 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f3328a lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.002667:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f3328a lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.002673:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x290:0x0].0x0 (ffff9090e460fa00) 00010000:00010000:1.0:1787508614.002676:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787508614.002679:0:230618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787508614.002684:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aae00/0xb126349c40f3329f lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f332ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.002690:0:230618:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aae00/0xb126349c40f3329f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f332ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787508614.002699:0:230618:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x286:0x0] 00000004:00010000:1.0:1787508614.002704:0:230618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b05d2056 reply state 000000003270ce37 transno 8589961993 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f33283 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.002709:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f33283 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.002713:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d1:0x0].0x0 (ffff9090e460f500) 00010000:00010000:1.0:1787508614.002715:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508614.002717:0:230618:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f332a6 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.002723:0:230618:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f332a6 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.002726:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f332a6 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.002745:0:230618:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1787508614.002755:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d1:0x0]: returning size 4096 00010000:00010000:2.0:1787508614.002766:0:202226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f332a6 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.002773:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f332a6 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.002823:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091c945b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:336035:x1874324509485696:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 23684us (26055us total) trans 8589961993 rc 0/0 00000100:00100000:1.0:1787508614.002830:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93679 00010000:00010000:2.0:1787508614.002855:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa000/0xb126349c40f332b4 lrc: 3/0,1 mode: --/EX res: [0x240000bd1:0x290:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.002865:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa000/0xb126349c40f332b4 lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x290:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.002873:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa000/0xb126349c40f332b4 lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x290:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.002899:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f332bb lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.002906:0:202226:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f332bb lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x0 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.002915:0:202226:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f332bb lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.002932:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0bce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480093696:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1787508614.005810:0:202226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508614.005992:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.006142:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480093696 00000100:00100000:1.0:1787508614.006150:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480093696 00000100:00100000:1.0:1787508614.006237:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29650 00000100:00100000:1.0:1787508614.006248:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:202226:x1874324480093696:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1787508614.006271:0:203182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.006294:0:203182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f332c2 lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f332bb expref: -99 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.006322:0:203182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f332ad lrc: 2/0,0 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3329f expref: 12 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.006332:0:203182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f332c2 lrc: 4/0,0 mode: --/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f332bb expref: 12 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.006376:0:203182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f332ad lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f3329f expref: 12 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.006392:0:203182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac8000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480093824:0@lo:104: 00000100:00100000:1.0:1787508614.006425:0:203182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508614.006470:0:203182:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c740fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787508614.006528:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480093824 00000100:00100000:3.0:1787508614.006532:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480093824 00000100:00100000:3.0:1787508614.006571:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18139 00000100:00100000:3.0:1787508614.006578:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:203182:x1874324480093824:12345-0@lo:104: 00010000:00010000:3.0:1787508614.006591:0:202210:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aae00/0xb126349c40f3329f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f332ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.006656:0:202210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787508614.006662:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:203182:x1874324480093824:12345-0@lo:104: Request processed in 85us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.006669:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18139 00010000:00010000:3.0:1787508614.006693:0:202214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787508614.006699:0:202214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aae00/0xb126349c40f3329f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f332ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.006707:0:202214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aae00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:3.0:1787508614.006712:0:202214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aae00/0xb126349c40f3329f lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f332ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508614.006721:0:202214:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aae00/0xb126349c40f3329f lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f332ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.006746:0:202214:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aae00/0xb126349c40f3329f lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f332ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.006752:0:202214:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787508614.006770:0:202214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aae00/0xb126349c40f3329f lrc: 1/0,0 mode: --/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f332ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.006777:0:202214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aae00/0xb126349c40f3329f lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f332ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.006792:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508614.006794:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508614.006796:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508614.006803:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787508614.006814:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480093952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787508614.006851:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508614.006879:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480093952 00000100:00100000:3.0:1787508614.006883:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480093952 00010000:00010000:3.0:1787508614.006899:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f332ad lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f3329f expref: 13 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.006920:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27815 00000100:00100000:3.0:1787508614.006926:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+13:3616:x1874324480093952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787508614.006935:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787508614.007425:0:203182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac8000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480093824:0@lo:104: 00010000:00010000:1.0:1787508614.007445:0:203182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f332c2 lrc: 3/0,0 mode: --/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f332bb expref: 13 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.007466:0:203182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x286:0x0].0x0 (ffff9090c5b9ef00) 00010000:00010000:1.0:1787508614.007469:0:203182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787508614.007473:0:203182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f332c2 lrc: 3/0,0 mode: --/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f332bb expref: 13 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.007481:0:203182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f332c2 lrc: 3/0,0 mode: --/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f332bb expref: 13 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.007489:0:203182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ae00, rc 0) 00000100:00100000:1.0:1787508614.007527:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:202226:x1874324480093696:12345-0@lo:101:mdt00_000.0 Request processed in 1281us (1725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.007533:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29650 00000100:00100000:3.0:1787508614.007582:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0bce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480093696:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1787508614.007594:0:202226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f332bb lrc: 4/0,1 mode: --/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f332c2 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.007602:0:202226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f332bb lrc: 4/0,1 mode: --/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f332c2 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787508614.009075:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944057 is committed 00010000:00010000:0.0:1787508614.009187:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f332ad lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x286:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f3329f expref: 11 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.009203:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x286:0x0].0x0 (ffff9090c5b9ef00) 00010000:00010000:0.0:1787508614.009208:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f332c2 lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f332bb expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.009217:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f332c2 lrc: 2/0,0 mode: EX/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f332bb expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.009226:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f332c2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f332bb expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.009259:0:205406:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f332c2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f332bb expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.009272:0:205406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091c9459500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:205406:1874324480094080:0@lo:105: 00000100:00100000:0.0:1787508614.009317:0:205406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508614.009361:0:205406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88000 going to sleep for 11 seconds 00000100:00100000:2.0:1787508614.009415:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480094080 00000100:00100000:2.0:1787508614.009422:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480094080 00000100:00100000:2.0:1787508614.009478:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18140 00000100:00100000:2.0:1787508614.009487:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091c9459f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:205406:x1874324480094080:12345-0@lo:105: 00010000:00010000:2.0:1787508614.009498:0:229363:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f332bb lrc: 5/0,1 mode: --/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f332c2 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.009513:0:229363:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f332bb lrc: 5/0,1 mode: --/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f332c2 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.009522:0:229363:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f332bb lrc: 5/0,1 mode: --/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f332c2 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.009531:0:229363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f332bb lrc: 5/0,1 mode: EX/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f332c2 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.009538:0:229363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f332bb lrc: 6/0,1 mode: EX/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f332c2 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.009546:0:229363:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f332bb lrc: 6/0,1 mode: EX/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f332c2 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.009570:0:229363:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090cd2aa200) 00000100:00100000:2.0:1787508614.009670:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091c9459f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:205406:x1874324480094080:12345-0@lo:105: Request processed in 184us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.009677:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18140 00010000:00010000:0.0:1787508614.009724:0:202226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f332bb lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f332c2 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.009734:0:202226:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f332bb lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f332c2 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.010428:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091c9458000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480094208:0@lo:403:mdt00_000.0 00000100:00100000:0.0:1787508614.010485:0:202226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508614.010515:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88900 going to sleep for 11 seconds 00000100:00100000:0.0:1787508614.010874:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.011047:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480094208 00000100:00100000:2.0:1787508614.011054:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480094208 00000100:00100000:2.0:1787508614.011089:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29651 00000100:00100000:2.0:1787508614.011097:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091c9459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:202226:x1874324480094208:12345-0@lo:403:mdt00_000.0 00000100:00100000:1.0:1787508614.011677:0:205406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091c9459500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:205406:1874324480094080:0@lo:105: 00010000:00010000:1.0:1787508614.011705:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508614.012029:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3616:x1874324480093952:12345-0@lo:103:ldlm_bl.0 Request processed in 5101us (5175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.012053:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27815 00000100:00100000:0.0:1787508614.012308:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480093952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787508614.012726:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091c9459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:202226:x1874324480094208:12345-0@lo:403:mdt00_000.0 Request processed in 1628us (2240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.012733:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29651 00000100:00100000:1.0:1787508614.013313:0:202226:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944057 gen 2 00000004:00080000:1.0:1787508614.013318:0:202226:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944057 committed transno 12884944057 00000100:00100000:1.0:1787508614.013338:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091c9458000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:202226:1874324480094208:0@lo:403:mdt00_000.0 00000100:00100000:3.0:1787508614.013755:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509486720 00000100:00100000:3.0:1787508614.013763:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509486720 00000100:00100000:3.0:1787508614.014080:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93680 00000100:00100000:3.0:1787508614.014090:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091c945a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+581:336036:x1874324509486720:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508614.014106:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.014125:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f332c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaade05 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.014193:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f332d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.014221:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33260 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33259 expref: 9 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.014230:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f332d0 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.014262:0:202228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33260 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f33259 expref: 9 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.014276:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480094336:0@lo:104: 00000100:00100000:3.0:1787508614.014326:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1787508614.014329:0:202226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xf:0x0].41, 664 off75064 00000100:00100000:3.0:1787508614.014361:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787508614.014389:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480094336 00000100:00100000:3.0:1787508614.014393:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480094336 00000100:00100000:3.0:1787508614.014427:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18141 00000100:00100000:3.0:1787508614.014434:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:202228:x1874324480094336:12345-0@lo:104: 00010000:00010000:3.0:1787508614.014445:0:202210:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f33259 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f33260 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.014498:0:202210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787508614.014504:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:202228:x1874324480094336:12345-0@lo:104: Request processed in 71us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.014510:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18141 00000040:00080000:1.0:1787508614.014534:0:202226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x5:0x0].584, 744 off740512 00000100:00100000:3.0:1787508614.014540:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480094336:0@lo:104: 00000004:00080000:1.0:1787508614.014540:0:202226:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090c740fb40 with version 13595 00010000:00010000:3.0:1787508614.014558:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f332d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.014617:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508614.014624:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f33259 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f33260 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.014632:0:204785:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 is referenced, will be cancelled later 00010000:00010000:0.0:1787508614.014635:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f33259 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f33260 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.014643:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508614.014645:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508614.014646:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787508614.015722:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1787508614.015739:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13595 rpc_version 13595 00000020:00100000:2.0:1787508614.015776:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787508614.015801:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090da0bd500 x1874324480094592/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2064/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787508614.015821:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0bd500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480094592:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508614.015883:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508614.015916:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9180 going to sleep for 11 seconds 00000100:00100000:0.0:1787508614.016074:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480094592 00000100:00100000:0.0:1787508614.016080:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480094592 00000100:00100000:0.0:1787508614.016130:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29652 00000100:00100000:0.0:1787508614.016138:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:202961:x1874324480094592:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787508614.016537:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:202961:x1874324480094592:12345-0@lo:1000:osp_up0-1.0 Request processed in 398us (652us total) trans 12884944058 rc 0/0 00000100:00100000:0.0:1787508614.016544:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29652 00000100:00100000:2.0:1787508614.016963:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0bd500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480094592:0@lo:1000:osp_up0-1.0 00000004:00200000:1.0:1787508614.016987:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d1:0x0]: returning size 4096 00010000:00010000:1.0:1787508614.017008:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa000/0xb126349c40f332b4 lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x290:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017018:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa000/0xb126349c40f332b4 lrc: 2/0,0 mode: EX/EX res: [0x240000bd1:0x290:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017025:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa000/0xb126349c40f332b4 lrc: 3/0,0 mode: EX/EX res: [0x240000bd1:0x290:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017031:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.017036:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa000/0xb126349c40f332b4 lrc: 3/0,0 mode: EX/EX res: [0x240000bd1:0x290:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017043:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa000/0xb126349c40f332b4 lrc: 4/0,0 mode: EX/EX res: [0x240000bd1:0x290:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017058:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x290:0x0].0x0 (ffff9090e460fa00) 00010000:00010000:1.0:1787508614.017061:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787508614.017066:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa000/0xb126349c40f332b4 lrc: 2/0,0 mode: --/EX res: [0x240000bd1:0x290:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017072:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa000/0xb126349c40f332b4 lrc: 0/0,0 mode: --/EX res: [0x240000bd1:0x290:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017085:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f332bb lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f332c2 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017093:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f332bb lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f332c2 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017099:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f332bb lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f332c2 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017122:0:202226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787508614.017131:0:202226:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x286:0x0] 00010000:00010000:1.0:1787508614.017139:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f332a6 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017146:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f332a6 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017151:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f332a6 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017155:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.017157:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f332a6 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017162:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f332a6 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017170:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d1:0x0].0x0 (ffff9090e460f500) 00010000:00010000:1.0:1787508614.017172:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.017175:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f332a6 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017181:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f332a6 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017192:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f33291 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33298 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.017195:0:202215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787508614.017198:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f33291 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f33298 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017205:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f33291 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f33298 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017228:0:202226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787508614.017237:0:202226:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787508614.017242:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f33259 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f33260 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017249:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f33259 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xb126349c40f33260 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017256:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f33259 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xb126349c40f33260 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017275:0:202226:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000004:00080000:1.0:1787508614.017279:0:202226:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787508614.017284:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f33275 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3327c expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017292:0:202226:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f33275 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3327c expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.017362:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336034:x1874324509485312:12345-192.168.201.30@tcp:36:rm.0 Request processed in 50670us (51247us total) trans 8589961994 rc 0/0 00000100:00100000:1.0:1787508614.017369:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93677 00010000:00010000:3.0:1787508614.017438:0:226765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787508614.017445:0:226765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f33259 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f33260 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.017452:0:226765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:3.0:1787508614.017464:0:226765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f33259 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f33260 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508614.017472:0:226765:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f33259 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f33260 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.017499:0:226765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f33259 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33260 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.017505:0:226765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787508614.017531:0:226765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f33259 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33260 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.017538:0:226765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f33259 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33260 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.017550:0:226765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787508614.017553:0:226765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f33291 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xb126349c40f33298 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.017559:0:226765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247be00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:3.0:1787508614.017563:0:226765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f33291 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xb126349c40f33298 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508614.017569:0:226765:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f33291 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xb126349c40f33298 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.017572:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480094720:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787508614.017586:0:226765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f33291 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f33298 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.017591:0:226765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787508614.017597:0:226765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f33291 lrc: 1/0,0 mode: --/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f33298 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.017603:0:226765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247be00/0xb126349c40f33291 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f33298 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.017610:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787508614.017619:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508614.017621:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508614.017623:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508614.017633:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480094848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508614.017657:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480094720 00000100:00100000:3.0:1787508614.017659:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508614.017663:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480094720 00000100:00100000:3.0:1787508614.017689:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480094848 00000100:00100000:3.0:1787508614.017692:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480094848 00010000:00010000:1.0:1787508614.017694:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33260 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f33259 expref: 11 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.017716:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27816 00010000:00010000:2.0:1787508614.017724:0:202215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f332bb lrc: 2/0,0 mode: EX/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xb126349c40f332c2 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.017724:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c1ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+12:3618:x1874324480094720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508614.017731:0:202215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa200 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:2.0:1787508614.017735:0:202215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f332bb lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xb126349c40f332c2 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017735:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00010000:2.0:1787508614.017741:0:202215:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f332bb lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xb126349c40f332c2 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017748:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33260 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f33259 expref: 12 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.017757:0:202215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f332bb lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f332c2 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017758:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.017762:0:202215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787508614.017762:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f332d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017771:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f332d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.017777:0:202215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f332bb lrc: 1/0,0 mode: --/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f332c2 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017778:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f332d0 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017796:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508614.017800:0:202215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f332bb lrc: 0/0,0 mode: --/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f332c2 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.017815:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508614.017816:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508614.017818:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508614.017821:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c1ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3618:x1874324480094720:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.017827:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27816 00000100:00100000:1.0:1787508614.017863:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9776 00000100:00100000:1.0:1787508614.017869:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8fb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3619:x1874324480094848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508614.017876:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508614.017886:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33298 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f33291 expref: 10 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.017895:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d1:0x0].0x0 (ffff9090c98d9400) 00010000:00010000:1.0:1787508614.017901:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508614.017932:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8fb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3619:x1874324480094848:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.017959:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9776 00000100:00100000:2.0:1787508614.018037:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480094848:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508614.018157:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508614.018170:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480094976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508614.018212:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508614.020044:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480094976 00000100:00100000:3.0:1787508614.020056:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480094976 00000100:00100000:3.0:1787508614.020111:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9777 00000100:00100000:3.0:1787508614.020119:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091c9459880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3616:x1874324480094976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787508614.020133:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508614.020158:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f332c2 lrc: 0/0,0 mode: --/EX res: [0x2000013a2:0x286:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f332bb expref: 9 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.020177:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x286:0x0].0x0 (ffff9090c5b9ef00) 00010000:00010000:3.0:1787508614.020188:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508614.020384:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480094720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787508614.020511:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091c9459880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:3616:x1874324480094976:12345-0@lo:103:ldlm_bl.0 Request processed in 392us (2308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.020519:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9777 00010000:00010000:3.0:1787508614.020551:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f332d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.020559:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f332d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508614.020613:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508614.020616:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508614.020636:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f332d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.020666:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f332c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade05 expref: 583 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.020680:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f332d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade05 expref: 582 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.020688:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.020690:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508614.020693:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e600, rc 0) 00000100:00100000:3.0:1787508614.020732:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091c945a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509486720:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 6644us (9860us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.020739:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93680 00000100:00100000:1.0:1787508614.025326:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.025372:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509486848 00000100:00100000:2.0:1787508614.025382:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509486848 00000100:00100000:2.0:1787508614.025436:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93681 00000100:00100000:2.0:1787508614.025447:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509486848:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508614.025475:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.025494:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f332d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaade0c expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.025550:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f332de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.025561:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f332de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.025569:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f332de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.025578:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f332e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.025583:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f332e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.025587:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f332e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.025637:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f332de lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.025644:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f332de lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.025650:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f332de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.025657:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f332de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.025663:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.025667:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f332de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.025675:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f332de lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.025686:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.025689:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.025692:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f332de lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.025696:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f332de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.025706:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f332e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.025710:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f332e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.025714:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f332e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.025717:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.025719:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f332e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.025722:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f332e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.025725:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090c98d9b00) 00010000:00010000:2.0:1787508614.025727:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.025728:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f332e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.025731:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f332e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.025752:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f332d7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade0c expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.025759:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.025760:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.025762:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f332d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade0c expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.025768:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aaa00, rc 0) 00000100:00100000:2.0:1787508614.025927:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509486848:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 482us (611us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508614.025935:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93681 00000100:00100000:0.0:1787508614.027148:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480094976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787508614.029757:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.030421:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.030551:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509486976 00000100:00100000:2.0:1787508614.030561:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509486976 00000100:00100000:1.0:1787508614.030569:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509487104 00000100:00100000:1.0:1787508614.030574:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509487104 00000100:00080000:3.0:1787508614.030628:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508614.030700:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93682 00000100:00100000:1.0:1787508614.030713:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93683 00000100:00100000:2.0:1787508614.030714:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:336037:x1874324509486976:12345-192.168.201.30@tcp:101:rm.0 00000100:00100000:1.0:1787508614.030720:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509487104:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508614.030734:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.030734:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.030753:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f332ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaade13 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.030753:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f332f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaade1a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.030823:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33301 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.030837:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33301 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.030848:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33301 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.030862:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33308 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.030869:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33308 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.030876:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33308 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.030926:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f332fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.030932:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33301 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.030937:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f332fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.030962:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f332fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.030965:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33301 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.030971:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33301 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.030977:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33301 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.030982:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.030986:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33301 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.030994:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33301 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508614.030995:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508614.030998:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1787508614.031005:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.031009:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.031013:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33301 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508614.031017:0:203348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f332fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.031019:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33301 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.031031:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33308 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.031036:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33308 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.031038:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f332ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade13 expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.031044:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33308 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.031049:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.031052:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33308 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.031053:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f332fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade13 expref: 11 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.031059:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33308 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.031066:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090c5b9e600) 00010000:00010000:2.0:1787508614.031067:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.031069:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508614.031069:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.031072:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab000, rc 0) 00010000:00010000:1.0:1787508614.031072:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33308 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.031076:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33308 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.031096:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f332f3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade1a expref: 583 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.031105:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.031107:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508614.031109:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f332f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade1a expref: 583 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.031116:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a600, rc 0) 00000100:00100000:2.0:1787508614.031124:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336037:x1874324509486976:12345-192.168.201.30@tcp:101:rm.0 Request processed in 415us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.031131:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93682 00000100:00100000:1.0:1787508614.031134:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509487104:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 416us (717us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508614.031139:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93683 00000100:00100000:3.0:1787508614.033379:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.033476:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509487232 00000100:00100000:0.0:1787508614.033490:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509487232 00000100:00100000:0.0:1787508614.033554:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93684 00000100:00100000:0.0:1787508614.033564:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509487232:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508614.033581:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508614.033598:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3330f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaade21 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.033658:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33316 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.033671:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33316 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.033682:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33316 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.033696:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3331d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.033703:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3331d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.033715:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3331d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.033771:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33316 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.033789:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33316 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.033795:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33316 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.033802:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33316 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.033808:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.033816:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33316 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.033824:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33316 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.033836:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.033838:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.033843:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33316 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.033850:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33316 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.033862:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3331d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.033867:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3331d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.033872:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3331d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.033877:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.033880:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3331d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.033885:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3331d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.033892:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090e460f100) 00010000:00010000:0.0:1787508614.033895:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.033897:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3331d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.033902:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3331d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.033930:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3330f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade21 expref: 583 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.033971:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.033974:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508614.033978:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3330f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade21 expref: 583 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.033988:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6400, rc 0) 00000100:00100000:0.0:1787508614.034036:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509487232:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 474us (672us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508614.034043:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93684 00000100:00100000:1.0:1787508614.037081:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.037118:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.037481:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509487360 00000100:00100000:3.0:1787508614.037492:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509487360 00000100:00100000:3.0:1787508614.037545:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509487616 00000100:00100000:3.0:1787508614.037550:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509487616 00000100:00100000:3.0:1787508614.037579:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93685 00000100:00100000:3.0:1787508614.037589:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336037:x1874324509487360:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508614.037608:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.037628:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33324 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaade28 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.037697:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3332b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.037712:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3332b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.037723:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3332b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.037738:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33332 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.037745:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33332 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.037751:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33332 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.037810:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3332b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.037818:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3332b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.037825:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3332b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.037833:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3332b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.037839:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.037844:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3332b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.037851:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3332b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.037864:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.037867:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.037872:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3332b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.037879:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3332b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.037892:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33332 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.037899:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33332 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.037906:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33332 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.037912:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.037915:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33332 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.037921:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33332 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.037928:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090ccb87900) 00010000:00010000:3.0:1787508614.037930:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.037933:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33332 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.037970:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33332 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.038002:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33324 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade28 expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.038012:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.038015:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508614.038019:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33324 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade28 expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.038028:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e400, rc 0) 00000100:00100000:3.0:1787508614.038091:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336037:x1874324509487360:12345-192.168.201.30@tcp:101:rm.0 Request processed in 503us (1019us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508614.038102:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93685 00000100:00100000:3.0:1787508614.038125:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93686 00000100:00100000:3.0:1787508614.038132:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509487616:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508614.038141:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.038151:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33339 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaade2f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.038193:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33340 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.038564:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33340 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.038576:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33340 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.038591:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33347 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.038599:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33347 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.038605:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33347 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.038639:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33340 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.038647:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33340 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.038659:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33340 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.038665:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33340 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.038671:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.038674:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33340 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.038680:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33340 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.038690:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.038693:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.038697:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33340 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.038703:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33340 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.038713:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33347 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.038719:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33347 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.038725:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33347 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.038731:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.038734:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33347 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.038741:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33347 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.038748:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xce5b6a33 (ffff9090ccb87d00) 00010000:00010000:3.0:1787508614.038750:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.038753:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33347 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.038759:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33347 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.038800:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33339 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade2f expref: 583 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.038811:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.038813:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508614.038816:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33339 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade2f expref: 583 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.038825:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fa00, rc 0) 00000100:00100000:3.0:1787508614.038855:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509487616:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 723us (1736us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508614.038862:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93686 00000100:00100000:3.0:1787508614.043489:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.043633:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509487872 00000100:00100000:1.0:1787508614.043642:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509487872 00000100:00100000:1.0:1787508614.043706:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93687 00000100:00100000:1.0:1787508614.043716:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509487872:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508614.043737:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.043758:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f3334e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaade36 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.043843:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33355 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.043858:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33355 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.043870:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33355 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.043889:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3335c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.043897:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3335c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.043904:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3335c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.044010:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33355 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.044018:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33355 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.044024:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33355 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.044031:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33355 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.044037:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.044041:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33355 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.044048:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33355 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.044061:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.044064:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.044069:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33355 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.044076:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33355 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.044090:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3335c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.044096:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3335c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.044102:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3335c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.044108:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.044110:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3335c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.044116:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3335c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.044123:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaf7dd568 (ffff9090c5b9e600) 00010000:00010000:1.0:1787508614.044125:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.044128:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3335c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.044134:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3335c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.044168:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f3334e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade36 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.044183:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.044186:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508614.044189:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f3334e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade36 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.044211:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a600, rc 0) 00000100:00100000:1.0:1787508614.044271:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509487872:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 556us (792us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508614.044279:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93687 00000100:00100000:3.0:1787508614.047392:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.047494:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509488000 00000100:00100000:1.0:1787508614.047505:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509488000 00000100:00100000:1.0:1787508614.047567:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93688 00000100:00100000:1.0:1787508614.047578:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336037:x1874324509488000:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508614.047596:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.047616:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33363 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaade3d expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.047675:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3336a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.047690:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3336a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.047700:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3336a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.047716:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33371 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.047724:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33371 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.047731:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33371 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.047792:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3336a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.047801:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3336a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.047808:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3336a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.047815:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3336a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.047822:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247bc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.047826:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3336a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.047834:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3336a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.047847:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.047851:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.047855:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3336a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.047862:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3336a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.047876:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33371 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.047883:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33371 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.047889:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33371 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.047894:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.047897:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33371 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.047904:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33371 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.047911:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090c5b9e900) 00010000:00010000:1.0:1787508614.047914:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.047917:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33371 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.047922:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33371 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.048002:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33363 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade3d expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.048013:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.048016:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508614.048020:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f33363 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade3d expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.048031:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a200, rc 0) 00000100:00100000:1.0:1787508614.048089:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336037:x1874324509488000:12345-192.168.201.30@tcp:101:rm.0 Request processed in 512us (706us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508614.048097:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93688 00000100:00100000:2.0:1787508614.051015:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.051246:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509488128 00000100:00100000:1.0:1787508614.051257:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509488128 00000100:00100000:1.0:1787508614.051317:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93689 00000100:00100000:1.0:1787508614.051327:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336037:x1874324509488128:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508614.051346:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.051474:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f33378 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaade44 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.051546:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3337f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.051560:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3337f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.051571:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3337f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.051587:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33386 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.051594:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33386 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.051599:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33386 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.051652:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3337f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.051660:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3337f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.051665:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3337f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.051672:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3337f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.051678:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.051683:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3337f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.051690:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3337f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.051701:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.051704:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.051709:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3337f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.051716:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3337f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.051730:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33386 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.051737:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33386 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.051743:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33386 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.051748:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.051750:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33386 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.051757:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33386 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.051764:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090c5b9eb00) 00010000:00010000:1.0:1787508614.051766:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.051769:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33386 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.051775:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33386 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.051866:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f33378 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade44 expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.051877:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.051879:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508614.051883:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f33378 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade44 expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.051891:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247be00, rc 0) 00000100:00100000:1.0:1787508614.052076:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336037:x1874324509488128:12345-192.168.201.30@tcp:101:rm.0 Request processed in 749us (1071us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508614.052088:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93689 00000100:00100000:1.0:1787508614.055188:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.055353:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509488384 00000100:00100000:2.0:1787508614.055363:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509488384 00000100:00100000:2.0:1787508614.055424:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93690 00000100:00100000:2.0:1787508614.055433:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509488384:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508614.055463:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.055486:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f3338d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaade4b expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.055555:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33394 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.055571:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33394 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.055582:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33394 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.055597:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3339b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.055604:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3339b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.055610:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3339b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.055663:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33394 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.055670:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33394 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.055676:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33394 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.055682:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33394 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.055688:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.055693:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33394 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.055700:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33394 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.055712:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.055715:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.055719:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33394 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.055726:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33394 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.055739:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3339b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.055746:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3339b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.055751:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3339b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.055755:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.055758:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3339b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.055764:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3339b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.055770:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3e9f33b0 (ffff9090c98d9b00) 00010000:00010000:2.0:1787508614.055773:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.055776:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3339b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.055795:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3339b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.055828:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f3338d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade4b expref: 583 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.055838:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.055840:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.055844:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f3338d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade4b expref: 583 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.055859:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab400, rc 0) 00000100:00100000:2.0:1787508614.055921:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509488384:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 488us (742us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508614.055929:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93690 00000100:00100000:1.0:1787508614.061673:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.061714:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.061805:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509488768 00000100:00100000:2.0:1787508614.061817:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509488768 00000100:00100000:2.0:1787508614.061875:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509488896 00000100:00100000:2.0:1787508614.061879:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509488896 00000100:00100000:2.0:1787508614.061911:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93691 00000100:00100000:2.0:1787508614.061921:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336037:x1874324509488768:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508614.061971:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.061995:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f333a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaade59 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062075:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f333a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062090:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f333a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062101:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f333a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062117:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f333b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062124:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f333b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062135:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f333b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062192:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f333a9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062210:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f333a9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062217:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f333a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062224:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f333a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062230:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.062234:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f333a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062241:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f333a9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062254:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.062257:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.062262:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f333a9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062268:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f333a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062283:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f333b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062289:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f333b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062294:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f333b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062300:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.062302:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f333b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062308:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f333b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062315:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090c98d9600) 00010000:00010000:2.0:1787508614.062318:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.062321:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f333b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062327:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f333b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062361:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f333a2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade59 expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062386:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.062389:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.062393:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f333a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade59 expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062407:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aaa00, rc 0) 00000100:00100000:2.0:1787508614.062477:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336037:x1874324509488768:12345-192.168.201.30@tcp:101:rm.0 Request processed in 557us (812us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508614.062484:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93691 00000100:00100000:2.0:1787508614.062505:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93692 00000100:00100000:2.0:1787508614.062512:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509488896:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508614.062521:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.062530:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f333b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaade52 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062562:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f333be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062571:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f333be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062578:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f333be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062590:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f333c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062597:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f333c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062603:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f333c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062634:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f333be lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062641:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f333be lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062646:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f333be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062652:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f333be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062656:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.062659:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f333be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062666:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f333be lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062675:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.062677:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.062680:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f333be lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062686:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f333be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062696:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f333c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062702:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f333c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062709:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f333c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062714:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.062717:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f333c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062723:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f333c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062731:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ad43c78 (ffff9090c98d9300) 00010000:00010000:2.0:1787508614.062734:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.062737:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f333c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062743:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f333c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062765:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f333b7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade52 expref: 583 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062773:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.062775:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.062779:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f333b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade52 expref: 583 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.062787:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aac00, rc 0) 00000100:00100000:2.0:1787508614.062814:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509488896:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 302us (1099us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508614.062823:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93692 00000100:00100000:1.0:1787508614.066736:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.066910:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509489024 00000100:00100000:2.0:1787508614.066920:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509489024 00000100:00100000:2.0:1787508614.067000:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93693 00000100:00100000:2.0:1787508614.067011:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336037:x1874324509489024:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508614.067031:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.067052:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f333cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaade60 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.067119:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f333d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.067132:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f333d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.067143:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f333d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.067153:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f333da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.067163:0:209004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f3327c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33275 expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.067172:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f333da lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.067206:0:209004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f3327c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f33275 expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.067228:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0bed80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480095104:0@lo:104: 00000100:00100000:2.0:1787508614.067274:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508614.068668:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9180 going to sleep for 11 seconds 00000100:00100000:3.0:1787508614.069784:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480095104 00000100:00100000:3.0:1787508614.069798:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480095104 00000100:00100000:1.0:1787508614.070048:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.070142:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509489280 00000100:00100000:3.0:1787508614.070146:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509489280 00000100:00100000:2.0:1787508614.070160:0:229386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18142 00000100:00100000:2.0:1787508614.070170:0:229386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:209004:x1874324480095104:12345-0@lo:104: 00010000:00010000:2.0:1787508614.070189:0:229386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f33275 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f3327c expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.070190:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93694 00000100:00100000:3.0:1787508614.070197:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509489280:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508614.070213:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.070233:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f333e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaade67 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.070272:0:229386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787508614.070278:0:229386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:209004:x1874324480095104:12345-0@lo:104: Request processed in 110us (3004us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.070284:0:229386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18142 00010000:00010000:3.0:1787508614.070298:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f333e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.070312:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f333e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.070322:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f333e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.070328:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0bed80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480095104:0@lo:104: 00010000:00010000:3.0:1787508614.070336:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f333ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.070342:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f333ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.070348:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f333ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.070348:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f333da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.070412:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f333e8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.070419:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f333e8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.070429:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f333e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.070437:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f333e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.070444:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.070449:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f333e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.070467:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f333e8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.070480:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.070483:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.070488:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f333e8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.070538:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f333e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.070551:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f333ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.070556:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f333ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.070562:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f333ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.070567:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.070571:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f333ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.070576:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f333ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.070584:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbfff8436 (ffff9090ccb87d00) 00010000:00010000:3.0:1787508614.070587:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.070590:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f333ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.070595:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f333ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.070627:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f333e1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade67 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.070636:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.070638:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508614.070641:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f333e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade67 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.070650:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fa00, rc 0) 00000100:00100000:3.0:1787508614.070708:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509489280:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 510us (664us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508614.070714:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93694 00010000:00010000:0.0:1787508614.071502:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508614.071510:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f33275 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f3327c expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.071520:0:204785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a800 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:0.0:1787508614.071525:0:204785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f33275 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f3327c expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508614.071534:0:204785:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f33275 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f3327c expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.071569:0:204785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f33275 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3327c expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.071577:0:204785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787508614.071612:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f33275 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3327c expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.071621:0:204785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f33275 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3327c expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.071640:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508614.071642:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508614.071643:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508614.071748:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091c9458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480095232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508614.071802:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508614.071843:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480095232 00000100:00100000:2.0:1787508614.071850:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480095232 00010000:00010000:2.0:1787508614.071875:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f3327c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f33275 expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.071910:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27817 00000100:00100000:2.0:1787508614.071918:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3617:x1874324480095232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508614.071929:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1787508614.074037:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944058 is committed 00010000:00010000:2.0:1787508614.074443:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f3327c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f33275 expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.074475:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090ccb87e00) 00010000:00010000:2.0:1787508614.074480:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f333da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.074490:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f333da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.074498:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f333da lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.074533:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508614.074604:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480095232:12345-0@lo:103:ldlm_bl.0 Request processed in 2685us (2801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.074614:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27817 00010000:00010000:0.0:1787508614.074723:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f333da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.074732:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f333da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.074803:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f333d3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.074812:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f333d3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.074819:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f333d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.074827:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f333d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.074833:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.074837:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f333d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.074845:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f333d3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.074856:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.074860:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.074864:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f333d3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.074871:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f333d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.074883:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f333da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.074889:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f333da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.074896:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f333da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.074902:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.074905:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f333da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.074911:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f333da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.074918:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090ccb87e00) 00010000:00010000:0.0:1787508614.074921:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.074924:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f333da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.074930:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f333da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.075106:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f333cc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade60 expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.075118:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.075120:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.075124:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f333cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade60 expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.075134:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa400, rc 0) 00000100:00100000:0.0:1787508614.075234:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336037:x1874324509489024:12345-192.168.201.30@tcp:101:rm.0 Request processed in 8224us (8507us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508614.075243:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93693 00000100:00100000:1.0:1787508614.078325:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091c9458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480095232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508614.081265:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.084323:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509489536 00000100:00100000:3.0:1787508614.084338:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509489536 00000100:00100000:2.0:1787508614.085061:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93695 00000100:00100000:2.0:1787508614.085076:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509489536:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508614.085098:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.085118:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f333f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaade6e expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.085194:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f333fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.085222:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f333fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.085235:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f333fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.085255:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33404 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.085263:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33404 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.085270:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33404 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.085327:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f333fd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.085335:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f333fd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.085342:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f333fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.085349:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f333fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.085355:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.085360:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f333fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.085380:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f333fd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.085396:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.085399:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.085406:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f333fd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.085413:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f333fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.085430:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33404 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.085436:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33404 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.085442:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33404 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.085448:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.085462:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33404 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.085470:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33404 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.085478:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x594a0ca2 (ffff9090c98d9300) 00010000:00010000:2.0:1787508614.085480:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.085484:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33404 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.085490:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33404 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.085524:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f333f6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade6e expref: 583 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.085540:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.085543:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.085547:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f333f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade6e expref: 583 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.085557:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aac00, rc 0) 00000100:00100000:2.0:1787508614.085632:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509489536:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 559us (4375us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508614.085641:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93695 00000100:00100000:0.0:1787508614.090612:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.090758:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509489792 00000100:00100000:3.0:1787508614.090769:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509489792 00000100:00100000:3.0:1787508614.090863:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93696 00000100:00100000:3.0:1787508614.090874:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091c9458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509489792:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508614.090894:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.090915:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3340b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaade75 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.091010:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33412 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.091025:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33412 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.091036:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33412 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.091050:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33419 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.091057:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33419 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.091063:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33419 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.091116:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33412 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.091123:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33412 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.091129:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33412 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.091136:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33412 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.091141:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.091145:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33412 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.091152:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33412 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.091163:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.091166:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.091170:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33412 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.091176:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33412 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.091189:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33419 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.091194:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33419 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.091199:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33419 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.091204:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.091207:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33419 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.091218:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33419 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.091224:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe67841 (ffff9090d2273d00) 00010000:00010000:3.0:1787508614.091226:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.091229:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33419 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.091234:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33419 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.091263:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3340b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade75 expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.091273:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.091274:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508614.091277:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3340b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade75 expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.091286:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fa00, rc 0) 00000100:00100000:3.0:1787508614.091350:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091c9458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509489792:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 478us (747us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508614.091357:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93696 00000100:00100000:3.0:1787508614.095389:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.095498:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509490048 00000100:00100000:1.0:1787508614.095509:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509490048 00000100:00100000:1.0:1787508614.095582:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93697 00000100:00100000:1.0:1787508614.095593:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509490048:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508614.095615:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.095635:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33420 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaade7c expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.095714:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33427 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.095729:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33427 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.095739:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33427 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.095759:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3342e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.095765:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3342e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.095771:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3342e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.095837:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33427 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.095845:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33427 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.095852:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33427 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.095859:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33427 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.095864:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.095869:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33427 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.095875:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33427 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.095888:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.095891:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.095896:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33427 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.095903:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33427 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.095921:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3342e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.095928:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3342e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.095934:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3342e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.095984:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.095988:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3342e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.095995:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3342e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.096003:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090c5b9eb00) 00010000:00010000:1.0:1787508614.096005:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.096008:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3342e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.096013:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3342e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.096047:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33420 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade7c expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.096062:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.096064:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508614.096067:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33420 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade7c expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.096076:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b000, rc 0) 00000100:00100000:1.0:1787508614.096129:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509490048:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 538us (750us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508614.096136:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93697 00000100:00100000:1.0:1787508614.100533:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.100638:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509490304 00000100:00100000:0.0:1787508614.100648:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509490304 00000100:00100000:0.0:1787508614.100714:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93698 00000100:00100000:0.0:1787508614.100725:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509490304:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508614.100748:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508614.100770:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33435 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaade83 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.100860:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3343c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.100875:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3343c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.100887:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3343c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.100903:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33443 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.100911:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33443 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.100918:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33443 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.101026:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3343c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.101034:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3343c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.101045:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3343c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.101052:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3343c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.101058:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.101062:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3343c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.101069:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3343c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.101083:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.101085:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.101090:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3343c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.101096:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3343c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.101109:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33443 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.101115:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33443 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.101122:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33443 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.101127:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.101130:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33443 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.101137:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33443 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.101145:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x90ba0166 (ffff9090e460f100) 00010000:00010000:0.0:1787508614.101148:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.101151:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33443 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.101157:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33443 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.101191:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33435 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade83 expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.101216:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.101219:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508614.101223:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33435 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade83 expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.101233:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6000, rc 0) 00000100:00100000:0.0:1787508614.101296:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509490304:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 572us (772us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508614.101305:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93698 00000100:00100000:0.0:1787508614.106166:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.106348:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509490560 00000100:00100000:2.0:1787508614.106361:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509490560 00000100:00100000:2.0:1787508614.106541:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93699 00000100:00100000:2.0:1787508614.106552:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091c945ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509490560:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508614.106574:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.106598:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3344a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaade8a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.106674:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33451 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.106689:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33451 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.106700:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33451 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.106714:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f33458 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.106721:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f33458 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.106727:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f33458 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.106804:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33451 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.106812:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33451 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.106818:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33451 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.106825:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33451 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.106831:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.106835:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33451 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.106842:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33451 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.106855:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.106858:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.106862:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33451 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.106869:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33451 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.106883:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f33458 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.106889:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f33458 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.106895:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f33458 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.106900:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aaa00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.106903:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f33458 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.106909:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f33458 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.106916:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaf3dc4c9 (ffff9090c98d9300) 00010000:00010000:2.0:1787508614.106919:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.106921:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f33458 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.106927:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f33458 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.107092:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3344a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade8a expref: 583 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.107104:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.107106:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.107111:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3344a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade8a expref: 583 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.107122:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aba00, rc 0) 00000100:00100000:2.0:1787508614.107289:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091c945ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509490560:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 737us (1132us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508614.107297:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93699 00000100:00100000:2.0:1787508614.112500:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.112600:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509490688 00000100:00100000:3.0:1787508614.112610:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509490688 00000100:00100000:3.0:1787508614.112674:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93700 00000100:00100000:3.0:1787508614.112685:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509490688:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508614.112705:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.112725:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3345f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaade91 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.114711:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33466 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.114734:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33466 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.114747:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33466 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.114764:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f3346d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.114772:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f3346d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.115097:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f3346d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.115278:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33466 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.115288:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33466 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.115292:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33466 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.115296:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33466 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.115300:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.115303:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33466 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.115307:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33466 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.115316:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.115318:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.115321:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33466 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.115326:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33466 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.115337:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f3346d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.115340:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f3346d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.115344:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f3346d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.115347:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.115349:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f3346d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.115352:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f3346d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.115356:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d2273d00) 00010000:00010000:0.0:1787508614.115357:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.115359:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f3346d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.115371:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f3346d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.115401:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3345f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade91 expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.115408:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.115409:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.115411:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3345f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade91 expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.115417:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fa00, rc 0) 00000100:00100000:0.0:1787508614.115501:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509490688:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 2817us (3011us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508614.115511:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93700 00000100:00100000:0.0:1787508614.119544:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.119911:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509490944 00000100:00100000:2.0:1787508614.119921:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509490944 00000100:00100000:2.0:1787508614.120008:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93701 00000100:00100000:2.0:1787508614.120018:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091c945aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336036:x1874324509490944:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:2.0:1787508614.120077:0:205405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508614.120106:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f332d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade05 expref: 582 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.120125:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.120130:0:205405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508614.120222:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33474 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.120236:0:205405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f332fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade13 expref: 10 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.120245:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33474 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.120277:0:205405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f332fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade13 expref: 10 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.120297:0:205405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f332fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade13 expref: 10 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.120310:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0bea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480095360:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508614.120396:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9180 going to sleep for 11 seconds 00000100:00100000:2.0:1787508614.126655:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0bea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480095360:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508614.126686:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33474 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.127155:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.127232:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509491072 00000100:00100000:1.0:1787508614.127240:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509491072 00010000:00010000:1.0:1787508614.127275:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f332fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade13 expref: 11 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.127309:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27818 00000100:00100000:1.0:1787508614.127318:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091c9458a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2400:x1874324509491072:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508614.127331:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508614.127338:0:229383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f332fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade13 expref: 11 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.127352:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f332fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade13 expref: 11 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.127378:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f332fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade13 expref: 11 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.127395:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.127399:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33474 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.127409:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33474 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.127416:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33474 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.127441:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508614.127500:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091c9458a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2400:x1874324509491072:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 183us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.127506:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27818 00010000:00010000:3.0:1787508614.127562:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33474 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.127570:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33474 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.127592:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3347b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.127602:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3347b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.127610:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3347b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787508614.128524:0:205405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1:0x0].1777, 2168 off1829816 00000040:00080000:3.0:1787508614.128601:0:205405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x1:0x0].1784, 2368 off2035280 00000004:00080000:3.0:1787508614.128609:0:205405:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d01c9c00 with version 3450 00000004:00080000:1.0:1787508614.128743:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3450 rpc_version 3450 00000020:00100000:1.0:1787508614.128788:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787508614.128797:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d0b51c00 x1874324480095616/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4232/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787508614.128818:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b51c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480095616:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787508614.128879:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508614.128914:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787508614.129803:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480095616 00000100:00100000:2.0:1787508614.129813:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480095616 00000100:00100000:2.0:1787508614.129855:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29653 00000100:00100000:2.0:1787508614.129865:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed03ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:202248:x1874324480095616:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787508614.130364:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed03ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:202248:x1874324480095616:12345-0@lo:1000:osp_up1-0.0 Request processed in 500us (1483us total) trans 8589961995 rc 0/0 00000100:00100000:2.0:1787508614.130373:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29653 00000100:00100000:1.0:1787508614.130428:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b51c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480095616:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1787508614.130741:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33482 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1259:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.130756:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33482 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1259:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.130766:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33482 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1259:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.130909:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.131053:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509491200 00000100:00100000:0.0:1787508614.131059:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509491200 00000100:00100000:0.0:1787508614.131108:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93702 00000100:00100000:0.0:1787508614.131117:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:336041:x1874324509491200:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508614.131130:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508614.131144:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33489 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaade98 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.131200:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f33490 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.131222:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33474 lrc: 2/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.131230:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f33490 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.131248:0:202228:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33474 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.131258:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f33490 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.131331:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33497 lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.131340:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33497 lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x16f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.131346:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33497 lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x16f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.131596:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aaa00/0xb126349c40f3349e lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x167:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.131605:0:205405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aaa00/0xb126349c40f3349e lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.131614:0:205405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aaa00/0xb126349c40f3349e lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.131631:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6350e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:205405:1874324480095744:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1787508614.131676:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508614.131741:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9840 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.132042:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480095744 00000100:00100000:1.0:1787508614.132049:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480095744 00000100:00100000:1.0:1787508614.132137:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29654 00000100:00100000:1.0:1787508614.132146:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:205405:x1874324480095744:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1787508614.132161:0:203182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.132177:0:203182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f334a5 lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x167:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f3349e expref: -99 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.132195:0:203182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f334a5 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f3349e expref: 11 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.132208:0:203182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f334a5 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3349e expref: 11 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.132216:0:203182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x167:0x0].0x0 (ffff9090c5b9eb00) 00010000:00010000:1.0:1787508614.132219:0:203182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.132222:0:203182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a200, rc 0) 00000100:00100000:1.0:1787508614.132270:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:205405:x1874324480095744:12345-0@lo:101:mdt00_004.0 Request processed in 125us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.132276:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29654 00000100:00100000:2.0:1787508614.132348:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6350e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:205405:1874324480095744:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1787508614.132375:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aaa00/0xb126349c40f3349e lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f334a5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.132386:0:205405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aaa00/0xb126349c40f3349e lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f334a5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508614.132407:0:205405:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e398a75c reply state 000000002c716ed4 transno 12884944059 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33497 lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x16f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.132418:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33497 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x16f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.132425:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16f:0x0].0x0 (ffff9090d2273c00) 00010000:00010000:2.0:1787508614.132427:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787508614.132430:0:205405:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787508614.132437:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aaa00/0xb126349c40f3349e lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f334a5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.132445:0:205405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aaa00/0xb126349c40f3349e lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f334a5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787508614.132464:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd2:0x167:0x0] 00000004:00010000:2.0:1787508614.132472:0:205405:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e398a75c reply state 000000002c716ed4 transno 12884944059 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33482 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1259:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.132480:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33482 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1259:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.132487:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1259:0x0].0x0 (ffff9090d2273e00) 00010000:00010000:2.0:1787508614.132489:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787508614.132491:0:205405:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1787508614.132495:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1259:0x0]: returning size 4096 00010000:00010000:2.0:1787508614.132506:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33474 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.132512:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33474 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.132518:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33474 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.132524:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33474 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.132530:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.132534:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33474 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.132541:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33474 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.132552:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.132554:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.132558:0:205405:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f33490 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.132565:0:205405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f33490 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.132570:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f33490 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.132601:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33474 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.132609:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33474 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508614.132622:0:205405:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e398a75c reply state 000000002c716ed4 transno 12884944059 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3347b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.132630:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3347b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.132636:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d2273000) 00010000:00010000:2.0:1787508614.132639:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787508614.132641:0:205405:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1787508614.132708:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091c945aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336036:x1874324509490944:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 12690us (13172us total) trans 12884944059 rc 0/0 00000100:00100000:2.0:1787508614.132715:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93701 00010000:00010000:3.0:1787508614.132795:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f33490 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.132804:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f33490 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508614.132844:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508614.132848:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508614.132864:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f33490 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.132889:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33489 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade98 expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.132903:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f33490 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade98 expref: 11 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.132910:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.132912:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508614.132914:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7600, rc 0) 00000100:00100000:3.0:1787508614.132937:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336041:x1874324509491200:12345-192.168.201.30@tcp:101:rm.0 Request processed in 1822us (2030us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.132980:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93702 00000100:00100000:0.0:1787508614.140311:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.140440:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509491456 00000100:00100000:2.0:1787508614.140449:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509491456 00000100:00100000:2.0:1787508614.140544:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93703 00000100:00100000:2.0:1787508614.140555:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091c9458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336041:x1874324509491456:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508614.140576:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.140598:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f334ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaade9f expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.140673:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f334b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.140693:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f334b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.140705:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f334b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.140721:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f334ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.140728:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f334ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.140735:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f334ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.140871:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f334b3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.140879:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f334b3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.140886:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f334b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.140892:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f334b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.140898:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.140902:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f334b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.140909:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f334b3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.140921:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.140924:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.140928:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f334b3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.140934:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f334b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.141004:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f334ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.141010:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f334ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.141016:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f334ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.141021:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.141024:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f334ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.141029:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f334ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.141037:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090c98d9600) 00010000:00010000:2.0:1787508614.141039:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.141042:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f334ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.141048:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f334ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.141080:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f334ac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade9f expref: 12 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.141090:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.141092:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.141095:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f334ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade9f expref: 12 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.141103:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab600, rc 0) 00000100:00100000:2.0:1787508614.141213:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091c9458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336041:x1874324509491456:12345-192.168.201.30@tcp:101:rm.0 Request processed in 659us (910us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508614.141220:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93703 00000100:00100000:0.0:1787508614.146444:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.146538:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509491584 00000100:00100000:2.0:1787508614.146548:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509491584 00000100:00100000:2.0:1787508614.146613:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93704 00000100:00100000:2.0:1787508614.146623:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091c9459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336041:x1874324509491584:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508614.146645:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.146667:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f334c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadea6 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.146736:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f334c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.146751:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f334c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.146761:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f334c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.146771:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f334cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.146787:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f334cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.146794:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f334cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.146892:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f334d6 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.146900:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f334d6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.146906:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f334d6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508614.147028:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1259:0x0]: returning size 4096 00000004:00200000:2.0:1787508614.147033:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1787508614.147054:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f334d6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.147067:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f334c8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.147074:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f334c8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.147079:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f334c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.147089:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f334c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.147095:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.147099:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f334c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.147106:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f334c8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.147119:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.147122:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.147127:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f334c8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.147133:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f334c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.147147:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f334cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.147153:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f334cf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.147159:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f334cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.147163:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.147165:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f334cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.147174:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f334cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.147181:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d2273000) 00010000:00010000:2.0:1787508614.147183:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.147186:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f334cf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.147191:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f334cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.147229:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f334c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadea6 expref: 13 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.147243:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f334d6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadea6 expref: 12 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.147250:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1259:0x0].0x0 (ffff9090d2273e00) 00010000:00010000:2.0:1787508614.147253:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508614.147255:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab000, rc 0) 00000100:00100000:2.0:1787508614.147317:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091c9459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336041:x1874324509491584:12345-192.168.201.30@tcp:101:rm.0 Request processed in 695us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.147324:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93704 00000100:00100000:0.0:1787508614.149632:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.149717:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509491712 00000100:00100000:2.0:1787508614.149728:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509491712 00000100:00100000:2.0:1787508614.149790:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93705 00000100:00100000:2.0:1787508614.149800:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091c9458700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336042:x1874324509491712:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1787508614.149829:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.149850:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f334dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadead expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.149918:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f334e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.149930:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f334e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.149979:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f334e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508614.150029:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508614.150033:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508614.150053:0:203348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f334e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.150077:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f334dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadead expref: 585 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.150098:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f334e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadead expref: 584 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.150106:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.150109:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508614.150113:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa000, rc 0) 00000100:00100000:2.0:1787508614.150166:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091c9458700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336042:x1874324509491712:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 367us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.150177:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93705 00000100:00100000:3.0:1787508614.158163:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.158265:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509491840 00000100:00100000:0.0:1787508614.158275:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509491840 00000100:00100000:0.0:1787508614.158331:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93706 00000100:00100000:0.0:1787508614.158340:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336041:x1874324509491840:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508614.158360:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508614.158388:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f334eb lrc: 2/0,0 mode: --/CR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadeb4 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.158442:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f334f2 lrc: 3/1,0 mode: --/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.158466:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f334f2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.158477:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f334f2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508614.158526:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a0:0x16f:0x0]: returning size 4096 00000004:00200000:0.0:1787508614.158531:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508614.158562:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f334eb lrc: 0/0,0 mode: --/CR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadeb4 expref: 14 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.158579:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f334f2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadeb4 expref: 13 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.158588:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16f:0x0].0x0 (ffff9090d2273c00) 00010000:00010000:0.0:1787508614.158590:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508614.158594:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6800, rc 0) 00000100:00100000:0.0:1787508614.158652:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336041:x1874324509491840:12345-192.168.201.30@tcp:101:rm.0 Request processed in 313us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508614.158659:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93706 00000100:00100000:1.0:1787508614.161293:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.161407:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509491968 00000100:00100000:2.0:1787508614.161422:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509491968 00000100:00100000:2.0:1787508614.161508:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93707 00000100:00100000:2.0:1787508614.161520:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336042:x1874324509491968:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1787508614.161547:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.161579:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f334f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadebb expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.161664:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33500 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.161678:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33500 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.161688:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33500 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.161703:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33507 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.161710:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33507 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.161717:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33507 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.161806:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33500 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.161817:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33500 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.161823:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33500 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.161830:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33500 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.161836:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.161840:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33500 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.161848:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33500 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.161861:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.161865:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.161869:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33500 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.161877:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33500 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.161900:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33507 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.161912:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33507 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.161920:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33507 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.161931:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.161934:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33507 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.162006:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33507 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.162094:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090c98d9600) 00010000:00010000:2.0:1787508614.162100:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.162107:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33507 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.162118:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33507 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.162182:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f334f9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadebb expref: 585 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.162198:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.162201:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.162205:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f334f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadebb expref: 585 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.162214:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa800, rc 0) 00000100:00100000:2.0:1787508614.162344:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336042:x1874324509491968:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 824us (1058us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508614.162354:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93707 00000100:00100000:2.0:1787508614.164021:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.164150:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509492096 00000100:00100000:0.0:1787508614.164159:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509492096 00000100:00100000:0.0:1787508614.164240:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93708 00000100:00100000:0.0:1787508614.164251:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336041:x1874324509492096:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508614.164275:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508614.164296:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f3350e lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x167:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadec2 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.164353:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33515 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.164380:0:209004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f334a5 lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x167:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3349e expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.164389:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33515 lrc: 4/1,0 mode: --/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.164421:0:209004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f334a5 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x167:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f3349e expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.164436:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091c9459c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:209004:1874324480095872:0@lo:104: 00000100:00100000:0.0:1787508614.164494:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508614.164534:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88240 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.164712:0:202209:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787508614.164725:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480095872 00000100:00100000:1.0:1787508614.164729:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480095872 00000100:00100000:1.0:1787508614.164770:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18143 00000100:00100000:1.0:1787508614.164776:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d08b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:209004:x1874324480095872:12345-0@lo:104: 00010000:00010000:1.0:1787508614.164788:0:202209:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aaa00/0xb126349c40f3349e lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f334a5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.164840:0:202209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787508614.164846:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d08b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:209004:x1874324480095872:12345-0@lo:104: Request processed in 71us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.164856:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18143 00010000:00010000:1.0:1787508614.164899:0:226765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787508614.164904:0:226765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aaa00/0xb126349c40f3349e lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f334a5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.164912:0:226765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aaa00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:1.0:1787508614.164917:0:226765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aaa00/0xb126349c40f3349e lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x167:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f334a5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508614.164925:0:226765:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aaa00/0xb126349c40f3349e lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x167:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f334a5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.164975:0:226765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aaa00/0xb126349c40f3349e lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x167:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f334a5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.164982:0:226765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787508614.165003:0:226765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aaa00/0xb126349c40f3349e lrc: 1/0,0 mode: --/PW res: [0x240000bd2:0x167:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f334a5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.165010:0:226765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aaa00/0xb126349c40f3349e lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x167:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f334a5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.165029:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508614.165030:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508614.165032:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508614.165043:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480096000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508614.165072:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508614.165123:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091c9459c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:209004:1874324480095872:0@lo:104: 00010000:00010000:1.0:1787508614.165142:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33515 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787508614.165213:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787508614.165325:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480096000 00000100:00100000:0.0:1787508614.165330:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480096000 00010000:00010000:0.0:1787508614.165349:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f334a5 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x167:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f3349e expref: 11 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.165381:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27819 00000100:00100000:0.0:1787508614.165389:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+11:3618:x1874324480096000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508614.165399:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787508614.166708:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.168307:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509492224 00000100:00100000:0.0:1787508614.168320:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509492224 00000100:00100000:0.0:1787508614.168386:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93709 00000100:00100000:0.0:1787508614.168396:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336042:x1874324509492224:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508614.168417:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508614.168437:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3351c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadec9 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.168517:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f33523 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.168533:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f33523 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.168545:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f33523 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.168560:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3352a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.168568:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3352a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.168575:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3352a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.168626:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f33523 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.168635:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f33523 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.168646:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f33523 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.168653:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f33523 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.168659:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.168664:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f33523 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.168671:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f33523 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.168684:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.168687:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.168692:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f33523 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.168699:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f33523 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.168712:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3352a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.168718:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3352a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.168724:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3352a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.168729:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.168732:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3352a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.168738:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3352a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.168745:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090e460f100) 00010000:00010000:0.0:1787508614.168747:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.168749:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3352a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.168755:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3352a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.168784:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3351c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadec9 expref: 585 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.168794:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.168797:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508614.168801:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f3351c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadec9 expref: 585 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.168810:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7e00, rc 0) 00000100:00100000:0.0:1787508614.169059:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336042:x1874324509492224:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 662us (2359us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508614.169067:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93709 00000001:00080000:1.0:1787508614.169436:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589961995 is committed 00000001:00080000:1.0:1787508614.169443:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589961994 is committed 00000001:00080000:1.0:1787508614.169477:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589961993 is committed 00000020:00080000:1.0:1787508614.169485:0:202955:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9090cbe40e40 refcount 2 committed 0 result 0 batchid 4294998375 00000020:00080000:1.0:1787508614.169490:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9091d47d0c00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9090cbe40300 00000020:00080000:1.0:1787508614.169494:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a2:0x5:0x0].583 00000020:00080000:1.0:1787508614.169496:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9091d47d0600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090e3c8e400 00000020:00080000:1.0:1787508614.169499:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd1:0xf:0x0].40 00000020:00080000:1.0:1787508614.169526:0:202955:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9090d1c88c00 refcount 2 committed 0 result 0 batchid 4294998374 00000020:00080000:1.0:1787508614.169530:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090c83d0800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d1c88540 00000020:00080000:1.0:1787508614.169533:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a2:0x5:0x0].582 00000020:00080000:1.0:1787508614.169535:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090c83d0600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090d7420e00 00000020:00080000:1.0:1787508614.169537:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd1:0xf:0x0].39 00010000:00010000:3.0:1787508614.169597:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6200/0xb126349c40f3314f lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.169607:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6200/0xb126349c40f3314f lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.169614:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6200/0xb126349c40f3314f lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.169620:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.169624:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6200/0xb126349c40f3314f lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.169635:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6200/0xb126349c40f3314f lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.169649:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d1:0x0].0x0 (ffff9090e460f500) 00010000:00010000:3.0:1787508614.169651:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.169655:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6200/0xb126349c40f3314f lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.169661:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6200/0xb126349c40f3314f lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.169673:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f33156 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x290:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.169680:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f33156 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x290:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.169687:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f33156 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x290:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.169692:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.169695:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f33156 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x290:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.169701:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f33156 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x290:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.169708:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x290:0x0].0x0 (ffff9090e460fa00) 00010000:00010000:3.0:1787508614.169710:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.169713:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f33156 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x290:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.169720:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f33156 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x290:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.169732:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f33283 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.169739:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f33283 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.169746:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f33283 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.169751:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.169754:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f33283 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.169761:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f33283 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.169768:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d1:0x0].0x0 (ffff9090e460f500) 00010000:00010000:3.0:1787508614.169771:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508614.169774:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f33283 lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.169780:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f33283 lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x13d1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.169794:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f3328a lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.169801:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f3328a lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.169808:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f3328a lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.169814:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.169817:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f3328a lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.169823:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f3328a lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.169831:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x290:0x0].0x0 (ffff9090e460fa00) 00010000:00010000:3.0:1787508614.169833:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508614.169836:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f3328a lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.169842:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f3328a lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x290:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787508614.170053:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294998375 committed batchid 4294998373 00000020:00080000:0.0:1787508614.170112:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998373 00010000:00010000:0.0:1787508614.170166:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f334a5 lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x167:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f3349e expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.170179:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x167:0x0].0x0 (ffff9090c5b9eb00) 00010000:00010000:0.0:1787508614.170184:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33515 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.170193:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33515 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.170212:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33515 lrc: 4/1,0 mode: PR/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.170238:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508614.170318:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480096000:12345-0@lo:103:ldlm_bl.0 Request processed in 4929us (5243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508614.170327:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27819 00000100:00100000:3.0:1787508614.170417:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480096000:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508614.170600:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33515 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.170610:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33515 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508614.170665:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd2:0x167:0x0]: returning size 4096 00000004:00200000:1.0:1787508614.170670:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787508614.170711:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f3350e lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x167:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadec2 expref: 7 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.170732:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33515 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadec2 expref: 6 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.170740:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x167:0x0].0x0 (ffff9090c5b9eb00) 00010000:00010000:1.0:1787508614.170743:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508614.170746:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7c00, rc 0) 00000100:00100000:1.0:1787508614.170780:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336041:x1874324509492096:12345-192.168.201.30@tcp:101:rm.0 Request processed in 6531us (6770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.170787:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93708 00000100:00100000:2.0:1787508614.173576:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.173624:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.173793:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509492352 00000100:00100000:3.0:1787508614.173804:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509492352 00000100:00100000:3.0:1787508614.173859:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509492608 00000100:00100000:3.0:1787508614.173862:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509492608 00000100:00100000:3.0:1787508614.173886:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93710 00000100:00100000:3.0:1787508614.173896:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336042:x1874324509492352:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1787508614.173917:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.173962:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33531 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaded0 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.174034:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33538 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.174047:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33538 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.174058:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33538 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.174073:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f3353f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.174080:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f3353f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.174087:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f3353f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.174148:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33538 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.174156:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33538 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.174162:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33538 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.174169:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33538 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.174175:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.174181:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33538 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.174188:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33538 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.174211:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.174215:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.174220:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33538 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.174228:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33538 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.174244:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f3353f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.174250:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f3353f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.174255:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f3353f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.174260:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.174263:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f3353f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.174268:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f3353f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.174275:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090d2273700) 00010000:00010000:3.0:1787508614.174278:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.174281:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f3353f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.174286:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f3353f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.174317:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33531 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaded0 expref: 585 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.174327:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.174329:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508614.174333:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33531 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaded0 expref: 585 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.174342:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e200, rc 0) 00000100:00100000:3.0:1787508614.174418:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336042:x1874324509492352:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 522us (851us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508614.174426:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93710 00000100:00100000:3.0:1787508614.174463:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93711 00000100:00100000:3.0:1787508614.174471:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336041:x1874324509492608:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508614.174480:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.174492:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33546 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaded7 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508614.174603:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1259:0x0]: returning size 4096 00010000:00010000:3.0:1787508614.174684:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33546 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaded7 expref: 15 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.174700:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.174703:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508614.174707:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33546 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaded7 expref: 15 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.174717:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e600, rc 0) 00000100:00100000:3.0:1787508614.174739:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336041:x1874324509492608:12345-192.168.201.30@tcp:101:rm.0 Request processed in 269us (1115us total) trans 12884944060 rc 301/301 00000100:00100000:3.0:1787508614.174746:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93711 00000100:00100000:2.0:1787508614.180109:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.180157:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.180619:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509492736 00000100:00100000:3.0:1787508614.180629:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509492736 00000100:00100000:3.0:1787508614.180679:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15398 00000100:00100000:3.0:1787508614.180690:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336041:x1874324509492736:12345-192.168.201.30@tcp:37:rm.0 00000100:00100000:0.0:1787508614.185407:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509492992 00000100:00100000:0.0:1787508614.185423:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509492992 00000100:00100000:0.0:1787508614.185505:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93712 00000100:00100000:0.0:1787508614.185516:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336042:x1874324509492992:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508614.185539:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508614.185560:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33554 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadede expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.185642:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3355b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.185656:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3355b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.185667:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3355b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.185684:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33562 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.185691:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33562 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.185698:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33562 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.185758:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3355b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.185767:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3355b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.185772:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3355b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.185791:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3355b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.185798:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.185803:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3355b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.185811:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3355b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.185825:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.185828:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.185833:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3355b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.185841:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3355b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.185854:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33562 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.185860:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33562 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.185867:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33562 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.185872:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cdb25e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.185874:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33562 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.185881:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33562 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.185888:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090e460f000) 00010000:00010000:0.0:1787508614.185890:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.185893:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33562 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.185899:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33562 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.185930:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33554 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadede expref: 585 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.186022:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.186025:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508614.186030:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33554 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadede expref: 585 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.186042:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6000, rc 0) 00000100:00100000:0.0:1787508614.186215:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336042:x1874324509492992:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 699us (6055us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508614.186222:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93712 00000100:00100000:2.0:1787508614.186588:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336041:x1874324509492736:12345-192.168.201.30@tcp:37:rm.0 Request processed in 5899us (6488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.186598:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15398 00000100:00100000:0.0:1787508614.190871:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.190972:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509493120 00000100:00100000:2.0:1787508614.190983:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509493120 00000100:00100000:2.0:1787508614.191049:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15399 00000100:00100000:2.0:1787508614.191061:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde31050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336041:x1874324509493120:12345-192.168.201.30@tcp:37:rm.0 00000100:00100000:3.0:1787508614.196875:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.197069:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509493248 00000100:00100000:1.0:1787508614.197080:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509493248 00000100:00100000:1.0:1787508614.197149:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93713 00000100:00100000:1.0:1787508614.197161:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336042:x1874324509493248:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508614.197184:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.197213:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33569 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadee5 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.197280:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33570 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.197296:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33570 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.197308:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33570 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.197319:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33577 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.197327:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33577 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.197334:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33577 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.197438:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3357e lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.197447:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3357e lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.197466:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3357e lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508614.197546:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1259:0x0]: returning size 4096 00000004:00200000:1.0:1787508614.197552:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1787508614.197572:0:209004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3357e lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.197584:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33570 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.197590:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33570 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.197596:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33570 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.197602:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33570 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.197613:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.197618:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33570 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.197625:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33570 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.197638:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.197641:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.197646:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33570 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.197652:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33570 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.197668:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33577 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.197674:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33577 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.197679:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33577 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.197684:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.197686:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33577 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.197692:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33577 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.197704:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d2273000) 00010000:00010000:1.0:1787508614.197707:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.197710:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33577 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.197714:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33577 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.197734:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33569 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadee5 expref: 586 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.197742:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3357e lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadee5 expref: 585 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.197747:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1259:0x0].0x0 (ffff9090d2273e00) 00010000:00010000:1.0:1787508614.197748:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508614.197750:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a000, rc 0) 00000100:00100000:1.0:1787508614.198124:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:336042:x1874324509493248:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 965us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.198130:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93713 00000100:00100000:1.0:1787508614.199210:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde31050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336041:x1874324509493120:12345-192.168.201.30@tcp:37:rm.0 Request processed in 8143us (8343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.199222:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15399 00000100:00100000:0.0:1787508614.202761:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.202813:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509493376 00000100:00100000:0.0:1787508614.202817:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.202823:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509493376 00000100:00100000:2.0:1787508614.202888:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93714 00000100:00100000:2.0:1787508614.202898:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091c9459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:336042:x1874324509493376:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1787508614.202918:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1787508614.202934:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509493632 00010000:00010000:2.0:1787508614.202965:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33585 lrc: 2/0,0 mode: --/CR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadeec expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.203023:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3358c lrc: 3/1,0 mode: --/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.203038:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3358c lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.203050:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3358c lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.203056:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509493632 00000004:00200000:2.0:1787508614.203094:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a0:0x16f:0x0]: returning size 4096 00000004:00200000:2.0:1787508614.203100:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787508614.203136:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33585 lrc: 0/0,0 mode: --/CR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadeec expref: 587 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.203155:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3358c lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadeec expref: 586 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.203164:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16f:0x0].0x0 (ffff9090d2273c00) 00010000:00010000:2.0:1787508614.203167:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508614.203171:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aba00, rc 0) 00000100:00100000:0.0:1787508614.203189:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15400 00000100:00100000:0.0:1787508614.203204:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091c9459f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336041:x1874324509493632:12345-192.168.201.30@tcp:35:rm.0 00000100:00100000:2.0:1787508614.203241:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091c9459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336042:x1874324509493376:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 344us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.203247:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93714 00000100:00100000:0.0:1787508614.203343:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091c9459f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336041:x1874324509493632:12345-192.168.201.30@tcp:35:rm.0 Request processed in 146us (524us total) trans 12884944061 rc 0/0 00000100:00100000:0.0:1787508614.203349:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15400 00000100:00100000:2.0:1787508614.205923:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.206067:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509493888 00000100:00100000:0.0:1787508614.206080:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509493888 00000100:00100000:0.0:1787508614.206145:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93715 00000100:00100000:0.0:1787508614.206156:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336041:x1874324509493888:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:0.0:1787508614.206339:0:230618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787508614.206384:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f334d6 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadea6 expref: 15 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.206411:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1259:0x0].0x0 (ffff9090d2273e00) 00010000:00010000:0.0:1787508614.206423:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f33490 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaade98 expref: 14 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.206429:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.206431:0:230618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508614.206461:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33593 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.206477:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f334e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadead expref: 585 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.206490:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33593 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.206526:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f334e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadead expref: 585 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.206540:0:230618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f334e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadead expref: 585 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.206554:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091c945b480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480096128:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508614.206680:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88240 going to sleep for 11 seconds 00000100:00100000:3.0:1787508614.208866:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.209002:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.209376:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509494144 00000100:00100000:1.0:1787508614.209384:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509494144 00010000:00010000:1.0:1787508614.209416:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f334e4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadead expref: 586 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.209444:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27820 00000100:00100000:1.0:1787508614.209463:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:2401:x1874324509494144:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508614.209475:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508614.209480:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f334e4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadead expref: 586 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.209491:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f334e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadead expref: 586 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.209509:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.209513:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33593 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.209520:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33593 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.209525:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33593 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.209538:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508614.209573:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:2401:x1874324509494144:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 122us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.209578:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27820 00010000:00010000:2.0:1787508614.209752:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f334e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadead expref: 585 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.209764:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091c945b480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480096128:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508614.209784:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33593 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.209793:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33593 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.209799:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33593 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.209818:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3359a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.209833:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3359a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.209841:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3359a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.209961:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f335a1 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x1259:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.209969:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3357e lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadee5 expref: 584 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.209974:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f335a1 lrc: 4/0,1 mode: --/EX res: [0x2000013a4:0x1259:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.209995:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3357e lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadee5 expref: 584 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.210004:0:230618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3357e lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadee5 expref: 584 pid: 209004 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.210014:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0bf480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480096256:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508614.210053:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9840 going to sleep for 11 seconds 00000100:00100000:0.0:1787508614.210569:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509494016 00000100:00100000:0.0:1787508614.210576:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509494016 00000100:00100000:0.0:1787508614.210676:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93716 00000100:00100000:0.0:1787508614.210686:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:336042:x1874324509494016:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508614.210707:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508614.210725:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f335a8 lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x167:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadef3 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.210775:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7800/0xb126349c40f335af lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.210798:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7800/0xb126349c40f335af lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.210807:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7800/0xb126349c40f335af lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508614.210852:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd2:0x167:0x0]: returning size 4096 00000004:00200000:0.0:1787508614.210858:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508614.210893:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f335a8 lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x167:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadef3 expref: 642 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.210909:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7800/0xb126349c40f335af lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadef3 expref: 641 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.210917:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x167:0x0].0x0 (ffff9090c5b9eb00) 00010000:00010000:0.0:1787508614.210920:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508614.210922:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7800, rc 0) 00000100:00100000:0.0:1787508614.210984:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+641:336042:x1874324509494016:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 299us (2123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508614.210990:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93716 00000100:00080000:3.0:1787508614.211743:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787508614.213532:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.213575:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.213605:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509494272 00000100:00100000:1.0:1787508614.213616:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509494272 00000100:00100000:1.0:1787508614.213686:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93717 00000100:00100000:1.0:1787508614.213697:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:336042:x1874324509494272:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508614.213720:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.213738:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f335b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadefa expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.213805:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f335bd lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.213818:0:209004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f335a1 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x1259:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.213825:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f335bd lrc: 4/1,0 mode: --/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.213842:0:209004:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f335a1 lrc: 4/0,1 mode: --/EX res: [0x2000013a4:0x1259:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.213851:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f335bd lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.213928:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509494400 00000100:00100000:3.0:1787508614.213932:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509494400 00010000:00010000:3.0:1787508614.213979:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3357e lrc: 5/0,0 mode: PR/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadee5 expref: 587 pid: 209004 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.214001:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27821 00000100:00100000:3.0:1787508614.214008:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c1ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+587:2400:x1874324509494400:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508614.214017:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508614.214021:0:229383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3357e lrc: 5/0,0 mode: PR/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadee5 expref: 587 pid: 209004 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.214032:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3357e lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadee5 expref: 587 pid: 209004 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.214045:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1259:0x0].0x0 (ffff9090d2273e00) 00010000:00010000:3.0:1787508614.214048:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f335a1 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x1259:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.214053:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f335a1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1259:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.214058:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f335a1 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x1259:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.214063:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f335bd lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.214066:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f335bd lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.214069:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f335bd lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.214080:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508614.214125:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c1ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+587:2400:x1874324509494400:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 118us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.214132:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27821 00010000:00010000:0.0:1787508614.214632:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3357e lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadee5 expref: 586 pid: 209004 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.214655:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0bf480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480096256:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508614.214675:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f335a1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1259:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.214683:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f335a1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1259:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.214688:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f335a1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1259:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.214710:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f335c4 lrc: 3/0,1 mode: --/EX res: [0x2000013a0:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.214719:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f334f2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadeb4 expref: 13 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.214726:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3358c lrc: 2/0,0 mode: PR/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadeec expref: 585 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.214733:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f335c4 lrc: 5/0,1 mode: --/EX res: [0x2000013a0:0x16f:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.214757:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3358c lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadeec expref: 585 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.214770:0:230618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3358c lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadeec expref: 585 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.214799:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091c9459180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480096384:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508614.214877:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f334f2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadeb4 expref: 13 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.214886:0:230618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f334f2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadeb4 expref: 13 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.214896:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091c9459880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480096512:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508614.214920:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787508614.218223:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.218258:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.218336:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509494528 00000100:00100000:2.0:1787508614.218346:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509494528 00010000:00010000:2.0:1787508614.218390:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3358c lrc: 5/0,0 mode: PR/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadeec expref: 586 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.218392:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509494656 00000100:00100000:1.0:1787508614.218396:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509494656 00010000:00010000:1.0:1787508614.218416:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f334f2 lrc: 5/0,0 mode: PR/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadeb4 expref: 14 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.218440:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27822 00000100:00100000:1.0:1787508614.218445:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27823 00000100:00100000:1.0:1787508614.218461:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2402:x1874324509494656:12345-192.168.201.30@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787508614.218465:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:2402:x1874324509494528:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508614.218477:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508614.218477:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508614.218485:0:225839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3358c lrc: 5/0,0 mode: PR/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadeec expref: 586 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.218485:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f334f2 lrc: 5/0,0 mode: PR/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadeb4 expref: 14 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.218500:0:225839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3358c lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadeec expref: 586 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.218570:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091c9459180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480096384:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508614.218583:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091c9459880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480096512:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508614.218916:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f334f2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadeb4 expref: 14 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.218959:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f334f2 lrc: 0/0,0 mode: --/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadeb4 expref: 14 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.218977:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16f:0x0].0x0 (ffff9090d2273c00) 00010000:00010000:1.0:1787508614.218983:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f335c4 lrc: 3/0,1 mode: --/EX res: [0x2000013a0:0x16f:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.218992:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f335c4 lrc: 3/0,1 mode: --/EX res: [0x2000013a0:0x16f:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.218998:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508614.219044:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f335c4 lrc: 3/0,1 mode: --/EX res: [0x2000013a0:0x16f:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.219086:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3358c lrc: 0/0,0 mode: --/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadeec expref: 586 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.219098:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16f:0x0].0x0 (ffff9090d2273c00) 00010000:00010000:2.0:1787508614.219102:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f335c4 lrc: 3/0,1 mode: --/EX res: [0x2000013a0:0x16f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.219110:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f335c4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a0:0x16f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.219118:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f335c4 lrc: 4/0,1 mode: EX/EX res: [0x2000013a0:0x16f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.219134:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2402:x1874324509494656:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 683us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.219143:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27823 00010000:00010000:2.0:1787508614.219169:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508614.219249:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:2402:x1874324509494528:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 800us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.219256:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27822 00010000:00010000:0.0:1787508614.219296:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f335c4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a0:0x16f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.219302:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f335c4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a0:0x16f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.219350:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f335cb lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.219357:0:230618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f335cb lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.219371:0:230618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f335cb lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.219391:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091c9459880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:230618:1874324480096640:0@lo:101:mdt00_006.0 00000100:00100000:0.0:1787508614.219435:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508614.219506:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787508614.219542:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480096640 00000100:00100000:2.0:1787508614.219548:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480096640 00000100:00100000:2.0:1787508614.219615:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29655 00000100:00100000:2.0:1787508614.219708:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091c9459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:230618:x1874324480096640:12345-0@lo:101:mdt00_006.0 00010000:00010000:2.0:1787508614.219726:0:202232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.219742:0:202232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f335d2 lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f335cb expref: -99 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.219761:0:202232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33515 lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadec2 expref: 5 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.219770:0:202232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7800/0xb126349c40f335af lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadef3 expref: 640 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.219778:0:202232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f335d2 lrc: 5/0,0 mode: --/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f335cb expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.219800:0:202232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7800/0xb126349c40f335af lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadef3 expref: 640 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.219813:0:202232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7800/0xb126349c40f335af lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadef3 expref: 640 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.219824:0:202232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0bca80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:202232:1874324480096768:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508614.219875:0:202232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33515 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadec2 expref: 5 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.219889:0:202232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33515 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadec2 expref: 5 pid: 209004 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.219897:0:202232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0bd880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:202232:1874324480096896:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508614.219916:0:202232:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787508614.221785:0:202232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0bd880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:202232:1874324480096896:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508614.222176:0:202232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0bca80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:202232:1874324480096768:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508614.222283:0:202232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f335d2 lrc: 3/0,0 mode: --/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f335cb expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.222298:0:202232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x167:0x0].0x0 (ffff9090c5b9eb00) 00010000:00010000:0.0:1787508614.222301:0:202232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787508614.222305:0:202232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f335d2 lrc: 3/0,0 mode: --/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f335cb expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.222314:0:202232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f335d2 lrc: 3/0,0 mode: --/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f335cb expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.222322:0:202232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab000, rc 0) 00000100:00100000:0.0:1787508614.222387:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091c9459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:230618:x1874324480096640:12345-0@lo:101:mdt00_006.0 Request processed in 2763us (2950us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508614.222395:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29655 00000100:00100000:2.0:1787508614.222459:0:230618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589961995 gen 2 00000004:00080000:2.0:1787508614.222465:0:230618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961986 committed transno 8589961995 00000020:00080000:2.0:1787508614.222471:0:230618:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9090d1d88180 refcount 2 committed 0 result 0 batchid 8589961981 00000020:00080000:2.0:1787508614.222474:0:230618:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9091d47d0e00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d1d88e40 00000020:00080000:2.0:1787508614.222477:0:230618:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd2:0x1:0x0].1783 00000020:00080000:2.0:1787508614.222478:0:230618:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9091d47d0900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090e3c8fa00 00000020:00080000:2.0:1787508614.222480:0:230618:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1:0x0].1776 00000004:00080000:2.0:1787508614.222505:0:230618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961987 committed transno 8589961995 00000004:00080000:2.0:1787508614.222515:0:230618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961989 committed transno 8589961995 00000004:00080000:2.0:1787508614.222524:0:230618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961990 committed transno 8589961995 00000004:00080000:2.0:1787508614.222531:0:230618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961995 committed transno 8589961995 00000100:00100000:2.0:1787508614.222544:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091c9459880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:230618:1874324480096640:0@lo:101:mdt00_006.0 00010000:00010000:2.0:1787508614.222559:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f335cb lrc: 4/0,1 mode: --/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f335d2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.222566:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f335cb lrc: 4/0,1 mode: --/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f335d2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787508614.222602:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589961981 committed batchid 8589961980 00000020:00080000:1.0:1787508614.222665:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961980 00000100:00100000:2.0:1787508614.223744:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.223851:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.224245:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509494784 00000100:00100000:0.0:1787508614.224245:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509494912 00000100:00100000:3.0:1787508614.224256:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509494784 00000100:00100000:0.0:1787508614.224256:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509494912 00010000:00010000:3.0:1787508614.224293:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33515 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadec2 expref: 6 pid: 209004 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.224293:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7800/0xb126349c40f335af lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadef3 expref: 641 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.224355:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27824 00000100:00100000:3.0:1787508614.224366:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2401:x1874324509494784:12345-192.168.201.30@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787508614.224371:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27825 00000100:00100000:0.0:1787508614.224377:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+641:2400:x1874324509494912:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508614.224380:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508614.224384:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508614.224388:0:229383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33515 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadec2 expref: 6 pid: 209004 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.224388:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7800/0xb126349c40f335af lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadef3 expref: 641 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.224401:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33515 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadec2 expref: 6 pid: 209004 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.224412:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7800/0xb126349c40f335af lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadef3 expref: 641 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.224484:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33515 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadec2 expref: 6 pid: 209004 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.224487:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7800/0xb126349c40f335af lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadef3 expref: 641 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.224502:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x167:0x0].0x0 (ffff9090c5b9eb00) 00010000:00010000:0.0:1787508614.224508:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f335d2 lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f335cb expref: 5 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.224518:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f335d2 lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f335cb expref: 5 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.224526:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f335d2 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f335cb expref: 5 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.224533:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x167:0x0].0x0 (ffff9090c5b9eb00) 00010000:00010000:3.0:1787508614.224537:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508614.224555:0:205406:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f335d2 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f335cb expref: 5 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.224571:0:205406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091c9458a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:205406:1874324480097024:0@lo:105: 00000100:00100000:0.0:1787508614.224613:0:205406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508614.224614:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2401:x1874324509494784:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 250us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.224622:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27824 00000100:00100000:0.0:1787508614.224660:0:205406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.224673:0:229386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480097024 00000100:00100000:1.0:1787508614.224677:0:229386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480097024 00000100:00100000:1.0:1787508614.224711:0:229386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18144 00000100:00100000:1.0:1787508614.224719:0:229386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091c945b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:205406:x1874324480097024:12345-0@lo:105: 00010000:00010000:1.0:1787508614.224729:0:229386:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f335cb lrc: 5/0,1 mode: --/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f335d2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.224738:0:229386:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f335cb lrc: 5/0,1 mode: --/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f335d2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.224747:0:229386:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f335cb lrc: 5/0,1 mode: --/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f335d2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.224754:0:229386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f335cb lrc: 5/0,1 mode: EX/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f335d2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.224761:0:229386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f335cb lrc: 6/0,1 mode: EX/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f335d2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.224768:0:229386:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f335cb lrc: 6/0,1 mode: EX/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f335d2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.224803:0:229386:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d56f7600) 00000100:00100000:1.0:1787508614.224839:0:229386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091c945b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:205406:x1874324480097024:12345-0@lo:105: Request processed in 121us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.224845:0:229386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18144 00010000:00010000:3.0:1787508614.224973:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f335cb lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f335d2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.224983:0:230618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f335cb lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f335d2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.225660:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9acaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:230618:1874324480097152:0@lo:403:mdt00_006.0 00000100:00100000:3.0:1787508614.225712:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508614.225740:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.225831:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480097152 00000100:00100000:1.0:1787508614.225836:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480097152 00000100:00100000:1.0:1787508614.225879:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29656 00000100:00100000:1.0:1787508614.225887:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d13be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:230618:x1874324480097152:12345-0@lo:403:mdt00_006.0 00000100:00100000:0.0:1787508614.226591:0:205406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091c9458a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:205406:1874324480097024:0@lo:105: 00010000:00010000:0.0:1787508614.226616:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508614.226666:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2400:x1874324509494912:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 2286us (2812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508614.226677:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27825 00000100:00100000:1.0:1787508614.227702:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d13be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:230618:x1874324480097152:12345-0@lo:403:mdt00_006.0 Request processed in 1812us (1985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.227710:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29656 00000100:00100000:0.0:1787508614.227922:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9acaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:230618:1874324480097152:0@lo:403:mdt00_006.0 00000040:00080000:1.0:1787508614.230753:0:230618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1:0x0].1778, 664 off1830480 00000040:00080000:1.0:1787508614.230916:0:230618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x1:0x0].1785, 744 off2036024 00000004:00080000:1.0:1787508614.230921:0:230618:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d3f11900 with version 3451 00000004:00080000:0.0:1787508614.230972:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3451 rpc_version 3451 00000020:00100000:0.0:1787508614.231010:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787508614.231022:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091c9458a80 x1874324480097408/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1448/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787508614.231046:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091c9458a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480097408:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787508614.231107:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508614.231139:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787508614.231144:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480097408 00000100:00100000:2.0:1787508614.231153:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480097408 00000100:00100000:2.0:1787508614.231217:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29657 00000100:00100000:2.0:1787508614.231226:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091c9459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:202248:x1874324480097408:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787508614.231529:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091c9459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:202248:x1874324480097408:12345-0@lo:1000:osp_up1-0.0 Request processed in 303us (420us total) trans 8589961996 rc 0/0 00000100:00100000:2.0:1787508614.231536:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29657 00000100:00100000:0.0:1787508614.231856:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091c9458a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480097408:0@lo:1000:osp_up1-0.0 00000004:00200000:1.0:1787508614.231863:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1259:0x0]: returning size 4096 00010000:00010000:1.0:1787508614.231884:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f335c4 lrc: 3/0,1 mode: EX/EX res: [0x2000013a0:0x16f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.231892:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f335c4 lrc: 2/0,0 mode: EX/EX res: [0x2000013a0:0x16f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.231898:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f335c4 lrc: 3/0,0 mode: EX/EX res: [0x2000013a0:0x16f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.231902:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.231905:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f335c4 lrc: 3/0,0 mode: EX/EX res: [0x2000013a0:0x16f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.231910:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f335c4 lrc: 4/0,0 mode: EX/EX res: [0x2000013a0:0x16f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.231924:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16f:0x0].0x0 (ffff9090d2273c00) 00010000:00010000:1.0:1787508614.231926:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787508614.231929:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f335c4 lrc: 2/0,0 mode: --/EX res: [0x2000013a0:0x16f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.231933:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f335c4 lrc: 0/0,0 mode: --/EX res: [0x2000013a0:0x16f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.231976:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f335cb lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f335d2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.231985:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f335cb lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f335d2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.231993:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f335cb lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f335d2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.232012:0:230618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787508614.232019:0:230618:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd2:0x167:0x0] 00010000:00010000:1.0:1787508614.232025:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f335a1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1259:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.232029:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f335a1 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x1259:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.232033:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f335a1 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1259:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.232036:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.232037:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f335a1 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1259:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.232041:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f335a1 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x1259:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.232046:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1259:0x0].0x0 (ffff9090d2273e00) 00010000:00010000:1.0:1787508614.232047:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787508614.232049:0:230618:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f335bd lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.232056:0:230618:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f335bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.232060:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f335bd lrc: 4/1,0 mode: PR/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.232079:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f335a1 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x1259:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.232087:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f335a1 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x1259:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.232099:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f335bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.232101:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33593 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.232107:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33593 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.232107:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f335bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.232114:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33593 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.232117:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33593 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.232122:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cdb25e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.232124:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33593 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.232128:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f335bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.232130:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33593 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.232139:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.232139:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f335bd lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.232141:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.232144:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33593 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.232145:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f335bd lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.232151:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33593 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.232151:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.232154:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f335bd lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.232159:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f335bd lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508614.232161:0:230618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c67a0d7 reply state 000000001d8d1096 transno 12884944062 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3359a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.232166:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1259:0x0].0x0 (ffff9090d2273e00) 00010000:00010000:0.0:1787508614.232168:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508614.232171:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f335bd lrc: 2/0,0 mode: --/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.232172:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3359a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.232177:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f335bd lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1259:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.232179:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d2273000) 00010000:00010000:1.0:1787508614.232181:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787508614.232184:0:230618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787508614.232222:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f335b6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadefa expref: 584 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.232232:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.232234:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.232238:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f335b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadefa expref: 584 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.232248:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b200, rc 0) 00000100:00100000:1.0:1787508614.232256:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336041:x1874324509493888:12345-192.168.201.30@tcp:36:rm.0 Request processed in 26102us (26343us total) trans 12884944062 rc 0/0 00000100:00100000:1.0:1787508614.232263:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93715 00000100:00100000:0.0:1787508614.232268:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336042:x1874324509494272:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 18575us (18749us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508614.232273:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93717 00010000:00010000:2.0:1787508614.232338:0:202215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787508614.232344:0:202215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f335cb lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xb126349c40f335d2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.232351:0:202215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7600 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:2.0:1787508614.232355:0:202215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f335cb lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xb126349c40f335d2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508614.232373:0:202215:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f335cb lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xb126349c40f335d2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.232399:0:202215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f335cb lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f335d2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.232406:0:202215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787508614.232428:0:202215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f335cb lrc: 1/0,0 mode: --/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f335d2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.232431:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480097536:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508614.232435:0:202215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f335cb lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f335d2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.232463:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508614.232466:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508614.232467:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508614.232481:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508614.233710:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480097536 00000100:00100000:2.0:1787508614.233723:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480097536 00000100:00100000:2.0:1787508614.234688:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9778 00000100:00100000:2.0:1787508614.234708:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d13bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+7:3619:x1874324480097536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508614.234725:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508614.234751:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f335d2 lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x167:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f335cb expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.234770:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x167:0x0].0x0 (ffff9090c5b9eb00) 00000100:00100000:3.0:1787508614.235780:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.236045:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509495040 00000100:00100000:1.0:1787508614.236054:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509495040 00000100:00100000:1.0:1787508614.236103:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93718 00000100:00100000:1.0:1787508614.236113:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d13bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336042:x1874324509495040:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508614.236131:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.236148:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f335d9 lrc: 2/0,0 mode: --/CR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadf01 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.236212:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f335e0 lrc: 3/1,0 mode: --/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.236225:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f335e0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.236235:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f335e0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.236255:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f335e0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.236266:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f335e0 lrc: 2/0,0 mode: PR/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.236273:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f335e0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.236278:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.236282:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f335e0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.236290:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f335e0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.236299:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16f:0x0].0x0 (ffff9090d2273c00) 00010000:00010000:1.0:1787508614.236302:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508614.236306:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f335e0 lrc: 2/0,0 mode: --/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.236312:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f335e0 lrc: 0/0,0 mode: --/PR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.236337:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f335d9 lrc: 1/0,0 mode: --/CR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf01 expref: 584 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.236345:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16f:0x0].0x0 (ffff9090d2273c00) 00010000:00010000:1.0:1787508614.236347:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.236351:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f335d9 lrc: 0/0,0 mode: --/CR res: [0x2000013a0:0x16f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf01 expref: 584 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.236372:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b800, rc 0) 00000100:00100000:1.0:1787508614.236428:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d13bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336042:x1874324509495040:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 316us (655us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508614.236435:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93718 00010000:00010000:2.0:1787508614.238157:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508614.238244:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d13bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+6:3619:x1874324480097536:12345-0@lo:103:ldlm_bl.0 Request processed in 3540us (5758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.238256:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9778 00000100:00100000:3.0:1787508614.238334:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480097536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787508614.239836:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.239888:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509495168 00000100:00100000:2.0:1787508614.239897:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509495168 00000100:00100000:2.0:1787508614.239991:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93719 00000100:00100000:2.0:1787508614.240001:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d13bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336043:x1874324509495168:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508614.240027:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.240048:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f335e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadf08 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.240113:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f335ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.240126:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f335ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.240143:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f335ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508614.240195:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508614.240199:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508614.240234:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f335ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.240263:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f335e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf08 expref: 16 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.240281:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f335ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf08 expref: 15 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.240291:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.240294:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508614.240298:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa600, rc 0) 00000100:00100000:2.0:1787508614.240351:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d13bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336043:x1874324509495168:12345-192.168.201.30@tcp:101:rm.0 Request processed in 351us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.240358:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93719 00000100:00100000:2.0:1787508614.243018:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.243073:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509495424 00000100:00100000:1.0:1787508614.243083:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509495424 00000100:00100000:1.0:1787508614.243145:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93720 00000100:00100000:1.0:1787508614.243155:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336043:x1874324509495424:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508614.243174:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.243194:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f335f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadf0f expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.243254:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f335fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.243268:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f335fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.243278:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f335fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.243293:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33603 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.243299:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33603 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.243305:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33603 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.243364:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f335fc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.243372:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f335fc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.243378:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f335fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.243384:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f335fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.243390:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.243394:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f335fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.243401:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f335fc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.243412:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.243416:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.243420:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f335fc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.243427:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f335fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.243440:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33603 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.243445:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33603 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.243460:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33603 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.243466:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247bc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.243469:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33603 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.243474:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33603 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.243480:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090ce7bad00) 00010000:00010000:1.0:1787508614.243482:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.243485:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33603 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.243490:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33603 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.243519:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f335f5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf0f expref: 16 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.243529:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.243531:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508614.243535:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f335f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf0f expref: 16 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.243543:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b600, rc 0) 00000100:00100000:1.0:1787508614.243606:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336043:x1874324509495424:12345-192.168.201.30@tcp:101:rm.0 Request processed in 452us (598us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508614.243614:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93720 00000100:00100000:3.0:1787508614.245629:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.245695:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.246178:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509495552 00000100:00100000:0.0:1787508614.246178:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509495296 00000100:00100000:1.0:1787508614.246188:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509495552 00000100:00100000:0.0:1787508614.246188:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509495296 00000100:00100000:0.0:1787508614.246272:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93721 00000100:00100000:1.0:1787508614.246278:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93722 00000100:00100000:0.0:1787508614.246282:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d13bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:336042:x1874324509495296:12345-192.168.201.30@tcp:101:chmod.0 00000100:00100000:1.0:1787508614.246284:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d13bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336043:x1874324509495552:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508614.246300:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508614.246300:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508614.246319:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7800/0xb126349c40f33611 lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x167:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadf16 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.246320:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3360a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadf1d expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.246377:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33618 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.246389:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33618 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.246399:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33618 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.246412:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3361f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.246418:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3361f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.246424:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3361f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.246429:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f33626 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.246435:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f33626 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.246443:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f33626 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.246463:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f33626 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.246470:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f33626 lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.246475:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f33626 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.246481:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33618 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.246481:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.246485:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f33626 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.246487:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33618 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.246493:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33618 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.246494:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f33626 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.246500:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33618 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.246505:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.246505:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x167:0x0].0x0 (ffff9090e460f100) 00010000:00010000:1.0:1787508614.246508:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33618 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.246508:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508614.246511:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f33626 lrc: 2/0,0 mode: --/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.246514:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33618 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.246518:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6000/0xb126349c40f33626 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x167:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.246521:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.246523:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.246525:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33618 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.246530:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33618 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.246539:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3361f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.246544:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3361f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.246547:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7800/0xb126349c40f33611 lrc: 1/0,0 mode: --/CR res: [0x240000bd2:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf16 expref: 641 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.246550:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3361f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.246555:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.246557:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x167:0x0].0x0 (ffff9090e460f100) 00010000:00010000:1.0:1787508614.246558:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3361f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.246559:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.246562:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7800/0xb126349c40f33611 lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf16 expref: 641 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.246569:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3361f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.246575:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090ce7ba600) 00010000:00010000:0.0:1787508614.246576:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7800, rc 0) 00010000:00010000:1.0:1787508614.246577:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.246580:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3361f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.246584:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3361f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.246602:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3360a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf1d expref: 16 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.246610:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.246612:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508614.246615:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3360a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf1d expref: 16 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.246623:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ae00, rc 0) 00000100:00100000:0.0:1787508614.246629:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d13bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:336042:x1874324509495296:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 349us (1007us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508614.246636:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93721 00000100:00100000:1.0:1787508614.246640:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d13bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336043:x1874324509495552:12345-192.168.201.30@tcp:101:rm.0 Request processed in 357us (945us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508614.246645:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93722 00000100:00100000:2.0:1787508614.249909:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.249937:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.250049:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509495680 00000100:00100000:1.0:1787508614.250060:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509495680 00000100:00100000:3.0:1787508614.250071:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509495808 00000100:00100000:3.0:1787508614.250075:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509495808 00000100:00100000:1.0:1787508614.250122:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93723 00000100:00100000:1.0:1787508614.250134:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336042:x1874324509495808:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508614.250161:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1787508614.250173:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93724 00000100:00100000:3.0:1787508614.250180:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336043:x1874324509495680:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508614.250181:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3362d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadf2b expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.250188:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.250195:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33634 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadf24 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.250243:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33642 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.250243:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3363b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.250257:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3363b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.250267:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3363b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.250301:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33642 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.250311:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33642 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508614.250328:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00010000:00010000:3.0:1787508614.250329:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33649 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508614.250332:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1787508614.250336:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33649 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.250341:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33649 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508614.250351:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3363b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.250375:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3362d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf2b expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.250391:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3363b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf2b expref: 584 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.250398:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33642 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.250398:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.250401:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508614.250406:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33642 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.250406:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a000, rc 0) 00010000:00010000:3.0:1787508614.250411:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33642 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.250417:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33642 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.250422:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.250426:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33642 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.250433:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33642 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.250443:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.250445:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.250447:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33642 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.250465:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33642 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.250475:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336042:x1874324509495808:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 344us (536us total) trans 0 rc 0/0 00010000:00010000:3.0:1787508614.250476:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33649 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.250483:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33649 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.250487:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93723 00010000:00010000:3.0:1787508614.250489:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33649 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.250494:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.250496:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33649 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.250502:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33649 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.250509:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090d2273700) 00010000:00010000:3.0:1787508614.250511:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.250514:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33649 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.250519:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33649 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.250541:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33634 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf24 expref: 16 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.250555:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.250558:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508614.250561:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33634 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf24 expref: 16 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.250568:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e600, rc 0) 00000100:00100000:3.0:1787508614.250590:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336043:x1874324509495680:12345-192.168.201.30@tcp:101:rm.0 Request processed in 411us (690us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508614.250596:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93724 00000100:00100000:0.0:1787508614.252772:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.252878:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.252879:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509495936 00000100:00100000:1.0:1787508614.252887:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509495936 00000100:00100000:2.0:1787508614.253523:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509496192 00000100:00100000:2.0:1787508614.253530:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509496192 00000100:00100000:2.0:1787508614.253614:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93725 00000100:00100000:2.0:1787508614.253625:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336043:x1874324509496192:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508614.253652:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.253674:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33650 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadf39 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.253744:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33657 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.253759:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33657 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.253770:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33657 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.253797:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3365e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.253805:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3365e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.253811:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3365e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.253869:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33657 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.253877:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33657 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.253884:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33657 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.253890:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33657 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.253897:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.253902:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33657 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.253910:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33657 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.253921:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.253925:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.253929:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33657 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.253936:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33657 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.253976:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3365e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.253982:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3365e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.253988:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3365e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.253994:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.253997:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3365e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.254003:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3365e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.254015:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090c98d9600) 00010000:00010000:2.0:1787508614.254018:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.254021:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3365e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.254026:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3365e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.254056:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33650 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf39 expref: 16 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.254066:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.254069:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.254072:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33650 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf39 expref: 16 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.254081:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aae00, rc 0) 00000100:00100000:2.0:1787508614.254140:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336043:x1874324509496192:12345-192.168.201.30@tcp:101:rm.0 Request processed in 518us (1261us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508614.254148:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93725 00000100:00100000:1.0:1787508614.256030:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93726 00000100:00100000:1.0:1787508614.256046:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336042:x1874324509495936:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508614.256065:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.256085:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33665 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadf32 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.256144:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3366c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.256154:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3366c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.256161:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3366c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.256169:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33673 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.256173:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33673 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.256177:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33673 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.256232:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3366c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.256243:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3366c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.256249:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3366c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.256256:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3366c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.256262:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.256265:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3366c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.256270:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3366c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.256278:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.256280:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.256282:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3366c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.256286:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3366c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.256295:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33673 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.256299:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33673 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.256302:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33673 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.256305:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.256307:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33673 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.256311:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33673 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.256314:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d2273000) 00010000:00010000:1.0:1787508614.256315:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.256317:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33673 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.256320:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33673 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.256338:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33665 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf32 expref: 585 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.256344:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.256345:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.256347:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33665 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf32 expref: 585 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.256351:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ae00, rc 0) 00000100:00100000:1.0:1787508614.256413:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336042:x1874324509495936:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 372us (3647us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508614.256421:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93726 00000100:00100000:0.0:1787508614.259408:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.259499:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509496320 00000100:00100000:3.0:1787508614.259511:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509496320 00000100:00100000:3.0:1787508614.259614:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93727 00000100:00100000:3.0:1787508614.259626:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336043:x1874324509496320:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508614.259651:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.259673:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3367a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadf40 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.259739:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33681 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.259753:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33681 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.259764:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33681 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.259775:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33688 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.259782:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33688 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.259788:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33688 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.259843:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33681 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.259850:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33681 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.259857:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33681 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.259862:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33681 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.259868:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.259873:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33681 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.259880:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33681 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.259892:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.259895:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.259899:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33681 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.259906:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33681 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.259920:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33688 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.259927:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33688 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.259933:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33688 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.259981:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.259985:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33688 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.259992:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33688 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.260000:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d2273000) 00010000:00010000:3.0:1787508614.260002:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.260005:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33688 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.260011:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33688 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.260035:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3367a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf40 expref: 16 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.260045:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.260047:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.260050:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3367a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf40 expref: 16 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.260059:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e600, rc 0) 00000100:00100000:3.0:1787508614.260110:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336043:x1874324509496320:12345-192.168.201.30@tcp:101:rm.0 Request processed in 486us (714us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508614.260116:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93727 00000100:00100000:0.0:1787508614.272101:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.272223:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509496448 00000100:00100000:2.0:1787508614.272233:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509496448 00000100:00100000:2.0:1787508614.272296:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93728 00000100:00100000:2.0:1787508614.272307:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336045:x1874324509496448:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508614.272330:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.272354:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f3368f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadf47 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.272468:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33696 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.272484:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33696 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.272495:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33696 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.272513:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3369d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.272520:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3369d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.272526:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3369d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.272595:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33696 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.272602:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33696 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.272609:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33696 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.272616:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33696 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.272860:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.272867:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33696 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.272876:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33696 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.272891:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.272894:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.272900:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33696 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.272907:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33696 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.272925:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3369d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.272931:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3369d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.272936:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3369d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.273040:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.273044:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3369d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.273050:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3369d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.273058:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090c98d9600) 00010000:00010000:2.0:1787508614.273060:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.273064:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3369d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.273069:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3369d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.273102:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f3368f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf47 expref: 585 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.273111:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.273113:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.273117:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f3368f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf47 expref: 585 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.273126:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aae00, rc 0) 00000100:00100000:2.0:1787508614.273181:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336045:x1874324509496448:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 875us (1090us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508614.273189:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93728 00000100:00100000:0.0:1787508614.279443:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.281026:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509496576 00000100:00100000:2.0:1787508614.281042:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509496576 00000100:00100000:2.0:1787508614.281113:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93729 00000100:00100000:2.0:1787508614.281123:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336045:x1874324509496576:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508614.281144:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.281164:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f336a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadf4e expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.281235:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f336ab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.281256:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f336ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.281268:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f336ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.281282:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f336b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.281290:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f336b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.281296:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f336b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.281378:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f336ab lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.281385:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f336ab lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.281391:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f336ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.281397:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f336ab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.281403:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.281408:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f336ab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.281416:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f336ab lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.281434:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.281437:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.281442:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f336ab lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.281457:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f336ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.281476:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f336b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.281483:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f336b2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.281490:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f336b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.281495:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.281497:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f336b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.281503:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f336b2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.281510:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090c98d9600) 00010000:00010000:2.0:1787508614.281512:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.281515:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f336b2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.281520:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f336b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.281556:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f336a4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf4e expref: 585 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.281567:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.281570:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.281574:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f336a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf4e expref: 585 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.281582:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aae00, rc 0) 00000100:00100000:2.0:1787508614.281669:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336045:x1874324509496576:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 546us (2243us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508614.281677:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93729 00000100:00100000:0.0:1787508614.285020:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.285112:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509496704 00000100:00100000:1.0:1787508614.285123:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509496704 00000100:00100000:1.0:1787508614.285183:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93730 00000100:00100000:1.0:1787508614.285208:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336045:x1874324509496704:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508614.285231:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.285255:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f336b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadf55 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.285333:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f336c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.285349:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f336c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.285360:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f336c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.285388:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f336c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.285395:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f336c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.285401:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f336c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.285467:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f336c0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.285475:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f336c0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.285481:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f336c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.285488:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f336c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.285495:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.285499:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f336c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.285506:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f336c0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.285518:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.285521:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.285525:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f336c0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.285531:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f336c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.285544:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f336c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.285549:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f336c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.285554:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f336c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.285558:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.285560:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f336c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.285569:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f336c7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.285576:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090ce7ba600) 00010000:00010000:1.0:1787508614.285578:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.285580:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f336c7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.285585:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f336c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.285616:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f336b9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf55 expref: 585 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.285625:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.285628:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508614.285631:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f336b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf55 expref: 585 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.285640:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ae00, rc 0) 00000100:00100000:1.0:1787508614.285699:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336045:x1874324509496704:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 505us (690us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508614.285707:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93730 00000100:00100000:3.0:1787508614.288420:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.291238:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509496960 00000100:00100000:2.0:1787508614.291255:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509496960 00000100:00100000:2.0:1787508614.291337:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93731 00000100:00100000:2.0:1787508614.291349:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d13bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336045:x1874324509496960:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508614.291371:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.291393:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f336ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadf5c expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.291476:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f336d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.291491:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f336d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.291502:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f336d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.291518:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f336dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.291527:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f336dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.291533:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f336dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.291590:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f336d5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.291599:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f336d5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.291606:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f336d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.291613:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f336d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.291619:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.291624:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f336d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.291632:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f336d5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.291644:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.291647:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.291652:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f336d5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.291660:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f336d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.291675:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f336dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.291682:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f336dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.291688:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f336dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.291694:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.291697:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f336dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.291703:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f336dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.291710:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xce5b6a33 (ffff9090c98d9b00) 00010000:00010000:2.0:1787508614.291712:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.291715:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f336dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.291720:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f336dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.291751:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f336ce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf5c expref: 585 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.291764:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.291766:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.291769:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f336ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf5c expref: 585 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.291778:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abc00, rc 0) 00000100:00100000:2.0:1787508614.291840:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d13bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336045:x1874324509496960:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 493us (3430us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508614.291847:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93731 00000100:00100000:0.0:1787508614.304277:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.304511:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509497216 00000100:00100000:2.0:1787508614.304523:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509497216 00000100:00100000:2.0:1787508614.304594:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93732 00000100:00100000:2.0:1787508614.304606:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336045:x1874324509497216:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508614.304638:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.304661:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f336e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadf63 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.304738:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f336ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.304752:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f336ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.304762:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f336ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.304775:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f336f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.304781:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f336f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.304788:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f336f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.304851:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f336ea lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.304857:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f336ea lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.304861:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f336ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.304865:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f336ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.304869:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.304871:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f336ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.304876:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f336ea lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.304886:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.304888:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.304892:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f336ea lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.304896:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f336ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.304907:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f336f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.304911:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f336f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.304915:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f336f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.304918:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.304919:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f336f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.304922:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f336f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.304926:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaf7dd568 (ffff9090c98d9b00) 00010000:00010000:2.0:1787508614.304927:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.304928:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f336f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.304931:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f336f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.305003:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f336e3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf63 expref: 585 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.305013:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.305015:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.305019:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f336e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf63 expref: 585 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.305028:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abc00, rc 0) 00000100:00100000:1.0:1787508614.305189:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336045:x1874324509497216:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 584us (923us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508614.305206:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93732 00000100:00100000:0.0:1787508614.312056:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.312272:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509497472 00000100:00100000:3.0:1787508614.312284:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509497472 00000100:00100000:1.0:1787508614.312571:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93733 00000100:00100000:1.0:1787508614.312584:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336045:x1874324509497472:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508614.312607:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.312630:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f336f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadf6a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.312714:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f336ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.312729:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f336ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.312740:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f336ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.312754:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33706 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.312761:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33706 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.312768:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33706 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.312836:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f336ff lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.312843:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f336ff lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.312850:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f336ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.312861:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f336ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.312867:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.312872:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f336ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.312880:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f336ff lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.312892:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.312895:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.312899:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f336ff lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.312905:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f336ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.312917:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33706 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.312923:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33706 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.312928:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33706 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.312933:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.312935:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33706 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.312971:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33706 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.312978:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3e9f33b0 (ffff9090ce7ba600) 00010000:00010000:1.0:1787508614.312981:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.312984:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33706 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.312989:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33706 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.313022:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f336f8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf6a expref: 585 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.313031:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.313033:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508614.313036:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f336f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf6a expref: 585 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.313044:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ae00, rc 0) 00000100:00100000:1.0:1787508614.313110:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336045:x1874324509497472:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 528us (1065us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508614.313118:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93733 00000100:00100000:3.0:1787508614.317351:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.317623:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509497728 00000100:00100000:2.0:1787508614.317637:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509497728 00000100:00100000:2.0:1787508614.317699:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93734 00000100:00100000:2.0:1787508614.317709:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d13bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336045:x1874324509497728:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508614.317730:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.317751:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3370d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadf71 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.317834:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33714 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.317848:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33714 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.317859:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33714 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.317874:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3371b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.317881:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3371b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.317887:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3371b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.321799:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33714 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.321819:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33714 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.321827:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33714 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.321835:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33714 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.321841:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.321846:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33714 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.321854:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33714 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.321873:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.321876:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.321881:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33714 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.321887:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33714 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.321904:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3371b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.321911:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3371b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.321917:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3371b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.321923:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.321926:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3371b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.321933:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3371b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.322003:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ad43c78 (ffff9090c98d9b00) 00010000:00010000:2.0:1787508614.322006:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.322010:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3371b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.322016:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3371b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.322072:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3370d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf71 expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.322083:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.322084:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.322088:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3370d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf71 expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.322098:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab200, rc 0) 00000100:00100000:2.0:1787508614.322575:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d13bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336045:x1874324509497728:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 4864us (5231us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508614.322583:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93734 00000100:00100000:0.0:1787508614.327904:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.328100:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509497984 00000100:00100000:2.0:1787508614.328113:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509497984 00000100:00100000:3.0:1787508614.328299:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93735 00000100:00100000:3.0:1787508614.328312:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336045:x1874324509497984:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508614.328338:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.328376:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33722 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadf78 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.328475:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33729 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.328492:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33729 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.328504:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33729 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.328522:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33730 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.328529:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33730 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.328537:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33730 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.328600:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33729 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.328608:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33729 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.328615:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33729 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.328623:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33729 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.328630:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.328634:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33729 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.328642:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33729 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.328657:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.328660:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.328665:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33729 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.328672:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33729 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.328687:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33730 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.328693:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33730 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.328698:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33730 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.328703:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.328705:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33730 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.328710:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33730 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.328716:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbfff8436 (ffff9090d2273700) 00010000:00010000:3.0:1787508614.328719:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.328721:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33730 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.328727:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33730 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.328759:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33722 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf78 expref: 585 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.328769:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.328772:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508614.328775:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33722 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf78 expref: 585 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.328806:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e600, rc 0) 00000100:00100000:3.0:1787508614.328881:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336045:x1874324509497984:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 571us (986us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508614.328889:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93735 00000100:00100000:0.0:1787508614.334862:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.335649:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509498240 00000100:00100000:1.0:1787508614.335661:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509498240 00000100:00100000:1.0:1787508614.335775:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93736 00000100:00100000:1.0:1787508614.335798:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336045:x1874324509498240:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508614.335821:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.335843:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33737 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadf7f expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.335923:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3373e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.337196:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3373e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.337222:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3373e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.337306:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33745 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.337318:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33745 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.337326:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33745 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.337404:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3373e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.337411:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3373e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.337417:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3373e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.337424:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3373e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.337429:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.337434:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3373e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.337441:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3373e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.337464:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.337467:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.337473:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3373e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.337480:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3373e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.337499:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33745 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.337505:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33745 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.337510:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33745 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.337514:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.337517:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33745 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.337522:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33745 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.337528:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x594a0ca2 (ffff9090e460f100) 00010000:00010000:0.0:1787508614.337530:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.337533:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33745 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.337538:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33745 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.337585:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33737 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf7f expref: 585 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.337596:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.337598:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508614.337602:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33737 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf7f expref: 585 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.337611:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ac00, rc 0) 00000100:00100000:0.0:1787508614.337712:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336045:x1874324509498240:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1916us (2861us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508614.337721:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93736 00000100:00100000:1.0:1787508614.349232:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.349517:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509498496 00000100:00100000:0.0:1787508614.349533:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509498496 00000100:00100000:0.0:1787508614.349613:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93737 00000100:00100000:0.0:1787508614.349636:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336045:x1874324509498496:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508614.349661:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508614.349689:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3374c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadf86 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.349772:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33753 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.349787:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33753 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.349799:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33753 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.349817:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3375a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.349824:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3375a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.349830:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3375a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.349894:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33753 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.349902:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33753 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.349909:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33753 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.349916:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33753 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.349921:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.349926:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33753 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.349933:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33753 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.349984:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.349988:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.349992:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33753 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.350000:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33753 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.350015:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3375a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.350021:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3375a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.350027:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3375a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.350032:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7a00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.350034:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3375a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.350040:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3375a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.350047:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe67841 (ffff9090e460f100) 00010000:00010000:0.0:1787508614.350050:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.350052:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3375a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.350058:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3375a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.350102:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3374c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf86 expref: 585 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.350116:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.350118:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508614.350122:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3374c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf86 expref: 585 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.350130:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6e00, rc 0) 00000100:00100000:0.0:1787508614.350197:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336045:x1874324509498496:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 574us (975us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508614.350204:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93737 00000100:00100000:2.0:1787508614.356151:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.356231:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509498752 00000100:00100000:3.0:1787508614.356242:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509498752 00000100:00100000:3.0:1787508614.356301:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93738 00000100:00100000:3.0:1787508614.356312:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336045:x1874324509498752:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508614.356331:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.356350:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33761 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadf8d expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.356440:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33768 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.356465:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33768 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.356476:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33768 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.356492:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3376f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.356499:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3376f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.356505:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3376f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.356562:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33768 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.356571:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33768 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.356576:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33768 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.356583:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33768 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.356589:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.356593:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33768 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.356599:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33768 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.356611:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.356614:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.356618:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33768 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.356636:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33768 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.356648:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3376f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.356655:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3376f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.356661:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3376f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.356667:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.356669:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3376f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.356675:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3376f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.356682:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090d2273700) 00010000:00010000:3.0:1787508614.356684:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.356687:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3376f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.356693:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3376f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.356910:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33761 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf8d expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.356922:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.356925:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508614.356929:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33761 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf8d expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.357063:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e600, rc 0) 00000100:00100000:3.0:1787508614.357771:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336045:x1874324509498752:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1458us (1627us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508614.357782:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93738 00000100:00100000:1.0:1787508614.369056:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.369154:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509499008 00000100:00100000:3.0:1787508614.369166:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509499008 00000100:00100000:3.0:1787508614.369244:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93739 00000100:00100000:3.0:1787508614.369256:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336045:x1874324509499008:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508614.369276:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.369302:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33776 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadf94 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.369393:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3377d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.369407:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3377d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.369418:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3377d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.369434:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33784 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.369441:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33784 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.369457:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33784 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.369528:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3377d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.369539:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3377d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.369544:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3377d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.369551:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3377d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.369557:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.369565:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3377d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.369572:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3377d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.369584:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.369588:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.369592:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3377d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.369598:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3377d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.369617:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33784 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.369763:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33784 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.369772:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33784 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.369893:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.369993:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33784 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.370000:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33784 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.370010:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x90ba0166 (ffff9090d2273700) 00010000:00010000:3.0:1787508614.370013:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.370015:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33784 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.370022:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33784 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.370061:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33776 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf94 expref: 585 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.370071:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.370073:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508614.370077:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33776 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf94 expref: 585 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.370086:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e600, rc 0) 00000100:00100000:3.0:1787508614.370200:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336045:x1874324509499008:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 945us (1154us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508614.370209:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93739 00000100:00100000:1.0:1787508614.379585:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.379686:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509499264 00000100:00100000:0.0:1787508614.379695:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509499264 00000100:00100000:0.0:1787508614.379762:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93740 00000100:00100000:0.0:1787508614.379776:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9b98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336045:x1874324509499264:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508614.379802:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508614.379825:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3378b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadf9b expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.379914:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f33792 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.379935:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f33792 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.379991:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f33792 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.380008:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33799 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.380016:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33799 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.380021:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33799 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.380077:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f33792 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.380084:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f33792 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.380089:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f33792 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.380097:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f33792 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.380104:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7a00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.380109:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f33792 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.380118:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f33792 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.380132:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.380136:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.380141:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f33792 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.380149:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f33792 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.380164:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33799 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.380170:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33799 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.380177:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33799 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.380183:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.380186:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33799 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.380193:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33799 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.380200:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaf3dc4c9 (ffff9090e460f100) 00010000:00010000:0.0:1787508614.380203:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.380205:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33799 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.380211:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33799 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.380244:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3378b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf9b expref: 585 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.380255:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.380258:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508614.380262:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3378b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf9b expref: 585 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.380272:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6e00, rc 0) 00000100:00100000:0.0:1787508614.380341:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9b98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336045:x1874324509499264:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 568us (771us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508614.380348:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93740 00000100:00100000:2.0:1787508614.389112:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.389205:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509499520 00000100:00100000:3.0:1787508614.389216:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509499520 00000100:00100000:3.0:1787508614.389282:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93741 00000100:00100000:3.0:1787508614.389292:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:336045:x1874324509499520:12345-192.168.201.30@tcp:36:lfs.0 00000100:00100000:3.0:1787508614.389407:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d13bd180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480097664:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508614.389471:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508614.389506:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.389640:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480097664 00000100:00100000:1.0:1787508614.389645:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480097664 00000100:00100000:1.0:1787508614.389681:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29658 00000100:00100000:1.0:1787508614.389687:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d13bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:205405:x1874324480097664:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787508614.389772:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d13bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:205405:x1874324480097664:12345-0@lo:1000:mdt00_004.0 Request processed in 85us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.389779:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29658 00000100:00100000:2.0:1787508614.389999:0:205405:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944058 gen 2 00000004:00080000:2.0:1787508614.390005:0:205405:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944058 committed transno 12884944058 00000020:00080000:2.0:1787508614.390012:0:205405:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9090c740fcc0 refcount 2 committed 0 result 0 batchid 4294998376 00000020:00080000:2.0:1787508614.390016:0:205405:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521c00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9090c740fb40 00000020:00080000:2.0:1787508614.390020:0:205405:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a2:0x5:0x0].584 00000020:00080000:2.0:1787508614.390023:0:205405:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521e00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090ce62a400 00000020:00080000:2.0:1787508614.390025:0:205405:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd1:0xf:0x0].41 00000100:00100000:2.0:1787508614.390049:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d13bd180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480097664:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508614.390094:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480097792:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508614.390123:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508614.390152:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9000 going to sleep for 11 seconds 00000020:00080000:0.0:1787508614.390209:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294998376 committed batchid 4294998373 00000020:00080000:0.0:1787508614.390263:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998373 00000100:00100000:3.0:1787508614.390307:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480097792 00000100:00100000:3.0:1787508614.390311:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480097792 00000100:00100000:3.0:1787508614.390345:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29659 00000100:00100000:3.0:1787508614.390352:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d74b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:205405:x1874324480097792:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508614.390440:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d74b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:205405:x1874324480097792:12345-0@lo:1000:mdt00_004.0 Request processed in 88us (315us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787508614.390456:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29659 00000100:00100000:0.0:1787508614.390534:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480097792:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1787508614.390598:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f337a0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.390608:0:205405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f337a0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.390629:0:205405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f337a0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.390643:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69d9180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480097920:0@lo:101:mdt00_004.0 00000100:00100000:0.0:1787508614.390670:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508614.390693:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.390906:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480097920 00000100:00100000:1.0:1787508614.390911:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480097920 00000100:00100000:1.0:1787508614.390981:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29660 00000100:00100000:1.0:1787508614.390988:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:205405:x1874324480097920:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1787508614.390999:0:202231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.391016:0:202231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f337a7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f337a0 expref: -99 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.391041:0:202231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f335ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf08 expref: 14 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.391050:0:202231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3363b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf2b expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.391060:0:202231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f337a7 lrc: 5/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f337a0 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.391083:0:202231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3363b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf2b expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.391097:0:202231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3363b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf2b expref: 583 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.391109:0:202231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d9b9b480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480098048:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508614.391176:0:202231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f335ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf08 expref: 14 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.391185:0:202231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f335ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf08 expref: 14 pid: 202226 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.391194:0:202231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d9b99880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480098176:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508614.391216:0:202231:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.395545:0:202231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d9b9b480 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480098048:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508614.395556:0:202231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d9b99880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480098176:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508614.395585:0:202231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f337a7 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f337a0 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.395596:0:202231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.395598:0:202231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.395601:0:202231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f337a7 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f337a0 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.395610:0:202231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247bc00, rc 0) 00000100:00100000:1.0:1787508614.395685:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:205405:x1874324480097920:12345-0@lo:101:mdt00_004.0 Request processed in 4696us (5012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.395693:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29660 00000100:00100000:0.0:1787508614.395797:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69d9180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480097920:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1787508614.395817:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f337a0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f337a7 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.395828:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f337a0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f337a7 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.396368:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.396402:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.396426:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509499776 00000100:00100000:1.0:1787508614.396434:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509499776 00010000:00010000:1.0:1787508614.396479:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f335ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf08 expref: 15 pid: 202226 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.396514:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509499648 00000100:00100000:1.0:1787508614.396518:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509499648 00010000:00010000:1.0:1787508614.396532:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3363b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf2b expref: 584 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.396558:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27826 00000100:00100000:1.0:1787508614.396567:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2400:x1874324509499776:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508614.396581:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508614.396587:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f335ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf08 expref: 15 pid: 202226 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.396596:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f335ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf08 expref: 15 pid: 202226 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.396615:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f335ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf08 expref: 15 pid: 202226 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.396644:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.396650:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f337a7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f337a0 expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.396659:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508614.396663:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27827 00000100:00100000:2.0:1787508614.396671:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091cc032850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:2401:x1874324509499648:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508614.396679:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508614.396684:0:229383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3363b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf2b expref: 584 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.396695:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3363b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf2b expref: 584 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.396703:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2400:x1874324509499776:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 137us (346us total) trans 0 rc 0/0 00010000:00010000:2.0:1787508614.396709:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f3363b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadf2b expref: 584 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.396709:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27826 00010000:00010000:2.0:1787508614.396720:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.396725:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f337a7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f337a0 expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.396734:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f337a7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f337a0 expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.396743:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f337a7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f337a0 expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.396776:0:229383:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f337a7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f337a0 expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.397055:0:229383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b38380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:229383:1874324480098304:0@lo:105: 00000100:00100000:2.0:1787508614.397094:0:229383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508614.397128:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480098304 00000100:00100000:2.0:1787508614.397134:0:229383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.397134:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480098304 00000100:00100000:1.0:1787508614.397175:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18145 00000100:00100000:1.0:1787508614.397183:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:229383:x1874324480098304:12345-0@lo:105: 00010000:00010000:1.0:1787508614.397194:0:202209:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f337a0 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f337a7 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.397204:0:202209:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f337a0 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f337a7 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.397213:0:202209:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f337a0 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f337a7 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.397222:0:202209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f337a0 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f337a7 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.397229:0:202209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f337a0 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f337a7 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.397237:0:202209:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f337a0 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f337a7 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.397258:0:202209:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d56f6e00) 00010000:00010000:3.0:1787508614.397277:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f337a0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f337a7 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.397286:0:205405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f337a0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f337a7 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.397290:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:229383:x1874324480098304:12345-0@lo:105: Request processed in 109us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.397296:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18145 00000004:00080000:3.0:1787508614.397311:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1787508614.397321:0:229383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b38380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:229383:1874324480098304:0@lo:105: 00010000:00010000:1.0:1787508614.397330:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508614.397348:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f337ae lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.397351:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091cc032850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:2401:x1874324509499648:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 682us (948us total) trans 0 rc 0/0 00010000:00010000:3.0:1787508614.397356:0:205405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f337ae lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.397358:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27827 00010000:00010000:3.0:1787508614.398244:0:205405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f337ae lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.398264:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d13bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480098432:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1787508614.398296:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508614.398323:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787508614.398341:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480098432 00000100:00100000:0.0:1787508614.398347:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480098432 00000100:00100000:0.0:1787508614.398392:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29661 00000100:00100000:0.0:1787508614.398401:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d13bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:205405:x1874324480098432:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1787508614.398416:0:202232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508614.398431:0:202232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f337b5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f337ae expref: -99 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.398461:0:202232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3347b lrc: 2/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.398468:0:202232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3359a lrc: 2/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.398476:0:202232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f337b5 lrc: 5/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f337ae expref: 8 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.398491:0:202232:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3359a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:0.0:1787508614.398519:0:202232:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:0.0:1787508614.398560:0:202232:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3347b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:0.0:1787508614.398572:0:202232:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:0.0:1787508614.398588:0:202232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f337b5 lrc: 3/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f337ae expref: 8 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.398602:0:202232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d2273000) 00010000:00010000:0.0:1787508614.398604:0:202232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.398608:0:202232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f337b5 lrc: 3/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f337ae expref: 8 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.398615:0:202232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7a00, rc 0) 00000100:00100000:0.0:1787508614.398736:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d13bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480098432:12345-0@lo:101:mdt00_004.0 Request processed in 335us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508614.398742:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29661 00000100:00100000:1.0:1787508614.398859:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d13bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480098432:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1787508614.398876:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f337ae lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f337b5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.398885:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f337ae lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f337b5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787508614.399964:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944062 is committed 00000020:00080000:2.0:1787508614.399978:0:202206:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8589961981 batchid updated 00010000:00010000:0.0:1787508614.399980:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3359a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.399989:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3359a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.399996:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3359a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787508614.399997:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944059 is committed 00000020:00080000:2.0:1787508614.400000:0:202206:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9090d01c9540 refcount 2 committed 0 result 0 batchid 8589961982 00010000:00010000:0.0:1787508614.400002:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa400 already unused, calling callback (ffffffffc19024f0) 00000020:00080000:2.0:1787508614.400004:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9091d47d0300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d01c9c00 00010000:00010000:0.0:1787508614.400006:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3359a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787508614.400007:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd2:0x1:0x0].1784 00000020:00080000:2.0:1787508614.400010:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9091d47d0d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090e3c8ee00 00000020:00080000:2.0:1787508614.400012:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1:0x0].1777 00010000:00010000:0.0:1787508614.400014:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3359a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.400028:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d2273000) 00010000:00010000:0.0:1787508614.400031:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.400036:0:3602:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f337b5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f337ae expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.400045:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3359a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.400052:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3359a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.400058:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3347b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.400065:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3347b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.400071:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3347b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.400077:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.400080:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3347b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.400086:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3347b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.400096:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d2273000) 00010000:00010000:3.0:1787508614.400098:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.400102:0:3603:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f337b5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f337ae expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787508614.400109:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589961982 committed batchid 8589961981 00010000:00010000:3.0:1787508614.400111:0:3603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f337b5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f337ae expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.400118:0:3603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f337b5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f337ae expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.400156:0:3603:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f337b5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f337ae expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.400169:0:3603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d13bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3603:1874324480098560:0@lo:105: 00000004:00080000:1.0:1787508614.400218:0:202262:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d1d88000 with version 3452 00000020:00080000:1.0:1787508614.400264:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589961981 cancel update log [0x240000bd2:0x1:0x0].1783: rc = 0 00000100:00100000:3.0:1787508614.400297:0:3603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1787508614.400310:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589961981 cancel update log [0x2000013a0:0x1:0x0].1776: rc = 0 00000020:00080000:1.0:1787508614.400318:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961981 00000004:00080000:0.0:1787508614.400343:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3452 rpc_version 3452 00000020:00100000:0.0:1787508614.400363:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787508614.400371:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090da0be300 x1874324480098816/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787508614.400380:0:3603:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787508614.400385:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0be300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480098816:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787508614.400415:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508614.400484:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.400520:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480098816 00000100:00100000:1.0:1787508614.400527:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480098816 00000100:00100000:1.0:1787508614.400594:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29662 00000100:00100000:1.0:1787508614.400602:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:202248:x1874324480098816:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787508614.400740:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:202248:x1874324480098816:12345-0@lo:1000:osp_up1-0.0 Request processed in 139us (324us total) trans 8589961997 rc 0/0 00000100:00100000:1.0:1787508614.400748:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29662 00000100:00100000:3.0:1787508614.401092:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0be300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480098816:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787508614.401149:0:229386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480098560 00000100:00100000:2.0:1787508614.401154:0:229386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480098560 00000100:00100000:2.0:1787508614.401186:0:229386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18146 00000100:00100000:2.0:1787508614.401202:0:229386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d13bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:3603:x1874324480098560:12345-0@lo:105: 00010000:00010000:2.0:1787508614.401215:0:229386:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f337ae lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f337b5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.401225:0:229386:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f337ae lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f337b5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.401234:0:229386:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f337ae lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f337b5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.401242:0:229386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f337ae lrc: 5/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f337b5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.401250:0:229386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f337ae lrc: 6/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f337b5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.401259:0:229386:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f337ae lrc: 6/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f337b5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.401282:0:229386:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090e4c8e600) 00010000:00010000:1.0:1787508614.401347:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f337ae lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f337b5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.401354:0:205405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f337ae lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f337b5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.401472:0:229386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d13bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:3603:x1874324480098560:12345-0@lo:105: Request processed in 279us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.401483:0:229386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18146 00000004:00080000:1.0:1787508614.401539:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1787508614.401574:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d9b99880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480098944:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787508614.401609:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508614.401929:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787508614.402200:0:3603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d13bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3603:1874324480098560:0@lo:105: 00010000:00010000:3.0:1787508614.402216:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3347b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.402222:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3347b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.402233:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33482 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1259:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.402237:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33482 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x1259:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.402241:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33482 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1259:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.402244:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.402246:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33482 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1259:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.402250:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33482 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x1259:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.402260:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1259:0x0].0x0 (ffff9090d2273e00) 00010000:00010000:3.0:1787508614.402263:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.402265:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33482 lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x1259:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.402268:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33482 lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x1259:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.402279:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33497 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x16f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.402282:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33497 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a0:0x16f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.402285:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33497 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x16f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.402288:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.402290:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33497 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x16f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.402293:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33497 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a0:0x16f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.402297:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x16f:0x0].0x0 (ffff9090d2273c00) 00010000:00010000:3.0:1787508614.402298:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.402299:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33497 lrc: 2/0,0 mode: --/TXN res: [0x2000013a0:0x16f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.402302:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33497 lrc: 0/0,0 mode: --/TXN res: [0x2000013a0:0x16f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.402427:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480098944 00000100:00100000:2.0:1787508614.402432:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480098944 00000100:00100000:2.0:1787508614.402494:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29663 00000100:00100000:2.0:1787508614.402500:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480098944:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508614.402563:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480098944:12345-0@lo:1000:mdt00_004.0 Request processed in 63us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.402574:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29663 00000100:00100000:1.0:1787508614.402597:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d9b99880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480098944:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508614.402639:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.402640:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d9b99880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480099072:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787508614.402665:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508614.402732:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787508614.402775:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480099072 00000100:00100000:3.0:1787508614.402787:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480099072 00000100:00100000:3.0:1787508614.402823:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29664 00000100:00100000:3.0:1787508614.402830:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480099072:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508614.402917:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480099072:12345-0@lo:1000:mdt00_004.0 Request processed in 88us (251us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787508614.402922:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29664 00000100:00100000:3.0:1787508614.402959:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509499904 00000100:00100000:3.0:1787508614.402962:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509499904 00000100:00100000:3.0:1787508614.402985:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93742 00000100:00100000:3.0:1787508614.402990:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d15adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:336056:x1874324509499904:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508614.402997:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.403010:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f337bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadfa2 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.403053:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f337c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.403061:0:202227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f337a7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f337a0 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.403067:0:202227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f337c3 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.403083:0:202227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f337a7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f337a0 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.403094:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d13bf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:202227:1874324480099200:0@lo:104: 00000100:00100000:3.0:1787508614.403113:0:202227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508614.403132:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.403303:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480099200 00000100:00100000:1.0:1787508614.403306:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480099200 00000100:00100000:1.0:1787508614.403333:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18147 00000100:00100000:1.0:1787508614.403338:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d13bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:202227:x1874324480099200:12345-0@lo:104: 00010000:00010000:1.0:1787508614.403347:0:202209:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f337a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f337a7 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.403389:0:202209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787508614.403393:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d13bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:202227:x1874324480099200:12345-0@lo:104: Request processed in 55us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.403397:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18147 00010000:00010000:1.0:1787508614.403409:0:202214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787508614.403412:0:202214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f337a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f337a7 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.403419:0:202214:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9090d56f6e00 is referenced, will be cancelled later 00010000:00010000:1.0:1787508614.403421:0:202214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f337a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f337a7 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.403425:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508614.403426:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508614.403427:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508614.403441:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d9b99880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480099072:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787508614.403540:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d9b99880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480099328:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787508614.403566:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508614.403584:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.403598:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480099328 00000100:00100000:1.0:1787508614.403601:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480099328 00000100:00100000:1.0:1787508614.403623:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29665 00000100:00100000:1.0:1787508614.403629:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480099328:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787508614.403689:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480099328:12345-0@lo:1000:mdt00_004.0 Request processed in 60us (122us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787508614.403697:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29665 00000100:00100000:1.0:1787508614.403723:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d9b99880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480099328:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787508614.403768:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d9b99880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480099456:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787508614.404004:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508614.404019:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.404031:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480099456 00000100:00100000:1.0:1787508614.404034:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480099456 00000100:00100000:1.0:1787508614.404057:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29666 00000100:00100000:1.0:1787508614.404063:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480099456:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787508614.404114:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480099456:12345-0@lo:1000:mdt00_004.0 Request processed in 51us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.404121:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29666 00000100:00100000:1.0:1787508614.404148:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d9b99880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480099456:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787508614.404189:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d9b99880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480099584:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787508614.404293:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508614.404309:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.404321:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480099584 00000100:00100000:1.0:1787508614.404324:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480099584 00000100:00100000:1.0:1787508614.404346:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29667 00000100:00100000:1.0:1787508614.404352:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480099584:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787508614.404588:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480099584:12345-0@lo:1000:mdt00_004.0 Request processed in 235us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.404596:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29667 00000100:00100000:1.0:1787508614.404629:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d13bf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:202227:1874324480099200:0@lo:104: 00010000:00010000:1.0:1787508614.404647:0:202227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f337c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.404708:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d9b99880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480099584:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508614.404748:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d13bf100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480099712:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508614.404773:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508614.404797:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.404847:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480099712 00000100:00100000:1.0:1787508614.404852:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480099712 00000100:00100000:1.0:1787508614.404913:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29668 00000100:00100000:1.0:1787508614.404921:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d13bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480099712:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787508614.404987:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d13bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480099712:12345-0@lo:1000:mdt00_004.0 Request processed in 67us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.404994:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29668 00000100:00100000:1.0:1787508614.405083:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d13bf100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480099712:0@lo:1000:mdt00_004.0 00000040:00080000:1.0:1787508614.406482:0:205405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xf:0x0].42, 2168 off77232 00000040:00080000:1.0:1787508614.406570:0:205405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x5:0x0].585, 2368 off742880 00000004:00080000:1.0:1787508614.406576:0:205405:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d1d88480 with version 13596 00000004:00080000:2.0:1787508614.406675:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13596 rpc_version 13596 00000020:00100000:2.0:1787508614.406716:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787508614.406726:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091f9b39880 x1874324480099968/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787508614.406748:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b39880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480099968:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508614.406819:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508614.407013:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9480 going to sleep for 11 seconds 00000100:00100000:0.0:1787508614.407492:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480099968 00000100:00100000:0.0:1787508614.407501:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480099968 00000100:00100000:0.0:1787508614.407558:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29669 00000100:00100000:0.0:1787508614.407568:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:202961:x1874324480099968:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787508614.408570:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:202961:x1874324480099968:12345-0@lo:1000:osp_up0-1.0 Request processed in 1000us (1748us total) trans 12884944063 rc 0/0 00000100:00100000:0.0:1787508614.408580:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29669 00000100:00100000:2.0:1787508614.409049:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b39880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480099968:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1787508614.409235:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f337ca lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.409249:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f337ca lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.409258:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f337ca lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.409275:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f337d1 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x291:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.409280:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f337d1 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x291:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.409286:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f337d1 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x291:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.409323:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a600/0xb126349c40f337d8 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.409331:0:205405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a600/0xb126349c40f337d8 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.409343:0:205405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a600/0xb126349c40f337d8 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.409369:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d9b98000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480100096:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1787508614.409405:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508614.409429:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88600 going to sleep for 11 seconds 00000100:00100000:2.0:1787508614.409495:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480100096 00000100:00100000:2.0:1787508614.409502:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480100096 00000100:00100000:2.0:1787508614.409548:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29670 00000100:00100000:2.0:1787508614.409557:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9b98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:205405:x1874324480100096:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1787508614.409575:0:203182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.409592:0:203182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f337df lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f337d8 expref: -99 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.409611:0:203182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f337df lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f337d8 expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.409622:0:203182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f337df lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f337d8 expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.409630:0:203182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x287:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:2.0:1787508614.409634:0:203182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.409638:0:203182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abe00, rc 0) 00000100:00100000:2.0:1787508614.409674:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9b98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:205405:x1874324480100096:12345-0@lo:101:mdt00_004.0 Request processed in 119us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.409679:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29670 00000100:00100000:3.0:1787508614.409788:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d9b98000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480100096:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1787508614.409804:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a600/0xb126349c40f337d8 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f337df expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.409814:0:205405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a600/0xb126349c40f337d8 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f337df expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508614.409836:0:205405:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cdd2b4f4 reply state 00000000f5546e3f transno 8589961998 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f337d1 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x291:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.409849:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f337d1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x291:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.409853:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x291:0x0].0x0 (ffff9090ce7bad00) 00010000:00010000:3.0:1787508614.409855:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508614.409857:0:205405:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787508614.409862:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a600/0xb126349c40f337d8 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f337df expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.409872:0:205405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a600/0xb126349c40f337d8 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f337df expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787508614.409883:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x287:0x0] 00000004:00010000:3.0:1787508614.409889:0:205405:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cdd2b4f4 reply state 00000000f5546e3f transno 8589961998 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f337ca lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.409896:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f337ca lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.409902:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d2:0x0].0x0 (ffff9090ce7ba600) 00010000:00010000:3.0:1787508614.409904:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508614.409906:0:205405:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787508614.409910:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d2:0x0]: returning size 4096 00000004:00080000:3.0:1787508614.409917:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1787508614.409925:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f337a0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f337a7 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.409932:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f337a0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xb126349c40f337a7 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.409937:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f337a0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xb126349c40f337a7 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.410002:0:205405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000004:00080000:3.0:1787508614.410007:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1787508614.410012:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f337ae lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f337b5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.410023:0:205405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f337ae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f337b5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.410104:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+642:336045:x1874324509499520:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 20811us (21002us total) trans 8589961998 rc 0/0 00000100:00100000:3.0:1787508614.410112:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93741 00010000:00010000:0.0:1787508614.410562:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508614.410570:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f337a0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f337a7 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.410579:0:204785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6e00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:0.0:1787508614.410585:0:204785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f337a0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f337a7 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508614.410593:0:204785:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f337a0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f337a7 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.410624:0:204785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f337a0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f337a7 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.410631:0:204785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787508614.410665:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f337a0 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f337a7 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.410673:0:204785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6e00/0xb126349c40f337a0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f337a7 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.410690:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508614.410692:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508614.410694:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508614.411113:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787508614.411131:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d15aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480100224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508614.411183:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508614.411292:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480100224 00000100:00100000:0.0:1787508614.411299:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480100224 00010000:00010000:0.0:1787508614.411325:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f337a7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f337a0 expref: 10 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.411368:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27828 00000100:00100000:0.0:1787508614.411377:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9b99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+10:3617:x1874324480100224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508614.411388:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508614.411406:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f337a7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f337a0 expref: 10 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.411424:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.411429:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f337c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.411437:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f337c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.411443:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f337c3 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.411478:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508614.411511:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9b99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3617:x1874324480100224:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508614.411517:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27828 00000100:00100000:1.0:1787508614.411727:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d15aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480100224:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508614.411756:0:202227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f337c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.411763:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f337c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508614.411827:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508614.411832:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508614.411854:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f337c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.411882:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f337bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfa2 expref: 12 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.411898:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f337c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfa2 expref: 11 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.411905:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.411907:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508614.411910:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e200, rc 0) 00000100:00100000:1.0:1787508614.412350:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d15adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336056:x1874324509499904:12345-192.168.201.30@tcp:101:rm.0 Request processed in 9356us (9710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.412366:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93742 00000100:00100000:0.0:1787508614.418715:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.418752:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.419439:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509500032 00000100:00100000:1.0:1787508614.419459:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509500032 00000100:00100000:1.0:1787508614.419551:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509500160 00000100:00100000:1.0:1787508614.419556:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509500160 00000100:00100000:3.0:1787508614.419590:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93743 00000100:00100000:2.0:1787508614.419669:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d15ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336056:x1874324509500032:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508614.419692:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.419714:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f337e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadfa9 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.419863:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f337ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.419880:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f337ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.419892:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f337ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.419909:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f337f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.419917:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f337f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.419923:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f337f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.420001:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f337ed lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.420015:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f337ed lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.420022:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f337ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.420028:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f337ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.420034:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.420038:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f337ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.420045:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f337ed lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.420057:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.420060:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.420064:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f337ed lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.420071:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f337ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.420086:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f337f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.420092:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f337f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.420098:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f337f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.420104:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.420107:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f337f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.420113:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f337f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.420120:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090c98d9600) 00010000:00010000:2.0:1787508614.420123:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.420125:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f337f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.420131:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f337f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.420163:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f337e6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfa9 expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.420174:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.420176:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.420180:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f337e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfa9 expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.420189:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa200, rc 0) 00000100:00100000:2.0:1787508614.420380:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d15ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336056:x1874324509500032:12345-192.168.201.30@tcp:101:rm.0 Request processed in 779us (1676us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508614.420389:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93743 00000100:00100000:2.0:1787508614.420412:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93744 00000100:00100000:2.0:1787508614.420421:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d15aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+581:336057:x1874324509500160:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1787508614.420429:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.420439:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f337fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadfb0 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.420485:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33802 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.420495:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33802 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.420503:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33802 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508614.420540:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508614.420544:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508614.420563:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33802 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.420582:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f337fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfb0 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.420596:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33802 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfb0 expref: 582 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.420603:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.420605:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508614.420607:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab000, rc 0) 00000100:00100000:2.0:1787508614.420629:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d15aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336057:x1874324509500160:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 210us (1876us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.420638:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93744 00000100:00100000:2.0:1787508614.423196:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.423300:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509500288 00000100:00100000:3.0:1787508614.423310:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509500288 00000100:00100000:3.0:1787508614.423368:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93745 00000100:00100000:3.0:1787508614.423378:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336057:x1874324509500288:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1787508614.423401:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.423421:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33809 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadfb7 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.423488:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33810 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.423501:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33810 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.423512:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33810 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.423527:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33817 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.423533:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33817 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.423540:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33817 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.423598:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33810 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.423605:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33810 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.423611:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33810 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.423617:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33810 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.423623:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.423627:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33810 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.423634:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33810 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.423647:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.423650:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.423654:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33810 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.423660:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33810 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.423675:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33817 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.423681:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33817 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.423687:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33817 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.423692:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.423695:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33817 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.423701:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33817 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.423707:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090ccb87700) 00010000:00010000:3.0:1787508614.423709:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.423713:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33817 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.423719:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33817 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.423745:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33809 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfb7 expref: 583 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.423751:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.423753:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508614.423755:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33809 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfb7 expref: 583 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.423764:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e800, rc 0) 00000100:00100000:3.0:1787508614.423834:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336057:x1874324509500288:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 457us (652us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508614.423839:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93745 00000100:00100000:3.0:1787508614.425764:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.427083:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509500416 00000100:00100000:1.0:1787508614.427098:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509500416 00000100:00100000:1.0:1787508614.427151:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93746 00000100:00100000:1.0:1787508614.427160:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d13bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336056:x1874324509500416:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508614.427179:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.427548:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3381e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadfbe expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.427683:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33825 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.427698:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33825 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.427709:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33825 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.427724:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3382c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.427731:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3382c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.427738:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3382c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.427804:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33825 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.427813:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33825 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.427820:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33825 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.427827:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33825 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.427833:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.427837:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33825 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.427843:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33825 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.427856:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.427859:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.427863:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33825 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.427869:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33825 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.427884:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3382c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.427890:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3382c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.427896:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3382c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.427901:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.427903:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3382c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.427909:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3382c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.427916:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090ce7ba200) 00010000:00010000:1.0:1787508614.427918:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.427921:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3382c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.427926:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3382c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.428148:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3381e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfbe expref: 12 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.428159:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.428161:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508614.428165:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3381e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfbe expref: 12 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.428176:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247bc00, rc 0) 00000100:00100000:1.0:1787508614.428256:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d13bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336056:x1874324509500416:12345-192.168.201.30@tcp:101:rm.0 Request processed in 1095us (2500us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508614.428264:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93746 00000100:00100000:3.0:1787508614.428329:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.428707:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509500544 00000100:00100000:1.0:1787508614.428715:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509500544 00000100:00100000:1.0:1787508614.428758:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93747 00000100:00100000:1.0:1787508614.428767:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336057:x1874324509500544:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508614.428781:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.428794:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33833 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadfc5 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.428835:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3383a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.428846:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3383a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.428854:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3383a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.428867:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33841 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.428875:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33841 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.428882:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33841 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.428918:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3383a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.428925:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3383a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.428931:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3383a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.428936:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3383a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.428967:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.428971:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3383a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.429156:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3383a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.429166:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.429169:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.429172:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3383a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.429178:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3383a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.429199:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33841 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.429205:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33841 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.429210:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33841 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.429215:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.429217:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33841 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.429222:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33841 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.429229:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090ce7bac00) 00010000:00010000:1.0:1787508614.429231:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.429233:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33841 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.429238:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33841 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.429261:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33833 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfc5 expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.429274:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.429276:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508614.429280:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33833 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfc5 expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.429288:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b600, rc 0) 00000100:00100000:1.0:1787508614.429336:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336057:x1874324509500544:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 569us (1007us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508614.429343:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93747 00000100:00100000:2.0:1787508614.431816:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.431864:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509500800 00000100:00100000:3.0:1787508614.431875:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509500800 00000100:00100000:1.0:1787508614.432392:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93748 00000100:00100000:1.0:1787508614.432405:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336056:x1874324509500800:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508614.432426:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.432456:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33848 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadfcc expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.432530:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3384f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.432543:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3384f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.432554:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3384f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.432556:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:1.0:1787508614.432568:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33856 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.432577:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509500928 00010000:00010000:1.0:1787508614.432579:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33856 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.432581:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509500928 00010000:00010000:1.0:1787508614.432586:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33856 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.432607:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93749 00000100:00100000:2.0:1787508614.432613:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336057:x1874324509500928:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1787508614.432620:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.432630:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f3385d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadfd3 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.432651:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3384f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.432658:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3384f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.432662:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33864 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.432664:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3384f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.432671:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3384f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.432672:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33864 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.432680:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33864 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.432692:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f3386b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.432699:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f3386b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.432706:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f3386b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.432731:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33864 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.432984:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.432990:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3384f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.433113:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3384f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.433129:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.433132:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.433137:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3384f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.433144:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3384f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.433157:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33856 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.433163:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33856 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.433165:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33864 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.433170:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33856 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.433172:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33864 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.433176:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.433179:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33864 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.433179:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33856 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.433184:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.433185:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33856 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.433187:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33864 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.433192:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090ce7bae00) 00010000:00010000:2.0:1787508614.433193:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33864 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.433195:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.433197:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33856 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.433262:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.433264:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.433268:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33864 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.433274:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33864 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.433285:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f3386b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.433291:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f3386b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.433297:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f3386b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.433302:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.433305:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f3386b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.433310:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f3386b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.433316:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090c98d9600) 00010000:00010000:2.0:1787508614.433318:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.433320:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f3386b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.433325:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f3386b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.433354:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f3385d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfd3 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.433418:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.433422:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.433426:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f3385d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfd3 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.433436:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aaa00, rc 0) 00000100:00100000:2.0:1787508614.433507:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336057:x1874324509500928:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 894us (951us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508614.433519:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93749 00010000:00010000:1.0:1787508614.434093:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33856 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.434127:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33848 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfcc expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.434137:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.434139:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508614.434143:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33848 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfcc expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.434151:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b000, rc 0) 00000100:00100000:1.0:1787508614.434177:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336056:x1874324509500800:12345-192.168.201.30@tcp:101:rm.0 Request processed in 1775us (2372us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508614.434184:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93748 00000100:00100000:0.0:1787508614.437007:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.437281:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509501184 00000100:00100000:1.0:1787508614.437291:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509501184 00000100:00100000:1.0:1787508614.437352:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93750 00000100:00100000:1.0:1787508614.437363:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d15af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336057:x1874324509501184:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508614.437384:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.437404:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33872 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadfda expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.437485:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33879 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.437497:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33879 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.437504:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33879 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.437514:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33880 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.437518:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33880 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.437525:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33880 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.437570:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33879 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.437575:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33879 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.437579:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33879 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.437583:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33879 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.437587:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.437590:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33879 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.437594:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33879 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.437601:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.437602:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.437605:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33879 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.437609:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33879 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.437618:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33880 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.437622:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33880 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.437626:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33880 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.437629:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.437630:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33880 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.437633:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33880 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.437636:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090ce7bac00) 00010000:00010000:1.0:1787508614.437638:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.437639:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33880 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.437642:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33880 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.437662:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33872 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfda expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.437668:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.437669:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508614.437671:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33872 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfda expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.437680:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b600, rc 0) 00000100:00100000:1.0:1787508614.437728:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d15af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336057:x1874324509501184:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 366us (732us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508614.437735:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93750 00000100:00100000:2.0:1787508614.441866:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.441902:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.441985:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509501312 00000100:00100000:0.0:1787508614.441996:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509501312 00000100:00100000:0.0:1787508614.442051:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509501440 00000100:00100000:0.0:1787508614.442055:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509501440 00000100:00100000:0.0:1787508614.442083:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93751 00000100:00100000:0.0:1787508614.442094:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8fb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336057:x1874324509501312:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508614.442114:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508614.442137:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f33887 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadfe1 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.442203:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f3388e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.442219:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f3388e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.442230:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f3388e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.442241:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33895 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.442251:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f337b5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f337ae expref: 8 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.442260:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33895 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.442295:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f337b5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f337ae expref: 8 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.442313:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d15ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480100352:0@lo:104: 00000100:00100000:0.0:1787508614.442382:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508614.442417:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480100352 00000100:00100000:0.0:1787508614.442422:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480100352 00000100:00100000:0.0:1787508614.442466:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18148 00000100:00100000:0.0:1787508614.442473:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d15adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:230618:x1874324480100352:12345-0@lo:104: 00010000:00010000:0.0:1787508614.442484:0:229363:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f337ae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f337b5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.442528:0:229363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787508614.442535:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d15adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:230618:x1874324480100352:12345-0@lo:104: Request processed in 64us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508614.442543:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18148 00000100:00100000:1.0:1787508614.442544:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93752 00000100:00100000:1.0:1787508614.442553:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8fb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336056:x1874324509501440:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508614.442563:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508614.442569:0:226765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787508614.442572:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3389c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadfe8 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.442576:0:226765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f337ae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f337b5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.442584:0:226765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:0.0:1787508614.442589:0:226765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f337ae lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f337b5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508614.442598:0:226765:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f337ae lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f337b5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.442604:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f338a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.442612:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f338a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.442619:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f338a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.442626:0:226765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f337ae lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f337b5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.442628:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f338aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.442633:0:226765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787508614.442635:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f338aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.442641:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f338aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.442653:0:226765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f337ae lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f337b5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.442660:0:226765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f337ae lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f337b5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.442678:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508614.442680:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508614.442682:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508614.442694:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d15ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480100480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508614.442722:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508614.442773:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88000 going to sleep for 11 seconds 00000100:00100000:0.0:1787508614.442794:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d15ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480100352:0@lo:104: 00010000:00010000:0.0:1787508614.442813:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33895 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.443649:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480100480 00000100:00100000:1.0:1787508614.443659:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480100480 00010000:00010000:1.0:1787508614.443683:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f337b5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f337ae expref: 9 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.443708:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27829 00000100:00100000:1.0:1787508614.443715:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d15ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3617:x1874324480100480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508614.443727:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:2.0:1787508614.445738:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944063 is committed 00000020:00080000:2.0:1787508614.445754:0:202206:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8589961982 batchid updated 00000020:00080000:1.0:1787508614.445903:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961982 00010000:00010000:3.0:1787508614.446150:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f337b5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f337ae expref: 8 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.446174:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d2273000) 00010000:00010000:3.0:1787508614.446180:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33895 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787508614.446428:0:202262:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d1d88540 with version 3453 00000020:00080000:1.0:1787508614.446484:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589961982 cancel update log [0x240000bd2:0x1:0x0].1784: rc = 0 00000020:00080000:1.0:1787508614.446584:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589961982 cancel update log [0x2000013a0:0x1:0x0].1777: rc = 0 00000020:00080000:1.0:1787508614.446597:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961982 00010000:00010000:3.0:1787508614.446624:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33895 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.446636:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33895 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.446647:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f338aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.446656:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f338aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.446662:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f338aa lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.446718:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508614.446838:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d15ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:3617:x1874324480100480:12345-0@lo:103:ldlm_bl.0 Request processed in 3122us (4113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.446848:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27829 00000100:00100000:3.0:1787508614.446916:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d15ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480100480:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508614.447026:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f338aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.447034:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f338aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.447145:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d9b9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:209004:1874324480100608:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787508614.447187:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508614.447228:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9ff2240 going to sleep for 11 seconds 00000100:00100000:3.0:1787508614.447395:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480100608 00000100:00100000:3.0:1787508614.447402:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480100608 00000100:00100000:3.0:1787508614.447462:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29671 00000100:00100000:3.0:1787508614.447472:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:209004:x1874324480100608:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787508614.447558:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:209004:x1874324480100608:12345-0@lo:1000:mdt00_005.0 Request processed in 87us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.447565:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29671 00000100:00100000:3.0:1787508614.447600:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d9b9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:209004:1874324480100608:0@lo:1000:mdt00_005.0 00010000:00010000:3.0:1787508614.447651:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f338b1 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.447664:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f338b1 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.447674:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f338b1 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508614.447697:0:209004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f338b1 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.447712:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f338a3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.447724:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f338a3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.447732:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f338a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.447739:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f338a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.447745:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.447750:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f338a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.447757:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f338a3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.447769:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.447772:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.447777:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f338a3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.447799:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f338a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.447812:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f338aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.447819:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f338aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.447826:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f338aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.447832:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.447835:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f338aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.447841:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f338aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.447849:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d2273000) 00010000:00010000:3.0:1787508614.447851:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.447854:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f338aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.447861:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f338aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.447896:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3389c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfe8 expref: 13 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.447911:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f338b1 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfe8 expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.447918:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d2:0x0].0x0 (ffff9090ccb87700) 00010000:00010000:3.0:1787508614.447921:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508614.447923:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e800, rc 0) 00000100:00100000:3.0:1787508614.448009:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8fb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336056:x1874324509501440:12345-192.168.201.30@tcp:101:rm.0 Request processed in 5457us (6106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.448016:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93752 00010000:00010000:2.0:1787508614.448335:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33895 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.448343:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33895 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.448411:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f338b8 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.448420:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f338b8 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.448429:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f338b8 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508614.448456:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f338b8 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.448468:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f3388e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.448474:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f3388e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.448480:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f3388e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.448491:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f3388e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.448497:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.448500:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f3388e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.448506:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f3388e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.448515:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.448518:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.448520:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f3388e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.448526:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f3388e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.448537:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33895 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.448543:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33895 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.448548:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33895 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.448552:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.448555:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33895 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.448564:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33895 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.448571:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d2273000) 00010000:00010000:2.0:1787508614.448573:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.448576:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33895 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.448581:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33895 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.448608:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f33887 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfe1 expref: 584 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.448621:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f338b8 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfe1 expref: 583 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.448629:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d2:0x0].0x0 (ffff9090ccb87700) 00010000:00010000:2.0:1787508614.448631:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.448634:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aaa00, rc 0) 00000100:00100000:2.0:1787508614.448664:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8fb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336057:x1874324509501312:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 6572us (6807us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.448672:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93751 00000004:00080000:0.0:1787508614.448855:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3453 rpc_version 3453 00000020:00100000:0.0:1787508614.448882:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787508614.448890:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091d15ad880 x1874324480100864/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787508614.448910:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d15ad880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480100864:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787508614.451374:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508614.451417:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88000 going to sleep for 11 seconds 00000100:00100000:3.0:1787508614.451681:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.451885:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509501568 00000100:00100000:1.0:1787508614.451894:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509501568 00000100:00100000:1.0:1787508614.451981:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93753 00000100:00100000:1.0:1787508614.451991:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+642:336057:x1874324509501568:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508614.452020:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.452041:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b600/0xb126349c40f338bf lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadfef expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.452103:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b800/0xb126349c40f338c6 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.452117:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b800/0xb126349c40f338c6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.452129:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b800/0xb126349c40f338c6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508614.452242:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d2:0x0]: returning size 4096 00000004:00200000:1.0:1787508614.452247:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787508614.452283:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b600/0xb126349c40f338bf lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfef expref: 644 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.452302:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b800/0xb126349c40f338c6 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfef expref: 643 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.452311:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d2:0x0].0x0 (ffff9090ce7ba600) 00010000:00010000:1.0:1787508614.452315:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508614.452318:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b800, rc 0) 00000100:00100000:1.0:1787508614.452387:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+643:336057:x1874324509501568:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 397us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.452395:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93753 00000100:00100000:2.0:1787508614.453017:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480100864 00000100:00100000:2.0:1787508614.453024:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480100864 00000100:00100000:2.0:1787508614.453061:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29672 00000100:00100000:2.0:1787508614.453068:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d15ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:202248:x1874324480100864:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787508614.453242:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d15ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:202248:x1874324480100864:12345-0@lo:1000:osp_up1-0.0 Request processed in 173us (1888us total) trans 8589961999 rc 0/0 00000100:00100000:2.0:1787508614.453250:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29672 00000100:00100000:3.0:1787508614.453418:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d15ad880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480100864:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787508614.454718:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.454797:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509501696 00000100:00100000:1.0:1787508614.454808:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509501696 00000100:00100000:1.0:1787508614.454865:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93754 00000100:00100000:1.0:1787508614.454875:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:336056:x1874324509501696:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508614.454894:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.454915:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f338cd lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadff6 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.455034:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247bc00/0xb126349c40f338d4 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.455050:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247bc00/0xb126349c40f338d4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.455062:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247bc00/0xb126349c40f338d4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508614.455160:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d2:0x0]: returning size 4096 00000004:00200000:1.0:1787508614.455166:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787508614.455618:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f338cd lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadff6 expref: 7 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.455640:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247bc00/0xb126349c40f338d4 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadff6 expref: 6 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.455649:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d2:0x0].0x0 (ffff9090ce7ba600) 00010000:00010000:1.0:1787508614.455652:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508614.455656:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247bc00, rc 0) 00000100:00100000:1.0:1787508614.455719:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336056:x1874324509501696:12345-192.168.201.30@tcp:101:rm.0 Request processed in 846us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.455727:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93754 00000100:00100000:3.0:1787508614.458478:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.458570:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509501824 00000100:00100000:2.0:1787508614.458580:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509501824 00000100:00100000:2.0:1787508614.458641:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93755 00000100:00100000:2.0:1787508614.458651:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+643:336057:x1874324509501824:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1787508614.458672:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.458692:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f338db lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x291:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaadffd expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.458749:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa600/0xb126349c40f338e2 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.458764:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa600/0xb126349c40f338e2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.458776:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa600/0xb126349c40f338e2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508614.458847:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x291:0x0]: returning size 4096 00000004:00200000:2.0:1787508614.458853:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787508614.458894:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f338db lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x291:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadffd expref: 645 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.458915:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa600/0xb126349c40f338e2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadffd expref: 644 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.458929:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x291:0x0].0x0 (ffff9090ce7bad00) 00010000:00010000:2.0:1787508614.458933:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508614.458936:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa600, rc 0) 00000100:00100000:2.0:1787508614.459172:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:336057:x1874324509501824:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 521us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.459180:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93755 00000100:00100000:0.0:1787508614.463437:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.463515:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.463859:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509501952 00000100:00100000:2.0:1787508614.463871:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509501952 00000100:00100000:2.0:1787508614.463991:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509502080 00000100:00100000:2.0:1787508614.463994:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509502080 00000100:00100000:1.0:1787508614.464060:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93756 00000100:00100000:1.0:1787508614.464074:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d15aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336056:x1874324509501952:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508614.464097:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.464118:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f338e9 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x291:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae004 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.464183:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a000/0xb126349c40f338f0 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.464209:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a000/0xb126349c40f338f0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.464220:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a000/0xb126349c40f338f0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508614.464263:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x291:0x0]: returning size 4096 00000004:00200000:1.0:1787508614.464268:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787508614.464302:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f338e9 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x291:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae004 expref: 8 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.464320:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a000/0xb126349c40f338f0 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae004 expref: 7 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.464328:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x291:0x0].0x0 (ffff9090ce7bad00) 00010000:00010000:1.0:1787508614.464331:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508614.464335:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a000, rc 0) 00000100:00100000:1.0:1787508614.464398:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d15aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:336056:x1874324509501952:12345-192.168.201.30@tcp:101:rm.0 Request processed in 328us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.464405:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93756 00000100:00100000:1.0:1787508614.464424:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93757 00000100:00100000:1.0:1787508614.464431:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d15afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336057:x1874324509502080:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508614.464439:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.464461:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f338f7 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x287:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae00b expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.464491:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f338fe lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.464502:0:205405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f337df lrc: 2/0,0 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f337d8 expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.464510:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f338fe lrc: 4/1,0 mode: --/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.464541:0:205405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f337df lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f337d8 expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.464557:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d9b99180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480100992:0@lo:104: 00000100:00100000:1.0:1787508614.464602:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508614.464635:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480100992 00000100:00100000:1.0:1787508614.464639:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480100992 00000100:00100000:1.0:1787508614.464670:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18149 00000100:00100000:1.0:1787508614.464676:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9b9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:205405:x1874324480100992:12345-0@lo:104: 00010000:00010000:1.0:1787508614.464688:0:202209:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a600/0xb126349c40f337d8 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f337df expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.464726:0:202209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787508614.464732:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9b9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:205405:x1874324480100992:12345-0@lo:104: Request processed in 56us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.464737:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18149 00010000:00010000:1.0:1787508614.464758:0:202215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787508614.464764:0:202215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a600/0xb126349c40f337d8 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f337df expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.464773:0:202215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a600 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:1.0:1787508614.464778:0:202215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a600/0xb126349c40f337d8 lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f337df expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508614.464786:0:202215:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a600/0xb126349c40f337d8 lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f337df expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.464811:0:202215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a600/0xb126349c40f337d8 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f337df expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.464817:0:202215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787508614.464845:0:202215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a600/0xb126349c40f337d8 lrc: 1/0,0 mode: --/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f337df expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.464853:0:202215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a600/0xb126349c40f337d8 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f337df expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.464869:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508614.464871:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508614.464872:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508614.464880:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787508614.464892:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d9b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480101120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508614.464924:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508614.464982:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480101120 00000100:00100000:1.0:1787508614.464986:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480101120 00010000:00010000:1.0:1787508614.465003:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f337df lrc: 5/0,0 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f337d8 expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.465025:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27830 00000100:00100000:1.0:1787508614.465031:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9b98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+7:3619:x1874324480101120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508614.465041:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787508614.465527:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9ff2900 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.465551:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d9b99180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480100992:0@lo:104: 00010000:00010000:1.0:1787508614.465570:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f338fe lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.468570:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.469509:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509502208 00000100:00100000:0.0:1787508614.469522:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509502208 00000100:00100000:0.0:1787508614.469597:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93758 00000100:00100000:0.0:1787508614.469608:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336056:x1874324509502208:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508614.469632:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508614.469658:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f33905 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x287:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae012 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.469721:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f3390c lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.469736:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f3390c lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.469747:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f3390c lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.470558:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f337df lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f337d8 expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.470579:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x287:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:1.0:1787508614.470585:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f338fe lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.470593:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f338fe lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.470599:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f338fe lrc: 4/1,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.470607:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f3390c lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.470618:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f3390c lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.470623:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f3390c lrc: 4/1,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.470704:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508614.470796:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9b98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480101120:12345-0@lo:103:ldlm_bl.0 Request processed in 5762us (5869us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.470806:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27830 00010000:00010000:3.0:1787508614.470870:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f338fe lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.470878:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f338fe lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508614.470932:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a2:0x287:0x0]: returning size 4096 00000004:00200000:3.0:1787508614.470966:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787508614.471010:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f338f7 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x287:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae00b expref: 585 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.471027:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f338fe lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae00b expref: 584 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.471035:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x287:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:3.0:1787508614.471038:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508614.471040:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b000, rc 0) 00000100:00100000:3.0:1787508614.471091:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d15afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336057:x1874324509502080:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 6660us (7575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.471098:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93757 00000100:00100000:2.0:1787508614.474140:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d9b9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480101120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508614.475535:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.475712:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509502464 00000100:00100000:3.0:1787508614.475723:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509502464 00000100:00100000:3.0:1787508614.475789:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93759 00000100:00100000:3.0:1787508614.475800:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:336057:x1874324509502464:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:3.0:1787508614.475854:0:209004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508614.475881:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b800/0xb126349c40f338c6 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfef expref: 644 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.475899:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d2:0x0].0x0 (ffff9090ce7ba600) 00010000:00010000:3.0:1787508614.475904:0:209004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508614.475927:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f33913 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.476035:0:209004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247bc00/0xb126349c40f338d4 lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadff6 expref: 6 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.476046:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f33913 lrc: 4/0,1 mode: --/PW res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.476080:0:209004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247bc00/0xb126349c40f338d4 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadff6 expref: 6 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.476095:0:209004:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247bc00/0xb126349c40f338d4 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadff6 expref: 6 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.476110:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3e300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:209004:1874324480101248:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508614.476225:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9e40 going to sleep for 11 seconds 00010000:00010000:0.0:1787508614.476503:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f3390c lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.476512:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f3390c lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508614.476561:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a2:0x287:0x0]: returning size 4096 00000004:00200000:0.0:1787508614.476566:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508614.476608:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f33905 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x287:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae012 expref: 14 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.476623:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f3390c lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae012 expref: 13 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.476631:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x287:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:0.0:1787508614.476634:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508614.476636:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6200, rc 0) 00000100:00100000:0.0:1787508614.476669:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336056:x1874324509502208:12345-192.168.201.30@tcp:101:rm.0 Request processed in 7063us (8110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508614.476677:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93758 00000100:00100000:1.0:1787508614.485674:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.485878:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509502720 00000100:00100000:2.0:1787508614.485889:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509502720 00000100:00100000:2.0:1787508614.485976:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93760 00000100:00100000:2.0:1787508614.485988:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9b99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:336056:x1874324509502720:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508614.486012:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.486036:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f3391a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae019 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508614.486218:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d2:0x0]: returning size 4096 00010000:00010000:2.0:1787508614.486319:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f3391a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae019 expref: 9 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.486333:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d36fd200) 00010000:00010000:2.0:1787508614.486336:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.486341:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f3391a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae019 expref: 9 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.486490:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abc00, rc 0) 00000100:00100000:2.0:1787508614.486545:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9b99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336056:x1874324509502720:12345-192.168.201.30@tcp:101:rm.0 Request processed in 561us (882us total) trans 8589962000 rc 301/301 00000100:00100000:2.0:1787508614.486552:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93760 00000100:00100000:2.0:1787508614.489984:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.490022:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.490088:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509502848 00000100:00100000:3.0:1787508614.490100:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509502848 00010000:00010000:3.0:1787508614.490150:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247bc00/0xb126349c40f338d4 lrc: 5/0,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadff6 expref: 8 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.490192:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27831 00000100:00100000:1.0:1787508614.490284:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509502976 00000100:00100000:1.0:1787508614.490288:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509502976 00000100:00100000:1.0:1787508614.490319:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93761 00000100:00100000:1.0:1787508614.490328:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:336056:x1874324509502976:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508614.490350:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.490429:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f33928 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae020 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.490527:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f3392f lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.490542:0:202227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f33913 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.490549:0:202227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f3392f lrc: 4/1,0 mode: --/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.490570:0:202227:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f33913 lrc: 4/0,1 mode: --/PW res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.490581:0:202227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f3392f lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.490633:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2401:x1874324509502848:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508614.490644:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508614.490650:0:225839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247bc00/0xb126349c40f338d4 lrc: 5/0,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadff6 expref: 10 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.490664:0:225839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247bc00/0xb126349c40f338d4 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadff6 expref: 10 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.490681:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d2:0x0].0x0 (ffff9090ce7ba600) 00010000:00010000:3.0:1787508614.490686:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f33913 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.490694:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f33913 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.490701:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f33913 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.490709:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f3392f lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.490714:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f3392f lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.490728:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508614.492038:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247bc00/0xb126349c40f338d4 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadff6 expref: 10 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.492060:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3e300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:209004:1874324480101248:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508614.492086:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f33913 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.492474:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f33913 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.492483:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f33913 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.492515:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f33936 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x291:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.492529:0:209004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa600/0xb126349c40f338e2 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadffd expref: 643 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.492538:0:209004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a000/0xb126349c40f338f0 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae004 expref: 9 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.492545:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f33936 lrc: 5/0,1 mode: --/PW res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.492578:0:209004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a000/0xb126349c40f338f0 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae004 expref: 9 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.492592:0:209004:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a000/0xb126349c40f338f0 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae004 expref: 9 pid: 205405 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.492610:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d9b9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:209004:1874324480101376:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508614.492695:0:209004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa600/0xb126349c40f338e2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadffd expref: 643 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.492705:0:209004:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa600/0xb126349c40f338e2 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadffd expref: 643 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.492714:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9acb100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:209004:1874324480101504:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508614.492732:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9ff2900 going to sleep for 11 seconds 00000100:00100000:3.0:1787508614.492854:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2401:x1874324509502848:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 2221us (2877us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.492864:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27831 00000100:00100000:2.0:1787508614.497507:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.497536:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.497648:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d9b9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:209004:1874324480101376:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508614.497662:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9acb100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:209004:1874324480101504:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508614.497688:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f33936 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.497874:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509503104 00000100:00100000:0.0:1787508614.497883:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509503104 00010000:00010000:0.0:1787508614.497923:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a000/0xb126349c40f338f0 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae004 expref: 9 pid: 205405 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.497986:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509503232 00000100:00100000:0.0:1787508614.497989:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509503232 00010000:00010000:0.0:1787508614.498005:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa600/0xb126349c40f338e2 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadffd expref: 644 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.498030:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27832 00000100:00100000:0.0:1787508614.498040:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2400:x1874324509503104:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508614.498056:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508614.498063:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a000/0xb126349c40f338f0 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae004 expref: 9 pid: 205405 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.498077:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a000/0xb126349c40f338f0 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae004 expref: 9 pid: 205405 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.498101:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a000/0xb126349c40f338f0 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae004 expref: 9 pid: 205405 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.498118:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x291:0x0].0x0 (ffff9090ce7bad00) 00010000:00010000:0.0:1787508614.498123:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f33936 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.498133:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f33936 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.498140:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508614.498271:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2400:x1874324509503104:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 232us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508614.498279:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27832 00000100:00100000:0.0:1787508614.498297:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27833 00000100:00100000:0.0:1787508614.498303:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:2400:x1874324509503232:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508614.498312:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508614.498316:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa600/0xb126349c40f338e2 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadffd expref: 644 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.498327:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa600/0xb126349c40f338e2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadffd expref: 644 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.498340:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa600/0xb126349c40f338e2 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadffd expref: 644 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.498350:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x291:0x0].0x0 (ffff9090ce7bad00) 00010000:00010000:0.0:1787508614.498354:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f33936 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.498372:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f33936 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.498380:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f33936 lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.498401:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508614.498419:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+643:2400:x1874324509503232:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 117us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508614.498426:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27833 00010000:00010000:0.0:1787508614.498545:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f33936 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.498553:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f33936 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.498597:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f3393d lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.498604:0:209004:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f3393d lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x0 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.498614:0:209004:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f3393d lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.498633:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d15ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480101632:0@lo:101:mdt00_005.0 00000100:00100000:0.0:1787508614.498673:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508614.498697:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88600 going to sleep for 11 seconds 00000100:00100000:3.0:1787508614.500180:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480101632 00000100:00100000:3.0:1787508614.500258:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480101632 00000100:00100000:3.0:1787508614.500355:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29673 00000100:00100000:3.0:1787508614.500374:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d15ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:209004:x1874324480101632:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1787508614.500395:0:225829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.500417:0:225829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33944 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f3393d expref: -99 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.500457:0:225829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f338fe lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae00b expref: 583 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.500466:0:225829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f3390c lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae012 expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.500474:0:225829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33944 lrc: 5/0,0 mode: --/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f3393d expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.500506:0:225829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f3390c lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae012 expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.500520:0:225829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f3390c lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae012 expref: 12 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.500533:0:225829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3dc00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480101760:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508614.500625:0:225829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f338fe lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae00b expref: 583 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.500635:0:225829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f338fe lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae00b expref: 583 pid: 205405 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.500649:0:225829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3d880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480101888:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508614.500671:0:225829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9840 going to sleep for 11 seconds 00000100:00100000:3.0:1787508614.503181:0:225829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3dc00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480101760:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508614.503209:0:225829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3d880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480101888:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508614.503247:0:225829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33944 lrc: 3/0,0 mode: --/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3393d expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.503260:0:225829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x287:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:3.0:1787508614.503263:0:225829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508614.503267:0:225829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33944 lrc: 3/0,0 mode: --/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3393d expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.503278:0:225829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33944 lrc: 3/0,0 mode: --/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3393d expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.503284:0:225829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fc00, rc 0) 00000100:00100000:3.0:1787508614.503349:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d15ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:209004:x1874324480101632:12345-0@lo:101:mdt00_005.0 Request processed in 2985us (4674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.503367:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29673 00000100:00100000:0.0:1787508614.503455:0:209004:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944063 gen 2 00000004:00080000:0.0:1787508614.503462:0:209004:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944063 committed transno 12884944063 00000100:00100000:0.0:1787508614.503489:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d15ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480101632:0@lo:101:mdt00_005.0 00010000:00010000:0.0:1787508614.503507:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f3393d lrc: 4/0,1 mode: --/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33944 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.503518:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f3393d lrc: 4/0,1 mode: --/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33944 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.506963:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.507071:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.507274:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509503488 00000100:00100000:2.0:1787508614.507283:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509503488 00010000:00010000:2.0:1787508614.507326:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f338fe lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae00b expref: 584 pid: 205405 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.507374:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509503360 00000100:00100000:2.0:1787508614.507377:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509503360 00010000:00010000:2.0:1787508614.507392:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f3390c lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae012 expref: 13 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.507425:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27834 00000100:00100000:2.0:1787508614.507436:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c1ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:2401:x1874324509503488:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508614.507462:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508614.507470:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f338fe lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae00b expref: 584 pid: 205405 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.507482:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f338fe lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae00b expref: 584 pid: 205405 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.507503:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f338fe lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae00b expref: 584 pid: 205405 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.507521:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x287:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:2.0:1787508614.507528:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33944 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3393d expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.507538:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33944 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3393d expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.507545:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508614.507597:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c1ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:2401:x1874324509503488:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 163us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.507605:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27834 00000100:00100000:2.0:1787508614.507653:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27835 00000100:00100000:2.0:1787508614.507660:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d15af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2401:x1874324509503360:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508614.507668:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508614.507675:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f3390c lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae012 expref: 13 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.507686:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f3390c lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae012 expref: 13 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.507700:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f3390c lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae012 expref: 13 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.507714:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x287:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:2.0:1787508614.507720:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33944 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3393d expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.507729:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33944 lrc: 2/0,0 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f3393d expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.507738:0:202212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33944 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f3393d expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.507775:0:202212:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33944 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3393d expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.507805:0:202212:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:202212:1874324480102016:0@lo:105: 00000100:00100000:2.0:1787508614.507849:0:202212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508614.507884:0:202212:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9000 going to sleep for 11 seconds 00000100:00100000:0.0:1787508614.508053:0:229363:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787508614.508064:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480102016 00000100:00100000:0.0:1787508614.508068:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480102016 00000100:00100000:0.0:1787508614.508096:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18150 00000100:00100000:0.0:1787508614.508102:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:202212:x1874324480102016:12345-0@lo:105: 00010000:00010000:0.0:1787508614.508113:0:229363:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f3393d lrc: 5/0,1 mode: --/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33944 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.508123:0:229363:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f3393d lrc: 5/0,1 mode: --/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33944 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.508131:0:229363:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f3393d lrc: 5/0,1 mode: --/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33944 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.508140:0:229363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f3393d lrc: 5/0,1 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f33944 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.508146:0:229363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f3393d lrc: 6/0,1 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f33944 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.508154:0:229363:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f3393d lrc: 6/0,1 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f33944 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.508176:0:229363:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d56f6c00) 00000100:00100000:0.0:1787508614.508228:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:202212:x1874324480102016:12345-0@lo:105: Request processed in 125us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508614.508235:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18150 00000100:00100000:0.0:1787508614.508292:0:202212:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:202212:1874324480102016:0@lo:105: 00010000:00010000:0.0:1787508614.508305:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508614.508328:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d15af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2401:x1874324509503360:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 669us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508614.508335:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27835 00010000:00010000:0.0:1787508614.508366:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f3393d lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33944 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.508375:0:209004:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f3393d lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33944 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787508614.508620:0:209004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xf:0x0].43, 344 off77576 00000040:00080000:0.0:1787508614.508688:0:209004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x5:0x0].586, 552 off743432 00000004:00080000:0.0:1787508614.508694:0:209004:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d1c88e40 with version 13597 00000004:00080000:2.0:1787508614.511738:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13597 rpc_version 13597 00000020:00100000:2.0:1787508614.511799:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787508614.511812:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d1cbd880 x1874324480102272/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1528/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787508614.511838:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbd880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480102272:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508614.511913:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508614.511985:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508614.512122:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480102272 00000100:00100000:3.0:1787508614.512131:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480102272 00000100:00100000:3.0:1787508614.512185:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29674 00000100:00100000:3.0:1787508614.512205:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:202961:x1874324480102272:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508614.512465:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:202961:x1874324480102272:12345-0@lo:1000:osp_up0-1.0 Request processed in 271us (552us total) trans 12884944064 rc 0/0 00000100:00100000:3.0:1787508614.512476:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29674 00000100:00100000:0.0:1787508614.512593:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbd880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480102272:0@lo:1000:osp_up0-1.0 00000004:00010000:3.0:1787508614.512727:0:209004:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc5ec785 reply state 000000001fb76249 transno 8589962001 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f33936 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.512750:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f33936 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.512761:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x291:0x0].0x0 (ffff9090ce7bad00) 00010000:00010000:3.0:1787508614.512765:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787508614.512769:0:209004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787508614.512788:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f3393d lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33944 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.512799:0:209004:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f3393d lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33944 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787508614.512811:0:209004:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x287:0x0] 00000004:00010000:3.0:1787508614.512820:0:209004:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc5ec785 reply state 000000001fb76249 transno 8589962001 ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f33913 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.512830:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f33913 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.512836:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d2:0x0].0x0 (ffff9090ce7ba600) 00010000:00010000:3.0:1787508614.512839:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508614.512842:0:209004:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f3392f lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.512852:0:209004:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f3392f lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.512864:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f3392f lrc: 4/1,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.512893:0:209004:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787508614.512904:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d2:0x0]: returning size 4096 00000100:00100000:3.0:1787508614.513001:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:336057:x1874324509502464:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 37201us (37471us total) trans 8589962001 rc 0/0 00000100:00100000:3.0:1787508614.513009:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93759 00010000:00010000:0.0:1787508614.513256:0:202227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f3392f lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.513265:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f3392f lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508614.513377:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d2:0x0]: returning size 4096 00000004:00200000:0.0:1787508614.513383:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1787508614.513399:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f3392f lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.513432:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f33928 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae020 expref: 8 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.513465:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f3392f lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae020 expref: 7 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.513474:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d2:0x0].0x0 (ffff9090ce7ba600) 00010000:00010000:0.0:1787508614.513477:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508614.513480:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b200, rc 0) 00000100:00100000:0.0:1787508614.513510:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:336056:x1874324509502976:12345-192.168.201.30@tcp:101:rm.0 Request processed in 23184us (23488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508614.513516:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93761 00000100:00100000:0.0:1787508614.516408:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.516586:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509503616 00000100:00100000:3.0:1787508614.516597:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509503616 00000100:00100000:3.0:1787508614.516659:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93762 00000100:00100000:3.0:1787508614.516671:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d15ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:336056:x1874324509503616:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508614.516691:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.516711:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f3394b lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x291:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae027 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.516769:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f33952 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.516785:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f33952 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.516798:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f33952 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508614.516848:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x291:0x0]: returning size 4096 00000004:00200000:3.0:1787508614.516853:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787508614.516891:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f3394b lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x291:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae027 expref: 9 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.516917:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f33952 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae027 expref: 8 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.516926:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x291:0x0].0x0 (ffff9090ce7bad00) 00010000:00010000:3.0:1787508614.516929:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508614.516933:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f200, rc 0) 00000100:00100000:3.0:1787508614.517017:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d15ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336056:x1874324509503616:12345-192.168.201.30@tcp:101:rm.0 Request processed in 348us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.517025:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93762 00000100:00100000:3.0:1787508614.519531:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.519645:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509503744 00000100:00100000:2.0:1787508614.519656:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509503744 00000100:00100000:2.0:1787508614.519726:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93763 00000100:00100000:2.0:1787508614.519738:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336056:x1874324509503744:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508614.519759:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.519780:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33959 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x287:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae02e expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.519840:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33960 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.519855:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33944 lrc: 2/0,0 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3393d expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.519864:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33960 lrc: 4/1,0 mode: --/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.519897:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33944 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f3393d expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.519912:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbc380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480102400:0@lo:104: 00000100:00100000:2.0:1787508614.519992:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508614.520035:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9840 going to sleep for 11 seconds 00000100:00100000:3.0:1787508614.520401:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480102400 00000100:00100000:3.0:1787508614.520407:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480102400 00000100:00100000:3.0:1787508614.520464:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18151 00000100:00100000:3.0:1787508614.520473:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:230618:x1874324480102400:12345-0@lo:104: 00010000:00010000:3.0:1787508614.520488:0:202209:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f3393d lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f33944 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.520558:0:202209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787508614.520566:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:230618:x1874324480102400:12345-0@lo:104: Request processed in 94us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.520573:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18151 00000100:00100000:2.0:1787508614.520739:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbc380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480102400:0@lo:104: 00010000:00010000:2.0:1787508614.520758:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33960 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.520995:0:202214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508614.521004:0:202214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f3393d lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f33944 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.521012:0:202214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6c00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:0.0:1787508614.521018:0:202214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f3393d lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f33944 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508614.521028:0:202214:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f3393d lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f33944 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.521063:0:202214:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f3393d lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33944 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.521075:0:202214:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787508614.521102:0:202214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f3393d lrc: 1/0,0 mode: --/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33944 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.521110:0:202214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f3393d lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33944 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.521135:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508614.521137:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508614.521139:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508614.521200:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d15adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480102528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787508614.521241:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508614.521383:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480102528 00000100:00100000:0.0:1787508614.521388:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480102528 00010000:00010000:0.0:1787508614.521413:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33944 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f3393d expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.521455:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27836 00000100:00100000:0.0:1787508614.521462:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3619:x1874324480102528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508614.521472:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1787508614.522805:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944064 is committed 00010000:00010000:2.0:1787508614.534585:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33944 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f3393d expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.534618:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x287:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:2.0:1787508614.534624:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33960 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.534634:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33960 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.534641:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33960 lrc: 4/1,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.534954:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508614.535049:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480102528:12345-0@lo:103:ldlm_bl.0 Request processed in 13585us (13805us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.535060:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27836 00000100:00100000:0.0:1787508614.535200:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d15adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480102528:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508614.535526:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33960 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.535536:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33960 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508614.535601:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a2:0x287:0x0]: returning size 4096 00000004:00200000:2.0:1787508614.535607:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787508614.535654:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33959 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x287:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae02e expref: 14 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.535671:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33960 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae02e expref: 13 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.535680:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x287:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:2.0:1787508614.535683:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508614.535686:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aae00, rc 0) 00000100:00100000:2.0:1787508614.535746:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336056:x1874324509503744:12345-192.168.201.30@tcp:101:rm.0 Request processed in 16010us (16225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.535755:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93763 00000100:00100000:0.0:1787508614.544121:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.544227:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509504000 00000100:00100000:2.0:1787508614.544238:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509504000 00000100:00100000:2.0:1787508614.544304:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93764 00000100:00100000:2.0:1787508614.544314:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d15adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336058:x1874324509504000:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508614.544336:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.544357:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33967 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae035 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.544454:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3396e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.544471:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3396e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.544484:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3396e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.544500:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f33975 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.544506:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f33975 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.544513:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f33975 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.544574:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3396e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.544587:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3396e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.544594:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3396e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.544602:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3396e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.544608:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.544613:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3396e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.544620:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3396e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.544633:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.544637:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.544641:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3396e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.544647:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3396e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.544662:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f33975 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.544668:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f33975 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.544674:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f33975 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.544680:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.544683:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f33975 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.544689:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f33975 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.544695:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xce5b6a33 (ffff9090d36fd200) 00010000:00010000:2.0:1787508614.544698:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.544701:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f33975 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.544707:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f33975 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.544739:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33967 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae035 expref: 584 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.544749:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.544752:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.544756:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33967 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae035 expref: 584 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.544765:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abc00, rc 0) 00000100:00100000:2.0:1787508614.544829:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d15adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336058:x1874324509504000:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 515us (721us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508614.544837:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93764 00000100:00100000:0.0:1787508614.548125:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.548226:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509504128 00000100:00100000:3.0:1787508614.548237:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509504128 00000100:00100000:3.0:1787508614.548301:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15401 00000100:00100000:3.0:1787508614.548313:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d15ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336056:x1874324509504128:12345-192.168.201.30@tcp:37:rm.0 00000100:00100000:1.0:1787508614.552070:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d15ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336056:x1874324509504128:12345-192.168.201.30@tcp:37:rm.0 Request processed in 3749us (3946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.552084:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15401 00000100:00100000:0.0:1787508614.559861:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.559911:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.560030:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509504512 00000100:00100000:3.0:1787508614.560041:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509504512 00000100:00100000:3.0:1787508614.560108:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93765 00000100:00100000:3.0:1787508614.560120:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d15ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336058:x1874324509504512:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508614.560144:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.560170:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3397c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae03c expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.560259:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33983 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.560273:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33983 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.560284:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33983 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.560299:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3398a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.560307:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3398a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.560314:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3398a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.560383:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33983 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.560392:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33983 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.560399:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33983 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.560406:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33983 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.560411:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.560416:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33983 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.560424:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33983 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.560438:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.560441:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.560458:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33983 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.560465:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33983 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.560481:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3398a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.560488:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3398a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.560494:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3398a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.560499:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.560502:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3398a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.560512:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3398a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.560519:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaf7dd568 (ffff9090ccb87200) 00010000:00010000:3.0:1787508614.560521:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.560524:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3398a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.560530:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3398a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.560562:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3397c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae03c expref: 584 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.560572:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.560575:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508614.560578:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3397c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae03c expref: 584 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.560588:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fa00, rc 0) 00000100:00100000:3.0:1787508614.560660:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d15ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336058:x1874324509504512:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 541us (747us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508614.560668:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93765 00000100:00100000:1.0:1787508614.561296:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509504256 00000100:00100000:1.0:1787508614.561305:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509504256 00000100:00100000:1.0:1787508614.561353:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15402 00000100:00100000:1.0:1787508614.561371:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d15ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336056:x1874324509504256:12345-192.168.201.30@tcp:37:rm.0 00000100:00100000:1.0:1787508614.565622:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d15ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336056:x1874324509504256:12345-192.168.201.30@tcp:37:rm.0 Request processed in 4242us (5761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.565635:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15402 00000100:00100000:1.0:1787508614.568621:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.568669:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509504768 00000100:00100000:1.0:1787508614.568675:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.568680:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509504768 00000100:00100000:0.0:1787508614.568746:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93766 00000100:00100000:0.0:1787508614.568757:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336058:x1874324509504768:12345-192.168.201.30@tcp:101:lfs.0 00000100:00100000:2.0:1787508614.568813:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509505024 00000100:00100000:2.0:1787508614.568819:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509505024 00010000:00010000:0.0:1787508614.568881:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1787508614.568886:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15403 00000100:00100000:2.0:1787508614.568894:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336056:x1874324509505024:12345-192.168.201.30@tcp:35:rm.0 00010000:00010000:0.0:1787508614.568902:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f33991 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae043 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.568985:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33998 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.568999:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33998 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.569009:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33998 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.569024:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3399f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.569032:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3399f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.569038:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3399f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.569099:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33998 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.569107:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33998 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.569113:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33998 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.569124:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33998 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.569131:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.569135:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33998 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.569142:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33998 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.569154:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.569157:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.569161:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33998 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.569166:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33998 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.569177:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3399f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.569182:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3399f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.569187:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3399f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.569191:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.569194:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3399f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.569204:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3399f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.569211:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3e9f33b0 (ffff9090e460f100) 00010000:00010000:0.0:1787508614.569213:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.569216:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3399f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.569221:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3399f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.569250:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f33991 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae043 expref: 584 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.569261:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.569263:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508614.569266:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f33991 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae043 expref: 584 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.569274:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6400, rc 0) 00000100:00100000:3.0:1787508614.569335:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:336056:x1874324509505024:12345-192.168.201.30@tcp:35:rm.0 Request processed in 441us (658us total) trans 8589962002 rc 0/0 00000100:00100000:0.0:1787508614.569335:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336058:x1874324509504768:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 579us (720us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508614.569342:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93766 00000100:00100000:3.0:1787508614.569343:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15403 00000100:00100000:0.0:1787508614.571920:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.572139:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509505152 00000100:00100000:2.0:1787508614.572152:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509505152 00000100:00100000:1.0:1787508614.572624:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.572631:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93767 00000100:00100000:3.0:1787508614.572643:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d15aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336056:x1874324509505152:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508614.572666:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1787508614.572685:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509505408 00010000:00010000:3.0:1787508614.572688:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f339a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae04a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.572690:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509505408 00000100:00100000:0.0:1787508614.572730:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93768 00000100:00100000:0.0:1787508614.572737:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336058:x1874324509505408:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508614.572746:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.572750:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f339ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.572753:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f339b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae051 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.572764:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f339ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.572774:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f339ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.572804:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f339bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.572813:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f339bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.572821:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f339bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.572835:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f339c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.572840:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f339c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.572846:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f339c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.572905:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f339bb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.572913:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f339bb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.572918:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f339bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.572925:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f339bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.572931:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.572935:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f339bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.572962:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f339bb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.572968:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f339c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.572975:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f339c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.572975:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.572977:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.572982:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f339c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.572982:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f339bb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.572989:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f339bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.573002:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f339c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.573008:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f339c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.573013:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f339c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.573017:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f339d0 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.573019:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.573022:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f339c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.573025:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f339d0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.573028:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f339c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.573032:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f339d0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.573039:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ad43c78 (ffff9090e460f300) 00010000:00010000:0.0:1787508614.573042:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.573044:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f339c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.573049:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f339c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508614.573055:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f339d0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.573065:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f339ad lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.573071:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f339ad lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.573077:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f339ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.573082:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f339ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.573578:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.573582:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f339b4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae051 expref: 584 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.573583:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f339ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.573592:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f339ad lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.573595:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.573597:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508614.573601:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f339b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae051 expref: 584 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.573602:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.573604:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.573607:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f339ad lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.573612:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6c00, rc 0) 00010000:00010000:3.0:1787508614.573613:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f339ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.573622:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f339c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.573628:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f339c9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.573633:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f339c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.573637:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.573639:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f339c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.573644:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f339c9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.573650:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090ccb87200) 00010000:00010000:3.0:1787508614.573652:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.573654:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f339c9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.573658:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f339c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.573682:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f339a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae04a expref: 15 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.573694:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f339d0 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae04a expref: 14 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.573701:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d2:0x0].0x0 (ffff9090ccb87700) 00010000:00010000:3.0:1787508614.573703:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508614.573706:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ea00, rc 0) 00000100:00100000:0.0:1787508614.573721:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336058:x1874324509505408:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 983us (1097us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508614.573725:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d15aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336056:x1874324509505152:12345-192.168.201.30@tcp:101:rm.0 Request processed in 1086us (1818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508614.573729:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93768 00000100:00100000:3.0:1787508614.573732:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93767 00000100:00100000:1.0:1787508614.576928:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.577158:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.577192:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.577219:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509505664 00000100:00100000:0.0:1787508614.577228:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509505664 00000100:00100000:0.0:1787508614.577299:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9779 00000100:00100000:0.0:1787508614.577307:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9b9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2400:x1874324509505664:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508614.577322:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508614.577346:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f339d0 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae04a expref: 14 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.577379:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d2:0x0].0x0 (ffff9090ccb87700) 00010000:00010000:0.0:1787508614.577383:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508614.577432:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9b9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2400:x1874324509505664:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 126us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508614.577439:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9779 00000100:00100000:2.0:1787508614.577711:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509505536 00000100:00100000:2.0:1787508614.577716:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509505536 00000100:00100000:2.0:1787508614.577879:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509505920 00000100:00100000:2.0:1787508614.577883:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509505920 00000100:00100000:2.0:1787508614.577917:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93769 00000100:00100000:3.0:1787508614.577922:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93770 00000100:00100000:2.0:1787508614.577924:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:336056:x1874324509505536:12345-192.168.201.30@tcp:101:rm.0 00000100:00100000:3.0:1787508614.577930:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336058:x1874324509505920:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508614.577965:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.577983:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f339d7 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae058 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.578004:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.578015:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f339de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae05f expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.578040:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f339e5 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.578053:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f339e5 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.578059:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f339ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.578063:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f339e5 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.578066:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f339ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.578073:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f339ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.578086:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f339f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.578091:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f339f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.578097:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f339f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.578142:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f339ec lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508614.578148:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d2:0x0]: returning size 4096 00010000:00010000:3.0:1787508614.578153:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f339ec lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508614.578153:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787508614.578159:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f339ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.578165:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f339ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.578172:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.578176:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f339ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.578182:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f339ec lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.578191:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.578194:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.578196:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f339d7 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae058 expref: 11 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.578197:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f339ec lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.578204:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f339ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.578213:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f339f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.578214:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f339e5 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae058 expref: 10 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.578220:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f339f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.578223:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d2:0x0].0x0 (ffff9090ce7ba600) 00010000:00010000:2.0:1787508614.578225:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508614.578227:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f339f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.578229:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab200, rc 0) 00010000:00010000:3.0:1787508614.578233:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.578235:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f339f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.578241:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f339f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.578247:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbfff8436 (ffff9090ccb87c00) 00010000:00010000:3.0:1787508614.578249:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.578252:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f339f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.578257:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f339f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.578274:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:336056:x1874324509505536:12345-192.168.201.30@tcp:101:rm.0 Request processed in 351us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.578280:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93769 00010000:00010000:3.0:1787508614.578281:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f339de lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae05f expref: 584 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.578289:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.578290:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508614.578293:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f339de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae05f expref: 584 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.578302:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fc00, rc 0) 00000100:00100000:3.0:1787508614.578323:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336058:x1874324509505920:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 394us (1130us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508614.578329:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93770 00000100:00100000:1.0:1787508614.581118:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.581276:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509506304 00000100:00100000:2.0:1787508614.581287:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509506304 00000100:00100000:2.0:1787508614.581458:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93771 00000100:00100000:2.0:1787508614.581472:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:336056:x1874324509506304:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1787508614.581524:0:205405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787508614.581552:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f339e5 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae058 expref: 10 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.581577:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f3392f lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae020 expref: 9 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.581590:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d2:0x0].0x0 (ffff9090ce7ba600) 00010000:00010000:2.0:1787508614.581596:0:205405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508614.581652:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aac00/0xb126349c40f339fa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.581661:0:205405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aac00/0xb126349c40f339fa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.581671:0:205405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aac00/0xb126349c40f339fa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.581696:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbe300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480102656:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1787508614.581750:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508614.582302:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9480 going to sleep for 11 seconds 00000100:00100000:3.0:1787508614.582423:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.582426:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480102656 00000100:00100000:1.0:1787508614.582432:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480102656 00000100:00100000:1.0:1787508614.582478:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29675 00000100:00100000:0.0:1787508614.582509:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509506560 00000100:00100000:0.0:1787508614.582514:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509506560 00000100:00100000:0.0:1787508614.582549:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93772 00000100:00100000:0.0:1787508614.582557:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336058:x1874324509506560:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508614.582572:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508614.582589:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f33a01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae066 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.582639:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33a08 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.582653:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33a08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.582666:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33a08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.582680:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33a0f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.582685:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33a0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.582692:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33a0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.582744:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33a08 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.582748:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33a08 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.582752:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33a08 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.582756:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33a08 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.582760:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.582763:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33a08 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.582767:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33a08 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.582774:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.582776:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.582779:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33a08 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.582786:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33a08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.582798:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33a0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.582804:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33a0f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.582810:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33a0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.582815:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.582818:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33a0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.582823:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33a0f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.582831:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x594a0ca2 (ffff9090e460f100) 00010000:00010000:0.0:1787508614.582833:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.582836:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33a0f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.582842:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33a0f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.582875:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f33a01 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae066 expref: 584 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.582882:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.582884:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508614.582886:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f33a01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae066 expref: 584 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.582897:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6400, rc 0) 00000100:00100000:0.0:1787508614.582978:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336058:x1874324509506560:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 421us (554us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508614.582986:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93772 00000100:00100000:1.0:1787508614.583056:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:205405:x1874324480102656:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1787508614.583071:0:202231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.583082:0:202231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33a16 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f339fa expref: -99 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.583096:0:202231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f337c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfa2 expref: 12 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.583102:0:202231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33802 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfb0 expref: 582 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.583107:0:202231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33a16 lrc: 5/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f339fa expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.583137:0:202231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33802 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfb0 expref: 582 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.583149:0:202231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33802 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfb0 expref: 582 pid: 202226 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.583158:0:202231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d021b800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480102784:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508614.583202:0:202231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f337c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfa2 expref: 12 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.583208:0:202231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f337c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfa2 expref: 12 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.583213:0:202231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0218380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480102912:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508614.583225:0:202231:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9ff2900 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.584504:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.586366:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.586455:0:202231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d021b800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480102784:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508614.586471:0:202231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0218380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480102912:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508614.586503:0:202231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33a16 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f339fa expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.586516:0:202231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.586519:0:202231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.586524:0:202231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33a16 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f339fa expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.586536:0:202231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247bc00, rc 0) 00000100:00100000:1.0:1787508614.586604:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:205405:x1874324480102656:12345-0@lo:101:mdt00_004.0 Request processed in 4119us (4852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.586613:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29675 00000100:00100000:0.0:1787508614.586711:0:205405:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944064 gen 2 00000004:00080000:0.0:1787508614.586716:0:205405:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944064 committed transno 12884944064 00000100:00100000:0.0:1787508614.586733:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbe300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480102656:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1787508614.586746:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aac00/0xb126349c40f339fa lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33a16 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.586753:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aac00/0xb126349c40f339fa lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33a16 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.587680:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509506048 00000100:00100000:2.0:1787508614.587691:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509506048 00000100:00100000:2.0:1787508614.587739:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509506816 00000100:00100000:2.0:1787508614.587743:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509506816 00010000:00010000:2.0:1787508614.587758:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f337c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfa2 expref: 14 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.587786:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27837 00000100:00100000:2.0:1787508614.587795:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2401:x1874324509506816:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508614.587811:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508614.587817:0:229383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f337c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfa2 expref: 14 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.587828:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f337c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfa2 expref: 14 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.587849:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f337c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfa2 expref: 14 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.587859:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9780 00010000:00010000:2.0:1787508614.587865:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00000100:00100000:3.0:1787508614.587868:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2401:x1874324509506048:12345-192.168.201.30@tcp:103:rm.0 00010000:00010000:2.0:1787508614.587871:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33a16 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f339fa expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.587876:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508614.587880:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508614.587886:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f338b1 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfe8 expref: 13 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.587895:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d2:0x0].0x0 (ffff9090ccb87700) 00010000:00010000:3.0:1787508614.587898:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508614.587987:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2401:x1874324509506048:12345-192.168.201.30@tcp:103:rm.0 Request processed in 120us (3490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.587988:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2401:x1874324509506816:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 194us (1630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.587995:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9780 00000100:00100000:1.0:1787508614.588088:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.588141:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.588174:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509506944 00000100:00100000:3.0:1787508614.588178:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509506944 00000100:00100000:3.0:1787508614.588208:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93773 00000100:00100000:3.0:1787508614.588215:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336058:x1874324509506944:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508614.588230:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.588243:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33a1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae06d expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.588588:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509506688 00000100:00100000:0.0:1787508614.588593:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509506688 00010000:00010000:0.0:1787508614.588612:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33802 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfb0 expref: 585 pid: 202226 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.588673:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33a24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.588686:0:203348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33a16 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f339fa expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.588694:0:203348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33a24 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.588734:0:203348:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33a16 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xb126349c40f339fa expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.588747:0:203348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33a24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.589091:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27837 00000100:00100000:0.0:1787508614.589175:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27838 00000100:00100000:0.0:1787508614.589185:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0218380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:2401:x1874324509506688:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508614.589258:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508614.589266:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33802 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfb0 expref: 585 pid: 202226 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.589279:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33802 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfb0 expref: 585 pid: 202226 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.589297:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33802 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfb0 expref: 585 pid: 202226 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.589310:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.589315:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33a24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.589324:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33a16 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xb126349c40f339fa expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.589332:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33a16 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xb126349c40f339fa expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.589339:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33a16 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xb126349c40f339fa expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.589346:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33a24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.589352:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33a24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.589439:0:202211:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33a16 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xb126349c40f339fa expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.589464:0:202211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091c945b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:202211:1874324480103168:0@lo:105: 00000100:00100000:0.0:1787508614.589515:0:202211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508614.589594:0:202211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787508614.589633:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480103168 00000100:00100000:2.0:1787508614.589638:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480103168 00000100:00100000:2.0:1787508614.589706:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18152 00000100:00100000:2.0:1787508614.589713:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d13bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:202211:x1874324480103168:12345-0@lo:105: 00010000:00010000:2.0:1787508614.589724:0:229363:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aac00/0xb126349c40f339fa lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33a16 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.589732:0:229363:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aac00/0xb126349c40f339fa lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33a16 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.589740:0:229363:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aac00/0xb126349c40f339fa lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33a16 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.589749:0:229363:0:(ldlm_lockd.c:2058:ldlm_handle_cp_callback()) ### completion AST includes blocking AST ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aac00/0xb126349c40f339fa lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xb126349c40f33a16 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.589756:0:229363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aac00/0xb126349c40f339fa lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xb126349c40f33a16 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.589763:0:229363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aac00/0xb126349c40f339fa lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xb126349c40f33a16 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.589771:0:229363:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aac00/0xb126349c40f339fa lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1480400000000 nid: local remote: 0xb126349c40f33a16 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.589923:0:229363:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090cd2aac00) 00000100:00100000:2.0:1787508614.589999:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d13bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:202211:x1874324480103168:12345-0@lo:105: Request processed in 286us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.590006:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18152 00000100:00100000:1.0:1787508614.590082:0:202211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091c945b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:202211:1874324480103168:0@lo:105: 00010000:00010000:1.0:1787508614.590102:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508614.590148:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0218380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:2401:x1874324509506688:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 965us (2058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.590156:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27838 00010000:00010000:3.0:1787508614.590555:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aac00/0xb126349c40f339fa lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f33a16 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.590565:0:205405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aac00/0xb126349c40f339fa lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f33a16 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787508614.590587:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1787508614.590620:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f33a2b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.590625:0:205405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f33a2b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.590632:0:205405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f33a2b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.590644:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480103296:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1787508614.590669:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508614.590684:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9180 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.591641:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480103296 00000100:00100000:1.0:1787508614.591651:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480103296 00000100:00100000:1.0:1787508614.591697:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29676 00000100:00100000:1.0:1787508614.591706:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:205405:x1874324480103296:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1787508614.591724:0:203182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.591742:0:203182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33a32 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f33a2b expref: -99 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.591766:0:203182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33a32 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f33a2b expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.591777:0:203182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33a32 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33a2b expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.591801:0:203182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090c5b0c800) 00010000:00010000:1.0:1787508614.591804:0:203182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.591807:0:203182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a400, rc 0) 00000100:00100000:1.0:1787508614.591861:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480103296:12345-0@lo:101:mdt00_004.0 Request processed in 156us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.591867:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29676 00000100:00100000:3.0:1787508614.591888:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480103296:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1787508614.591906:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f33a2b lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33a32 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.591921:0:205405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f33a2b lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33a32 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787508614.591965:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1787508614.592054:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d13bd180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480103424:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508614.592088:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508614.592112:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88540 going to sleep for 11 seconds 00000100:00100000:3.0:1787508614.592118:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480103424 00000100:00100000:3.0:1787508614.592122:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480103424 00000100:00100000:3.0:1787508614.592153:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29677 00000100:00100000:3.0:1787508614.592160:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480103424:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508614.592242:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480103424:12345-0@lo:1000:mdt00_004.0 Request processed in 83us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.592250:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29677 00000100:00100000:0.0:1787508614.592264:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d13bd180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480103424:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508614.592306:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b39880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480103552:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508614.592330:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508614.592351:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88540 going to sleep for 11 seconds 00000100:00100000:3.0:1787508614.592464:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480103552 00000100:00100000:3.0:1787508614.592468:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480103552 00000100:00100000:3.0:1787508614.592499:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29678 00000100:00100000:3.0:1787508614.592506:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d13bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480103552:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508614.592591:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d13bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480103552:12345-0@lo:1000:mdt00_004.0 Request processed in 85us (259us total) trans 0 rc 1/1 00000100:00100000:3.0:1787508614.592597:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29678 00000100:00100000:0.0:1787508614.592616:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b39880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480103552:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1787508614.592662:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f33a39 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.592670:0:205405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f33a39 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.592679:0:205405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f33a39 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.592691:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b39880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480103680:0@lo:101:mdt00_004.0 00000100:00100000:0.0:1787508614.592710:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508614.592755:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88000 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.592925:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480103680 00000100:00100000:1.0:1787508614.592929:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480103680 00000100:00100000:1.0:1787508614.593069:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29679 00000100:00100000:1.0:1787508614.593077:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480103680:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1787508614.593086:0:202231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.593101:0:202231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33a40 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f33a39 expref: -99 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.593122:0:202231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f338b8 lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfe1 expref: 583 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.593133:0:202231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33a40 lrc: 4/0,0 mode: --/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f33a39 expref: 9 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.593155:0:202231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f338b8 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfe1 expref: 583 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.593167:0:202231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f338b8 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfe1 expref: 583 pid: 230618 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.593180:0:202231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d021b100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480103808:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508614.593343:0:202231:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9ff2900 going to sleep for 11 seconds 00000100:00100000:2.0:1787508614.595931:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.596501:0:202231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d021b100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480103808:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508614.596538:0:202231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33a40 lrc: 3/0,0 mode: --/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33a39 expref: 9 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.596552:0:202231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d2:0x0].0x0 (ffff9090ccb87700) 00010000:00010000:1.0:1787508614.596555:0:202231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508614.596559:0:202231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33a40 lrc: 3/0,0 mode: --/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33a39 expref: 9 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.596572:0:202231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ac00, rc 0) 00000100:00100000:1.0:1787508614.596683:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:205405:x1874324480103680:12345-0@lo:101:mdt00_004.0 Request processed in 3606us (3969us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.596691:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29679 00000100:00100000:3.0:1787508614.596764:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509507072 00000100:00100000:0.0:1787508614.596769:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b39880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480103680:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1787508614.596772:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509507072 00010000:00010000:3.0:1787508614.596806:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f338b8 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfe1 expref: 584 pid: 230618 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.596850:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27839 00000100:00100000:3.0:1787508614.596860:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091cc030850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:2400:x1874324509507072:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508614.596876:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508614.596882:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f338b8 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfe1 expref: 584 pid: 230618 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.596894:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f338b8 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfe1 expref: 584 pid: 230618 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.596915:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f338b8 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaadfe1 expref: 584 pid: 230618 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.596928:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d2:0x0].0x0 (ffff9090ccb87700) 00010000:00010000:3.0:1787508614.596933:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33a40 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33a39 expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.596968:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33a40 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f33a39 expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.596978:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33a40 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f33a39 expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.597007:0:205406:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33a40 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33a39 expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.597021:0:205406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:205406:1874324480103936:0@lo:105: 00000100:00100000:3.0:1787508614.597056:0:205406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787508614.597079:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f33a39 lrc: 4/0,1 mode: --/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33a40 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.597090:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f33a39 lrc: 4/0,1 mode: --/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33a40 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.597092:0:205406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9180 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.597138:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480103936 00000100:00100000:1.0:1787508614.597142:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480103936 00000100:00100000:1.0:1787508614.597172:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18153 00000100:00100000:1.0:1787508614.597178:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:205406:x1874324480103936:12345-0@lo:105: 00010000:00010000:1.0:1787508614.597188:0:202209:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f33a39 lrc: 5/0,1 mode: --/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33a40 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.597261:0:202209:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f33a39 lrc: 5/0,1 mode: --/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33a40 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.597273:0:202209:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f33a39 lrc: 5/0,1 mode: --/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33a40 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.597281:0:202209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f33a39 lrc: 5/0,1 mode: EX/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f33a40 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.597287:0:202209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f33a39 lrc: 6/0,1 mode: EX/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f33a40 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.597296:0:202209:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f33a39 lrc: 6/0,1 mode: EX/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f33a40 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.597321:0:202209:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d56f6400) 00000100:00100000:1.0:1787508614.597419:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:205406:x1874324480103936:12345-0@lo:105: Request processed in 240us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.597425:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18153 00010000:00010000:2.0:1787508614.597485:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f33a39 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33a40 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.597494:0:205405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f33a39 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33a40 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.597528:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f33a47 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.597540:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f33a47 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.597547:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f33a47 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.597565:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f33a4e lrc: 3/0,1 mode: --/EX res: [0x240000bd1:0x291:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.597573:0:205405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f33952 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae027 expref: 8 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.597580:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f33a4e lrc: 4/0,1 mode: --/EX res: [0x240000bd1:0x291:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.597606:0:205405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f33952 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae027 expref: 8 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.597619:0:205405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f33952 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae027 expref: 8 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.597629:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbd180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:205405:1874324480104064:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508614.597722:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9840 going to sleep for 11 seconds 00000100:00100000:3.0:1787508614.597809:0:205406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:205406:1874324480103936:0@lo:105: 00010000:00010000:3.0:1787508614.597827:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508614.597849:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091cc030850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:2400:x1874324509507072:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 992us (1932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.597858:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27839 00000100:00100000:0.0:1787508614.600808:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbd180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:205405:1874324480104064:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508614.600839:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f33a4e lrc: 3/0,1 mode: --/EX res: [0x240000bd1:0x291:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.602559:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.602742:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509507200 00000100:00100000:3.0:1787508614.602751:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509507200 00010000:00010000:3.0:1787508614.602801:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f33952 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae027 expref: 9 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.602840:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27840 00000100:00100000:3.0:1787508614.602851:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2402:x1874324509507200:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508614.602866:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508614.602872:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f33952 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae027 expref: 9 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.602885:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f33952 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae027 expref: 9 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.602906:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f33952 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae027 expref: 9 pid: 203348 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.602920:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x291:0x0].0x0 (ffff9090ce7bad00) 00010000:00010000:3.0:1787508614.602925:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f33a4e lrc: 3/0,1 mode: --/EX res: [0x240000bd1:0x291:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.602934:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f33a4e lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x291:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.602985:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f33a4e lrc: 4/0,1 mode: EX/EX res: [0x240000bd1:0x291:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.603013:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508614.603059:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2402:x1874324509507200:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 211us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.603066:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27840 00010000:00010000:0.0:1787508614.603142:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f33a4e lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x291:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.603149:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f33a4e lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x291:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.603195:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f33a55 lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.603202:0:205405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f33a55 lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.603211:0:205405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f33a55 lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.603230:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1514700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480104192:0@lo:101:mdt00_004.0 00000100:00100000:0.0:1787508614.603272:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508614.603308:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88000 going to sleep for 11 seconds 00000100:00100000:3.0:1787508614.603726:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480104192 00000100:00100000:3.0:1787508614.603733:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480104192 00000100:00100000:3.0:1787508614.603775:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29680 00000100:00100000:3.0:1787508614.603783:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:205405:x1874324480104192:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1787508614.603797:0:203182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.603812:0:203182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33a5c lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f33a55 expref: -99 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.603833:0:203182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33960 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae02e expref: 10 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.603841:0:203182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33a5c lrc: 4/0,0 mode: --/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f33a55 expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.603864:0:203182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33960 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae02e expref: 10 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.603875:0:203182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33960 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae02e expref: 10 pid: 230618 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.603892:0:203182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3c380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480104320:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508614.604137:0:203182:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787508614.607740:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.607985:0:203182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3c380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480104320:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508614.608027:0:203182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33a5c lrc: 3/0,0 mode: --/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33a55 expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.608039:0:203182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x287:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:3.0:1787508614.608042:0:203182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787508614.608045:0:203182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33a5c lrc: 3/0,0 mode: --/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33a55 expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.608054:0:203182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33a5c lrc: 3/0,0 mode: --/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33a55 expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.608061:0:203182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e800, rc 0) 00000100:00100000:3.0:1787508614.608131:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:205405:x1874324480104192:12345-0@lo:101:mdt00_004.0 Request processed in 4347us (4857us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.608140:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29680 00000100:00100000:2.0:1787508614.608512:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1514700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480104192:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1787508614.608530:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f33a55 lrc: 4/0,1 mode: --/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33a5c expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.608540:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f33a55 lrc: 4/0,1 mode: --/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33a5c expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.609590:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509507328 00000100:00100000:0.0:1787508614.609603:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509507328 00010000:00010000:0.0:1787508614.609646:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33960 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae02e expref: 11 pid: 230618 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.609728:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27841 00000100:00100000:0.0:1787508614.609739:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2400:x1874324509507328:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508614.609754:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508614.609761:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33960 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae02e expref: 11 pid: 230618 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.609775:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33960 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae02e expref: 11 pid: 230618 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.609809:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33960 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x287:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae02e expref: 11 pid: 230618 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.609826:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x287:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:0.0:1787508614.609832:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33a5c lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33a55 expref: 9 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.609842:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33a5c lrc: 2/0,0 mode: EX/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f33a55 expref: 9 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.609850:0:202212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33a5c lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f33a55 expref: 9 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.609884:0:202212:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33a5c lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33a55 expref: 9 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.609898:0:202212:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1517800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:202212:1874324480104448:0@lo:105: 00000100:00100000:0.0:1787508614.609980:0:202212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508614.610029:0:202212:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88540 going to sleep for 11 seconds 00000100:00100000:2.0:1787508614.610141:0:229386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480104448 00000100:00100000:2.0:1787508614.610146:0:229386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480104448 00000100:00100000:2.0:1787508614.610185:0:229386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18154 00000100:00100000:2.0:1787508614.610201:0:229386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1517b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:202212:x1874324480104448:12345-0@lo:105: 00010000:00010000:2.0:1787508614.610212:0:229386:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f33a55 lrc: 5/0,1 mode: --/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33a5c expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.610222:0:229386:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f33a55 lrc: 5/0,1 mode: --/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33a5c expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.610236:0:229386:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f33a55 lrc: 5/0,1 mode: --/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33a5c expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.610244:0:229386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f33a55 lrc: 5/0,1 mode: EX/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f33a5c expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.610250:0:229386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f33a55 lrc: 6/0,1 mode: EX/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f33a5c expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.610258:0:229386:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f33a55 lrc: 6/0,1 mode: EX/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f33a5c expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.610280:0:229386:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d56f6000) 00000100:00100000:2.0:1787508614.610318:0:229386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1517b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:202212:x1874324480104448:12345-0@lo:105: Request processed in 126us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.610324:0:229386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18154 00010000:00010000:3.0:1787508614.610566:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f33a55 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33a5c expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.610577:0:205405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f33a55 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33a5c expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.611428:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480104576:0@lo:403:mdt00_004.0 00000100:00100000:3.0:1787508614.611500:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508614.611524:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787508614.611727:0:202212:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1517800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:202212:1874324480104448:0@lo:105: 00010000:00010000:0.0:1787508614.611745:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508614.611857:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2400:x1874324509507328:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 2119us (4126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508614.611867:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27841 00000100:00100000:2.0:1787508614.612042:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480104576 00000100:00100000:2.0:1787508614.612048:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480104576 00000100:00100000:2.0:1787508614.612088:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29681 00000100:00100000:2.0:1787508614.612096:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:205405:x1874324480104576:12345-0@lo:403:mdt00_004.0 00000100:00100000:2.0:1787508614.614657:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:205405:x1874324480104576:12345-0@lo:403:mdt00_004.0 Request processed in 2548us (3144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.614673:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29681 00000100:00100000:2.0:1787508614.614739:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480104576:0@lo:403:mdt00_004.0 00000040:00080000:0.0:1787508614.617959:0:205405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xf:0x0].44, 664 off78240 00000040:00080000:0.0:1787508614.618155:0:205405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x5:0x0].587, 744 off744176 00000004:00080000:0.0:1787508614.618162:0:205405:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d1c88540 with version 13598 00000004:00080000:2.0:1787508614.618592:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13598 rpc_version 13598 00000020:00100000:2.0:1787508614.618628:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787508614.618639:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d1cbe300 x1874324480104832/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1808/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787508614.618663:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbe300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480104832:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508614.618728:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508614.618771:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787508614.619010:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480104832 00000100:00100000:0.0:1787508614.619018:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480104832 00000100:00100000:0.0:1787508614.619073:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29682 00000100:00100000:0.0:1787508614.619083:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:202961:x1874324480104832:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787508614.619609:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:202961:x1874324480104832:12345-0@lo:1000:osp_up0-1.0 Request processed in 526us (880us total) trans 12884944065 rc 0/0 00000100:00100000:0.0:1787508614.619618:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29682 00000100:00100000:2.0:1787508614.619797:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbe300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480104832:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1787508614.619923:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d2:0x0]: returning size 4096 00010000:00010000:0.0:1787508614.620018:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f33a4e lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x291:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.620030:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f33a4e lrc: 2/0,0 mode: EX/EX res: [0x240000bd1:0x291:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.620038:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f33a4e lrc: 3/0,0 mode: EX/EX res: [0x240000bd1:0x291:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.620044:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.620048:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f33a4e lrc: 3/0,0 mode: EX/EX res: [0x240000bd1:0x291:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.620056:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f33a4e lrc: 4/0,0 mode: EX/EX res: [0x240000bd1:0x291:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.620073:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x291:0x0].0x0 (ffff9090ce7bad00) 00010000:00010000:0.0:1787508614.620076:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787508614.620080:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f33a4e lrc: 2/0,0 mode: --/EX res: [0x240000bd1:0x291:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.620087:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f33a4e lrc: 0/0,0 mode: --/EX res: [0x240000bd1:0x291:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.620101:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f33a55 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33a5c expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.620110:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f33a55 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f33a5c expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.620117:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f33a55 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f33a5c expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.620187:0:205405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787508614.620204:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x287:0x0] 00010000:00010000:0.0:1787508614.620211:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f33a47 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.620216:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f33a47 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.620222:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f33a47 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.620227:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.620230:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f33a47 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.620236:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f33a47 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.620245:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d2:0x0].0x0 (ffff9090ce7ba600) 00010000:00010000:0.0:1787508614.620248:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.620251:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f33a47 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.620257:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f33a47 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.620267:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f33a39 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33a40 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.620274:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f33a39 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f33a40 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.620281:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f33a39 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f33a40 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.620704:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787508614.620712:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f33a55 lrc: 2/0,0 mode: EX/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xb126349c40f33a5c expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.620720:0:204785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6000 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:1.0:1787508614.620725:0:204785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f33a55 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xb126349c40f33a5c expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508614.620733:0:204785:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f33a55 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xb126349c40f33a5c expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.620772:0:204785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f33a55 lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f33a5c expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.620843:0:204785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787508614.620904:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d021b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480104960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787508614.620983:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787508614.621066:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f33a55 lrc: 1/0,0 mode: --/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f33a5c expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.621075:0:204785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6000/0xb126349c40f33a55 lrc: 0/0,0 mode: --/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f33a5c expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.621094:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787508614.621098:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f33a39 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xb126349c40f33a40 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.621105:0:204785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6400 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:1.0:1787508614.621109:0:204785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f33a39 lrc: 5/0,0 mode: EX/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xb126349c40f33a40 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508614.621116:0:204785:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f33a39 lrc: 5/0,0 mode: EX/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xb126349c40f33a40 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.621135:0:204785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f33a39 lrc: 4/0,0 mode: --/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f33a40 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.621142:0:204785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787508614.621207:0:205405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000004:00080000:0.0:1787508614.621224:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787508614.621231:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508614.621238:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aac00/0xb126349c40f339fa lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f33a16 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.621245:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aac00/0xb126349c40f339fa lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xb126349c40f33a16 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.621256:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aac00/0xb126349c40f339fa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xb126349c40f33a16 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.621269:0:205405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000004:00080000:0.0:1787508614.621273:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787508614.621278:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f33a2b lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33a32 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.621285:0:205405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f33a2b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33a32 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.621368:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336056:x1874324509506304:12345-192.168.201.30@tcp:36:rm.0 Request processed in 39884us (40245us total) trans 8589962003 rc 0/0 00000100:00100000:0.0:1787508614.621377:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93771 00000100:00100000:2.0:1787508614.621553:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480104960 00000100:00100000:2.0:1787508614.621562:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480104960 00000100:00100000:2.0:1787508614.621610:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9781 00000100:00100000:2.0:1787508614.621619:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+11:3616:x1874324480104960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508614.621631:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508614.621648:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33a5c lrc: 0/0,0 mode: --/EX res: [0x2000013a2:0x287:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f33a55 expref: 11 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.621661:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x287:0x0].0x0 (ffff9090c98d9b00) 00010000:00010000:2.0:1787508614.621668:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508614.622286:0:202215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508614.622294:0:202215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aac00/0xb126349c40f339fa lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f33a16 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.622303:0:202215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aac00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:0.0:1787508614.622307:0:202215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aac00/0xb126349c40f339fa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f33a16 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508614.622315:0:202215:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aac00/0xb126349c40f339fa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f33a16 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.622342:0:202215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aac00/0xb126349c40f339fa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33a16 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.622349:0:202215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787508614.622378:0:202215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aac00/0xb126349c40f339fa lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33a16 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.622386:0:202215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aac00/0xb126349c40f339fa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33a16 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.622399:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508614.622401:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508614.622402:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508614.622410:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787508614.622423:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480105216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508614.622473:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508614.624346:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d021a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480105088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508614.624422:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787508614.624978:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f33a39 lrc: 1/0,0 mode: --/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f33a40 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.624995:0:204785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6400/0xb126349c40f33a39 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f33a40 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.625019:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508614.625021:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508614.625023:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508614.628614:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480105216 00000100:00100000:0.0:1787508614.628629:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480105216 00010000:00010000:0.0:1787508614.628681:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33a16 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xb126349c40f339fa expref: 11 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.628731:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480105088 00000100:00100000:0.0:1787508614.628735:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480105088 00000100:00100000:0.0:1787508614.628762:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27842 00000100:00100000:0.0:1787508614.628772:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1515f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+12:3619:x1874324480105216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508614.628786:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508614.628797:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33a16 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f339fa expref: 12 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.628825:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33a16 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000020 nid: 0@lo remote: 0xb126349c40f339fa expref: 12 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.628842:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.628847:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33a24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.628857:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33a24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.628864:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33a24 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.628893:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508614.628995:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1515f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+11:3619:x1874324480105216:12345-0@lo:103:ldlm_bl.0 Request processed in 225us (6522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508614.629002:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27842 00000100:00100000:0.0:1787508614.629019:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9782 00000100:00100000:0.0:1787508614.629025:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1514380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+10:3617:x1874324480105088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508614.629032:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508614.629041:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33a40 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f33a39 expref: 10 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.629050:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d2:0x0].0x0 (ffff9090ccb87700) 00010000:00010000:0.0:1787508614.629058:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508614.629082:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1514380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+9:3617:x1874324480105088:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (4661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508614.629091:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9782 00000100:00100000:0.0:1787508614.629131:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480105216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508614.629160:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d021a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480105088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787508614.630499:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3616:x1874324480104960:12345-0@lo:103:ldlm_bl.0 Request processed in 8871us (9507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.630510:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9781 00000100:00100000:3.0:1787508614.631486:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d021b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480104960:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787508614.631524:0:203348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33a24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.631534:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33a24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508614.631594:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508614.631598:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508614.631621:0:203348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33a24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.631654:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33a1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae06d expref: 583 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.631675:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33a24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae06d expref: 582 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.631683:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.631686:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508614.631689:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fe00, rc 0) 00000100:00100000:3.0:1787508614.631761:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336058:x1874324509506944:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 43546us (43618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.631769:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93773 00000100:00100000:0.0:1787508614.641569:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.641617:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.641706:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509507456 00000100:00100000:3.0:1787508614.641718:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509507456 00000100:00100000:3.0:1787508614.641775:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509507584 00000100:00100000:3.0:1787508614.641790:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509507584 00000100:00100000:3.0:1787508614.641814:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93774 00000100:00100000:3.0:1787508614.641822:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336058:x1874324509507456:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508614.641841:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.641860:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33a63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae074 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.641921:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33a6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.641934:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33a6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.641971:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33a6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.641985:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33a71 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.641992:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33a71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.641997:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33a71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.642044:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33a6a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.642051:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33a6a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.642058:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33a6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.642064:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33a6a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.642070:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fa00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.642073:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33a6a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.642080:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33a6a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.642092:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.642094:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.642099:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33a6a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.642105:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33a6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.642117:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33a71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.642122:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33a71 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.642126:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33a71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.642131:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.642134:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33a71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.642139:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33a71 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.642145:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090ccb87200) 00010000:00010000:3.0:1787508614.642147:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.642150:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33a71 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.642155:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33a71 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.642184:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33a63 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae074 expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.642205:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.642207:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508614.642210:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33a63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae074 expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.642219:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f200, rc 0) 00000100:00100000:3.0:1787508614.642278:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336058:x1874324509507456:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 456us (718us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508614.642285:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93774 00000100:00100000:3.0:1787508614.642308:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93775 00000100:00100000:3.0:1787508614.642315:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:336059:x1874324509507584:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508614.642323:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.642331:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33a78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae07b expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.642361:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33a7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.642369:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33a7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.642377:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33a7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508614.642412:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508614.642417:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508614.642436:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33a7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.642462:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33a78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae07b expref: 12 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.642475:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33a7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae07b expref: 11 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.642482:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.642484:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508614.642486:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e200, rc 0) 00000100:00100000:3.0:1787508614.642506:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336059:x1874324509507584:12345-192.168.201.30@tcp:101:rm.0 Request processed in 192us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.642512:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93775 00000100:00100000:3.0:1787508614.646249:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.646297:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.646400:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509507712 00000100:00100000:1.0:1787508614.646409:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509507712 00000100:00100000:1.0:1787508614.646482:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509507840 00000100:00100000:1.0:1787508614.646486:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509507840 00000100:00100000:1.0:1787508614.646513:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93776 00000100:00100000:1.0:1787508614.646523:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336058:x1874324509507712:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508614.646544:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.646565:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f33a86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae082 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.646630:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33a8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.646644:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33a8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.646654:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33a8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.646672:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33a94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.646679:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33a94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.646686:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33a94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.646744:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33a8d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.646751:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33a8d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.646757:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33a8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.646763:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33a8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.646769:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.646773:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33a8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.646928:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33a8d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.646975:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.646979:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.646983:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33a8d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.646990:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33a8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647003:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33a94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647009:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33a94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647016:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33a94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647020:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.647023:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33a94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647029:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33a94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647036:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090c6987700) 00010000:00010000:1.0:1787508614.647038:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.647041:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33a94 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647045:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33a94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647075:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f33a86 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae082 expref: 583 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647085:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.647087:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508614.647090:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f33a86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae082 expref: 583 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647104:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a600, rc 0) 00000100:00100000:1.0:1787508614.647162:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336058:x1874324509507712:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 640us (923us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508614.647169:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93776 00000100:00100000:1.0:1787508614.647188:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93777 00000100:00100000:1.0:1787508614.647196:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336059:x1874324509507840:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508614.647204:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.647214:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33a9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae089 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647243:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33aa2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647252:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647259:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647271:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33aa9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647277:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647282:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647311:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33aa2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647318:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33aa2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647323:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33aa2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647329:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33aa2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647333:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.647336:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33aa2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647341:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33aa2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647348:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.647350:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.647592:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33aa2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647599:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33aa2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647609:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647615:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33aa9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647623:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647628:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247bc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.647631:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647636:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33aa9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647644:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090c6987900) 00010000:00010000:1.0:1787508614.647646:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.647648:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33aa9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647654:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33aa9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647675:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33a9b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae089 expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647683:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.647685:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508614.647688:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33a9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae089 expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.647697:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ae00, rc 0) 00000100:00100000:1.0:1787508614.647723:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336059:x1874324509507840:12345-192.168.201.30@tcp:101:rm.0 Request processed in 529us (1426us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508614.647734:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93777 00000100:00100000:3.0:1787508614.652325:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.652383:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.652562:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509507968 00000100:00100000:2.0:1787508614.652572:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509507968 00000100:00100000:2.0:1787508614.652635:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509508096 00000100:00100000:2.0:1787508614.652639:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509508096 00000100:00100000:2.0:1787508614.652665:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93778 00000100:00100000:2.0:1787508614.652676:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336058:x1874324509507968:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508614.652697:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.652719:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f33ab0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae090 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.652801:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33ab7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.652816:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.652827:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.652841:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33abe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.652848:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33abe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.652855:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33abe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.652908:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33ab7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.652915:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33ab7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.652920:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33ab7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.652927:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33ab7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.652937:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.652966:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33ab7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.652974:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33ab7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.652986:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.652989:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.652993:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33ab7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653000:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33ab7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653014:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33abe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653021:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33abe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653026:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33abe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653031:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.653034:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33abe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653039:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33abe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653050:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090d36fd200) 00010000:00010000:2.0:1787508614.653052:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.653055:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33abe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653060:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33abe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653088:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f33ab0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae090 expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653099:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.653100:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.653103:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f33ab0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae090 expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653111:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab400, rc 0) 00000100:00100000:2.0:1787508614.653167:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336058:x1874324509507968:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 494us (853us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508614.653174:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93778 00000100:00100000:2.0:1787508614.653203:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93779 00000100:00100000:2.0:1787508614.653210:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336059:x1874324509508096:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508614.653218:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.653226:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f33ac5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae097 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653257:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33acc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653266:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33acc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653272:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33acc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653283:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33ad3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653289:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653296:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653316:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33acc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653322:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33acc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653327:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33acc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653333:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33acc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653338:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.653341:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33acc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653347:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33acc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653367:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.653370:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.653373:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33acc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653378:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33acc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653388:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653394:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33ad3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653400:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653405:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.653408:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653414:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33ad3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653420:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090d36fd700) 00010000:00010000:2.0:1787508614.653422:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.653425:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33ad3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653430:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33ad3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653467:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f33ac5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae097 expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653476:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.653478:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.653481:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f33ac5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae097 expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.653490:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab200, rc 0) 00000100:00100000:2.0:1787508614.653512:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336059:x1874324509508096:12345-192.168.201.30@tcp:101:rm.0 Request processed in 303us (1129us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508614.653519:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93779 00000100:00100000:1.0:1787508614.657497:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.657659:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509508352 00000100:00100000:2.0:1787508614.657669:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509508352 00000100:00100000:2.0:1787508614.657734:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93780 00000100:00100000:2.0:1787508614.657744:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336058:x1874324509508352:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508614.657767:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.657803:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f33ada lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae09e expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.657880:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ae1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.657895:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ae1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.657906:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ae1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.657921:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33ae8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.657929:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.657936:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.658022:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ae1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.658030:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ae1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.658037:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ae1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.658044:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ae1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.658050:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.658054:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ae1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.658061:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ae1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.658074:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.658077:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.658082:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ae1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.658088:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ae1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.658103:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.658109:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33ae8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.658114:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.658119:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.658121:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.658127:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33ae8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.658134:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe67841 (ffff9090d36fd800) 00010000:00010000:2.0:1787508614.658136:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.658138:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33ae8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.658144:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33ae8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.658180:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f33ada lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae09e expref: 583 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.658316:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.658319:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.658323:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f33ada lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae09e expref: 583 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.658334:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aaa00, rc 0) 00000100:00100000:2.0:1787508614.658476:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336058:x1874324509508352:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 733us (989us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508614.658484:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93780 00000100:00100000:3.0:1787508614.664804:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.664853:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.664937:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509508608 00000100:00100000:2.0:1787508614.664983:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509508608 00000100:00100000:2.0:1787508614.665039:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509508736 00000100:00100000:2.0:1787508614.665043:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509508736 00000100:00100000:2.0:1787508614.665064:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93781 00000100:00100000:2.0:1787508614.665073:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336058:x1874324509508608:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508614.665094:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.665113:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f33aef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae0a5 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665187:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33af6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665202:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33af6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665213:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33af6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665233:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33afd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665240:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33afd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665246:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33afd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665296:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33af6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665304:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33af6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665309:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33af6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665316:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33af6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665322:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.665326:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33af6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665334:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33af6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665346:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.665349:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.665353:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33af6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665372:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33af6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665386:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33afd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665393:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33afd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665398:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33afd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665402:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.665405:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33afd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665411:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33afd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665418:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090d36fd700) 00010000:00010000:2.0:1787508614.665420:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.665423:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33afd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665429:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f33afd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665475:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f33aef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0a5 expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665490:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.665493:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.665496:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f33aef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0a5 expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665505:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab200, rc 0) 00000100:00100000:2.0:1787508614.665566:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336058:x1874324509508608:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 493us (788us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508614.665573:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93781 00000100:00100000:2.0:1787508614.665591:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93782 00000100:00100000:2.0:1787508614.665598:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336059:x1874324509508736:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508614.665605:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.665612:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f33b04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae0ac expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665641:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b0b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665648:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665655:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b0b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665665:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33b12 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665675:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33b12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665681:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33b12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665698:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b0b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665704:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b0b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665709:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b0b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665715:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b0b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665719:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.665722:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b0b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665727:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b0b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665735:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.665736:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.665739:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b0b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665744:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665753:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33b12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665759:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33b12 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665764:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33b12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665769:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.665772:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33b12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665776:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33b12 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665795:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090d36fd200) 00010000:00010000:2.0:1787508614.665798:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.665801:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33b12 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665806:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33b12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665826:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f33b04 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0ac expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665834:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.665836:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.665840:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f33b04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0ac expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.665847:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab400, rc 0) 00000100:00100000:2.0:1787508614.665867:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336059:x1874324509508736:12345-192.168.201.30@tcp:101:rm.0 Request processed in 270us (1014us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508614.665872:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93782 00000100:00100000:3.0:1787508614.672488:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.672581:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.673064:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509508992 00000100:00100000:1.0:1787508614.673075:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509508992 00000100:00100000:1.0:1787508614.673163:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509509248 00000100:00100000:1.0:1787508614.673166:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509509248 00000100:00100000:0.0:1787508614.673207:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93783 00000100:00100000:0.0:1787508614.673219:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336058:x1874324509508992:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508614.673241:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508614.673261:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f33b19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae0b3 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.673332:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f33b20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.673346:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f33b20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.673422:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93784 00000100:00100000:2.0:1787508614.673431:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336059:x1874324509509248:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508614.673439:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.673457:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f33b27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae0ba expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.673487:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33b2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.673512:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f33b20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.673527:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33b35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.673535:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.673541:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.673599:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f33b20 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.673771:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33b2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.673930:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33b2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.673968:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.673976:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.673982:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.674008:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33b2e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.674015:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33b2e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.674021:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33b2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.674027:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33b2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.674033:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.674037:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33b2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.674044:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33b2e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.674055:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.674058:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.674062:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33b2e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.674068:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f33b2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.674080:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.674087:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b3c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.674094:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.674099:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.674102:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.674107:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b3c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.674113:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090d36fd200) 00010000:00010000:2.0:1787508614.674115:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.674118:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b3c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.674123:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.674150:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f33b27 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0ba expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.674159:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.674161:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.674164:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f33b27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0ba expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.674171:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab400, rc 0) 00010000:00010000:0.0:1787508614.674266:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f33b20 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.674274:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f33b20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.674280:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f33b20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.674285:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.674288:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f33b20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.674294:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f33b20 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.674303:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.674305:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.674308:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f33b20 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.674313:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f33b20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.674323:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33b35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.674329:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33b35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.674336:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33b35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.674341:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.674343:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33b35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.674349:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33b35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.674420:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x90ba0166 (ffff9090e460f900) 00010000:00010000:0.0:1787508614.674422:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.674425:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33b35 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.674431:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33b35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.674465:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f33b19 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0b3 expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.674473:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.674475:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508614.674477:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f33b19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0b3 expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.674485:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6c00, rc 0) 00000100:00100000:0.0:1787508614.674590:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336058:x1874324509508992:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1373us (2110us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508614.674601:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93783 00000100:00100000:2.0:1787508614.674660:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336059:x1874324509509248:12345-192.168.201.30@tcp:101:rm.0 Request processed in 1230us (2078us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508614.674669:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93784 00000100:00100000:0.0:1787508614.682008:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.682212:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509509376 00000100:00100000:1.0:1787508614.682222:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509509376 00000100:00100000:1.0:1787508614.682277:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93785 00000100:00100000:1.0:1787508614.682288:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336059:x1874324509509376:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508614.682310:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.682334:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33b43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae0c1 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.682410:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33b4a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.682425:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33b4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.682437:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33b4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.682459:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33b51 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.682470:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33a32 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33a2b expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.682478:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33b51 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.682512:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33a32 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f33a2b expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.682528:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d021ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480105344:0@lo:104: 00000100:00100000:1.0:1787508614.682575:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508614.682621:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9ff2900 going to sleep for 11 seconds 00000100:00100000:2.0:1787508614.682755:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480105344 00000100:00100000:2.0:1787508614.682761:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480105344 00000100:00100000:2.0:1787508614.682812:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18155 00000100:00100000:2.0:1787508614.682820:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:230618:x1874324480105344:12345-0@lo:104: 00010000:00010000:2.0:1787508614.682832:0:202209:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f33a2b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f33a32 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.682893:0:202209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787508614.682900:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:230618:x1874324480105344:12345-0@lo:104: Request processed in 81us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.682907:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18155 00010000:00010000:0.0:1787508614.683121:0:202214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508614.683129:0:202214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f33a2b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f33a32 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.683138:0:202214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:0.0:1787508614.683143:0:202214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f33a2b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f33a32 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508614.683152:0:202214:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f33a2b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f33a32 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.683179:0:202214:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f33a2b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33a32 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.683194:0:202214:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787508614.683221:0:202214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f33a2b lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33a32 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.683229:0:202214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f33a2b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33a32 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.683247:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508614.683249:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508614.683251:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508614.683259:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787508614.683271:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480105472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508614.683305:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508614.683335:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480105472 00000100:00100000:0.0:1787508614.683339:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480105472 00010000:00010000:0.0:1787508614.683370:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33a32 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f33a2b expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.683393:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27843 00000100:00100000:0.0:1787508614.683400:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1514a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3618:x1874324480105472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508614.683409:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787508614.685488:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d021ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480105344:0@lo:104: 00010000:00010000:1.0:1787508614.685516:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33b51 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787508614.685896:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944065 is committed 00010000:00010000:0.0:1787508614.686139:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33a32 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f33a2b expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.686156:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090c5b0c800) 00010000:00010000:0.0:1787508614.686161:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33b51 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.686171:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33b51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.686178:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33b51 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.686268:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508614.686419:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1514a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480105472:12345-0@lo:103:ldlm_bl.0 Request processed in 3017us (3111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508614.686429:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27843 00010000:00010000:1.0:1787508614.686554:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33b51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.686561:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33b51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.686620:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33b4a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.686627:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33b4a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.686633:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33b4a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.686640:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33b4a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.686646:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247bc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.686651:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33b4a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.686658:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33b4a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.686668:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.686671:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.686675:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33b4a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.686681:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33b4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.686691:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33b51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.686696:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33b51 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.686702:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33b51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.686707:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.686710:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33b51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.686716:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33b51 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.686723:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090c5b0c800) 00010000:00010000:1.0:1787508614.686726:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.686729:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33b51 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.686735:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f33b51 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.686776:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33b43 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0c1 expref: 12 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.686803:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.686805:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.686809:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33b43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0c1 expref: 12 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.686817:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ae00, rc 0) 00000100:00100000:1.0:1787508614.686872:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1516300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336059:x1874324509509376:12345-192.168.201.30@tcp:101:rm.0 Request processed in 4586us (4874us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508614.686880:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93785 00000100:00100000:0.0:1787508614.689841:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.690920:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509509632 00000100:00100000:3.0:1787508614.690936:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509509632 00000100:00100000:3.0:1787508614.691037:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93786 00000100:00100000:3.0:1787508614.691047:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336058:x1874324509509632:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508614.691067:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.691089:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33b58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae0c8 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.691163:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33b5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.691176:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33b5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.691195:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33b5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.691211:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33b66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.691218:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33b66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.691224:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33b66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.691280:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33b5f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.691288:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33b5f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.691294:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33b5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.691301:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33b5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.691307:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.691311:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33b5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.691319:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33b5f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.691331:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.691334:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.691338:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33b5f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.691345:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33b5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.691498:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33b66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.691506:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33b66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.691512:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33b66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.691517:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.691519:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33b66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.691525:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33b66 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.691532:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaf3dc4c9 (ffff9090ccb87200) 00010000:00010000:3.0:1787508614.691535:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.691537:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33b66 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.691542:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33b66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.691576:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33b58 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0c8 expref: 583 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.691586:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.691589:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508614.691592:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33b58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0c8 expref: 583 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.691601:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fc00, rc 0) 00000100:00100000:3.0:1787508614.691676:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336058:x1874324509509632:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 630us (1845us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508614.691686:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93786 00000100:00100000:3.0:1787508614.706672:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.706759:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509509760 00000100:00100000:0.0:1787508614.706770:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509509760 00000100:00100000:0.0:1787508614.706841:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93787 00000100:00100000:0.0:1787508614.706851:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d15af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336058:x1874324509509760:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508614.706871:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508614.706891:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33b6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae0cf expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.706979:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f33b74 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.706994:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f33b74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.707005:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f33b74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.707020:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33b7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.707027:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33b7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.707034:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33b7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.707094:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f33b74 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.707102:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f33b74 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.707109:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f33b74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.707120:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f33b74 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.707127:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.707131:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f33b74 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.707139:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f33b74 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.707151:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.707154:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.707158:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f33b74 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.707165:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f33b74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.707177:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33b7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.707183:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33b7b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.707190:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33b7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.707205:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.707208:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33b7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.707217:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33b7b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.707225:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090c6913a00) 00010000:00010000:0.0:1787508614.707227:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.707230:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33b7b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.707237:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33b7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.707269:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33b6d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0cf expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.707280:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.707282:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.707286:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33b6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0cf expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.707295:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7e00, rc 0) 00000100:00100000:0.0:1787508614.707364:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d15af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336058:x1874324509509760:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 503us (691us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508614.707372:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93787 00000100:00100000:2.0:1787508614.708737:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1517100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480105472:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508614.714767:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508614.717197:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.717335:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509510016 00000100:00100000:2.0:1787508614.717346:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509510016 00000100:00100000:2.0:1787508614.717424:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93788 00000100:00100000:2.0:1787508614.717435:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336058:x1874324509510016:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:2.0:1787508614.717505:0:205405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508614.717535:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33a24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae06d expref: 582 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.717557:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.717562:0:205405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508614.717641:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f33b82 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.717655:0:205405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33a7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae07b expref: 10 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.717664:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f33b82 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.717697:0:205405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33a7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae07b expref: 10 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.717712:0:205405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33a7f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae07b expref: 10 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.717726:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480105600:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508614.717815:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787508614.733450:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.733624:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480105600:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508614.733655:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f33b82 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.733732:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509510144 00000100:00100000:1.0:1787508614.733739:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509510144 00010000:00010000:1.0:1787508614.733775:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33a7f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae07b expref: 11 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.733812:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27844 00000100:00100000:1.0:1787508614.733820:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde3d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2400:x1874324509510144:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508614.733834:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508614.733841:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33a7f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae07b expref: 11 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.733860:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33a7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae07b expref: 11 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.733881:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33a7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae07b expref: 11 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.733897:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.733902:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f33b82 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.733912:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f33b82 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.733919:0:202212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f33b82 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.733978:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508614.734029:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde3d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2400:x1874324509510144:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 209us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.734036:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27844 00010000:00010000:2.0:1787508614.734319:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f33b82 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.734327:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f33b82 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.734359:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b89 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.734370:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b89 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.734378:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b89 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787508614.735206:0:205405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1:0x0].1779, 2168 off1832648 00000040:00080000:2.0:1787508614.735274:0:205405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x1:0x0].1786, 2368 off2038392 00000004:00080000:2.0:1787508614.735280:0:205405:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d74d93c0 with version 3454 00000004:00080000:1.0:1787508614.736175:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3454 rpc_version 3454 00000020:00100000:1.0:1787508614.736233:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787508614.736245:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d021ad80 x1874324480105856/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3976/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787508614.736269:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d021ad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480105856:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787508614.736333:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508614.736382:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9ff29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508614.736561:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480105856 00000100:00100000:3.0:1787508614.736569:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480105856 00000100:00100000:3.0:1787508614.736612:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29683 00000100:00100000:3.0:1787508614.736621:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:202248:x1874324480105856:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787508614.737123:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:202248:x1874324480105856:12345-0@lo:1000:osp_up1-0.0 Request processed in 501us (788us total) trans 8589962004 rc 0/0 00000100:00100000:3.0:1787508614.737132:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29683 00000100:00100000:1.0:1787508614.738094:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d021ad80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480105856:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1787508614.738657:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33b90 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x125a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.738673:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33b90 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.738684:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33b90 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.738702:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33b97 lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x170:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.738710:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33b97 lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x170:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.738717:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33b97 lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x170:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.738752:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f33b9e lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.738762:0:205405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f33b9e lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.738771:0:205405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f33b9e lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.738804:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d9b9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:205405:1874324480105984:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1787508614.738863:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508614.738900:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.739047:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480105984 00000100:00100000:1.0:1787508614.739055:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480105984 00000100:00100000:1.0:1787508614.739095:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29684 00000100:00100000:1.0:1787508614.739103:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:205405:x1874324480105984:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1787508614.739121:0:203182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.739138:0:203182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f33ba5 lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f33b9e expref: -99 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.739158:0:203182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f33ba5 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f33b9e expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.739169:0:203182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f33ba5 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33b9e expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.739176:0:203182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x168:0x0].0x0 (ffff9090c6987900) 00010000:00010000:1.0:1787508614.739179:0:203182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.739182:0:203182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ac00, rc 0) 00000100:00100000:1.0:1787508614.739342:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:205405:x1874324480105984:12345-0@lo:101:mdt00_004.0 Request processed in 239us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.739349:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29684 00000100:00100000:3.0:1787508614.739561:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d9b9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:205405:1874324480105984:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1787508614.739579:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f33b9e lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33ba5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.739589:0:205405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f33b9e lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33ba5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508614.739609:0:205405:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5afec27 reply state 00000000ad1f8eeb transno 12884944066 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33b97 lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x170:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.739622:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33b97 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x170:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.739628:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x170:0x0].0x0 (ffff9090ccb87000) 00010000:00010000:3.0:1787508614.739631:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508614.739634:0:205405:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787508614.739639:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f33b9e lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33ba5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.739647:0:205405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f33b9e lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33ba5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787508614.739658:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd2:0x168:0x0] 00000004:00010000:3.0:1787508614.739664:0:205405:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5afec27 reply state 00000000ad1f8eeb transno 12884944066 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33b90 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.739672:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33b90 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x125a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.739679:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125a:0x0].0x0 (ffff9090ccb87200) 00010000:00010000:3.0:1787508614.739681:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508614.739683:0:205405:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787508614.739687:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125a:0x0]: returning size 4096 00010000:00010000:3.0:1787508614.739698:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f33b82 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.739704:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f33b82 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.739709:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f33b82 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.739715:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f33b82 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.739721:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.739725:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f33b82 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.739732:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f33b82 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.739743:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.739745:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.739749:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f33b82 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.739755:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f33b82 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508614.739768:0:205405:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5afec27 reply state 00000000ad1f8eeb transno 12884944066 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b89 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.739776:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.739841:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd200) 00010000:00010000:3.0:1787508614.739844:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508614.739847:0:205405:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1787508614.740018:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1515880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336058:x1874324509510016:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 22583us (22837us total) trans 12884944066 rc 0/0 00000100:00100000:3.0:1787508614.740026:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93788 00000100:00100000:0.0:1787508614.750556:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.750662:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509510272 00000100:00100000:1.0:1787508614.750673:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509510272 00000100:00100000:1.0:1787508614.750746:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93789 00000100:00100000:1.0:1787508614.750756:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:336062:x1874324509510272:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508614.750787:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.750812:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33bac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae0d6 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.750883:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f33bb3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.750897:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f33bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.750908:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f33bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508614.750986:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508614.750990:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508614.751010:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f33bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.751035:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33bac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0d6 expref: 12 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.751051:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f33bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0d6 expref: 11 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.751059:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.751062:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508614.751066:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a600, rc 0) 00000100:00100000:1.0:1787508614.751122:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1515c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336062:x1874324509510272:12345-192.168.201.30@tcp:101:rm.0 Request processed in 368us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.751129:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93789 00000100:00100000:0.0:1787508614.753601:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.753683:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509510400 00000100:00100000:1.0:1787508614.753695:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509510400 00000100:00100000:1.0:1787508614.753751:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93790 00000100:00100000:1.0:1787508614.753761:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336062:x1874324509510400:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508614.753791:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.753813:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33bba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae0dd expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.753874:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33bc1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.753886:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33bc1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.753897:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33bc1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.753911:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33bc8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.753916:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.753922:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.754012:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33bc1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.754019:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33bc1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.754025:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33bc1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.754035:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33bc1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.754041:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.754045:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33bc1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.754052:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33bc1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.754064:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.754067:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.754072:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33bc1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.754079:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33bc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.754093:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.754099:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33bc8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.754105:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.754110:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.754113:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.754121:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33bc8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.754128:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090c6987700) 00010000:00010000:1.0:1787508614.754131:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.754133:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33bc8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.754139:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33bc8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.754168:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33bba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0dd expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.754177:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.754180:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508614.754183:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33bba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0dd expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.754409:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b000, rc 0) 00000100:00100000:1.0:1787508614.754572:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336062:x1874324509510400:12345-192.168.201.30@tcp:101:rm.0 Request processed in 811us (980us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508614.754580:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93790 00000100:00100000:0.0:1787508614.759107:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.759138:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.759247:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509510528 00000100:00100000:1.0:1787508614.759259:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509510528 00000100:00100000:1.0:1787508614.759322:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509510656 00000100:00100000:1.0:1787508614.759326:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509510656 00000100:00100000:1.0:1787508614.759349:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93791 00000100:00100000:1.0:1787508614.759371:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336063:x1874324509510528:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508614.759400:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.759423:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33bcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae0e4 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.759502:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33bd6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.759515:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.759526:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508614.759571:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508614.759574:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508614.759594:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.759618:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33bcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0e4 expref: 585 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.759637:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33bd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0e4 expref: 584 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.759647:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.759650:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508614.759653:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ae00, rc 0) 00000100:00100000:1.0:1787508614.759709:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1516a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336063:x1874324509510528:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 340us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.759718:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93791 00000100:00100000:1.0:1787508614.759734:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93792 00000100:00100000:1.0:1787508614.759741:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336062:x1874324509510656:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508614.759747:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.759755:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33bdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae0eb expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.759798:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33be4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.759806:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33be4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.759813:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33be4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.759828:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33beb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.759835:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33beb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.759842:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33beb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.759894:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33be4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.759902:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33be4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.759912:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33be4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.759919:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33be4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.759925:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.759929:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33be4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.759937:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33be4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.759974:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.759977:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.759981:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33be4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.759987:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33be4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.759997:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33beb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.760003:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33beb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.760008:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33beb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.760013:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cdb25e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.760016:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33beb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.760021:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33beb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.760028:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090c5b0c800) 00010000:00010000:1.0:1787508614.760030:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.760033:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33beb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.760038:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33beb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.760062:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33bdd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0eb expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.760073:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.760075:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508614.760078:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33bdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0eb expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.760087:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a400, rc 0) 00000100:00100000:1.0:1787508614.760111:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1515f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336062:x1874324509510656:12345-192.168.201.30@tcp:101:rm.0 Request processed in 371us (972us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508614.760117:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93792 00000100:00100000:2.0:1787508614.767493:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.767576:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.767664:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509510784 00000100:00100000:3.0:1787508614.767674:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509510784 00000100:00100000:3.0:1787508614.767759:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509510912 00000100:00100000:3.0:1787508614.767763:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509510912 00000100:00100000:1.0:1787508614.768050:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93793 00000100:00100000:1.0:1787508614.768064:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336062:x1874324509510784:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508614.768085:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.768107:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f33bf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae0f2 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768173:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33bf9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768196:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33bf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768209:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33bf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768225:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f33c00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768232:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f33c00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768239:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f33c00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768294:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33bf9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768302:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33bf9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768308:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33bf9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768315:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33bf9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768324:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4a00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.768329:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33bf9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768337:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33bf9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768350:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.768364:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.768369:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33bf9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768375:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33bf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768387:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f33c00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768392:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f33c00 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768397:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f33c00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768403:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.768406:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f33c00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768412:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f33c00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768423:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090ce7ba300) 00010000:00010000:1.0:1787508614.768426:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.768429:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f33c00 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768434:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f33c00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768477:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f33bf2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0f2 expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768488:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.768490:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508614.768494:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f33bf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0f2 expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768503:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4c00, rc 0) 00000100:00100000:1.0:1787508614.768565:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336062:x1874324509510784:12345-192.168.201.30@tcp:101:rm.0 Request processed in 505us (1083us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508614.768572:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93793 00000100:00100000:1.0:1787508614.768596:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93794 00000100:00100000:1.0:1787508614.768602:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336063:x1874324509510912:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508614.768610:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.768618:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33c07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae0f9 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768650:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33c0e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768658:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33c0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768664:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33c0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768676:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33c15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768683:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33c15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768690:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33c15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768714:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33c0e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768721:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33c0e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768726:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33c0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768732:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33c0e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768737:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.768740:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33c0e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768746:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33c0e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768755:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.768758:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.768760:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33c0e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768766:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33c0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.768775:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33c15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.771022:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33c15 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.771032:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33c15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.771038:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.771043:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33c15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.771052:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33c15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.771069:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090ce7ba800) 00010000:00010000:1.0:1787508614.771072:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.771076:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33c15 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.771083:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33c15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.771146:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33c07 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0f9 expref: 585 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.771156:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.771158:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508614.771161:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33c07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0f9 expref: 585 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.771171:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5200, rc 0) 00000100:00100000:1.0:1787508614.772349:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336063:x1874324509510912:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 3739us (4765us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508614.772500:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.773453:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93794 00000100:00100000:1.0:1787508614.773493:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509511168 00000100:00100000:1.0:1787508614.773501:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509511168 00000100:00100000:1.0:1787508614.773547:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93795 00000100:00100000:1.0:1787508614.773556:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336062:x1874324509511168:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508614.773577:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.773600:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33c1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae100 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.773674:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33c23 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.773687:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33c23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.773698:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33c23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.773712:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33c2a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.773719:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33c2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.773724:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33c2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.774125:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33c23 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.774137:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33c23 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.774143:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33c23 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.774149:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33c23 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.774155:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.774160:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33c23 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.774168:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33c23 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.774181:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.774184:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.774198:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33c23 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.774206:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33c23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.774222:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33c2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.774228:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33c2a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.774233:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33c2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.774239:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.774242:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33c2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.774248:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33c2a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.774256:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090ce7ba100) 00010000:00010000:1.0:1787508614.774259:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.774262:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33c2a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.774268:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33c2a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.774307:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33c1c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae100 expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.774323:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.774325:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508614.774329:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33c1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae100 expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.774338:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5400, rc 0) 00000100:00100000:1.0:1787508614.774398:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336062:x1874324509511168:12345-192.168.201.30@tcp:101:rm.0 Request processed in 843us (1899us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508614.774406:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93795 00000100:00100000:3.0:1787508614.779645:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.779729:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.780339:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509511296 00000100:00100000:2.0:1787508614.780406:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509511296 00000100:00100000:2.0:1787508614.780514:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509511424 00000100:00100000:2.0:1787508614.780518:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509511424 00000100:00100000:2.0:1787508614.780547:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93796 00000100:00100000:2.0:1787508614.780557:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4856a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336063:x1874324509511296:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1787508614.780580:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.780602:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33c31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae107 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.780669:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f33c38 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.780684:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f33c38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.780695:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f33c38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.780709:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33c3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.780716:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33c3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.780727:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33c3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.780839:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f33c38 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.780847:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f33c38 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.780853:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f33c38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.780860:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f33c38 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.780866:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aaa00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.780869:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f33c38 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.780877:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f33c38 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.780890:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.780893:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.780897:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f33c38 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.780904:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f33c38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.780919:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33c3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.780925:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33c3f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.780930:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33c3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.780935:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.780937:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33c3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.780962:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33c3f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.780970:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090d36fd700) 00010000:00010000:2.0:1787508614.780972:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.780975:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33c3f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.780981:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f33c3f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.781013:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33c31 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae107 expref: 585 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.781023:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.781025:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.781029:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f33c31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae107 expref: 585 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.781043:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aae00, rc 0) 00000100:00100000:1.0:1787508614.781150:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93797 00000100:00100000:1.0:1787508614.781162:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4857b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336062:x1874324509511424:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508614.781172:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.781182:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33c46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae10e expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.781224:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33c4d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.781233:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33c4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.781241:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33c4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.781251:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33c54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.781261:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33c54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.781267:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33c54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.781336:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948d800/0xb126349c40f33c5b lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.781345:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948d800/0xb126349c40f33c5b lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.781363:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948d800/0xb126349c40f33c5b lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508614.781451:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125a:0x0]: returning size 4096 00000004:00200000:1.0:1787508614.781456:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1787508614.781476:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948d800/0xb126349c40f33c5b lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.781487:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33c4d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.781493:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33c4d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.781498:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33c4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.781504:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33c4d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.781512:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.781516:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33c4d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.781521:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33c4d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.781530:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.781532:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.781535:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33c4d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.781540:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f33c4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.781550:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33c54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.781556:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33c54 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.781562:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33c54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.781566:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247bc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.781569:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33c54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.781575:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33c54 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.781585:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd200) 00010000:00010000:1.0:1787508614.781588:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.781590:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33c54 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.781596:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f33c54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.781616:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f33c46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae10e expref: 13 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.781627:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948d800/0xb126349c40f33c5b lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae10e expref: 12 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.781634:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125a:0x0].0x0 (ffff9090ccb87200) 00010000:00010000:1.0:1787508614.781636:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508614.781639:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c948d800, rc 0) 00000100:00100000:2.0:1787508614.782020:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4856a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336063:x1874324509511296:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 1462us (2383us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508614.782029:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93796 00000100:00100000:1.0:1787508614.782130:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4857b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336062:x1874324509511424:12345-192.168.201.30@tcp:101:rm.0 Request processed in 972us (2401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.782137:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93797 00000100:00100000:3.0:1787508614.784815:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.786262:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509511552 00000100:00100000:1.0:1787508614.786278:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509511552 00000100:00100000:1.0:1787508614.786458:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93798 00000100:00100000:1.0:1787508614.786470:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336062:x1874324509511552:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508614.786492:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.786516:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948d200/0xb126349c40f33c62 lrc: 2/0,0 mode: --/CR res: [0x2000013a0:0x170:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae115 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.786586:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948c400/0xb126349c40f33c69 lrc: 3/1,0 mode: --/PR res: [0x2000013a0:0x170:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.786601:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948c400/0xb126349c40f33c69 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.786613:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948c400/0xb126349c40f33c69 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508614.786661:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a0:0x170:0x0]: returning size 4096 00000004:00200000:1.0:1787508614.786666:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787508614.786702:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948d200/0xb126349c40f33c62 lrc: 0/0,0 mode: --/CR res: [0x2000013a0:0x170:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae115 expref: 14 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.786721:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948c400/0xb126349c40f33c69 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae115 expref: 13 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.786730:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x170:0x0].0x0 (ffff9090ccb87000) 00010000:00010000:1.0:1787508614.786734:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508614.786737:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c948c400, rc 0) 00000100:00100000:1.0:1787508614.786822:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336062:x1874324509511552:12345-192.168.201.30@tcp:101:rm.0 Request processed in 354us (2017us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.786829:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93798 00000100:00100000:0.0:1787508614.790637:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.790673:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.790860:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509511680 00000100:00100000:1.0:1787508614.790870:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509511680 00000100:00100000:1.0:1787508614.790928:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509511808 00000100:00100000:1.0:1787508614.790932:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509511808 00000100:00100000:1.0:1787508614.790989:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93799 00000100:00100000:1.0:1787508614.790999:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336063:x1874324509511680:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508614.791020:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.791045:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33c70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae11c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.791108:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33c77 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.791121:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33c77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.791131:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33c77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.791146:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33c7e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.791153:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33c7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.791158:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33c7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.791284:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93800 00000100:00100000:0.0:1787508614.791296:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336062:x1874324509511808:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508614.791311:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508614.791324:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f33c85 lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x168:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae123 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.791370:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33c8c lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x168:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.791382:0:209004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f33ba5 lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33b9e expref: 9 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.791390:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33c8c lrc: 4/1,0 mode: --/PR res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.791422:0:209004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f33ba5 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f33b9e expref: 9 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.791436:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1514700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:209004:1874324480106112:0@lo:104: 00000100:00100000:0.0:1787508614.791501:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508614.791532:0:229386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480106112 00000100:00100000:0.0:1787508614.791536:0:229386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480106112 00000100:00100000:0.0:1787508614.791570:0:229386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18156 00000100:00100000:0.0:1787508614.791576:0:229386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:209004:x1874324480106112:12345-0@lo:104: 00010000:00010000:0.0:1787508614.791590:0:229386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f33b9e lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f33ba5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.791634:0:229386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787508614.791640:0:229386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:209004:x1874324480106112:12345-0@lo:104: Request processed in 64us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508614.791646:0:229386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18156 00010000:00010000:0.0:1787508614.791666:0:202215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508614.791672:0:202215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f33b9e lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f33ba5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.791680:0:202215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:0.0:1787508614.791686:0:202215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f33b9e lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f33ba5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508614.791695:0:202215:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f33b9e lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f33ba5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.791720:0:202215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f33b9e lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33ba5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.791726:0:202215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787508614.791753:0:202215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f33b9e lrc: 1/0,0 mode: --/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33ba5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.791760:0:202215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8f800/0xb126349c40f33b9e lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33ba5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.791909:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508614.791912:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508614.791914:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508614.791922:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787508614.791936:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480106240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508614.791993:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508614.792035:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d21c4300 going to sleep for 11 seconds 00000100:00100000:0.0:1787508614.792055:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1514700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:209004:1874324480106112:0@lo:104: 00010000:00010000:0.0:1787508614.792074:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33c8c lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.792155:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480106240 00000100:00100000:2.0:1787508614.792161:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480106240 00010000:00010000:2.0:1787508614.792183:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f33ba5 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f33b9e expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.792223:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27845 00000100:00100000:2.0:1787508614.792230:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed436680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+10:3617:x1874324480106240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508614.792241:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508614.797235:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33c77 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.797254:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33c77 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.797261:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33c77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.797273:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33c77 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.797280:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.797285:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33c77 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.797293:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33c77 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.797312:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.797316:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.797321:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33c77 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.797328:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f33c77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.797340:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33c7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.797347:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33c7e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.797365:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33c7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.797370:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.797373:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33c7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.797383:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33c7e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.797391:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090ce7baf00) 00010000:00010000:1.0:1787508614.797393:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.797396:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33c7e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.797402:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f33c7e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.797459:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33c70 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae11c expref: 585 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.797470:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.797472:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508614.797477:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f33c70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae11c expref: 585 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.797487:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cdb25e00, rc 0) 00000100:00100000:1.0:1787508614.797565:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336063:x1874324509511680:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 6565us (6938us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508614.797575:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93799 00000100:00100000:3.0:1787508614.801340:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.801430:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509512064 00000100:00100000:1.0:1787508614.801449:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509512064 00000100:00100000:1.0:1787508614.801515:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93801 00000100:00100000:1.0:1787508614.801527:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336063:x1874324509512064:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508614.801552:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.801574:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33c93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae12a expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.801647:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33c9a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.801661:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33c9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.801673:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33c9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.801690:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33ca1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.801697:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.801703:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.801756:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33c9a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.801764:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33c9a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.801769:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33c9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.801775:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33c9a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.801781:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.801785:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33c9a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.801791:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33c9a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.801805:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.801807:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.801812:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33c9a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.801817:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f33c9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.801832:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.801838:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33ca1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.801843:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.801847:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.801850:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.801855:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33ca1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.801866:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090d171fc00) 00010000:00010000:1.0:1787508614.801868:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.801870:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33ca1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.801875:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33ca1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.801906:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33c93 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae12a expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.801916:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.801918:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508614.801922:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f33c93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae12a expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.801931:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b000, rc 0) 00000100:00100000:1.0:1787508614.802015:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336063:x1874324509512064:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 490us (687us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508614.802022:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93801 00000001:00080000:0.0:1787508614.806585:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589962004 is committed 00000001:00080000:0.0:1787508614.806604:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589962003 is committed 00000001:00080000:0.0:1787508614.806634:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589962001 is committed 00000020:00080000:0.0:1787508614.806640:0:202955:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9090d1c88240 refcount 2 committed 0 result 0 batchid 4294998378 00000020:00080000:0.0:1787508614.806645:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cd2caf00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d1c88e40 00000020:00080000:0.0:1787508614.806648:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a2:0x5:0x0].586 00000020:00080000:0.0:1787508614.806651:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cd2ca700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090d7421000 00000020:00080000:0.0:1787508614.806654:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd1:0xf:0x0].43 00000020:00080000:1.0:1787508614.806695:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998373 00010000:00010000:2.0:1787508614.807408:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f337ca lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.807424:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f337ca lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.807433:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f337ca lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.807449:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247be00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.807455:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f337ca lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.807462:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f337ca lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.807486:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d2:0x0].0x0 (ffff9090ce7ba600) 00010000:00010000:2.0:1787508614.807489:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.807494:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f337ca lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.807500:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f337ca lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.807513:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f337d1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x291:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.807519:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f337d1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x291:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.807525:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f337d1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x291:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.807529:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.807532:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f337d1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x291:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.807538:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f337d1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x291:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.807544:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x291:0x0].0x0 (ffff9090ce7bad00) 00010000:00010000:2.0:1787508614.807546:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.807548:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f337d1 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x291:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.807554:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f337d1 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x291:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.807572:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f33913 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.807578:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f33913 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.807585:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f33913 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.807589:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.807592:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f33913 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.807598:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f33913 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.807604:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d2:0x0].0x0 (ffff9090ce7ba600) 00010000:00010000:2.0:1787508614.807605:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508614.807608:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f33913 lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.807612:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f33913 lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x13d2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.807626:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f33936 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.807631:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f33936 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.807637:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f33936 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.807642:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.807645:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f33936 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.807650:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f33936 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.807656:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x291:0x0].0x0 (ffff9090ce7bad00) 00010000:00010000:2.0:1787508614.807658:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508614.807660:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f33936 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.807666:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f33936 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x291:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787508614.807805:0:202955:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9090d1d88d80 refcount 2 committed 0 result 0 batchid 4294998377 00000020:00080000:0.0:1787508614.807809:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521d00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d1d88480 00000020:00080000:0.0:1787508614.807813:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a2:0x5:0x0].585 00000020:00080000:0.0:1787508614.807815:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090ce62b400 00000020:00080000:0.0:1787508614.807818:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd1:0xf:0x0].42 00000020:00080000:1.0:1787508614.807853:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294998378 committed batchid 4294998373 00000020:00080000:1.0:1787508614.807935:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998373 00000020:00080000:0.0:1787508614.808283:0:202955:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 4294998376 batchid updated 00000020:00080000:0.0:1787508614.808291:0:202955:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 4294998375 batchid updated 00010000:00010000:2.0:1787508614.808637:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f33ba5 lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f33b9e expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.808655:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x168:0x0].0x0 (ffff9090c6987900) 00010000:00010000:2.0:1787508614.808660:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33c8c lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.808670:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33c8c lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.808677:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33c8c lrc: 4/1,0 mode: PR/PR res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.808714:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508614.808810:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed436680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480106240:12345-0@lo:103:ldlm_bl.0 Request processed in 16578us (16814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.808822:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27845 00000100:00100000:3.0:1787508614.809348:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed434a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480106240:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508614.809548:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33c8c lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.809562:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33c8c lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508614.809630:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd2:0x168:0x0]: returning size 4096 00000004:00200000:0.0:1787508614.809636:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508614.809685:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6800/0xb126349c40f33c85 lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x168:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae123 expref: 7 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.809703:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33c8c lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae123 expref: 6 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.809711:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x168:0x0].0x0 (ffff9090c6987900) 00010000:00010000:0.0:1787508614.809714:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508614.809717:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7c00, rc 0) 00000100:00100000:0.0:1787508614.809774:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1517100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336062:x1874324509511808:12345-192.168.201.30@tcp:101:rm.0 Request processed in 18481us (19099us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508614.809794:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93800 00000100:00100000:3.0:1787508614.813808:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.813896:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509512192 00000100:00100000:1.0:1787508614.813906:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509512192 00000100:00100000:1.0:1787508614.814011:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93802 00000100:00100000:1.0:1787508614.814022:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336063:x1874324509512192:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508614.814043:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.814064:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33ca8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae131 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.814137:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33caf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.814153:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33caf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.814166:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33caf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.814177:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33cb6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.814184:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.814191:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.814294:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f33cbd lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.814304:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f33cbd lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.814311:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f33cbd lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508614.814670:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125a:0x0]: returning size 4096 00000004:00200000:1.0:1787508614.814676:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1787508614.814701:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f33cbd lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.814714:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33caf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.814719:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33caf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.814726:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33caf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.814732:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33caf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.814739:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.814743:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33caf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.814749:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33caf lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.814761:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.814764:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.814769:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33caf lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.814775:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33caf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.814788:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.814799:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33cb6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.814805:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.814810:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.814813:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.814818:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33cb6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.814825:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd200) 00010000:00010000:1.0:1787508614.814828:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.814831:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33cb6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.814837:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33cb6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.814865:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33ca8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae131 expref: 586 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.814878:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f33cbd lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae131 expref: 585 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.814884:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125a:0x0].0x0 (ffff9090ccb87200) 00010000:00010000:1.0:1787508614.814887:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508614.814890:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4c00, rc 0) 00000100:00100000:1.0:1787508614.815152:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:336063:x1874324509512192:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 1130us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.815161:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93802 00000100:00100000:0.0:1787508614.822289:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.822369:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509512448 00000100:00100000:1.0:1787508614.822381:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509512448 00000100:00100000:1.0:1787508614.822457:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93803 00000100:00100000:1.0:1787508614.822469:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336062:x1874324509512448:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508614.822494:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.822516:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33cc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae138 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508614.822657:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125a:0x0]: returning size 4096 00010000:00010000:1.0:1787508614.822761:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33cc4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae138 expref: 15 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.822776:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.822779:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508614.822784:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33cc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae138 expref: 15 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.822799:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5400, rc 0) 00000100:00100000:1.0:1787508614.822875:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336062:x1874324509512448:12345-192.168.201.30@tcp:101:rm.0 Request processed in 408us (597us total) trans 12884944067 rc 301/301 00000100:00100000:1.0:1787508614.822882:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93803 00000100:00100000:0.0:1787508614.826003:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.826150:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509512576 00000100:00100000:1.0:1787508614.826163:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509512576 00000100:00100000:1.0:1787508614.826226:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93804 00000100:00100000:1.0:1787508614.826237:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:336063:x1874324509512576:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508614.826260:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.826283:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33cd2 lrc: 2/0,0 mode: --/CR res: [0x2000013a0:0x170:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae13f expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.826344:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33cd9 lrc: 3/1,0 mode: --/PR res: [0x2000013a0:0x170:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.826360:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33cd9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.826372:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33cd9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508614.826416:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a0:0x170:0x0]: returning size 4096 00000004:00200000:1.0:1787508614.826421:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787508614.826468:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33cd2 lrc: 0/0,0 mode: --/CR res: [0x2000013a0:0x170:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae13f expref: 587 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.826487:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33cd9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae13f expref: 586 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.826496:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x170:0x0].0x0 (ffff9090ccb87000) 00010000:00010000:1.0:1787508614.826499:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508614.826502:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5600, rc 0) 00000100:00100000:1.0:1787508614.826568:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336063:x1874324509512576:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 332us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508614.826575:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93804 00000100:00100000:2.0:1787508614.829455:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.829558:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509512704 00000100:00100000:0.0:1787508614.829568:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509512704 00000100:00100000:0.0:1787508614.829629:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93805 00000100:00100000:0.0:1787508614.829641:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:336063:x1874324509512704:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508614.829662:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508614.829682:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f33ce0 lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x168:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae146 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.829758:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f33ce7 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x168:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.829772:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f33ce7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.829795:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f33ce7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508614.829839:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd2:0x168:0x0]: returning size 4096 00000004:00200000:0.0:1787508614.829844:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508614.829888:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f33ce0 lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x168:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae146 expref: 642 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.829906:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f33ce7 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae146 expref: 641 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.829914:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x168:0x0].0x0 (ffff9090c6987900) 00010000:00010000:0.0:1787508614.829917:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508614.829921:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7a00, rc 0) 00000100:00100000:0.0:1787508614.830025:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+641:336063:x1874324509512704:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 385us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508614.830033:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93805 00000100:00100000:0.0:1787508614.832881:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.832990:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509512832 00000100:00100000:2.0:1787508614.833000:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509512832 00000100:00100000:2.0:1787508614.833058:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15404 00000100:00100000:2.0:1787508614.833068:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde33c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336062:x1874324509512832:12345-192.168.201.30@tcp:37:rm.0 00000100:00100000:1.0:1787508614.836198:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.836282:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509513088 00000100:00100000:3.0:1787508614.836293:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509513088 00000100:00100000:3.0:1787508614.836359:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93806 00000100:00100000:3.0:1787508614.836370:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336063:x1874324509513088:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:3.0:1787508614.836421:0:202228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508614.836459:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f33cbd lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae131 expref: 586 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.836479:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125a:0x0].0x0 (ffff9090ccb87200) 00010000:00010000:3.0:1787508614.836484:0:202228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508614.836508:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33cee lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x125a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.836523:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948d800/0xb126349c40f33c5b lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae10e expref: 15 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.836532:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33cee lrc: 4/0,1 mode: --/PW res: [0x2000013a4:0x125a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.836568:0:202228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948d800/0xb126349c40f33c5b lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae10e expref: 15 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.836582:0:202228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948d800/0xb126349c40f33c5b lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae10e expref: 15 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.836597:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d4855500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480106368:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508614.836690:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.839497:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d4855500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480106368:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508614.839537:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33cee lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x125a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.840437:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde33c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336062:x1874324509512832:12345-192.168.201.30@tcp:37:rm.0 Request processed in 7365us (7560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.840459:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15404 00000100:00100000:0.0:1787508614.842846:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.843222:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509513216 00000100:00100000:2.0:1787508614.843233:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509513216 00010000:00010000:2.0:1787508614.843277:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948d800/0xb126349c40f33c5b lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae10e expref: 14 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.843321:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27846 00000100:00100000:2.0:1787508614.843332:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2401:x1874324509513216:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508614.843351:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508614.843525:0:229383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948d800/0xb126349c40f33c5b lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae10e expref: 14 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.843541:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948d800/0xb126349c40f33c5b lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae10e expref: 14 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.843566:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948d800/0xb126349c40f33c5b lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae10e expref: 14 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.843588:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125a:0x0].0x0 (ffff9090ccb87200) 00010000:00010000:2.0:1787508614.843594:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33cee lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x125a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.843603:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33cee lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.843611:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33cee lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x125a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.843644:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508614.843743:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2401:x1874324509513216:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 412us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.843752:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27846 00010000:00010000:1.0:1787508614.843821:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33cee lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.843830:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33cee lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.843859:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33cf5 lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x170:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.843872:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948c400/0xb126349c40f33c69 lrc: 2/0,0 mode: PR/PR res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae115 expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.843880:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33cd9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae13f expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.843887:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33cf5 lrc: 5/0,1 mode: --/PW res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.843917:0:202228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33cd9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae13f expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.843931:0:202228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33cd9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae13f expref: 585 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.843984:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d021bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480106496:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508614.844053:0:202228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948c400/0xb126349c40f33c69 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae115 expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.844062:0:202228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948c400/0xb126349c40f33c69 lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae115 expref: 12 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.844071:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0218700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480106624:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508614.844093:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9ff2600 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.851321:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.851526:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509513344 00000100:00100000:3.0:1787508614.851538:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509513344 00000100:00100000:3.0:1787508614.851602:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15405 00000100:00100000:3.0:1787508614.851613:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336062:x1874324509513344:12345-192.168.201.30@tcp:37:rm.0 00000100:00100000:3.0:1787508614.857894:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336062:x1874324509513344:12345-192.168.201.30@tcp:37:rm.0 Request processed in 6271us (6574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.857907:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15405 00000100:00100000:1.0:1787508614.859101:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d021bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480106496:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508614.859118:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0218700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480106624:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508614.859142:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33cf5 lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.861043:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.861075:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.861169:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509513472 00000100:00100000:2.0:1787508614.861179:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509513472 00010000:00010000:2.0:1787508614.861232:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33cd9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae13f expref: 586 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.861269:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509513600 00000100:00100000:2.0:1787508614.861272:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509513600 00010000:00010000:2.0:1787508614.861285:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948c400/0xb126349c40f33c69 lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae115 expref: 13 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.861317:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27847 00000100:00100000:2.0:1787508614.861326:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0218700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:2400:x1874324509513472:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508614.861341:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508614.861361:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33cd9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae13f expref: 586 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.861377:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33cd9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae13f expref: 586 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.861398:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33cd9 lrc: 0/0,0 mode: --/PR res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae13f expref: 586 pid: 202227 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.861414:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x170:0x0].0x0 (ffff9090ccb87000) 00010000:00010000:2.0:1787508614.861419:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33cf5 lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.861430:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33cf5 lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.861437:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508614.861504:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0218700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:2400:x1874324509513472:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 178us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.861513:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27847 00000100:00100000:2.0:1787508614.861531:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27848 00000100:00100000:2.0:1787508614.861538:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2400:x1874324509513600:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508614.861546:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508614.861552:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948c400/0xb126349c40f33c69 lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae115 expref: 13 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.861561:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948c400/0xb126349c40f33c69 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae115 expref: 13 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.861579:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948c400/0xb126349c40f33c69 lrc: 0/0,0 mode: --/PR res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae115 expref: 13 pid: 202228 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.861590:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x170:0x0].0x0 (ffff9090ccb87000) 00010000:00010000:2.0:1787508614.861594:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33cf5 lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.861602:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33cf5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.861609:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33cf5 lrc: 4/0,1 mode: PW/PW res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.861631:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508614.861652:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2400:x1874324509513600:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 114us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.861659:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27848 00010000:00010000:1.0:1787508614.862169:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33cf5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.862179:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33cf5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.862236:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c96e4a00/0xb126349c40f33cfc lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.862244:0:202228:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c96e4a00/0xb126349c40f33cfc lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x0 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.862257:0:202228:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c96e4a00/0xb126349c40f33cfc lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.862276:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0218000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:202228:1874324480106752:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1787508614.862319:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508614.862351:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9ff2600 going to sleep for 11 seconds 00000100:00100000:3.0:1787508614.862505:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480106752 00000100:00100000:3.0:1787508614.862512:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480106752 00000100:00100000:3.0:1787508614.862552:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29685 00000100:00100000:3.0:1787508614.862561:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:202228:x1874324480106752:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1787508614.862578:0:202231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.862596:0:202231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f33d03 lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f33cfc expref: -99 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.862618:0:202231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33c8c lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae123 expref: 5 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.862628:0:202231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f33ce7 lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae146 expref: 640 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.862638:0:202231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f33d03 lrc: 5/0,0 mode: --/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f33cfc expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.862661:0:202231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f33ce7 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae146 expref: 640 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.862674:0:202231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f33ce7 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae146 expref: 640 pid: 209004 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.862691:0:202231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d4855180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:202231:1874324480106880:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508614.862764:0:202231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33c8c lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae123 expref: 5 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.862775:0:202231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33c8c lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae123 expref: 5 pid: 209004 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.862784:0:202231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d4856300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:202231:1874324480107008:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508614.862807:0:202231:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.866166:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.866308:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509513728 00000100:00100000:0.0:1787508614.866318:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509513728 00010000:00010000:0.0:1787508614.866372:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f33ce7 lrc: 5/0,0 mode: PR/PR res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae146 expref: 641 pid: 209004 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.866416:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27849 00000100:00100000:0.0:1787508614.866427:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+641:2403:x1874324509513728:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508614.866450:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508614.866457:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f33ce7 lrc: 5/0,0 mode: PR/PR res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae146 expref: 641 pid: 209004 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.866473:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f33ce7 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae146 expref: 641 pid: 209004 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.866495:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x168:0x0].0x0 (ffff9090c6987900) 00010000:00010000:0.0:1787508614.866503:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f33d03 lrc: 3/0,0 mode: --/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f33cfc expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.866513:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f33d03 lrc: 3/0,0 mode: --/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f33cfc expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.866520:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508614.866584:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+641:2403:x1874324509513728:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 160us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508614.866591:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27849 00010000:00010000:3.0:1787508614.867072:0:202231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f33ce7 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae146 expref: 640 pid: 209004 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.867090:0:202231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d4855180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:202231:1874324480106880:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508614.867102:0:202231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d4856300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:202231:1874324480107008:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508614.867132:0:202231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f33d03 lrc: 3/0,0 mode: --/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33cfc expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.867142:0:202231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x168:0x0].0x0 (ffff9090c6987900) 00010000:00010000:3.0:1787508614.867145:0:202231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508614.867148:0:202231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f33d03 lrc: 3/0,0 mode: --/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33cfc expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.867158:0:202231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f33d03 lrc: 3/0,0 mode: --/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33cfc expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.867172:0:202231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fa00, rc 0) 00000100:00100000:3.0:1787508614.867303:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:202228:x1874324480106752:12345-0@lo:101:mdt00_002.0 Request processed in 4743us (4982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.867312:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29685 00000100:00100000:0.0:1787508614.868504:0:202228:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589962004 gen 2 00000004:00080000:0.0:1787508614.868515:0:202228:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961996 committed transno 8589962004 00000020:00080000:0.0:1787508614.868521:0:202228:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9090d3f11300 refcount 2 committed 0 result 0 batchid 8589961983 00000020:00080000:0.0:1787508614.868525:0:202228:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d3f11900 00000020:00080000:0.0:1787508614.868531:0:202228:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd2:0x1:0x0].1785 00000020:00080000:0.0:1787508614.868534:0:202228:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090ce62ac00 00000020:00080000:0.0:1787508614.868537:0:202228:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1:0x0].1778 00000004:00080000:0.0:1787508614.868574:0:202228:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961997 committed transno 8589962004 00000004:00080000:0.0:1787508614.868585:0:202228:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589961999 committed transno 8589962004 00000004:00080000:0.0:1787508614.868598:0:202228:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589962004 committed transno 8589962004 00000100:00100000:0.0:1787508614.868614:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0218000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:202228:1874324480106752:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1787508614.868636:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c96e4a00/0xb126349c40f33cfc lrc: 4/0,1 mode: --/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33d03 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.868647:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c96e4a00/0xb126349c40f33cfc lrc: 4/0,1 mode: --/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33d03 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787508614.870344:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589961983 committed batchid 8589961982 00000020:00080000:1.0:1787508614.870429:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961982 00000100:00100000:1.0:1787508614.872045:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.872089:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.872169:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509513984 00000100:00100000:2.0:1787508614.872178:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509513984 00000100:00100000:2.0:1787508614.872247:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15406 00000100:00100000:2.0:1787508614.872258:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336062:x1874324509513984:12345-192.168.201.30@tcp:35:rm.0 00000100:00100000:2.0:1787508614.872508:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336062:x1874324509513984:12345-192.168.201.30@tcp:35:rm.0 Request processed in 250us (470us total) trans 12884944068 rc 0/0 00000100:00100000:2.0:1787508614.872515:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15406 00000100:00100000:0.0:1787508614.875264:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509514112 00000100:00100000:0.0:1787508614.875281:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509514112 00010000:00010000:0.0:1787508614.875329:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33c8c lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae123 expref: 6 pid: 209004 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.875380:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27850 00000100:00100000:0.0:1787508614.875390:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2401:x1874324509514112:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508614.875405:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508614.875412:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33c8c lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae123 expref: 6 pid: 209004 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.875427:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33c8c lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae123 expref: 6 pid: 209004 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.875462:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7c00/0xb126349c40f33c8c lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae123 expref: 6 pid: 209004 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.875481:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x168:0x0].0x0 (ffff9090c6987900) 00010000:00010000:0.0:1787508614.875488:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f33d03 lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33cfc expref: 5 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.875498:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f33d03 lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f33cfc expref: 5 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.875506:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f33d03 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f33cfc expref: 5 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.875541:0:202211:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f33d03 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33cfc expref: 5 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508614.875555:0:202211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed434e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:202211:1874324480107136:0@lo:105: 00000100:00100000:0.0:1787508614.875623:0:202211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508614.875671:0:202211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d21c4300 going to sleep for 11 seconds 00000100:00100000:2.0:1787508614.875811:0:202209:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787508614.875825:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480107136 00000100:00100000:2.0:1787508614.875829:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480107136 00000100:00100000:2.0:1787508614.875864:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18157 00000100:00100000:2.0:1787508614.875871:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d3ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:202211:x1874324480107136:12345-0@lo:105: 00010000:00010000:2.0:1787508614.875882:0:202209:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c96e4a00/0xb126349c40f33cfc lrc: 5/0,1 mode: --/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33d03 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.875893:0:202209:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c96e4a00/0xb126349c40f33cfc lrc: 5/0,1 mode: --/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33d03 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.875902:0:202209:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c96e4a00/0xb126349c40f33cfc lrc: 5/0,1 mode: --/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33d03 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.875910:0:202209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c96e4a00/0xb126349c40f33cfc lrc: 5/0,1 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f33d03 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.875918:0:202209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c96e4a00/0xb126349c40f33cfc lrc: 6/0,1 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f33d03 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.875926:0:202209:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c96e4a00/0xb126349c40f33cfc lrc: 6/0,1 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f33d03 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.875977:0:202209:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090c96e4a00) 00000100:00100000:2.0:1787508614.876021:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d3ef0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:202211:x1874324480107136:12345-0@lo:105: Request processed in 150us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.876028:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18157 00000100:00100000:2.0:1787508614.876089:0:202211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed434e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:202211:1874324480107136:0@lo:105: 00010000:00010000:2.0:1787508614.876106:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508614.876142:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0219500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2401:x1874324509514112:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 754us (4052us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.876153:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27850 00010000:00010000:2.0:1787508614.876175:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c96e4a00/0xb126349c40f33cfc lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33d03 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.876185:0:202228:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c96e4a00/0xb126349c40f33cfc lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33d03 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.876332:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.877208:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509514240 00000100:00100000:3.0:1787508614.877216:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509514240 00000100:00100000:3.0:1787508614.877250:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93807 00000100:00100000:3.0:1787508614.877258:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336062:x1874324509514240:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508614.877277:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.877295:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33d0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae14d expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787508614.877728:0:202228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1:0x0].1780, 344 off1832992 00010000:00010000:3.0:1787508614.877917:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d11 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.877931:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.877971:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.877986:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.877993:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.878000:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.878080:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33d1f lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.878089:0:205405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33cee lrc: 2/0,1 mode: PW/PW res: [0x2000013a4:0x125a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.878097:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33d1f lrc: 4/1,0 mode: --/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.878114:0:205405:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33cee lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.878128:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33d1f lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787508614.878603:0:202228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x1:0x0].1787, 552 off2038944 00000004:00080000:2.0:1787508614.878613:0:202228:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d74d9a80 with version 3455 00000004:00080000:1.0:1787508614.878700:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3455 rpc_version 3455 00000020:00100000:1.0:1787508614.878732:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787508614.878742:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d0218000 x1874324480107392/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1528/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787508614.878763:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0218000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480107392:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787508614.878973:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508614.879009:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9ff2180 going to sleep for 11 seconds 00000100:00100000:0.0:1787508614.879090:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480107392 00000100:00100000:0.0:1787508614.879098:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480107392 00000100:00100000:0.0:1787508614.879142:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29686 00000100:00100000:0.0:1787508614.879151:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:202248:x1874324480107392:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787508614.879615:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:202248:x1874324480107392:12345-0@lo:1000:osp_up1-0.0 Request processed in 463us (641us total) trans 8589962005 rc 0/0 00000100:00100000:0.0:1787508614.879623:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29686 00000100:00100000:1.0:1787508614.879749:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0218000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480107392:0@lo:1000:osp_up1-0.0 00000004:00010000:2.0:1787508614.879935:0:202228:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000131366c1 reply state 0000000035ee2a25 transno 12884944069 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33cf5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.879988:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33cf5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.879998:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x170:0x0].0x0 (ffff9090ccb87000) 00010000:00010000:2.0:1787508614.880001:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787508614.880004:0:202228:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787508614.880012:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c96e4a00/0xb126349c40f33cfc lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33d03 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.880020:0:202228:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c96e4a00/0xb126349c40f33cfc lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33d03 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787508614.880032:0:202228:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd2:0x168:0x0] 00000004:00010000:2.0:1787508614.880042:0:202228:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000131366c1 reply state 0000000035ee2a25 transno 12884944069 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33cee lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.880056:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33cee lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x125a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.880062:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125a:0x0].0x0 (ffff9090ccb87200) 00010000:00010000:2.0:1787508614.880065:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508614.880067:0:202228:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33d1f lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.880076:0:202228:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33d1f lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.880082:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33d1f lrc: 4/1,0 mode: PR/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.880109:0:202228:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1787508614.880120:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125a:0x0]: returning size 4096 00000100:00100000:2.0:1787508614.880244:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336063:x1874324509513088:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 43873us (44054us total) trans 12884944069 rc 0/0 00000100:00100000:2.0:1787508614.880252:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93806 00010000:00010000:3.0:1787508614.880448:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33d1f lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.880456:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33d1f lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508614.880548:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125a:0x0]: returning size 4096 00000004:00200000:3.0:1787508614.880552:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1787508614.880569:0:205405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33d1f lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.880582:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d11 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.880588:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d11 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.880597:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.880604:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d11 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.880610:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.880614:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d11 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.880622:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d11 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.880634:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.880637:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.880641:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d11 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.880649:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.880663:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.880670:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d18 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.880675:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.880680:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.880683:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.880689:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d18 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.880696:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd200) 00010000:00010000:3.0:1787508614.880699:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.880702:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d18 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.880708:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.880738:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33d0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae14d expref: 15 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.880751:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33d1f lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae14d expref: 14 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.880759:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125a:0x0].0x0 (ffff9090ccb87200) 00010000:00010000:3.0:1787508614.880761:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508614.880763:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e200, rc 0) 00000100:00100000:3.0:1787508614.880809:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336062:x1874324509514240:12345-192.168.201.30@tcp:101:rm.0 Request processed in 3551us (4477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.880815:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93807 00000100:00100000:2.0:1787508614.892551:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.892662:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509514496 00000100:00100000:3.0:1787508614.892675:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509514496 00000100:00100000:3.0:1787508614.892793:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93808 00000100:00100000:3.0:1787508614.892805:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336062:x1874324509514496:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:3.0:1787508614.892869:0:230618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787508614.892898:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33d1f lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x125a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae14d expref: 14 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.892921:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125a:0x0].0x0 (ffff9090ccb87200) 00010000:00010000:3.0:1787508614.892931:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f33bb3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0d6 expref: 13 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.892971:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.892976:0:230618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508614.892998:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33d26 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.893012:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33bd6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0e4 expref: 585 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.893019:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33d26 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.893050:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33bd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0e4 expref: 585 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.893065:0:230618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33bd6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0e4 expref: 585 pid: 202226 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.893081:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d4856300 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480107520:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508614.893168:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.896137:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.896310:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d4856300 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480107520:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508614.896341:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33d26 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.896509:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509514752 00000100:00100000:3.0:1787508614.896517:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509514752 00000100:00100000:3.0:1787508614.896618:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93809 00000100:00100000:3.0:1787508614.896629:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509514752:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508614.896653:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.896672:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33d2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae154 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.896749:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d34 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.896763:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.896773:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.896803:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d3b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.896810:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.896816:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.896882:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d34 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.896890:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d34 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.896901:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.896908:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d34 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.896914:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.896918:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d34 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.896926:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d34 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.896983:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.896986:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.896990:0:202226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33d26 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.897000:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d34 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.897006:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.897020:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.897026:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d3b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.897032:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.897037:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.897040:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.897045:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d3b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.897052:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xce5b6a33 (ffff9090ccb87500) 00010000:00010000:3.0:1787508614.897054:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.897056:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d3b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.897061:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d3b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.897094:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33d2d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae154 expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.897104:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.897106:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508614.897109:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33d2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae154 expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.897118:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ea00, rc 0) 00000100:00100000:3.0:1787508614.897178:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509514752:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 549us (1050us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508614.897257:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93809 00000100:00100000:1.0:1787508614.898671:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.898761:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509514880 00000100:00100000:2.0:1787508614.898771:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509514880 00000100:00100000:1.0:1787508614.899758:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.899828:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509515008 00000100:00100000:3.0:1787508614.899835:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509515008 00000100:00100000:3.0:1787508614.899896:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93810 00000100:00100000:3.0:1787508614.899908:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+587:336064:x1874324509515008:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508614.899931:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.899991:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33d42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae15b expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.900058:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33d49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.900071:0:202227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33d26 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.900079:0:202227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33d49 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.900098:0:202227:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33d26 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.900113:0:202227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33d49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.900810:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33bd6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0e4 expref: 588 pid: 202226 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.900893:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27851 00000100:00100000:2.0:1787508614.900903:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+588:2400:x1874324509514880:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508614.900915:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508614.900921:0:225839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33bd6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0e4 expref: 588 pid: 202226 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.900934:0:225839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33bd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0e4 expref: 588 pid: 202226 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.900978:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f33bd6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae0e4 expref: 588 pid: 202226 timeout: 13685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.900995:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.900999:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33d49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.901006:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33d26 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.901013:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33d26 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.901019:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33d26 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.901026:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33d49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.901036:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33d49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.901056:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508614.901118:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+587:2400:x1874324509514880:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 216us (2455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.901125:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27851 00010000:00010000:3.0:1787508614.901379:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33d26 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.901388:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33d26 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.901406:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f33d50 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.901415:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f33d50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.901424:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f33d50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.901532:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f33d57 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x125a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.901541:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f33d57 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x125a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.901548:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f33d57 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x125a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.901565:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f33d5e lrc: 3/0,1 mode: --/EX res: [0x2000013a0:0x170:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.901573:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f33d5e lrc: 3/0,1 mode: EX/EX res: [0x2000013a0:0x170:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.901579:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f33d5e lrc: 3/0,1 mode: EX/EX res: [0x2000013a0:0x170:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.901612:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c9a3b400/0xb126349c40f33d65 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.901619:0:230618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c9a3b400/0xb126349c40f33d65 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x0 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.901630:0:230618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c9a3b400/0xb126349c40f33d65 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.901654:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d4855180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:230618:1874324480107648:0@lo:101:mdt00_006.0 00000100:00100000:3.0:1787508614.901704:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508614.901733:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9540 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.901800:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480107648 00000100:00100000:1.0:1787508614.901808:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480107648 00000100:00100000:1.0:1787508614.901850:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29687 00000100:00100000:1.0:1787508614.901859:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:230618:x1874324480107648:12345-0@lo:101:mdt00_006.0 00010000:00010000:1.0:1787508614.901879:0:225829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.901895:0:225829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f33d6c lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f33d65 expref: -99 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.901914:0:225829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f33d03 lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33cfc expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.901924:0:225829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f33d6c lrc: 4/0,0 mode: --/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f33d65 expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.901973:0:225829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f33d03 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f33cfc expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508614.901985:0:225829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3c000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:225829:1874324480107776:0@lo:104: 00000100:00100000:1.0:1787508614.902016:0:225829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508614.902051:0:225829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9ff2180 going to sleep for 11 seconds 00000100:00100000:0.0:1787508614.903332:0:229386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480107776 00000100:00100000:0.0:1787508614.903344:0:229386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480107776 00000100:00100000:0.0:1787508614.903527:0:229386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18158 00000100:00100000:0.0:1787508614.903537:0:229386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091c9458a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:225829:x1874324480107776:12345-0@lo:104: 00010000:00010000:0.0:1787508614.903551:0:229386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c96e4a00/0xb126349c40f33cfc lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f33d03 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.903642:0:229386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787508614.903648:0:229386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091c9458a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:225829:x1874324480107776:12345-0@lo:104: Request processed in 113us (1631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508614.903655:0:229386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18158 00000100:00100000:3.0:1787508614.903720:0:225829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3c000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:225829:1874324480107776:0@lo:104: 00010000:00010000:3.0:1787508614.903748:0:225829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f33d6c lrc: 3/0,0 mode: --/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33d65 expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.903759:0:225829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x168:0x0].0x0 (ffff9090c6987900) 00010000:00010000:3.0:1787508614.903762:0:225829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787508614.903766:0:225829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f33d6c lrc: 3/0,0 mode: --/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33d65 expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.903776:0:225829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f33d6c lrc: 3/0,0 mode: --/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33d65 expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.903797:0:225829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5400, rc 0) 00000100:00100000:3.0:1787508614.903837:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:230618:x1874324480107648:12345-0@lo:101:mdt00_006.0 Request processed in 1980us (2133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.903843:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29687 00000100:00100000:3.0:1787508614.903878:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d4855180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:230618:1874324480107648:0@lo:101:mdt00_006.0 00010000:00010000:3.0:1787508614.903895:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c9a3b400/0xb126349c40f33d65 lrc: 4/0,1 mode: --/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33d6c expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.903905:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c9a3b400/0xb126349c40f33d65 lrc: 4/0,1 mode: --/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33d6c expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.904460:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787508614.904468:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c96e4a00/0xb126349c40f33cfc lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f33d03 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.904477:0:204785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4a00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:1.0:1787508614.904483:0:204785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c96e4a00/0xb126349c40f33cfc lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f33d03 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508614.904491:0:204785:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c96e4a00/0xb126349c40f33cfc lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f33d03 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.904531:0:204785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c96e4a00/0xb126349c40f33cfc lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33d03 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.904538:0:204785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787508614.904589:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091c9459f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480107904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787508614.904635:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508614.904705:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480107904 00000100:00100000:2.0:1787508614.904712:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480107904 00010000:00010000:2.0:1787508614.904738:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f33d03 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f33cfc expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508614.904763:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27852 00000100:00100000:2.0:1787508614.904769:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4855880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+8:3617:x1874324480107904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508614.904791:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508614.905061:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c96e4a00/0xb126349c40f33cfc lrc: 1/0,0 mode: --/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33d03 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.905069:0:204785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c96e4a00/0xb126349c40f33cfc lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33d03 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.905086:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508614.905088:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508614.905090:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787508614.906817:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589962005 is committed 00000020:00080000:0.0:1787508614.906831:0:202955:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 4294998378 batchid updated 00010000:00010000:3.0:1787508614.907138:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f33d03 lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x168:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f33cfc expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.907159:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x168:0x0].0x0 (ffff9090c6987900) 00010000:00010000:3.0:1787508614.907165:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f33d6c lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33d65 expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.907177:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f33d6c lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f33d65 expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.907202:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f33d6c lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f33d65 expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.907244:0:205406:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f33d6c lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33d65 expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.907260:0:205406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d4854380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:205406:1874324480108032:0@lo:105: 00000100:00100000:3.0:1787508614.907324:0:205406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1787508614.907386:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998378 00000004:00080000:1.0:1787508614.907455:0:202975:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d9ff2b40 with version 13599 00000100:00100000:3.0:1787508614.907972:0:205406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9540 going to sleep for 11 seconds 00000020:00080000:1.0:1787508614.908028:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294998374 cancel update log [0x2000013a2:0x5:0x0].582: rc = 0 00000020:00080000:1.0:1787508614.908114:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294998374 cancel update log [0x240000bd1:0xf:0x0].39: rc = 0 00000004:00080000:1.0:1787508614.908142:0:202975:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d9ff2a80 with version 13600 00000020:00080000:1.0:1787508614.908145:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294998375 cancel update log [0x2000013a2:0x5:0x0].583: rc = 0 00000020:00080000:1.0:1787508614.908165:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294998375 cancel update log [0x240000bd1:0xf:0x0].40: rc = 0 00000004:00080000:1.0:1787508614.908256:0:202975:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d9ff20c0 with version 13601 00000020:00080000:1.0:1787508614.908261:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294998376 cancel update log [0x2000013a2:0x5:0x0].584: rc = 0 00000020:00080000:1.0:1787508614.908286:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294998376 cancel update log [0x240000bd1:0xf:0x0].41: rc = 0 00000004:00080000:1.0:1787508614.908306:0:202975:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d9ff29c0 with version 13602 00000020:00080000:1.0:1787508614.908309:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294998377 cancel update log [0x2000013a2:0x5:0x0].585: rc = 0 00000020:00080000:1.0:1787508614.908328:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294998377 cancel update log [0x240000bd1:0xf:0x0].42: rc = 0 00000004:00080000:1.0:1787508614.908418:0:202975:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d9ff2c00 with version 13603 00000020:00080000:1.0:1787508614.908422:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294998378 cancel update log [0x2000013a2:0x5:0x0].586: rc = 0 00000020:00080000:1.0:1787508614.908457:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294998378 cancel update log [0x240000bd1:0xf:0x0].43: rc = 0 00000020:00080000:1.0:1787508614.908464:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998378 00000004:00080000:2.0:1787508614.908575:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13599 rpc_version 13599 00000020:00100000:2.0:1787508614.908604:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787508614.908616:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d0218700 x1874324480108288/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787508614.908639:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0218700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480108288:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508614.908693:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508614.908759:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787508614.908791:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480108032 00000100:00100000:2.0:1787508614.908798:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480108032 00000100:00100000:2.0:1787508614.908852:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18159 00000100:00100000:2.0:1787508614.908861:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4856680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:205406:x1874324480108032:12345-0@lo:105: 00010000:00010000:2.0:1787508614.908877:0:202209:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c9a3b400/0xb126349c40f33d65 lrc: 5/0,1 mode: --/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33d6c expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.908888:0:202209:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c9a3b400/0xb126349c40f33d65 lrc: 5/0,1 mode: --/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33d6c expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.908898:0:202209:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c9a3b400/0xb126349c40f33d65 lrc: 5/0,1 mode: --/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33d6c expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.908907:0:202209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c9a3b400/0xb126349c40f33d65 lrc: 5/0,1 mode: EX/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f33d6c expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.908914:0:202209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c9a3b400/0xb126349c40f33d65 lrc: 6/0,1 mode: EX/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f33d6c expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.908923:0:202209:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c9a3b400/0xb126349c40f33d65 lrc: 6/0,1 mode: EX/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f33d6c expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.908971:0:202209:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090c9a3b400) 00000100:00100000:2.0:1787508614.909018:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4856680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:205406:x1874324480108032:12345-0@lo:105: Request processed in 158us (1694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.909026:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18159 00000100:00100000:2.0:1787508614.909065:0:205406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d4854380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:205406:1874324480108032:0@lo:105: 00010000:00010000:2.0:1787508614.909084:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508614.909120:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4855880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+6:3617:x1874324480107904:12345-0@lo:103:ldlm_bl.0 Request processed in 4350us (4484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508614.909129:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27852 00000100:00100000:2.0:1787508614.909162:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091c9459f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480107904:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787508614.909497:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c9a3b400/0xb126349c40f33d65 lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33d6c expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.909509:0:230618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c9a3b400/0xb126349c40f33d65 lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33d6c expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508614.910436:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d4855180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:230618:1874324480108416:0@lo:403:mdt00_006.0 00000100:00100000:3.0:1787508614.910510:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508614.911170:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480108288 00000100:00100000:1.0:1787508614.911179:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480108288 00000100:00100000:1.0:1787508614.911239:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480108416 00000100:00100000:1.0:1787508614.911243:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480108416 00000100:00100000:1.0:1787508614.911267:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29688 00000100:00100000:1.0:1787508614.911276:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:202961:x1874324480108288:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508614.911531:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29689 00000100:00100000:3.0:1787508614.911541:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:230618:x1874324480108416:12345-0@lo:403:mdt00_006.0 00000100:00100000:3.0:1787508614.913835:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:230618:x1874324480108416:12345-0@lo:403:mdt00_006.0 Request processed in 2288us (3316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.913849:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29689 00000100:00100000:1.0:1787508614.914083:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:202961:x1874324480108288:12345-0@lo:1000:osp_up0-1.0 Request processed in 2807us (5389us total) trans 12884944070 rc 0/0 00000100:00100000:1.0:1787508614.914091:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29688 00000100:00100000:3.0:1787508614.914246:0:202961:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944065 gen 2 00000004:00080000:3.0:1787508614.914253:0:202961:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944065 committed transno 12884944065 00000020:00080000:3.0:1787508614.914259:0:202961:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9090d1c88e40 refcount 2 committed 0 result 0 batchid 4294998379 00000020:00080000:3.0:1787508614.914263:0:202961:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cd2ca000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d1c88540 00000020:00080000:3.0:1787508614.914267:0:202961:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a2:0x5:0x0].587 00000020:00080000:3.0:1787508614.914269:0:202961:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cd2ca800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090ca673e00 00000020:00080000:3.0:1787508614.914272:0:202961:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd1:0xf:0x0].44 00000020:00080000:1.0:1787508614.914303:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294998379 committed batchid 4294998378 00000020:00080000:1.0:1787508614.914337:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998378 00000100:00100000:3.0:1787508614.914454:0:202961:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9090d0218700 x1874324480108288/t12884944070(12884944070) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1787508630 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787508614.914476:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0218700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480108288:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1787508614.914490:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13600 rpc_version 13600 00000020:00100000:3.0:1787508614.914515:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787508614.914522:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091d4854380 x1874324480108672/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787508614.914543:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d4854380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480108672:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508614.914580:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508614.914613:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.914721:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480108672 00000100:00100000:1.0:1787508614.914728:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480108672 00000100:00100000:1.0:1787508614.914770:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29690 00000100:00100000:1.0:1787508614.914777:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:202961:x1874324480108672:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508614.914885:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:202961:x1874324480108672:12345-0@lo:1000:osp_up0-1.0 Request processed in 107us (303us total) trans 12884944071 rc 0/0 00000100:00100000:1.0:1787508614.914892:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29690 00000100:00100000:2.0:1787508614.914993:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d4854380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480108672:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1787508614.915001:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13601 rpc_version 13601 00000020:00100000:2.0:1787508614.915013:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787508614.915018:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d021b100 x1874324480108928/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787508614.915030:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d021b100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480108928:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508614.915057:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508614.915077:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3f11900 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.915152:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480108928 00000100:00100000:1.0:1787508614.915157:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480108928 00000100:00100000:1.0:1787508614.915181:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29691 00000100:00100000:1.0:1787508614.915313:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202961:x1874324480108928:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508614.915492:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:202961:x1874324480108928:12345-0@lo:1000:osp_up0-1.0 Request processed in 304us (433us total) trans 12884944072 rc 0/0 00000100:00100000:1.0:1787508614.915500:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29691 00000100:00100000:2.0:1787508614.915574:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d021b100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480108928:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1787508614.915581:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13602 rpc_version 13602 00000020:00100000:2.0:1787508614.915594:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787508614.915598:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d13bdc00 x1874324480109184/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787508614.915612:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d13bdc00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480109184:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508614.915638:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508614.915662:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3f11900 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.915716:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480109184 00000100:00100000:1.0:1787508614.915721:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480109184 00000100:00100000:1.0:1787508614.915755:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29692 00000100:00100000:1.0:1787508614.915762:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d15ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:202961:x1874324480109184:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508614.915837:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d15ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:202961:x1874324480109184:12345-0@lo:1000:osp_up0-1.0 Request processed in 75us (197us total) trans 12884944073 rc 0/0 00000100:00100000:1.0:1787508614.915844:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29692 00000100:00100000:2.0:1787508614.915920:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d13bdc00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480109184:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1787508614.915927:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13603 rpc_version 13603 00000020:00100000:2.0:1787508614.915967:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787508614.915972:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091d15ac380 x1874324480109440/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787508614.915985:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d15ac380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480109440:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508614.916012:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508614.916024:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3f11900 going to sleep for 11 seconds 00000100:00100000:2.0:1787508614.916037:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480109440 00000100:00100000:2.0:1787508614.916040:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480109440 00000100:00100000:2.0:1787508614.916060:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29693 00000100:00100000:2.0:1787508614.916066:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d15ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:202961:x1874324480109440:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508614.916150:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d15ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:202961:x1874324480109440:12345-0@lo:1000:osp_up0-1.0 Request processed in 83us (137us total) trans 12884944074 rc 0/0 00000100:00100000:2.0:1787508614.916157:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29693 00000100:00100000:2.0:1787508614.916202:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d15ac380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480109440:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508614.916542:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9600 going to sleep for 11 seconds 00000100:00100000:1.0:1787508614.916562:0:230618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589962005 gen 2 00000004:00080000:1.0:1787508614.916566:0:230618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589962005 committed transno 8589962005 00000100:00100000:1.0:1787508614.916586:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d4855180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:230618:1874324480108416:0@lo:403:mdt00_006.0 00000040:00080000:1.0:1787508614.918337:0:230618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1:0x0].1781, 664 off1833656 00000040:00080000:1.0:1787508614.918683:0:230618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x1:0x0].1788, 744 off2039688 00000004:00080000:1.0:1787508614.918691:0:230618:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d9ff2f00 with version 3456 00000004:00080000:3.0:1787508614.918761:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3456 rpc_version 3456 00000020:00100000:3.0:1787508614.918796:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787508614.918808:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091d4855500 x1874324480109696/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1448/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787508614.918832:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d4855500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480109696:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787508614.918904:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508614.918980:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787508614.919084:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480109696 00000100:00100000:2.0:1787508614.919093:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480109696 00000100:00100000:2.0:1787508614.919178:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29694 00000100:00100000:2.0:1787508614.919199:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed03d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:202248:x1874324480109696:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787508614.919576:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed03d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:202248:x1874324480109696:12345-0@lo:1000:osp_up1-0.0 Request processed in 389us (671us total) trans 8589962006 rc 0/0 00000100:00100000:2.0:1787508614.919584:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29694 00000100:00100000:3.0:1787508614.919823:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d4855500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480109696:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1787508614.921593:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125a:0x0]: returning size 4096 00010000:00010000:0.0:1787508614.921631:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f33d5e lrc: 3/0,1 mode: EX/EX res: [0x2000013a0:0x170:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.921642:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f33d5e lrc: 2/0,0 mode: EX/EX res: [0x2000013a0:0x170:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.921651:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f33d5e lrc: 3/0,0 mode: EX/EX res: [0x2000013a0:0x170:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.921657:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d0ff0c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.921662:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f33d5e lrc: 3/0,0 mode: EX/EX res: [0x2000013a0:0x170:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.921670:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f33d5e lrc: 4/0,0 mode: EX/EX res: [0x2000013a0:0x170:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.921686:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x170:0x0].0x0 (ffff9090ccb87000) 00010000:00010000:0.0:1787508614.921690:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787508614.921696:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f33d5e lrc: 2/0,0 mode: --/EX res: [0x2000013a0:0x170:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.921702:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f33d5e lrc: 0/0,0 mode: --/EX res: [0x2000013a0:0x170:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.921719:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c9a3b400/0xb126349c40f33d65 lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33d6c expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.921727:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c9a3b400/0xb126349c40f33d65 lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f33d6c expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.921735:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c9a3b400/0xb126349c40f33d65 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f33d6c expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.921770:0:230618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787508614.921782:0:230618:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd2:0x168:0x0] 00010000:00010000:0.0:1787508614.921790:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f33d57 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x125a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.921796:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f33d57 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x125a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.921802:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f33d57 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x125a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.921807:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d0ff1800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.921810:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f33d57 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x125a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.921817:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f33d57 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x125a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.921826:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125a:0x0].0x0 (ffff9090ccb87200) 00010000:00010000:0.0:1787508614.921829:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787508614.921832:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f33d57 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x125a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.921838:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f33d57 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x125a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.921856:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33d26 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.921862:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33d26 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.921868:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33d26 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.921874:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33d26 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.921879:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.921882:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33d26 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.921888:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33d26 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.921897:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.921899:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.921902:0:230618:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33d49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.921916:0:230618:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33d49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.921924:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33d49 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.921985:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33d26 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.921992:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33d26 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508614.922003:0:230618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f03c34ff reply state 0000000064a76a85 transno 12884944075 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f33d50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.922014:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f33d50 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.922021:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd200) 00010000:00010000:0.0:1787508614.922023:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787508614.922026:0:230618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787508614.922116:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336062:x1874324509514496:12345-192.168.201.30@tcp:36:rm.0 Request processed in 29309us (29570us total) trans 12884944075 rc 0/0 00000100:00100000:0.0:1787508614.922125:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93808 00010000:00010000:3.0:1787508614.922222:0:202214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787508614.922230:0:202214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c9a3b400/0xb126349c40f33d65 lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xb126349c40f33d6c expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.922237:0:202214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c9a3b400 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:3.0:1787508614.922241:0:202214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c9a3b400/0xb126349c40f33d65 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xb126349c40f33d6c expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508614.922250:0:202214:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c9a3b400/0xb126349c40f33d65 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xb126349c40f33d6c expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.922289:0:202214:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c9a3b400/0xb126349c40f33d65 lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f33d6c expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.922296:0:202214:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787508614.922326:0:202214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c9a3b400/0xb126349c40f33d65 lrc: 1/0,0 mode: --/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f33d6c expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.922334:0:202214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090c9a3b400/0xb126349c40f33d65 lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f33d6c expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.922487:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508614.922489:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508614.922491:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508614.922500:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787508614.922517:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d4857800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480109824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787508614.922573:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787508614.922628:0:202227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33d49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.922637:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33d49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508614.922687:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508614.922691:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508614.922709:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33d49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.922736:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33d42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae15b expref: 587 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.922752:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33d49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae15b expref: 586 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.922760:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.922762:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508614.922765:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e800, rc 0) 00000100:00100000:3.0:1787508614.922792:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509515008:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 22886us (23038us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.922799:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93810 00000100:00100000:3.0:1787508614.925548:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480109824 00000100:00100000:3.0:1787508614.925563:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480109824 00000100:00100000:3.0:1787508614.925628:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9783 00000100:00100000:3.0:1787508614.925638:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4857480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3619:x1874324480109824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787508614.925653:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508614.925677:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f33d6c lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x168:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f33d65 expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.925697:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x168:0x0].0x0 (ffff9090c6987900) 00010000:00010000:3.0:1787508614.925707:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508614.925782:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4857480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1874324480109824:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (3208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.925789:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9783 00000100:00100000:3.0:1787508614.925840:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d4857800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480109824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508614.927457:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.927665:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509515136 00000100:00100000:3.0:1787508614.927676:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509515136 00000100:00100000:3.0:1787508614.927770:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93811 00000100:00100000:3.0:1787508614.927791:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091c945b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509515136:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508614.927811:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.927835:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33d73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae162 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.927898:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d7a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.927912:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.927922:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.927969:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.927978:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.927984:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.928042:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d7a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.928049:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d7a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.928055:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d7a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.928060:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d7a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.928066:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.928070:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d7a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.928076:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d7a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.928088:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.928091:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.928095:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d7a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.928102:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33d7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.928115:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.928121:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d81 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.928127:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.928132:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.928135:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.928141:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.928147:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090ccb87500) 00010000:00010000:3.0:1787508614.928149:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.928151:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d81 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.928157:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33d81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.928185:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33d73 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae162 expref: 587 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.928211:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.928213:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508614.928217:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33d73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae162 expref: 587 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.928227:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ea00, rc 0) 00000100:00100000:3.0:1787508614.928285:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091c945b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509515136:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 505us (844us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508614.928292:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93811 00000100:00100000:1.0:1787508614.934078:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.934205:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509515264 00000100:00100000:3.0:1787508614.934215:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509515264 00000100:00100000:3.0:1787508614.934279:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93812 00000100:00100000:3.0:1787508614.934291:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091c9459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336065:x1874324509515264:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508614.934316:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.934341:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33d88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae169 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.934417:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33d8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.934431:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33d8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.934453:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33d8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508614.934499:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508614.934503:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508614.934523:0:203348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33d8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.934547:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33d88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae169 expref: 16 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.934567:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33d8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae169 expref: 15 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.934575:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.934578:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508614.934581:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e200, rc 0) 00000100:00100000:3.0:1787508614.934848:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091c9459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336065:x1874324509515264:12345-192.168.201.30@tcp:101:rm.0 Request processed in 558us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508614.934855:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93812 00000100:00100000:1.0:1787508614.936499:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.936758:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509515392 00000100:00100000:0.0:1787508614.936768:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509515392 00000100:00100000:3.0:1787508614.937912:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.938710:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509515520 00000100:00100000:0.0:1787508614.938723:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509515520 00000100:00100000:0.0:1787508614.938833:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93813 00000100:00100000:0.0:1787508614.938845:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091c9459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509515392:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508614.938870:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508614.938894:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33d96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae170 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.938981:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f33d9d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.938997:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f33d9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939009:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f33d9d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939025:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33da4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939033:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33da4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939040:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33da4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939100:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f33d9d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939109:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f33d9d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939115:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f33d9d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939123:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f33d9d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939131:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.939135:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f33d9d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939143:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f33d9d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939156:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.939159:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.939164:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f33d9d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939171:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f33d9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939200:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33da4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939207:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33da4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939213:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33da4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939218:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.939221:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33da4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939227:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33da4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939238:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090c6913d00) 00010000:00010000:0.0:1787508614.939241:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.939243:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33da4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939249:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f33da4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939279:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33d96 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae170 expref: 587 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939289:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.939291:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508614.939294:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f33d96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae170 expref: 587 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939304:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7c00, rc 0) 00000100:00100000:0.0:1787508614.939383:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091c9459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509515392:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 540us (2891us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508614.939390:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93813 00000100:00100000:0.0:1787508614.939521:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93814 00000100:00100000:0.0:1787508614.939529:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336065:x1874324509515520:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508614.939539:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508614.939549:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f33dab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae177 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939580:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f33db2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939589:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f33db2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939596:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f33db2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939608:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33db9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939615:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33db9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939621:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33db9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939647:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f33db2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939654:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f33db2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939660:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f33db2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939666:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f33db2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939671:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.939674:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f33db2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939680:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f33db2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939688:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.939690:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.939693:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f33db2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939699:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f33db2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939708:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33db9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939713:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33db9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939719:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33db9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939724:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.939726:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33db9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939732:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33db9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939739:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090c6913400) 00010000:00010000:0.0:1787508614.939741:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.939744:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33db9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939750:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f33db9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939777:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f33dab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae177 expref: 16 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939786:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.939789:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508614.939792:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f33dab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae177 expref: 16 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.939800:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7a00, rc 0) 00000100:00100000:0.0:1787508614.939831:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336065:x1874324509515520:12345-192.168.201.30@tcp:101:rm.0 Request processed in 303us (1925us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508614.939838:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93814 00000100:00100000:1.0:1787508614.944369:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.944408:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.944503:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509515648 00000100:00100000:2.0:1787508614.944513:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509515648 00000100:00100000:2.0:1787508614.944573:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509515776 00000100:00100000:2.0:1787508614.944577:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509515776 00000100:00100000:2.0:1787508614.944706:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93815 00000100:00100000:2.0:1787508614.944717:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091c9459f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509515648:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508614.944738:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.944759:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33dc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae17e expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.944835:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33dc7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.944850:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33dc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.944861:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33dc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.944876:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f33dce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.944883:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f33dce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.944890:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f33dce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.944968:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33dc7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.944976:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33dc7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.944983:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33dc7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.944989:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33dc7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.944996:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.945000:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33dc7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945007:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33dc7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945019:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.945022:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.945026:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33dc7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945033:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f33dc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945046:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f33dce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945053:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f33dce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945059:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f33dce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945064:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.945066:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f33dce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945072:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f33dce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945078:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090d36fd700) 00010000:00010000:2.0:1787508614.945081:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.945083:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f33dce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945089:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f33dce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945124:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33dc0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae17e expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945135:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.945138:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.945142:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33dc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae17e expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945151:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab000, rc 0) 00000100:00100000:2.0:1787508614.945224:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091c9459f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509515648:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 508us (875us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508614.945231:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93815 00000100:00100000:2.0:1787508614.945250:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93816 00000100:00100000:2.0:1787508614.945257:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336065:x1874324509515776:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508614.945266:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.945274:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33dd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae185 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945302:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33ddc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945310:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33ddc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945316:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33ddc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945332:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33de3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945339:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33de3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945345:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33de3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945366:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33ddc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945373:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33ddc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945379:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33ddc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945384:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33ddc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945390:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.945393:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33ddc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945399:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33ddc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945408:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.945410:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.945413:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33ddc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945420:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33ddc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945428:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33de3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945435:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33de3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945454:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33de3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945459:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.945462:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33de3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945468:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33de3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945476:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090d36fd800) 00010000:00010000:2.0:1787508614.945478:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.945481:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33de3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945486:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33de3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945508:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33dd5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae185 expref: 16 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945520:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.945522:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.945525:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33dd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae185 expref: 16 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.945533:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa200, rc 0) 00000100:00100000:2.0:1787508614.945556:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336065:x1874324509515776:12345-192.168.201.30@tcp:101:rm.0 Request processed in 299us (1147us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508614.945562:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93816 00000100:00100000:1.0:1787508614.949130:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.949208:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.949458:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509516032 00000100:00100000:0.0:1787508614.949470:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509516032 00000100:00100000:0.0:1787508614.949532:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509516160 00000100:00100000:0.0:1787508614.949535:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509516160 00000100:00100000:0.0:1787508614.949568:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93817 00000100:00100000:0.0:1787508614.949579:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336065:x1874324509516032:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508614.949599:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508614.949622:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f33dea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae193 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.949691:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f33df1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.949705:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f33df1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.949721:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f33df1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.949735:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33df8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.949742:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33df8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.949749:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33df8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.949817:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f33df1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.949825:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f33df1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.949830:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f33df1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.949837:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f33df1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.949843:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.949848:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f33df1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.949855:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f33df1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.949867:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.949870:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.949874:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f33df1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.949880:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f33df1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.949893:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33df8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.949899:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33df8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.949905:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33df8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.949909:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.949912:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33df8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.949918:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33df8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.949924:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090c6913100) 00010000:00010000:0.0:1787508614.949927:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.949929:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33df8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.949934:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f33df8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.949996:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f33dea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae193 expref: 16 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.950007:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.950009:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508614.950013:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f33dea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae193 expref: 16 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.950021:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7600, rc 0) 00000100:00100000:0.0:1787508614.950084:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336065:x1874324509516032:12345-192.168.201.30@tcp:101:rm.0 Request processed in 507us (965us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508614.950091:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93817 00000100:00100000:0.0:1787508614.950109:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93818 00000100:00100000:0.0:1787508614.950117:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509516160:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508614.950125:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508614.950134:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f33dff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae18c expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.950173:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33e06 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.950181:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33e06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.950202:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33e06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.950215:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f33e0d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.950225:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f33e0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.950231:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f33e0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.950258:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33e06 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.950265:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33e06 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.950271:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33e06 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.950277:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33e06 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.950282:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.950285:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33e06 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.950291:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33e06 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.950299:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.950301:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.950304:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33e06 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.950310:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f33e06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.950320:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f33e0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.950326:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f33e0d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.950333:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f33e0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.950338:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d0ff1800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508614.950341:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f33e0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.950347:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f33e0d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.950577:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaf7dd568 (ffff9090c6913f00) 00010000:00010000:0.0:1787508614.950580:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508614.950583:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f33e0d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.950590:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f33e0d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.950617:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f33dff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae18c expref: 587 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.950626:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508614.950629:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508614.950633:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f33dff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae18c expref: 587 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508614.950642:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6200, rc 0) 00000100:00100000:0.0:1787508614.950668:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509516160:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 552us (1460us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508614.950675:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93818 00000100:00100000:0.0:1787508614.953710:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.953806:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509516416 00000100:00100000:1.0:1787508614.953817:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509516416 00000100:00100000:1.0:1787508614.953883:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93819 00000100:00100000:1.0:1787508614.953894:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336065:x1874324509516416:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508614.953914:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.953936:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f33e14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae19a expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.954035:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33e1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.954050:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33e1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.954061:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33e1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.954074:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33e22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.954081:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33e22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.954087:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33e22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.954143:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33e1b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.954150:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33e1b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.954155:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33e1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.954166:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33e1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.954172:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.954176:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33e1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.954183:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33e1b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.954207:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.954210:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.954215:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33e1b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.954221:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33e1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.954231:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33e22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.954236:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33e22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.954241:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33e22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.954245:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.954247:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33e22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.954256:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33e22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.954261:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090d171f400) 00010000:00010000:1.0:1787508614.954263:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.954266:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33e22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.954271:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33e22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.954300:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f33e14 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae19a expref: 16 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.954309:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.954311:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508614.954314:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f33e14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae19a expref: 16 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.954322:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4400, rc 0) 00000100:00100000:1.0:1787508614.954524:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336065:x1874324509516416:12345-192.168.201.30@tcp:101:rm.0 Request processed in 631us (821us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508614.954531:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93819 00000100:00100000:0.0:1787508614.959169:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508614.959211:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508614.959333:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509516672 00000100:00100000:3.0:1787508614.959344:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509516672 00000100:00100000:3.0:1787508614.959403:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509516800 00000100:00100000:3.0:1787508614.959406:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509516800 00000100:00100000:3.0:1787508614.959427:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93820 00000100:00100000:3.0:1787508614.959447:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509516672:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508614.959467:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.959488:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33e29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae1a1 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.959562:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33e30 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.959582:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33e30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.959595:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33e30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.959610:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33e37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.959617:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33e37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.959624:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33e37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.959682:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33e30 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.959690:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33e30 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.959696:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33e30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.959702:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33e30 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.959709:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ea00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.959713:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33e30 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.959720:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33e30 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.959731:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.959734:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.959739:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33e30 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.959745:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33e30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.959758:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33e37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.959764:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33e37 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.959770:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33e37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.959775:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.959791:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33e37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.959799:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33e37 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.959806:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3e9f33b0 (ffff9090ccb87500) 00010000:00010000:3.0:1787508614.959808:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.959810:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33e37 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.959817:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33e37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.959851:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33e29 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1a1 expref: 587 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.959860:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.959862:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508614.959865:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f33e29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1a1 expref: 587 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.959873:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fa00, rc 0) 00000100:00100000:3.0:1787508614.959928:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509516672:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 493us (770us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508614.959935:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93820 00000100:00100000:3.0:1787508614.959990:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93821 00000100:00100000:3.0:1787508614.959998:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336065:x1874324509516800:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508614.960006:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508614.960014:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33e3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae1a8 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.960043:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33e45 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.960050:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33e45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.960057:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33e45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.960072:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33e4c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.960080:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33e4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.960086:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33e4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.960108:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33e45 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.960114:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33e45 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.960120:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33e45 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.960126:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33e45 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.960131:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.960134:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33e45 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.960140:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33e45 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.960148:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.960150:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.960153:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33e45 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.960159:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33e45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.960169:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33e4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.960175:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33e4c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.960181:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33e4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.960198:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508614.960201:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33e4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.960206:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33e4c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.960213:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd200) 00010000:00010000:3.0:1787508614.960215:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.960218:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33e4c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.960224:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33e4c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.960241:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33e3e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1a8 expref: 16 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.960254:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508614.960256:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508614.960260:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33e3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1a8 expref: 16 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508614.960267:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e400, rc 0) 00000100:00100000:3.0:1787508614.960289:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336065:x1874324509516800:12345-192.168.201.30@tcp:101:rm.0 Request processed in 292us (1078us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508614.960296:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93821 00000100:00100000:0.0:1787508614.964623:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.964694:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509517056 00000100:00100000:1.0:1787508614.964704:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509517056 00000100:00100000:1.0:1787508614.964764:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93822 00000100:00100000:1.0:1787508614.964773:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509517056:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508614.964805:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.964826:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f33e53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae1af expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.964893:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33e5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.964906:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33e5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.964915:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33e5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.964928:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33e61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.964934:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33e61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.964983:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33e61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.965040:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33e5a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.965047:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33e5a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.965053:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33e5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.965058:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33e5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.965064:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4a00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.965068:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33e5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.965074:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33e5a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.965085:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.965088:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.965092:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33e5a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.965098:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33e5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.965110:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33e61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.965115:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33e61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.965120:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33e61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.965125:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.965128:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33e61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.965134:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33e61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.965144:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ad43c78 (ffff9090d171fe00) 00010000:00010000:1.0:1787508614.965147:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.965149:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33e61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.965155:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33e61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.965186:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f33e53 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1af expref: 587 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.965207:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.965209:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508614.965213:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f33e53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1af expref: 587 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.965222:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4c00, rc 0) 00000100:00100000:1.0:1787508614.965282:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509517056:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 509us (669us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508614.965290:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93822 00000100:00100000:0.0:1787508614.969978:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.970182:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509517312 00000100:00100000:2.0:1787508614.970203:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509517312 00000100:00100000:2.0:1787508614.970268:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93823 00000100:00100000:2.0:1787508614.970278:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509517312:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508614.970299:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.970320:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33e68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae1b6 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.970585:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33e6f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.970603:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33e6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.970615:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33e6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.970632:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33e76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.970640:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33e76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.970647:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33e76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.970708:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33e6f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.970716:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33e6f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.970723:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33e6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.970729:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33e6f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.970736:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.970740:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33e6f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.970748:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33e6f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.970761:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.970764:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.970768:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33e6f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.970774:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33e6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.970790:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33e76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.970796:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33e76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.970801:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33e76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.970806:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.970808:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33e76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.970815:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33e76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.970822:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbfff8436 (ffff9090d36fd800) 00010000:00010000:2.0:1787508614.970824:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.970827:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33e76 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.970832:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33e76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.970864:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33e68 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1b6 expref: 587 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.970874:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.970876:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.970880:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f33e68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1b6 expref: 587 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.970888:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa200, rc 0) 00000100:00100000:2.0:1787508614.970983:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509517312:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 706us (1015us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508614.970991:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93823 00000100:00100000:0.0:1787508614.976741:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508614.976862:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509517568 00000100:00100000:1.0:1787508614.976874:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509517568 00000100:00100000:1.0:1787508614.976981:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93824 00000100:00100000:1.0:1787508614.976994:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509517568:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508614.977015:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508614.977038:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f33e7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae1bd expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.977121:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33e84 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.977137:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33e84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.977151:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33e84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.977167:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33e8b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.977174:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33e8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.977181:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33e8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.977254:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33e84 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.977262:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33e84 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.977268:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33e84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.977274:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33e84 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.977280:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.977284:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33e84 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.977292:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33e84 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.977304:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.977307:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.977311:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33e84 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.977319:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33e84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.977333:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33e8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.977340:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33e8b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.977346:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33e8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.977514:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4a00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508614.977518:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33e8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.977525:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33e8b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.977534:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x594a0ca2 (ffff9090d171fe00) 00010000:00010000:1.0:1787508614.977537:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508614.977540:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33e8b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.977547:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33e8b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.977582:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f33e7d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1bd expref: 587 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.977592:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508614.977595:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508614.977599:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f33e7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1bd expref: 587 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508614.977608:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4c00, rc 0) 00000100:00100000:1.0:1787508614.977774:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509517568:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 782us (1043us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508614.977783:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93824 00000100:00100000:0.0:1787508614.989091:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508614.989305:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509517824 00000100:00100000:2.0:1787508614.989316:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509517824 00000100:00100000:2.0:1787508614.989393:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93825 00000100:00100000:2.0:1787508614.989404:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509517824:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508614.989430:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508614.989464:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33e92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae1c4 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.989541:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33e99 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.989554:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33e99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.989565:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33e99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.989579:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ea0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.989585:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.989595:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.989652:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33e99 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.989659:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33e99 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.989665:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33e99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.989672:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33e99 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.989677:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.989681:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33e99 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.989688:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33e99 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.989701:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.989704:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.989709:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33e99 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.989714:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33e99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.989729:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.989735:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ea0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.989741:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.989745:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508614.989748:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.989753:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ea0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.989759:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe67841 (ffff9090d36fd800) 00010000:00010000:2.0:1787508614.989762:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508614.989764:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ea0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.989770:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ea0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.989817:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33e92 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1c4 expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.989826:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508614.989828:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508614.989832:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33e92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1c4 expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508614.989846:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab600, rc 0) 00000100:00100000:2.0:1787508614.990334:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509517824:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 928us (1252us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508614.990343:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93825 00000100:00100000:2.0:1787508615.007061:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.007151:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509518080 00000100:00100000:3.0:1787508615.007161:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509518080 00000100:00100000:3.0:1787508615.007240:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93826 00000100:00100000:3.0:1787508615.007252:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d15ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509518080:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508615.007276:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.007301:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33ea7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae1cb expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.007390:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33eae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.007405:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33eae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.007417:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33eae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.007432:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33eb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.007453:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.007461:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.007521:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33eae lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.007529:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33eae lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.007536:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33eae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.007543:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33eae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.007549:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.007554:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33eae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.007562:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33eae lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.007573:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.007576:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.007581:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33eae lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.007588:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33eae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.007603:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.007610:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33eb5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.007616:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.007622:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.007625:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.007631:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33eb5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.007638:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090ccb87500) 00010000:00010000:3.0:1787508615.007641:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.007644:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33eb5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.007650:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33eb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.007683:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33ea7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1cb expref: 587 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.007694:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.007696:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508615.007701:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33ea7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1cb expref: 587 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.007710:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e400, rc 0) 00000100:00100000:3.0:1787508615.007789:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d15ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509518080:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 539us (740us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508615.007797:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93826 00000100:00100000:0.0:1787508615.024123:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.024239:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509518336 00000100:00100000:2.0:1787508615.024249:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509518336 00000100:00100000:2.0:1787508615.024314:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93827 00000100:00100000:2.0:1787508615.024325:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509518336:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508615.024346:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.024378:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33ebc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae1d2 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.024469:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ec3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.024485:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ec3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.024497:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ec3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.024514:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33eca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.024521:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33eca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.024532:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33eca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.024590:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ec3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.024598:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ec3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.024605:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ec3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.024612:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ec3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.024619:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.024623:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ec3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.024631:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ec3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.024643:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.024646:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.024650:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ec3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.024657:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33ec3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.024671:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33eca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.024678:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33eca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.024684:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33eca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.024688:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.024691:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33eca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.024697:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33eca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.024705:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x90ba0166 (ffff9090d36fd800) 00010000:00010000:2.0:1787508615.024707:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.024710:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33eca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.024715:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33eca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.024749:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33ebc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1d2 expref: 587 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.024760:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.024762:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508615.024766:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33ebc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1d2 expref: 587 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.024780:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab600, rc 0) 00000100:00100000:2.0:1787508615.024850:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509518336:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 527us (738us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508615.024858:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93827 00000100:00100000:1.0:1787508615.037046:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.037160:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509518592 00000100:00100000:2.0:1787508615.037171:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509518592 00000100:00100000:2.0:1787508615.037247:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93828 00000100:00100000:2.0:1787508615.037258:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509518592:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508615.037280:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.037303:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33ed1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae1d9 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.037395:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33ed8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.037410:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33ed8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.037421:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33ed8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.037445:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33edf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.037453:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33edf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.037459:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33edf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.037517:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33ed8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.037524:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33ed8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.037529:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33ed8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.037535:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33ed8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.037541:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.037545:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33ed8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.037552:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33ed8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.037564:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.037567:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.037571:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33ed8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.037577:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33ed8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.037592:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33edf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.037598:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33edf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.037604:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33edf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.037609:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.037611:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33edf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.037617:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33edf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.037623:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaf3dc4c9 (ffff9090d36fd800) 00010000:00010000:2.0:1787508615.037625:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.037628:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33edf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.037633:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33edf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.037666:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33ed1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1d9 expref: 587 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.037676:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.037679:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508615.037682:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33ed1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1d9 expref: 587 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.037692:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab600, rc 0) 00000100:00100000:2.0:1787508615.037760:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509518592:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 504us (723us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508615.037772:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93828 00000100:00100000:3.0:1787508615.051378:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.051489:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509518720 00000100:00100000:2.0:1787508615.051500:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509518720 00000100:00100000:2.0:1787508615.051566:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93829 00000100:00100000:2.0:1787508615.051577:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509518720:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508615.051597:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.051620:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33ee6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae1e0 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.051683:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33eed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.051697:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33eed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.051708:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33eed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.051718:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33ef4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.051725:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.051731:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.052662:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33eed lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.052679:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33eed lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.052686:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33eed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.052694:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33eed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.052700:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.052705:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33eed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.052714:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33eed lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.052728:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.052731:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.052736:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33eed lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.052743:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f33eed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.052759:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.052766:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33ef4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.052772:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.053409:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.053417:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.053426:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33ef4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.053466:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd200) 00010000:00010000:2.0:1787508615.053470:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.053474:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33ef4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.053481:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f33ef4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.053520:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33ee6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1e0 expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.053532:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.053534:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.053538:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f33ee6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1e0 expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.053549:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab600, rc 0) 00000100:00100000:3.0:1787508615.053884:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336064:x1874324509518720:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 2305us (2512us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508615.053894:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93829 00000100:00100000:0.0:1787508615.060703:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.061043:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509518976 00000100:00100000:3.0:1787508615.061056:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509518976 00000100:00100000:3.0:1787508615.061145:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93830 00000100:00100000:3.0:1787508615.061157:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:336064:x1874324509518976:12345-192.168.201.30@tcp:36:lfs.0 00000100:00100000:3.0:1787508615.061296:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d4856300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480109952:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787508615.061407:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508615.061455:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9600 going to sleep for 11 seconds 00000100:00100000:1.0:1787508615.062485:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480109952 00000100:00100000:1.0:1787508615.062494:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480109952 00000100:00100000:1.0:1787508615.062549:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29695 00000100:00100000:1.0:1787508615.062558:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:202228:x1874324480109952:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787508615.062668:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:202228:x1874324480109952:12345-0@lo:1000:mdt00_002.0 Request processed in 111us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.062677:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29695 00000100:00100000:3.0:1787508615.063076:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d4856300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480109952:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787508615.063139:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d4856300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480110080:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787508615.063176:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508615.063206:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9600 going to sleep for 11 seconds 00000100:00100000:1.0:1787508615.063280:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480110080 00000100:00100000:1.0:1787508615.063285:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480110080 00000100:00100000:1.0:1787508615.063328:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29696 00000100:00100000:1.0:1787508615.063336:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:202228:x1874324480110080:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787508615.064141:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:202228:x1874324480110080:12345-0@lo:1000:mdt00_002.0 Request processed in 802us (961us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787508615.064150:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29696 00000100:00100000:0.0:1787508615.067866:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d4856300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480110080:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787508615.068050:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d0ff0c00/0xb126349c40f33efb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.068062:0:202228:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d0ff0c00/0xb126349c40f33efb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.068073:0:202228:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d0ff0c00/0xb126349c40f33efb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508615.068095:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480110208:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1787508615.068158:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508615.068184:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d21c40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508615.068256:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480110208 00000100:00100000:1.0:1787508615.068274:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480110208 00000100:00100000:1.0:1787508615.068321:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29697 00000100:00100000:1.0:1787508615.068329:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:202228:x1874324480110208:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1787508615.068345:0:203182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.068360:0:203182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33f02 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f33efb expref: -99 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.068384:0:203182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33d49 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae15b expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.068394:0:203182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33d8f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae169 expref: 14 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.068402:0:203182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33f02 lrc: 5/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f33efb expref: 12 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.068423:0:203182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33d8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae169 expref: 14 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.068447:0:203182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33d8f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae169 expref: 14 pid: 203348 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.068463:0:203182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0219500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480110336:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508615.068532:0:203182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33d49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae15b expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.068542:0:203182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33d49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae15b expref: 585 pid: 202227 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.068550:0:203182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0218000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480110464:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508615.068567:0:203182:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88540 going to sleep for 11 seconds 00000100:00100000:1.0:1787508615.074574:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.074612:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.074706:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509519104 00000100:00100000:2.0:1787508615.074716:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509519104 00010000:00010000:2.0:1787508615.074759:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33d8f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae169 expref: 15 pid: 203348 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.074812:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509519232 00000100:00100000:2.0:1787508615.074816:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509519232 00010000:00010000:2.0:1787508615.074831:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33d49 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae15b expref: 586 pid: 202227 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.074854:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27853 00000100:00100000:2.0:1787508615.074863:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6ac5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2402:x1874324509519104:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508615.074877:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508615.074883:0:225839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33d8f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae169 expref: 15 pid: 203348 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.074896:0:225839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33d8f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae169 expref: 15 pid: 203348 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.074917:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.074924:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33f02 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f33efb expref: 12 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.074934:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508615.075005:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6ac5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2402:x1874324509519104:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 143us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.075012:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27853 00000100:00100000:2.0:1787508615.075031:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27854 00000100:00100000:2.0:1787508615.075037:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:2402:x1874324509519232:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508615.075045:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508615.075050:0:225839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33d49 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae15b expref: 586 pid: 202227 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.075061:0:225839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33d49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae15b expref: 586 pid: 202227 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.075071:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.075075:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33f02 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f33efb expref: 12 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.075084:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33f02 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xb126349c40f33efb expref: 12 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.075092:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33f02 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xb126349c40f33efb expref: 12 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.075121:0:225839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33f02 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33efb expref: 12 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.075134:0:225839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d15ad180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:225839:1874324480110592:0@lo:105: 00000100:00100000:2.0:1787508615.075169:0:225839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.075198:0:225839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3f11900 going to sleep for 11 seconds 00010000:00010000:3.0:1787508615.075509:0:203182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f33d8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae169 expref: 14 pid: 203348 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.075514:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480110592 00000100:00100000:1.0:1787508615.075520:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480110592 00000100:00100000:3.0:1787508615.075532:0:203182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0219500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480110336:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508615.075550:0:203182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f33d49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae15b expref: 586 pid: 202227 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.075565:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18160 00000100:00100000:3.0:1787508615.075571:0:203182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0218000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480110464:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508615.075575:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d15ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:225839:x1874324480110592:12345-0@lo:105: 00010000:00010000:1.0:1787508615.075587:0:229363:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d0ff0c00/0xb126349c40f33efb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33f02 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.075597:0:229363:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d0ff0c00/0xb126349c40f33efb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33f02 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.075602:0:203182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33f02 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33efb expref: 12 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.075607:0:229363:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d0ff0c00/0xb126349c40f33efb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33f02 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.075617:0:203182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.075620:0:229363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d0ff0c00/0xb126349c40f33efb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f33f02 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.075622:0:203182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.075627:0:203182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5c00, rc 0) 00010000:00010000:1.0:1787508615.075634:0:229363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d0ff0c00/0xb126349c40f33efb lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f33f02 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.075643:0:229363:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d0ff0c00/0xb126349c40f33efb lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f33f02 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.075657:0:229363:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d0ff0c00) 00000100:00100000:3.0:1787508615.075676:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:202228:x1874324480110208:12345-0@lo:101:mdt00_002.0 Request processed in 7346us (7517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.075684:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29697 00000100:00100000:1.0:1787508615.075703:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d15ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:225839:x1874324480110592:12345-0@lo:105: Request processed in 129us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.075711:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18160 00000100:00100000:1.0:1787508615.075742:0:225839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d15ad180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:225839:1874324480110592:0@lo:105: 00010000:00010000:1.0:1787508615.075752:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508615.075770:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:2402:x1874324509519232:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 734us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.075788:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27854 00000100:00100000:0.0:1787508615.076046:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480110208:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1787508615.076063:0:202228:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d0ff0c00/0xb126349c40f33efb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33f02 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787508615.076081:0:202228:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787508615.076117:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6200/0xb126349c40f33f09 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.076124:0:202228:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6200/0xb126349c40f33f09 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.076132:0:202228:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6200/0xb126349c40f33f09 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508615.076147:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480110720:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1787508615.076177:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508615.076199:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d21c40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.077013:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480110720 00000100:00100000:3.0:1787508615.077033:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480110720 00000100:00100000:3.0:1787508615.077078:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29698 00000100:00100000:3.0:1787508615.077087:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:202228:x1874324480110720:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1787508615.077103:0:225829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.077118:0:225829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33f10 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f33f09 expref: -99 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.077139:0:225829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b89 lrc: 2/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.077145:0:225829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f33d50 lrc: 2/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.077152:0:225829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33f10 lrc: 5/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f33f09 expref: 13 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.077168:0:225829:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f33d50 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:3.0:1787508615.077208:0:225829:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:3.0:1787508615.077242:0:225829:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:3.0:1787508615.077257:0:225829:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:3.0:1787508615.077276:0:225829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33f10 lrc: 3/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33f09 expref: 13 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.077284:0:225829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd200) 00010000:00010000:3.0:1787508615.077287:0:225829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.077290:0:225829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33f10 lrc: 3/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33f09 expref: 13 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.077297:0:225829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e400, rc 0) 00000100:00100000:3.0:1787508615.077350:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:202228:x1874324480110720:12345-0@lo:101:mdt00_002.0 Request processed in 265us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.077357:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29698 00000100:00100000:0.0:1787508615.077457:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480110720:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1787508615.077472:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6200/0xb126349c40f33f09 lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33f10 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.077481:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6200/0xb126349c40f33f09 lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33f10 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787508615.081483:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944075 is committed 00000001:00080000:1.0:1787508615.081504:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944074 is committed 00000001:00080000:1.0:1787508615.081586:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944069 is committed 00010000:00010000:3.0:1787508615.081592:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f33d50 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787508615.081594:0:202206:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9090d74d9180 refcount 2 committed 0 result 0 batchid 8589961985 00000020:00080000:1.0:1787508615.081600:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cbc97e00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d74d9a80 00000020:00080000:1.0:1787508615.081608:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd2:0x1:0x0].1787 00000020:00080000:1.0:1787508615.081611:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cbc97c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090cdbf8000 00010000:00010000:3.0:1787508615.081612:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f33d50 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787508615.081614:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1:0x0].1780 00010000:00010000:3.0:1787508615.081625:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f33d50 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.081636:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d34a3e00 already unused, calling callback (ffffffffc19024f0) 00000020:00080000:1.0:1787508615.081640:0:202206:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8589961983 batchid updated 00010000:00010000:3.0:1787508615.081641:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f33d50 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787508615.081650:0:202206:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9090d74d9300 refcount 2 committed 0 result 0 batchid 8589961984 00010000:00010000:3.0:1787508615.081652:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f33d50 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787508615.081656:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cbc97b00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d74d93c0 00000020:00080000:1.0:1787508615.081664:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd2:0x1:0x0].1786 00000020:00080000:1.0:1787508615.081666:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cbc97700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090cdbf9e00 00000020:00080000:1.0:1787508615.081669:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1:0x0].1779 00010000:00010000:3.0:1787508615.081676:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd200) 00010000:00010000:3.0:1787508615.081680:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.081687:0:3603:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33f10 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33f09 expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.081699:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f33d50 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.081705:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f33d50 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787508615.082508:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589961985 committed batchid 8589961983 00000004:00080000:0.0:1787508615.082637:0:202262:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d21c40c0 with version 3457 00000020:00080000:0.0:1787508615.082651:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589961983 cancel update log [0x240000bd2:0x1:0x0].1785: rc = 0 00000020:00080000:0.0:1787508615.082693:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589961983 cancel update log [0x2000013a0:0x1:0x0].1778: rc = 0 00000020:00080000:0.0:1787508615.082701:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961983 00000004:00080000:3.0:1787508615.082986:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3457 rpc_version 3457 00000020:00100000:3.0:1787508615.083020:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787508615.083030:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d1cbca80 x1874324480110976/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787508615.083052:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480110976:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787508615.083120:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508615.083165:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9840 going to sleep for 11 seconds 00000100:00100000:0.0:1787508615.083273:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.083356:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509519360 00000100:00100000:3.0:1787508615.083364:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509519360 00000100:00100000:3.0:1787508615.083420:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93831 00000100:00100000:3.0:1787508615.083430:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:336073:x1874324509519360:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508615.083455:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.083475:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33f17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae1e7 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.083536:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33f1e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.083550:0:209004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33f02 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33efb expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.083557:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33f1e lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.083580:0:209004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33f02 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f33efb expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508615.083592:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbe300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480111104:0@lo:104: 00000100:00100000:3.0:1787508615.083622:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508615.083652:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9540 going to sleep for 11 seconds 00000100:00100000:1.0:1787508615.083832:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480110976 00000100:00100000:1.0:1787508615.083837:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480110976 00000100:00100000:1.0:1787508615.083879:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29699 00000100:00100000:1.0:1787508615.083886:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:202248:x1874324480110976:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787508615.084055:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:202248:x1874324480110976:12345-0@lo:1000:osp_up1-0.0 Request processed in 168us (934us total) trans 8589962007 rc 0/0 00000100:00100000:1.0:1787508615.084063:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29699 00000100:00100000:3.0:1787508615.084336:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbca80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480110976:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1787508615.084526:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.084536:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b89 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.084543:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.084550:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.084555:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.084562:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b89 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.084576:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd200) 00010000:00010000:2.0:1787508615.084579:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.084584:0:3602:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33f10 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33f09 expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.084594:0:3602:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33f10 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f33f09 expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.084602:0:3602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33f10 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f33f09 expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.084629:0:3602:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33f10 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33f09 expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.084639:0:3602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d15ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3602:1874324480111232:0@lo:105: 00000100:00100000:2.0:1787508615.084671:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.084740:0:3602:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3f11240 going to sleep for 11 seconds 00000100:00100000:0.0:1787508615.085039:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480111104 00000100:00100000:0.0:1787508615.085045:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480111104 00000100:00100000:0.0:1787508615.085089:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480111232 00000100:00100000:0.0:1787508615.085093:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480111232 00000100:00100000:0.0:1787508615.085117:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18161 00000100:00100000:0.0:1787508615.085125:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0218000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+5:209004:x1874324480111104:12345-0@lo:104: 00010000:00010000:0.0:1787508615.085139:0:202210:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d0ff0c00/0xb126349c40f33efb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f33f02 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.085185:0:202210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787508615.085190:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0218000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+5:209004:x1874324480111104:12345-0@lo:104: Request processed in 67us (1568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508615.085196:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18161 00000100:00100000:0.0:1787508615.085209:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18162 00000100:00100000:0.0:1787508615.085214:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d15ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:3602:x1874324480111232:12345-0@lo:105: 00010000:00010000:0.0:1787508615.085222:0:202210:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6200/0xb126349c40f33f09 lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33f10 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.085230:0:202210:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6200/0xb126349c40f33f09 lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33f10 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.085237:0:202210:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6200/0xb126349c40f33f09 lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33f10 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.085244:0:202210:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6200/0xb126349c40f33f09 lrc: 5/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f33f10 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.085256:0:202210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6200/0xb126349c40f33f09 lrc: 6/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f33f10 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.085264:0:202210:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6200/0xb126349c40f33f09 lrc: 6/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f33f10 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.085283:0:202210:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d56f6200) 00000100:00100000:0.0:1787508615.085312:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d15ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:3602:x1874324480111232:12345-0@lo:105: Request processed in 97us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508615.085318:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18162 00010000:00010000:0.0:1787508615.085338:0:226765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508615.085343:0:226765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d0ff0c00/0xb126349c40f33efb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f33f02 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508615.085492:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbe300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480111104:0@lo:104: 00010000:00010000:3.0:1787508615.085514:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33f1e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.085561:0:226765:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9090d0ff0c00 is referenced, will be cancelled later 00010000:00010000:0.0:1787508615.085564:0:226765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d0ff0c00/0xb126349c40f33efb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f33f02 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.085572:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508615.085573:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508615.085575:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508615.085585:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6200/0xb126349c40f33f09 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33f10 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.085593:0:202228:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6200/0xb126349c40f33f09 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33f10 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787508615.085616:0:202228:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1787508615.085655:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480111360:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787508615.085687:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508615.085747:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d21c4300 going to sleep for 11 seconds 00000100:00100000:2.0:1787508615.086058:0:3602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d15ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3602:1874324480111232:0@lo:105: 00010000:00010000:2.0:1787508615.086075:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b89 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086086:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f33b89 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086102:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33b90 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x125a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086108:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33b90 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x125a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086114:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33b90 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x125a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086119:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.086123:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33b90 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x125a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086129:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33b90 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x125a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086140:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125a:0x0].0x0 (ffff9090ccb87200) 00010000:00010000:2.0:1787508615.086143:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.086147:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33b90 lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x125a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086152:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33b90 lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x125a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086162:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33b97 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x170:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086167:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33b97 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a0:0x170:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086173:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33b97 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x170:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086179:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.086181:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33b97 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x170:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086187:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33b97 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a0:0x170:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086194:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x170:0x0].0x0 (ffff9090ccb87000) 00010000:00010000:2.0:1787508615.086196:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.086198:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33b97 lrc: 2/0,0 mode: --/TXN res: [0x2000013a0:0x170:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086204:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33b97 lrc: 0/0,0 mode: --/TXN res: [0x2000013a0:0x170:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086219:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33cee lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x125a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086224:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33cee lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x125a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086230:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33cee lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x125a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086235:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.086237:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33cee lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x125a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086246:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33cee lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x125a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086253:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125a:0x0].0x0 (ffff9090ccb87200) 00010000:00010000:2.0:1787508615.086255:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508615.086258:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33cee lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x125a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086263:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33cee lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x125a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086277:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33cf5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086283:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33cf5 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086288:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33cf5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086294:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.086296:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33cf5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086302:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33cf5 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086308:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x170:0x0].0x0 (ffff9090ccb87000) 00010000:00010000:2.0:1787508615.086310:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508615.086312:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33cf5 lrc: 2/0,0 mode: --/TXN res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.086318:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33cf5 lrc: 0/0,0 mode: --/TXN res: [0x2000013a0:0x170:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508615.086622:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480111360 00000100:00100000:3.0:1787508615.086628:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480111360 00000100:00100000:2.0:1787508615.086760:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29700 00000100:00100000:2.0:1787508615.086768:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:202228:x1874324480111360:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787508615.086980:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:202228:x1874324480111360:12345-0@lo:1000:mdt00_002.0 Request processed in 213us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.086989:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29700 00000100:00100000:0.0:1787508615.087062:0:202228:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944074 gen 2 00000004:00080000:0.0:1787508615.087068:0:202228:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944070 committed transno 12884944074 00000004:00080000:0.0:1787508615.087087:0:202228:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944071 committed transno 12884944074 00000004:00080000:0.0:1787508615.087103:0:202228:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944072 committed transno 12884944074 00000004:00080000:0.0:1787508615.087111:0:202228:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944073 committed transno 12884944074 00000004:00080000:0.0:1787508615.087121:0:202228:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944074 committed transno 12884944074 00000100:00100000:0.0:1787508615.087133:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0bd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480111360:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787508615.087188:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1517480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480111488:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787508615.087220:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508615.087249:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d21c4300 going to sleep for 11 seconds 00000100:00100000:1.0:1787508615.087314:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480111488 00000100:00100000:1.0:1787508615.087319:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480111488 00000100:00100000:1.0:1787508615.087368:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29701 00000100:00100000:1.0:1787508615.087376:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202228:x1874324480111488:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787508615.087482:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1517b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202228:x1874324480111488:12345-0@lo:1000:mdt00_002.0 Request processed in 106us (261us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787508615.087489:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29701 00000100:00100000:2.0:1787508615.087625:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1517480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480111488:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787508615.087703:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d15ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480111616:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787508615.087732:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.087756:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3f11300 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.087961:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480111616 00000100:00100000:3.0:1787508615.087967:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480111616 00000100:00100000:3.0:1787508615.088000:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29702 00000100:00100000:3.0:1787508615.088007:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d15ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202228:x1874324480111616:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787508615.088072:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d15ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202228:x1874324480111616:12345-0@lo:1000:mdt00_002.0 Request processed in 65us (339us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787508615.088079:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29702 00000100:00100000:2.0:1787508615.088216:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d15ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480111616:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787508615.088269:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d15ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480111744:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787508615.088295:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.088320:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3f11300 going to sleep for 11 seconds 00000100:00100000:0.0:1787508615.088377:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480111744 00000100:00100000:0.0:1787508615.088381:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480111744 00000100:00100000:0.0:1787508615.088415:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29703 00000100:00100000:0.0:1787508615.088422:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d74b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202228:x1874324480111744:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787508615.088482:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d74b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202228:x1874324480111744:12345-0@lo:1000:mdt00_002.0 Request processed in 60us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508615.088489:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29703 00000100:00100000:2.0:1787508615.088616:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d15ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480111744:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787508615.088659:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d15ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480111872:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787508615.088684:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.088709:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3f11300 going to sleep for 11 seconds 00000100:00100000:1.0:1787508615.089170:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480111872 00000100:00100000:1.0:1787508615.089175:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480111872 00000100:00100000:1.0:1787508615.089215:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29704 00000100:00100000:1.0:1787508615.089223:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d13bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:202228:x1874324480111872:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787508615.089311:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d13bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:202228:x1874324480111872:12345-0@lo:1000:mdt00_002.0 Request processed in 87us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.089318:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29704 00000100:00100000:2.0:1787508615.089495:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d15ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480111872:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787508615.089543:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d13be680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480112000:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787508615.089569:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.089601:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3f11300 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.089649:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480112000 00000100:00100000:3.0:1787508615.089653:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480112000 00000100:00100000:3.0:1787508615.089687:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29705 00000100:00100000:3.0:1787508615.089695:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d13bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:202228:x1874324480112000:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787508615.089758:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d13bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:202228:x1874324480112000:12345-0@lo:1000:mdt00_002.0 Request processed in 64us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.089764:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29705 00000100:00100000:2.0:1787508615.090021:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d13be680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480112000:0@lo:1000:mdt00_002.0 00000040:00080000:2.0:1787508615.091184:0:202228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xf:0x0].45, 2168 off80408 00000040:00080000:2.0:1787508615.091343:0:202228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x5:0x0].588, 2368 off746544 00000004:00080000:2.0:1787508615.091421:0:202228:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d3f11240 with version 13604 00000004:00080000:0.0:1787508615.091530:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13604 rpc_version 13604 00000020:00100000:0.0:1787508615.091571:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787508615.091580:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d1514700 x1874324480112256/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787508615.091604:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1514700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480112256:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787508615.091660:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508615.091737:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d21c4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.091878:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480112256 00000100:00100000:3.0:1787508615.091885:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480112256 00000100:00100000:3.0:1787508615.091974:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29706 00000100:00100000:3.0:1787508615.091983:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202961:x1874324480112256:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508615.097109:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:202961:x1874324480112256:12345-0@lo:1000:osp_up0-1.0 Request processed in 5117us (5437us total) trans 12884944076 rc 0/0 00000100:00100000:3.0:1787508615.097126:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29706 00000100:00100000:2.0:1787508615.097293:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1514700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480112256:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1787508615.097542:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e800/0xb126349c40f33f25 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.097558:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e800/0xb126349c40f33f25 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.097573:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e800/0xb126349c40f33f25 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.097597:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f33f2c lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x292:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.097604:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f33f2c lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x292:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.097610:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f33f2c lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x292:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.097647:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8fa00/0xb126349c40f33f33 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.097654:0:202228:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8fa00/0xb126349c40f33f33 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.097665:0:202228:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8fa00/0xb126349c40f33f33 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508615.097684:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0219500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480112384:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1787508615.097724:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508615.097795:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9540 going to sleep for 11 seconds 00000100:00100000:2.0:1787508615.098044:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480112384 00000100:00100000:2.0:1787508615.098051:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480112384 00000100:00100000:1.0:1787508615.098208:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29707 00000100:00100000:1.0:1787508615.098218:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:202228:x1874324480112384:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1787508615.098239:0:202232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.098257:0:202232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f33f3a lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f33f33 expref: -99 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.098290:0:202232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f33f3a lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f33f33 expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.098302:0:202232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f33f3a lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33f33 expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.098311:0:202232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x288:0x0].0x0 (ffff9090d9e7b900) 00010000:00010000:1.0:1787508615.098314:0:202232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.098317:0:202232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4400, rc 0) 00000100:00100000:1.0:1787508615.098370:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:202228:x1874324480112384:12345-0@lo:101:mdt00_002.0 Request processed in 153us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.098377:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29707 00000100:00100000:3.0:1787508615.098509:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0219500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480112384:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1787508615.098524:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8fa00/0xb126349c40f33f33 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33f3a expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.098534:0:202228:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8fa00/0xb126349c40f33f33 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f33f3a expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508615.098554:0:202228:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c4e7ba2 reply state 0000000081507728 transno 8589962008 ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f33f2c lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x292:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.098567:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f33f2c lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x292:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.098574:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x292:0x0].0x0 (ffff9090ccb87400) 00010000:00010000:3.0:1787508615.098576:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508615.098579:0:202228:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787508615.098585:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8fa00/0xb126349c40f33f33 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33f3a expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.098592:0:202228:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8fa00/0xb126349c40f33f33 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33f3a expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787508615.098601:0:202228:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x288:0x0] 00000004:00010000:3.0:1787508615.098607:0:202228:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c4e7ba2 reply state 0000000081507728 transno 8589962008 ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e800/0xb126349c40f33f25 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.098616:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e800/0xb126349c40f33f25 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.098621:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d3:0x0].0x0 (ffff9090ccb87500) 00010000:00010000:3.0:1787508615.098624:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508615.098626:0:202228:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787508615.098630:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d3:0x0]: returning size 4096 00000004:00080000:3.0:1787508615.098639:0:202228:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1787508615.098648:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d0ff0c00/0xb126349c40f33efb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f33f02 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.098656:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d0ff0c00/0xb126349c40f33efb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xb126349c40f33f02 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.098667:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d0ff0c00/0xb126349c40f33efb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xb126349c40f33f02 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.098691:0:202228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000004:00080000:3.0:1787508615.098696:0:202228:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1787508615.098701:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6200/0xb126349c40f33f09 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33f10 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.098708:0:202228:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6200/0xb126349c40f33f09 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f33f10 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508615.098783:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+642:336064:x1874324509518976:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 37627us (38088us total) trans 8589962008 rc 0/0 00000100:00100000:3.0:1787508615.098791:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93830 00010000:00010000:0.0:1787508615.099064:0:202215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508615.099071:0:202215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d0ff0c00/0xb126349c40f33efb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f33f02 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.099079:0:202215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d0ff0c00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:0.0:1787508615.099085:0:202215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d0ff0c00/0xb126349c40f33efb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f33f02 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508615.099093:0:202215:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d0ff0c00/0xb126349c40f33efb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f33f02 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.099123:0:202215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d0ff0c00/0xb126349c40f33efb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33f02 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.099129:0:202215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787508615.099148:0:202215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d0ff0c00/0xb126349c40f33efb lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33f02 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.099156:0:202215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d0ff0c00/0xb126349c40f33efb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33f02 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.099168:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508615.099170:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508615.099171:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508615.099181:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480112512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508615.099215:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508615.099518:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480112512 00000100:00100000:3.0:1787508615.099525:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480112512 00010000:00010000:3.0:1787508615.099545:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33f02 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f33efb expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508615.099565:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27855 00000100:00100000:3.0:1787508615.099571:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4854380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:3619:x1874324480112512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787508615.099581:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508615.099594:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33f02 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f33efb expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.099605:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.099611:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33f1e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.099619:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33f1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.099626:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33f1e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.099650:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508615.099678:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4854380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3619:x1874324480112512:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.099684:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27855 00000100:00100000:0.0:1787508615.099758:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480112512:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508615.099809:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33f1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.099816:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33f1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508615.099862:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508615.099866:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508615.099883:0:209004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33f1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.099908:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33f17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1e7 expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.099923:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33f1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1e7 expref: 11 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.099930:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.099932:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508615.099934:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fe00, rc 0) 00000100:00100000:0.0:1787508615.101722:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336073:x1874324509519360:12345-192.168.201.30@tcp:101:rm.0 Request processed in 18280us (18438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508615.101736:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93831 00000100:00100000:0.0:1787508615.107770:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.108323:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509519488 00000100:00100000:1.0:1787508615.108334:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509519488 00000100:00100000:1.0:1787508615.108409:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93832 00000100:00100000:1.0:1787508615.108418:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336073:x1874324509519488:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508615.108449:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.108473:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33f41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae1ee expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.108539:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33f48 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.108559:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33f48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.108570:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33f48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.108584:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33f4f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.108590:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33f4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.108595:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33f4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.108653:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33f48 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.108660:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33f48 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.108666:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33f48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.108673:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33f48 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.108679:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.108685:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33f48 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.108693:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33f48 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.108705:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.108708:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.108713:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33f48 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.108719:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33f48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.108731:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33f4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.108737:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33f4f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.108743:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33f4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.108747:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.108750:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33f4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.108756:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33f4f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.108763:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090d9e7b700) 00010000:00010000:1.0:1787508615.108765:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.108767:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33f4f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.108772:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33f4f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.108818:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33f41 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1ee expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.108829:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.108831:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508615.108834:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33f41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1ee expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.108844:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5600, rc 0) 00000100:00100000:1.0:1787508615.108918:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336073:x1874324509519488:12345-192.168.201.30@tcp:101:rm.0 Request processed in 500us (1160us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508615.108926:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93832 00000100:00100000:2.0:1787508615.116079:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.116162:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509519616 00000100:00100000:3.0:1787508615.116173:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509519616 00000100:00100000:3.0:1787508615.116248:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93833 00000100:00100000:3.0:1787508615.116261:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d13be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336073:x1874324509519616:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508615.116284:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.116306:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33f56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae1f5 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.116372:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33f5d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.116387:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33f5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.116397:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33f5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.116416:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33f64 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.116423:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33f64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.116429:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33f64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.116506:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33f5d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.116514:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33f5d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.116519:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33f5d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.116524:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33f5d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.116530:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ea00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.116533:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33f5d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.116540:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33f5d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.116553:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.116556:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.116561:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33f5d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.116567:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33f5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.116582:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33f64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.116588:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33f64 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.116592:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33f64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.116597:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.116600:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33f64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.116605:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33f64 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.116612:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090ccb87300) 00010000:00010000:3.0:1787508615.116614:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.116616:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33f64 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.116621:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33f64 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.116649:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33f56 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1f5 expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.116659:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.116661:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508615.116665:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33f56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1f5 expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.116675:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f800, rc 0) 00000100:00100000:3.0:1787508615.116743:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d13be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336073:x1874324509519616:12345-192.168.201.30@tcp:101:rm.0 Request processed in 485us (673us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508615.116751:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93833 00000100:00100000:2.0:1787508615.121034:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.121064:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.121157:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509519744 00000100:00100000:3.0:1787508615.121168:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509519744 00000100:00100000:3.0:1787508615.121216:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509519872 00000100:00100000:3.0:1787508615.121219:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509519872 00000100:00100000:3.0:1787508615.121251:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93834 00000100:00100000:3.0:1787508615.121261:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d13bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336073:x1874324509519744:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508615.121283:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.121305:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33f6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae1fc expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121379:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33f72 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121394:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33f72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121405:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33f72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121419:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33f79 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121427:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33f79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121445:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33f79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121503:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33f72 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121510:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33f72 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121515:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33f72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121522:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33f72 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121528:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.121533:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33f72 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121540:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33f72 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121552:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.121555:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.121560:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33f72 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121567:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33f72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121582:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33f79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121589:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33f79 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121594:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33f79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121599:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.121601:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33f79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121606:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33f79 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121613:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090ccb87600) 00010000:00010000:3.0:1787508615.121615:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.121617:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33f79 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121622:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33f79 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121652:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33f6b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1fc expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121663:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.121665:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508615.121669:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33f6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1fc expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121684:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f000, rc 0) 00000100:00100000:3.0:1787508615.121740:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d13bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336073:x1874324509519744:12345-192.168.201.30@tcp:101:rm.0 Request processed in 480us (716us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508615.121747:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93834 00000100:00100000:3.0:1787508615.121769:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93835 00000100:00100000:3.0:1787508615.121776:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d13bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+581:336074:x1874324509519872:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1787508615.121796:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.121806:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f33f80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae203 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121838:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f33f87 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121846:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f33f87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121853:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f33f87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508615.121892:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508615.121895:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508615.121916:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f33f87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121934:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f33f80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae203 expref: 583 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121971:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f33f87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae203 expref: 582 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.121978:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.121981:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508615.121983:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d0ff0c00, rc 0) 00000100:00100000:3.0:1787508615.122004:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d13bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336074:x1874324509519872:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 230us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.122010:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93835 00000100:00100000:0.0:1787508615.127196:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.127281:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509520128 00000100:00100000:3.0:1787508615.127292:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509520128 00000100:00100000:3.0:1787508615.127365:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93836 00000100:00100000:3.0:1787508615.127375:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d5739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336073:x1874324509520128:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508615.127398:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.127420:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f33f8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae20a expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.127506:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f33f95 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.127520:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f33f95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.127530:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f33f95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.127545:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33f9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.127551:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33f9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.127558:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33f9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.127610:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f33f95 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.127617:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f33f95 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.127623:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f33f95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.127630:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f33f95 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.127635:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d34a3e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.127639:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f33f95 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.127646:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f33f95 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.127657:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.127660:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.127665:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f33f95 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.127671:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3e00/0xb126349c40f33f95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.127685:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33f9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.127691:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33f9c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.127696:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33f9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.127701:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.127703:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33f9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.127707:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33f9c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.127714:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090ccb87600) 00010000:00010000:3.0:1787508615.127716:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.127718:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33f9c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.127722:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33f9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.127750:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f33f8e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae20a expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.127759:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.127761:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508615.127765:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1800/0xb126349c40f33f8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae20a expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.127777:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d0ff1800, rc 0) 00000100:00100000:3.0:1787508615.127841:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d5739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336073:x1874324509520128:12345-192.168.201.30@tcp:101:rm.0 Request processed in 466us (667us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508615.127848:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93836 00000100:00100000:2.0:1787508615.136203:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.136304:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509520256 00000100:00100000:3.0:1787508615.136316:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509520256 00000100:00100000:3.0:1787508615.136389:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93837 00000100:00100000:3.0:1787508615.136400:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d13bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336074:x1874324509520256:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1787508615.136422:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.136455:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33fa3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae211 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.136524:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33faa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.136538:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33faa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.136548:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33faa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.136563:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33fb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.136569:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.136576:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.136637:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33faa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.136645:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33faa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.136650:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33faa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.136656:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33faa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.136662:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.136666:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33faa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.136672:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33faa lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.136684:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.136687:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.136692:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33faa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.136699:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f33faa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.136715:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.136720:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33fb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.136726:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.136731:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.136733:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.136738:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33fb1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.136745:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090ccb87600) 00010000:00010000:3.0:1787508615.136747:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.136752:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33fb1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.136758:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f33fb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.136788:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33fa3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae211 expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.136798:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.136801:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508615.136804:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f33fa3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae211 expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.136814:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f000, rc 0) 00000100:00100000:3.0:1787508615.136889:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d13bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336074:x1874324509520256:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 489us (705us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508615.136900:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93837 00000100:00100000:2.0:1787508615.140077:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.140173:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509520384 00000100:00100000:1.0:1787508615.140194:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509520384 00000100:00100000:1.0:1787508615.140258:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93838 00000100:00100000:1.0:1787508615.140269:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d15ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336074:x1874324509520384:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508615.140290:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.140311:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33fb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae218 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.140395:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33fbf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.140410:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33fbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.140422:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33fbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.140447:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33fc6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.140455:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.140461:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.140523:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33fbf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.140531:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33fbf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.140538:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33fbf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.140544:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33fbf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.140549:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.140554:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33fbf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.140561:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33fbf lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.140574:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.140577:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.140581:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33fbf lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.140588:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f33fbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.140601:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.140607:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33fc6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.140612:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.140617:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.140620:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.140625:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33fc6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.140631:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090d9e7b700) 00010000:00010000:1.0:1787508615.140633:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.140635:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33fc6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.140640:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f33fc6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.140667:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33fb8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae218 expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.140681:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.140683:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508615.140686:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f33fb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae218 expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.140694:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5600, rc 0) 00000100:00100000:1.0:1787508615.140813:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d15ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336074:x1874324509520384:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 544us (745us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508615.140821:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93838 00000100:00100000:0.0:1787508615.145038:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.145175:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509520512 00000100:00100000:1.0:1787508615.145194:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509520512 00000100:00100000:1.0:1787508615.145253:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93839 00000100:00100000:1.0:1787508615.145264:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d573b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336073:x1874324509520512:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508615.145287:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.145309:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33fcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae21f expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.145386:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33fd4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.145400:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33fd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.145411:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33fd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.145421:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33fdb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.145432:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33f10 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33f09 expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.145451:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33fdb lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.145485:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33f10 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f33f09 expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.145502:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6ac5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480112640:0@lo:104: 00000100:00100000:1.0:1787508615.145548:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508615.145579:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88600 going to sleep for 11 seconds 00000100:00100000:0.0:1787508615.145776:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480112640 00000100:00100000:0.0:1787508615.145781:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480112640 00000100:00100000:0.0:1787508615.145821:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18163 00000100:00100000:0.0:1787508615.145828:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:230618:x1874324480112640:12345-0@lo:104: 00010000:00010000:0.0:1787508615.145840:0:202210:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6200/0xb126349c40f33f09 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f33f10 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.145904:0:202210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787508615.145910:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:230618:x1874324480112640:12345-0@lo:104: Request processed in 83us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508615.145918:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18163 00010000:00010000:0.0:1787508615.145966:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508615.145972:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6200/0xb126349c40f33f09 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f33f10 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.145980:0:204785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6200 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:0.0:1787508615.145985:0:204785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6200/0xb126349c40f33f09 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f33f10 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508615.145998:0:204785:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6200/0xb126349c40f33f09 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f33f10 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.146023:0:204785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6200/0xb126349c40f33f09 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33f10 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.146030:0:204785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787508615.146050:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6200/0xb126349c40f33f09 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33f10 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.146058:0:204785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6200/0xb126349c40f33f09 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33f10 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.146076:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508615.146078:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508615.146080:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508615.146092:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d5738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480112768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508615.146123:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508615.146198:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6ac5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480112640:0@lo:104: 00010000:00010000:1.0:1787508615.146216:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33fdb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.149067:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.149405:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509520640 00000100:00100000:3.0:1787508615.149418:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509520640 00000100:00100000:3.0:1787508615.149482:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93840 00000100:00100000:3.0:1787508615.149493:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336074:x1874324509520640:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1787508615.149516:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.149540:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33fe2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae226 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.149614:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33fe9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.149628:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33fe9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.149638:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33fe9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.149651:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33ff0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.149656:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.149662:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.149717:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33fe9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.149729:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33fe9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.149734:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33fe9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.149742:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33fe9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.149747:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.149752:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33fe9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.149760:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33fe9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.149773:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.149776:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.149781:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33fe9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.149787:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f33fe9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.149801:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.149807:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33ff0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.149812:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33ff0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.149816:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ea00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.149819:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33ff0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.149825:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33ff0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.149832:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090ccb87300) 00010000:00010000:3.0:1787508615.149834:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.149837:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33ff0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.149843:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f33ff0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.149874:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33fe2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae226 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.149883:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.149885:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508615.149888:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f33fe2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae226 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.149897:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f800, rc 0) 00000100:00100000:3.0:1787508615.149979:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336074:x1874324509520640:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 488us (926us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508615.149986:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93840 00000100:00100000:2.0:1787508615.151615:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480112768 00000100:00100000:2.0:1787508615.151629:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480112768 00010000:00010000:2.0:1787508615.151671:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33f10 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f33f09 expref: 9 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.151717:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27856 00000100:00100000:2.0:1787508615.151726:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d5739880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3616:x1874324480112768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508615.151739:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1787508615.154536:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944076 is committed 00000020:00080000:0.0:1787508615.154555:0:202206:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8589961985 batchid updated 00000020:00080000:1.0:1787508615.154624:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961985 00000004:00080000:1.0:1787508615.154688:0:202262:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d1d88600 with version 3458 00000020:00080000:1.0:1787508615.154702:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589961984 cancel update log [0x240000bd2:0x1:0x0].1786: rc = 0 00000020:00080000:1.0:1787508615.154786:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589961984 cancel update log [0x2000013a0:0x1:0x0].1779: rc = 0 00000004:00080000:1.0:1787508615.154807:0:202262:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d1d88840 with version 3459 00000020:00080000:1.0:1787508615.154810:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589961985 cancel update log [0x240000bd2:0x1:0x0].1787: rc = 0 00000020:00080000:1.0:1787508615.154830:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589961985 cancel update log [0x2000013a0:0x1:0x0].1780: rc = 0 00000020:00080000:1.0:1787508615.154835:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961985 00000004:00080000:3.0:1787508615.154917:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3458 rpc_version 3458 00000020:00100000:3.0:1787508615.154986:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787508615.154998:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d0219500 x1874324480113024/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787508615.155026:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0219500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480113024:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787508615.155099:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508615.155146:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9300 going to sleep for 11 seconds 00000100:00100000:0.0:1787508615.155309:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480113024 00000100:00100000:0.0:1787508615.155318:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480113024 00000100:00100000:0.0:1787508615.155388:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29708 00000100:00100000:0.0:1787508615.155398:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:202248:x1874324480113024:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787508615.155574:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:202248:x1874324480113024:12345-0@lo:1000:osp_up1-0.0 Request processed in 178us (474us total) trans 8589962009 rc 0/0 00000100:00100000:0.0:1787508615.155583:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29708 00000100:00100000:1.0:1787508615.155665:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0219500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480113024:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787508615.155679:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3459 rpc_version 3459 00000020:00100000:1.0:1787508615.155692:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787508615.155698:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091e6ac5c00 x1874324480113280/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787508615.155712:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6ac5c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480113280:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787508615.155741:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508615.155770:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88e40 going to sleep for 11 seconds 00010000:00010000:2.0:1787508615.156030:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f33f10 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f33f09 expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.156050:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd200) 00010000:00010000:2.0:1787508615.156056:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33fdb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.156068:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33fdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.156076:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33fdb lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.156101:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508615.156144:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d5739880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+7:3616:x1874324480112768:12345-0@lo:103:ldlm_bl.0 Request processed in 4420us (10020us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.156157:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27856 00000100:00100000:2.0:1787508615.156211:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d5738380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480112768:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508615.156238:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33fdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.156246:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33fdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.156367:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b39c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:230618:1874324480113408:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1787508615.156397:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.156412:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8540 going to sleep for 11 seconds 00000100:00100000:1.0:1787508615.156582:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480113280 00000100:00100000:1.0:1787508615.156588:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480113280 00000100:00100000:1.0:1787508615.156623:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480113408 00000100:00100000:1.0:1787508615.156626:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480113408 00000100:00100000:1.0:1787508615.156638:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29709 00000100:00100000:1.0:1787508615.156644:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6ac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:202248:x1874324480113280:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787508615.156743:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6ac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:202248:x1874324480113280:12345-0@lo:1000:osp_up1-0.0 Request processed in 98us (1001us total) trans 8589962010 rc 0/0 00000100:00100000:1.0:1787508615.156750:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29709 00000100:00100000:1.0:1787508615.156781:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6ac5c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480113280:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787508615.156799:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29710 00000100:00100000:1.0:1787508615.156805:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:230618:x1874324480113408:12345-0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1787508615.156850:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:230618:x1874324480113408:12345-0@lo:1000:mdt00_006.0 Request processed in 45us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.156856:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29710 00000100:00100000:2.0:1787508615.157244:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b39c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:230618:1874324480113408:0@lo:1000:mdt00_006.0 00010000:00010000:2.0:1787508615.157295:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f33ff7 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.157306:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f33ff7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.157317:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f33ff7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508615.157341:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f33ff7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.157366:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33fd4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.157374:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33fd4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.157383:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33fd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.157390:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33fd4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.157397:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.157401:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33fd4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.157408:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33fd4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.157419:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.157422:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.157426:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33fd4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.157442:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f33fd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.157454:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33fdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.157460:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33fdb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.157467:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33fdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.157471:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4a00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.157475:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33fdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.157480:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33fdb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.157487:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd200) 00010000:00010000:2.0:1787508615.157489:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.157492:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33fdb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.157498:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f33fdb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.157534:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f33fcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae21f expref: 13 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.157547:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f33ff7 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae21f expref: 12 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.157555:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d3:0x0].0x0 (ffff9090d36fd800) 00010000:00010000:2.0:1787508615.157557:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508615.157560:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abe00, rc 0) 00000100:00100000:2.0:1787508615.157626:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d573b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336073:x1874324509520512:12345-192.168.201.30@tcp:101:rm.0 Request processed in 12363us (12597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.157634:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93839 00000100:00100000:2.0:1787508615.163172:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.163248:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509520768 00000100:00100000:3.0:1787508615.163258:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509520768 00000100:00100000:3.0:1787508615.163320:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93841 00000100:00100000:3.0:1787508615.163330:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:336073:x1874324509520768:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508615.163361:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.163386:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f33ffe lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae22d expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.163460:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f34005 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.163475:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f34005 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.163486:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f34005 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508615.163587:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d3:0x0]: returning size 4096 00000004:00200000:3.0:1787508615.163592:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787508615.163630:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f33ffe lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae22d expref: 7 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.163648:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f34005 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae22d expref: 6 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.163658:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d3:0x0].0x0 (ffff9090ccb87500) 00010000:00010000:3.0:1787508615.163662:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508615.163665:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ea00, rc 0) 00000100:00100000:3.0:1787508615.163724:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336073:x1874324509520768:12345-192.168.201.30@tcp:101:rm.0 Request processed in 395us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.163731:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93841 00000100:00100000:0.0:1787508615.165802:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.166055:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509521024 00000100:00100000:2.0:1787508615.166065:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509521024 00000100:00100000:2.0:1787508615.166125:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93842 00000100:00100000:2.0:1787508615.166137:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d5739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336074:x1874324509521024:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1787508615.166158:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.166179:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3400c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae234 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.166262:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34013 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.166275:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34013 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.166286:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34013 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.166302:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3401a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.166310:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3401a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.166316:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3401a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.166387:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34013 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.166395:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34013 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.166403:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34013 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.166415:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34013 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.166421:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.166426:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34013 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.166444:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34013 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.166458:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.166461:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.166465:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34013 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.166472:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34013 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.166485:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3401a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.166491:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3401a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.166497:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3401a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.166501:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.166504:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3401a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.166514:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3401a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.166522:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090d36fd200) 00010000:00010000:2.0:1787508615.166524:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.166527:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3401a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.166533:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3401a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.166566:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3400c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae234 expref: 583 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.166576:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.166579:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508615.166583:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3400c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae234 expref: 583 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.166591:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa600, rc 0) 00000100:00100000:2.0:1787508615.166659:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d5739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336074:x1874324509521024:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 523us (879us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508615.166666:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93842 00000100:00100000:0.0:1787508615.173241:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508615.173287:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.173360:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509521152 00000100:00100000:2.0:1787508615.173371:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509521152 00000100:00100000:2.0:1787508615.173442:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509521280 00000100:00100000:2.0:1787508615.173445:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509521280 00000100:00100000:2.0:1787508615.173476:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93843 00000100:00100000:2.0:1787508615.173488:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d5738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336073:x1874324509521152:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508615.173510:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.173532:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f34021 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x292:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae23b expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.173596:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f34028 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x292:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.173610:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f34028 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.173622:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f34028 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508615.173674:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x292:0x0]: returning size 4096 00000004:00200000:2.0:1787508615.173679:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787508615.173716:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f34021 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x292:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae23b expref: 8 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.173734:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f34028 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae23b expref: 7 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.173743:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x292:0x0].0x0 (ffff9090ccb87400) 00010000:00010000:2.0:1787508615.173746:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508615.173749:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aac00, rc 0) 00000100:00100000:2.0:1787508615.173803:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d5738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:336073:x1874324509521152:12345-192.168.201.30@tcp:101:rm.0 Request processed in 318us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.173810:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93843 00000100:00100000:2.0:1787508615.173829:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93844 00000100:00100000:2.0:1787508615.173836:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d5738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336074:x1874324509521280:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1787508615.173844:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.173854:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f3402f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae242 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.173884:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34036 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.173892:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34036 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.173898:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34036 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.173910:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f3403d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.173916:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f3403d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.173923:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f3403d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.174019:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34044 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.174028:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34044 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.174035:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34044 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508615.174055:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34044 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.174069:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34036 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.174076:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34036 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.174082:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34036 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.174089:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34036 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.174095:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.174099:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34036 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.174107:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34036 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.174117:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.174119:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.174123:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34036 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.174129:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34036 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.174138:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f3403d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.174144:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f3403d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.174150:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f3403d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.174155:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aaa00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.174157:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f3403d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.174163:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f3403d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.174170:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd700) 00010000:00010000:2.0:1787508615.174173:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.174175:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f3403d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.174180:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f3403d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.174211:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f3402f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae242 expref: 584 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.174223:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34044 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae242 expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.174230:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d3:0x0].0x0 (ffff9090d36fd800) 00010000:00010000:2.0:1787508615.174232:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508615.174235:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa600, rc 0) 00000100:00100000:2.0:1787508615.174258:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d5738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336074:x1874324509521280:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 422us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.174265:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93844 00000100:00100000:0.0:1787508615.179032:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.179127:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509521408 00000100:00100000:1.0:1787508615.179140:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509521408 00000100:00100000:1.0:1787508615.179213:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93845 00000100:00100000:1.0:1787508615.179223:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+642:336074:x1874324509521408:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508615.179249:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.179270:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f3404b lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae249 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.179333:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f34052 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.179347:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f34052 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.179369:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f34052 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508615.179480:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d3:0x0]: returning size 4096 00000004:00200000:1.0:1787508615.179485:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787508615.179525:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f3404b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae249 expref: 644 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.179544:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f34052 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae249 expref: 643 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.179552:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d3:0x0].0x0 (ffff9090ccb87500) 00010000:00010000:1.0:1787508615.179555:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508615.179558:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5400, rc 0) 00000100:00100000:1.0:1787508615.179622:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+643:336074:x1874324509521408:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 399us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.179628:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93845 00000100:00100000:2.0:1787508615.183031:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.183073:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.183143:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509521536 00000100:00100000:3.0:1787508615.183155:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509521536 00000100:00100000:3.0:1787508615.183201:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509521664 00000100:00100000:3.0:1787508615.183204:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509521664 00000100:00100000:3.0:1787508615.183233:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93846 00000100:00100000:3.0:1787508615.183243:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+643:336074:x1874324509521536:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1787508615.183262:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.183284:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f34059 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x292:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae250 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.183344:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f34060 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x292:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.183372:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f34060 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.183384:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f34060 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508615.183430:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x292:0x0]: returning size 4096 00000004:00200000:3.0:1787508615.183447:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787508615.183494:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f34059 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x292:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae250 expref: 645 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.183516:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f34060 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae250 expref: 644 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.183524:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x292:0x0].0x0 (ffff9090ccb87400) 00010000:00010000:3.0:1787508615.183528:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508615.183532:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e600, rc 0) 00000100:00100000:3.0:1787508615.183602:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:336074:x1874324509521536:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 360us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.183610:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93846 00000100:00100000:3.0:1787508615.183633:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93847 00000100:00100000:3.0:1787508615.183640:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336073:x1874324509521664:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508615.183649:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.183661:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34067 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x288:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae257 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.183689:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3406e lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x288:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.183700:0:205405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f33f3a lrc: 2/0,0 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f33f33 expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.183708:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3406e lrc: 4/1,0 mode: --/PR res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.183741:0:205405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f33f3a lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f33f33 expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508615.183758:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbe300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480113536:0@lo:104: 00000100:00100000:3.0:1787508615.183804:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508615.183851:0:229363:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787508615.183862:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480113536 00000100:00100000:3.0:1787508615.183866:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480113536 00000100:00100000:3.0:1787508615.183893:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18164 00000100:00100000:3.0:1787508615.183899:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9607850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:205405:x1874324480113536:12345-0@lo:104: 00010000:00010000:3.0:1787508615.183910:0:229363:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8fa00/0xb126349c40f33f33 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f33f3a expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.183993:0:229363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787508615.183999:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9607850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:205405:x1874324480113536:12345-0@lo:104: Request processed in 101us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.184005:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18164 00010000:00010000:3.0:1787508615.184044:0:202214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787508615.184050:0:202214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8fa00/0xb126349c40f33f33 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f33f3a expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.184058:0:202214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fa00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:3.0:1787508615.184064:0:202214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8fa00/0xb126349c40f33f33 lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f33f3a expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508615.184072:0:202214:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8fa00/0xb126349c40f33f33 lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f33f3a expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.184097:0:202214:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8fa00/0xb126349c40f33f33 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33f3a expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.184104:0:202214:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787508615.184124:0:202214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8fa00/0xb126349c40f33f33 lrc: 1/0,0 mode: --/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33f3a expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.184131:0:202214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8fa00/0xb126349c40f33f33 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f33f3a expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.184148:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508615.184150:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508615.184151:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508615.184163:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091c9458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480113664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787508615.184194:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508615.184231:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480113664 00000100:00100000:3.0:1787508615.184235:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480113664 00010000:00010000:3.0:1787508615.184251:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f33f3a lrc: 5/0,0 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f33f33 expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508615.184275:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27857 00000100:00100000:3.0:1787508615.184282:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+7:3617:x1874324480113664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787508615.184291:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787508615.184894:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9300 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.184915:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbe300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480113536:0@lo:104: 00010000:00010000:3.0:1787508615.184933:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3406e lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.188213:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f33f3a lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f33f33 expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.188237:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x288:0x0].0x0 (ffff9090d9e7b900) 00010000:00010000:0.0:1787508615.188242:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3406e lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.188251:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3406e lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.188258:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3406e lrc: 4/1,0 mode: PR/PR res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.188293:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508615.188425:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3406e lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.188448:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3406e lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508615.188508:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a2:0x288:0x0]: returning size 4096 00000004:00200000:3.0:1787508615.188515:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787508615.188562:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34067 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x288:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae257 expref: 14 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.188580:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3406e lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae257 expref: 13 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.188588:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x288:0x0].0x0 (ffff9090d9e7b900) 00010000:00010000:3.0:1787508615.188591:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508615.188594:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f200, rc 0) 00000100:00100000:3.0:1787508615.188653:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336073:x1874324509521664:12345-192.168.201.30@tcp:101:rm.0 Request processed in 5011us (5578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.188662:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93847 00000100:00100000:0.0:1787508615.189165:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480113664:12345-0@lo:103:ldlm_bl.0 Request processed in 4881us (4968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508615.189174:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27857 00000100:00100000:1.0:1787508615.189751:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091c9458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480113664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787508615.193118:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508615.193222:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509521920 00000100:00100000:0.0:1787508615.193232:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509521920 00000100:00100000:0.0:1787508615.193289:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93848 00000100:00100000:0.0:1787508615.193299:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:336073:x1874324509521920:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508615.193319:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508615.193343:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f34075 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae25e expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508615.193523:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d3:0x0]: returning size 4096 00010000:00010000:0.0:1787508615.193629:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f34075 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae25e expref: 9 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.193644:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090c9878100) 00010000:00010000:0.0:1787508615.193647:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508615.193652:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f34075 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae25e expref: 9 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.193670:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7e00, rc 0) 00000100:00100000:0.0:1787508615.193737:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336073:x1874324509521920:12345-192.168.201.30@tcp:101:rm.0 Request processed in 439us (628us total) trans 8589962011 rc 301/301 00000100:00100000:0.0:1787508615.193745:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93848 00000100:00100000:2.0:1787508615.196764:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.196873:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509522048 00000100:00100000:1.0:1787508615.196883:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509522048 00000100:00100000:2.0:1787508615.197039:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93849 00000100:00100000:2.0:1787508615.197052:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336074:x1874324509522048:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1787508615.197072:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.197093:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f34083 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x288:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae265 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.197153:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3408a lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x288:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.197166:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3408a lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.197178:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3408a lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508615.197237:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a2:0x288:0x0]: returning size 4096 00000004:00200000:2.0:1787508615.197242:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787508615.197278:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f34083 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x288:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae265 expref: 585 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.197297:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3408a lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae265 expref: 584 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.197307:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x288:0x0].0x0 (ffff9090d9e7b900) 00010000:00010000:2.0:1787508615.197310:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508615.197313:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa800, rc 0) 00000100:00100000:2.0:1787508615.197384:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336074:x1874324509522048:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 334us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.197391:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93849 00000100:00100000:2.0:1787508615.200855:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.200975:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509522304 00000100:00100000:1.0:1787508615.200985:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509522304 00000100:00100000:1.0:1787508615.201035:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93850 00000100:00100000:1.0:1787508615.201045:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:336074:x1874324509522304:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:1.0:1787508615.201099:0:202228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508615.201126:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f34052 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae249 expref: 644 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.201143:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d3:0x0].0x0 (ffff9090ccb87500) 00010000:00010000:1.0:1787508615.201148:0:202228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787508615.201168:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f34091 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.201193:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f34005 lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae22d expref: 7 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.201202:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f34091 lrc: 4/0,1 mode: --/PW res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.201232:0:202228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f34005 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae22d expref: 7 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.201247:0:202228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f34005 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae22d expref: 7 pid: 202228 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.201261:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6ac4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:202228:1874324480113792:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508615.201336:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787508615.203555:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6ac4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:202228:1874324480113792:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508615.203583:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f34091 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.206677:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.206756:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509522432 00000100:00100000:1.0:1787508615.206766:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509522432 00000100:00100000:1.0:1787508615.206828:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15407 00000100:00100000:1.0:1787508615.206839:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336073:x1874324509522432:12345-192.168.201.30@tcp:37:rm.0 00000100:00100000:0.0:1787508615.210732:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.211610:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336073:x1874324509522432:12345-192.168.201.30@tcp:37:rm.0 Request processed in 4768us (4939us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.211622:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15407 00000100:00100000:3.0:1787508615.212395:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509522560 00000100:00100000:3.0:1787508615.212404:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509522560 00010000:00010000:3.0:1787508615.212452:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f34005 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae22d expref: 8 pid: 202228 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508615.212495:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27858 00000100:00100000:3.0:1787508615.212505:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2401:x1874324509522560:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508615.212519:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508615.212526:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f34005 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae22d expref: 8 pid: 202228 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.212540:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f34005 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae22d expref: 8 pid: 202228 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.212562:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f34005 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae22d expref: 8 pid: 202228 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.212578:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d3:0x0].0x0 (ffff9090ccb87500) 00010000:00010000:3.0:1787508615.212583:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f34091 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.212594:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f34091 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.212601:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f34091 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.212624:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508615.212657:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2401:x1874324509522560:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 153us (1934us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.212664:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27858 00010000:00010000:1.0:1787508615.213547:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f34091 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.213559:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f34091 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.213589:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f34098 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x292:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.213602:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f34028 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae23b expref: 6 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.213611:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f34060 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae250 expref: 643 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.213618:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f34098 lrc: 5/0,1 mode: --/PW res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.213654:0:202228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f34060 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae250 expref: 643 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.213668:0:202228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f34060 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae250 expref: 643 pid: 205405 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.213681:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6ac4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:202228:1874324480113920:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508615.213765:0:202228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f34028 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae23b expref: 6 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.213775:0:202228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f34028 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae23b expref: 6 pid: 202227 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.213873:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6ac4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:202228:1874324480114048:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508615.213898:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787508615.219416:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6ac4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:202228:1874324480113920:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508615.219443:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6ac4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:202228:1874324480114048:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508615.219470:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f34098 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.223284:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.223336:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.223516:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509522816 00000100:00100000:3.0:1787508615.223525:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509522816 00000100:00100000:3.0:1787508615.223580:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15408 00000100:00100000:3.0:1787508615.223589:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336073:x1874324509522816:12345-192.168.201.30@tcp:37:rm.0 00000100:00100000:1.0:1787508615.225097:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509522688 00000100:00100000:1.0:1787508615.225108:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509522688 00010000:00010000:1.0:1787508615.225141:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f34060 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae250 expref: 644 pid: 205405 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.225195:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27859 00000100:00100000:1.0:1787508615.225204:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:2402:x1874324509522688:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508615.225217:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508615.225224:0:229383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f34060 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae250 expref: 644 pid: 205405 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.225237:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f34060 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae250 expref: 644 pid: 205405 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.225264:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f34060 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae250 expref: 644 pid: 205405 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.225281:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x292:0x0].0x0 (ffff9090ccb87400) 00010000:00010000:1.0:1787508615.225287:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f34098 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.225295:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f34098 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.225302:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508615.225593:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+643:2402:x1874324509522688:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 388us (2318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.225601:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27859 00000100:00100000:2.0:1787508615.229630:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.229711:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509522944 00000100:00100000:3.0:1787508615.229723:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509522944 00010000:00010000:3.0:1787508615.229767:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f34028 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae23b expref: 7 pid: 202227 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508615.229809:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27860 00000100:00100000:3.0:1787508615.229819:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2400:x1874324509522944:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508615.229834:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508615.229841:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f34028 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae23b expref: 7 pid: 202227 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.229855:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f34028 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae23b expref: 7 pid: 202227 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.229876:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f34028 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae23b expref: 7 pid: 202227 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.229894:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x292:0x0].0x0 (ffff9090ccb87400) 00010000:00010000:3.0:1787508615.229899:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f34098 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.229909:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f34098 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.229917:0:202212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f34098 lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.229975:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508615.230031:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509522944:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 213us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.230038:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27860 00010000:00010000:1.0:1787508615.230236:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f34098 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.230249:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f34098 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.230299:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c96e4e00/0xb126349c40f3409f lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.230307:0:202228:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c96e4e00/0xb126349c40f3409f lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x0 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.230317:0:202228:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c96e4e00/0xb126349c40f3409f lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.230337:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6ac4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480114176:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1787508615.230382:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508615.230419:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787508615.230471:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480114176 00000100:00100000:2.0:1787508615.230476:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480114176 00000100:00100000:2.0:1787508615.230519:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29711 00000100:00100000:2.0:1787508615.230528:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:202228:x1874324480114176:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1787508615.230543:0:202232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.230558:0:202232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f340a6 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f3409f expref: -99 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.230578:0:202232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3406e lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae257 expref: 14 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.230587:0:202232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3408a lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae265 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.230594:0:202232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f340a6 lrc: 5/0,0 mode: --/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f3409f expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.230616:0:202232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3408a lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae265 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.230630:0:202232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3408a lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae265 expref: 583 pid: 202226 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.230641:0:202232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788c700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:202232:1874324480114304:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508615.230708:0:202232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3406e lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae257 expref: 14 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.230717:0:202232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3406e lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae257 expref: 14 pid: 205405 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.230725:0:202232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788ea00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:202232:1874324480114432:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508615.230748:0:202232:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8540 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.233701:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336073:x1874324509522816:12345-192.168.201.30@tcp:37:rm.0 Request processed in 10100us (10352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.233716:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15408 00000100:00100000:1.0:1787508615.238507:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.238637:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509523200 00000100:00100000:3.0:1787508615.238647:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509523200 00000100:00100000:3.0:1787508615.238709:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15409 00000100:00100000:3.0:1787508615.238719:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde32450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336073:x1874324509523200:12345-192.168.201.30@tcp:35:rm.0 00000100:00100000:3.0:1787508615.238998:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde32450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:336073:x1874324509523200:12345-192.168.201.30@tcp:35:rm.0 Request processed in 280us (503us total) trans 8589962012 rc 0/0 00000100:00100000:3.0:1787508615.239007:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15409 00000100:00100000:2.0:1787508615.242755:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.242793:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.242923:0:202232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788c700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:202232:1874324480114304:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508615.242937:0:202232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788ea00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:202232:1874324480114432:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508615.243004:0:202232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f340a6 lrc: 3/0,0 mode: --/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3409f expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.243018:0:202232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x288:0x0].0x0 (ffff9090d9e7b900) 00010000:00010000:1.0:1787508615.243022:0:202232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508615.243027:0:202232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f340a6 lrc: 3/0,0 mode: --/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3409f expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.243037:0:202232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f340a6 lrc: 3/0,0 mode: --/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3409f expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.243045:0:202232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aba00, rc 0) 00000100:00100000:1.0:1787508615.243108:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:202228:x1874324480114176:12345-0@lo:101:mdt00_002.0 Request processed in 12580us (12724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.243117:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29711 00000100:00100000:1.0:1787508615.243172:0:202228:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944076 gen 2 00000004:00080000:1.0:1787508615.243192:0:202228:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944076 committed transno 12884944076 00000100:00100000:1.0:1787508615.243224:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6ac4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480114176:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1787508615.243241:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c96e4e00/0xb126349c40f3409f lrc: 4/0,1 mode: --/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f340a6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.243252:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c96e4e00/0xb126349c40f3409f lrc: 4/0,1 mode: --/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f340a6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508615.245136:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509523456 00000100:00100000:0.0:1787508615.245150:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509523456 00010000:00010000:0.0:1787508615.245249:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3406e lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae257 expref: 13 pid: 205405 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508615.245340:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509523328 00000100:00100000:0.0:1787508615.245351:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509523328 00010000:00010000:0.0:1787508615.245367:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3408a lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae265 expref: 584 pid: 202226 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508615.245392:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27861 00000100:00100000:0.0:1787508615.245400:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2401:x1874324509523456:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508615.245414:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508615.245420:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3406e lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae257 expref: 13 pid: 205405 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.245445:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3406e lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae257 expref: 13 pid: 205405 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.245467:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3406e lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae257 expref: 13 pid: 205405 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.245484:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x288:0x0].0x0 (ffff9090d9e7b900) 00010000:00010000:0.0:1787508615.245490:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f340a6 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3409f expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.245501:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f340a6 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3409f expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.245508:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508615.245559:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2401:x1874324509523456:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 159us (2817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508615.245566:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27861 00000100:00100000:0.0:1787508615.245581:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27862 00000100:00100000:0.0:1787508615.245587:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:2401:x1874324509523328:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508615.245594:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508615.245599:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3408a lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae265 expref: 584 pid: 202226 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.245610:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3408a lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae265 expref: 584 pid: 202226 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.245627:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3408a lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae265 expref: 584 pid: 202226 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.245637:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x288:0x0].0x0 (ffff9090d9e7b900) 00010000:00010000:0.0:1787508615.245641:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f340a6 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3409f expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.245651:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f340a6 lrc: 2/0,0 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f3409f expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.245659:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f340a6 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f3409f expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.245686:0:202213:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f340a6 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3409f expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508615.245699:0:202213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:202213:1874324480114560:0@lo:105: 00000100:00100000:0.0:1787508615.245742:0:202213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508615.246097:0:202213:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d21c4300 going to sleep for 11 seconds 00000100:00100000:0.0:1787508615.246115:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480114560 00000100:00100000:0.0:1787508615.246120:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480114560 00000100:00100000:0.0:1787508615.246148:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18165 00000100:00100000:0.0:1787508615.246154:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:202213:x1874324480114560:12345-0@lo:105: 00010000:00010000:0.0:1787508615.246164:0:202210:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c96e4e00/0xb126349c40f3409f lrc: 5/0,1 mode: --/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f340a6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.246239:0:202210:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c96e4e00/0xb126349c40f3409f lrc: 5/0,1 mode: --/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f340a6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.246249:0:202210:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c96e4e00/0xb126349c40f3409f lrc: 5/0,1 mode: --/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f340a6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.246257:0:202210:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c96e4e00/0xb126349c40f3409f lrc: 5/0,1 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f340a6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.246264:0:202210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c96e4e00/0xb126349c40f3409f lrc: 6/0,1 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f340a6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.246272:0:202210:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c96e4e00/0xb126349c40f3409f lrc: 6/0,1 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f340a6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.246290:0:202210:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090c96e4e00) 00000100:00100000:0.0:1787508615.246323:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:202213:x1874324480114560:12345-0@lo:105: Request processed in 169us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508615.246330:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18165 00010000:00010000:1.0:1787508615.246429:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c96e4e00/0xb126349c40f3409f lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f340a6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.246449:0:202228:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c96e4e00/0xb126349c40f3409f lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f340a6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787508615.246660:0:202228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xf:0x0].46, 344 off80752 00000040:00080000:1.0:1787508615.246716:0:202228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x5:0x0].589, 552 off747096 00000004:00080000:1.0:1787508615.246721:0:202228:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d1d88e40 with version 13605 00000100:00100000:0.0:1787508615.246845:0:202213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:202213:1874324480114560:0@lo:105: 00010000:00010000:0.0:1787508615.246859:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508615.246887:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:2401:x1874324509523328:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1299us (4093us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508615.246894:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27862 00000004:00080000:2.0:1787508615.248118:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13605 rpc_version 13605 00000020:00100000:2.0:1787508615.248160:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787508615.248169:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090c788ea00 x1874324480114816/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1528/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787508615.248202:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788ea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480114816:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508615.248258:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.248294:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787508615.248470:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480114816 00000100:00100000:0.0:1787508615.248477:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480114816 00000100:00100000:0.0:1787508615.248528:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29712 00000100:00100000:0.0:1787508615.248537:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:202961:x1874324480114816:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787508615.248884:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202961:x1874324480114816:12345-0@lo:1000:osp_up0-1.0 Request processed in 347us (625us total) trans 12884944077 rc 0/0 00000100:00100000:0.0:1787508615.248892:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29712 00000100:00100000:1.0:1787508615.249563:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788ea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480114816:0@lo:1000:osp_up0-1.0 00000004:00010000:0.0:1787508615.249635:0:202228:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f32c161 reply state 00000000b2fb7356 transno 8589962013 ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f34098 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.249657:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f34098 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.249666:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x292:0x0].0x0 (ffff9090ccb87400) 00010000:00010000:0.0:1787508615.249668:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787508615.249673:0:202228:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787508615.249679:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c96e4e00/0xb126349c40f3409f lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f340a6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.249688:0:202228:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c96e4e00/0xb126349c40f3409f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f340a6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787508615.249700:0:202228:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x288:0x0] 00000004:00010000:0.0:1787508615.249708:0:202228:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f32c161 reply state 00000000b2fb7356 transno 8589962013 ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f34091 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.249717:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f34091 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.249723:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d3:0x0].0x0 (ffff9090ccb87500) 00010000:00010000:0.0:1787508615.249725:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787508615.249727:0:202228:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1787508615.249738:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d3:0x0]: returning size 4096 00000100:00100000:0.0:1787508615.250017:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:336074:x1874324509522304:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 48971us (49169us total) trans 8589962013 rc 0/0 00000100:00100000:0.0:1787508615.250026:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93850 00000100:00100000:2.0:1787508615.250267:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508615.256936:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509523584 00000100:00100000:0.0:1787508615.256969:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509523584 00000100:00100000:0.0:1787508615.257042:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93851 00000100:00100000:0.0:1787508615.257053:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336073:x1874324509523584:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508615.257074:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508615.257098:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f340ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae26c expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.257168:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f340b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.257196:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f340b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.257209:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f340b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.257226:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f340bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.257233:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f340bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.257240:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f340bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.257312:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f340c2 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.257322:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f340c2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.257329:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f340c2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508615.257350:0:205405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f340c2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.257366:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f340b4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.257374:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f340b4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.257380:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f340b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.257387:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f340b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.257393:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508615.257398:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f340b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.257405:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f340b4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.257418:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508615.257421:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508615.257426:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f340b4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.257464:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f340b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.257478:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f340bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.257484:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f340bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.257490:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f340bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.257495:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508615.257498:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f340bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.257504:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f340bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.257511:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090c9878100) 00010000:00010000:0.0:1787508615.257513:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508615.257516:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f340bb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.257522:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f340bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.257553:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f340ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae26c expref: 14 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.257570:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f340c2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae26c expref: 13 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.257577:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d3:0x0].0x0 (ffff9090d36fd800) 00010000:00010000:0.0:1787508615.257579:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508615.257582:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6c00, rc 0) 00000100:00100000:0.0:1787508615.257642:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336073:x1874324509523584:12345-192.168.201.30@tcp:101:rm.0 Request processed in 591us (7375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508615.257649:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93851 00000100:00100000:2.0:1787508615.268663:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.268757:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.268809:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.268851:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509523840 00000100:00100000:3.0:1787508615.268860:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509523840 00000100:00100000:3.0:1787508615.268927:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9784 00000100:00100000:3.0:1787508615.268937:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2403:x1874324509523840:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508615.268980:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508615.269007:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f340c2 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae26c expref: 13 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.269026:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d3:0x0].0x0 (ffff9090d36fd800) 00010000:00010000:3.0:1787508615.269032:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508615.269093:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2403:x1874324509523840:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 156us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.269101:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9784 00000100:00100000:1.0:1787508615.272482:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509523712 00000100:00100000:1.0:1787508615.272499:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509523712 00000100:00100000:1.0:1787508615.272566:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509524096 00000100:00100000:1.0:1787508615.272570:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509524096 00000100:00100000:1.0:1787508615.272598:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93852 00000100:00100000:1.0:1787508615.272608:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:336073:x1874324509523712:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508615.272635:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.272655:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f340c9 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae273 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.272717:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4a00/0xb126349c40f340d0 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.272731:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4a00/0xb126349c40f340d0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.272743:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4a00/0xb126349c40f340d0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508615.273027:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d3:0x0]: returning size 4096 00000004:00200000:1.0:1787508615.273033:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787508615.273075:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f340c9 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae273 expref: 9 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.273094:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4a00/0xb126349c40f340d0 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae273 expref: 8 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.273104:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d3:0x0].0x0 (ffff9090ccb87500) 00010000:00010000:1.0:1787508615.273107:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508615.273111:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4a00, rc 0) 00000100:00100000:1.0:1787508615.273174:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336073:x1874324509523712:12345-192.168.201.30@tcp:101:rm.0 Request processed in 567us (4520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.273416:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93852 00000100:00100000:1.0:1787508615.273449:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93853 00000100:00100000:1.0:1787508615.273458:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336075:x1874324509524096:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508615.273469:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.273481:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f340d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae27a expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.273530:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f340de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.273540:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f340de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.273549:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f340de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.273563:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f340e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.273571:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f340e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.273578:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f340e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.273626:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f340de lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.273634:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f340de lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.273643:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f340de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.273649:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f340de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.273656:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.273660:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f340de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.273667:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f340de lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.273676:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.273679:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.273682:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f340de lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.273688:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f340de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.273699:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f340e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.273705:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f340e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.273711:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f340e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.273716:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.273719:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f340e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.273726:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f340e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.273733:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xce5b6a33 (ffff9090d9e7b600) 00010000:00010000:1.0:1787508615.273736:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.273739:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f340e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.273745:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f340e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.273771:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f340d7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae27a expref: 584 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.274060:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.274063:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508615.274068:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f340d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae27a expref: 584 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.274080:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5200, rc 0) 00000100:00100000:1.0:1787508615.274119:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336075:x1874324509524096:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 663us (5309us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508615.274126:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93853 00000100:00100000:2.0:1787508615.277884:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.278007:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.282419:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.282466:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.282510:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509524224 00000100:00100000:3.0:1787508615.282522:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509524224 00000100:00100000:3.0:1787508615.282574:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 978 00000100:00100000:3.0:1787508615.282585:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091cbbc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2401:x1874324509524224:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508615.282655:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091cbbc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2401:x1874324509524224:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 72us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.282663:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 978 00000100:00100000:1.0:1787508615.282874:0:225834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509524352 00000100:00100000:1.0:1787508615.282880:0:225834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509524352 00000100:00100000:1.0:1787508615.282955:0:225834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509524608 00000100:00100000:1.0:1787508615.282959:0:225834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509524608 00000100:00100000:1.0:1787508615.282986:0:225834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2268 00000100:00100000:1.0:1787508615.282994:0:225834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2401:x1874324509524352:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508615.283026:0:225834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2401:x1874324509524352:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 34us (5153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.283033:0:225834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2268 00000100:00100000:1.0:1787508615.283045:0:225834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2269 00000100:00100000:1.0:1787508615.283051:0:225834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2401:x1874324509524608:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508615.283072:0:225834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2401:x1874324509524608:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (5066us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.283078:0:225834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2269 00000100:00080000:3.0:1787508615.283205:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787508615.283211:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787508615.283371:0:225832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509524480 00000100:00100000:2.0:1787508615.283376:0:225832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509524480 00000100:00100000:2.0:1787508615.283419:0:225832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2270 00000100:00100000:2.0:1787508615.283427:0:225832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2401:x1874324509524480:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508615.283465:0:225832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2401:x1874324509524480:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 39us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.283471:0:225832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2270 00000100:00100000:2.0:1787508615.283522:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.283543:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509524736 00000100:00100000:2.0:1787508615.283548:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509524736 00000100:00100000:2.0:1787508615.283583:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9785 00000100:00100000:2.0:1787508615.283589:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde3e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2401:x1874324509524736:12345-192.168.201.30@tcp:103:rm.0 00010000:00010000:2.0:1787508615.283601:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508615.283625:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f33ff7 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae21f expref: 12 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.283645:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d3:0x0].0x0 (ffff9090d36fd800) 00010000:00010000:2.0:1787508615.283650:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508615.283669:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde3e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2401:x1874324509524736:12345-192.168.201.30@tcp:103:rm.0 Request processed in 80us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.283676:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9785 00000100:00100000:2.0:1787508615.283741:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.283971:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.285230:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509524992 00000100:00100000:2.0:1787508615.285241:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509524992 00000100:00100000:2.0:1787508615.285294:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509525248 00000100:00100000:2.0:1787508615.285298:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509525248 00000100:00100000:2.0:1787508615.285327:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93854 00000100:00100000:2.0:1787508615.285336:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336073:x1874324509524992:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1787508615.285386:0:230618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508615.285411:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4a00/0xb126349c40f340d0 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae273 expref: 8 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.285440:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d3:0x0].0x0 (ffff9090ccb87500) 00010000:00010000:2.0:1787508615.285445:0:230618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508615.285493:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa000/0xb126349c40f340ec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.285502:0:230618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa000/0xb126349c40f340ec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.285511:0:230618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa000/0xb126349c40f340ec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.285532:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788d500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480114944:0@lo:101:mdt00_006.0 00000100:00100000:2.0:1787508615.285589:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.285616:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8900 going to sleep for 11 seconds 00000100:00100000:2.0:1787508615.285636:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93855 00000100:00100000:2.0:1787508615.285645:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336075:x1874324509525248:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508615.285655:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.285667:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f340f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae281 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.285716:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f340fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.285729:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f340fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.285738:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f340fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.285752:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34101 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.285758:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34101 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.285764:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34101 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.285995:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f340fa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.286004:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f340fa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.286010:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f340fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.286021:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f340fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.286027:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.286031:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f340fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.286039:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f340fa lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.286049:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.286052:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.286055:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f340fa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.286062:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f340fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.286072:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34101 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.286078:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34101 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.286083:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34101 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.286087:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.286090:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34101 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.286099:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34101 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.286107:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaf7dd568 (ffff9090d36fd700) 00010000:00010000:2.0:1787508615.286109:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.286112:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34101 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.286118:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34101 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.286149:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f340f3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae281 expref: 584 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.286157:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.286159:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508615.286162:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f340f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae281 expref: 584 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.286170:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aac00, rc 0) 00000100:00100000:2.0:1787508615.286277:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336075:x1874324509525248:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 632us (2306us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508615.286284:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93855 00000100:00100000:3.0:1787508615.286571:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480114944 00000100:00100000:3.0:1787508615.286578:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480114944 00000100:00100000:3.0:1787508615.286630:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29713 00000100:00100000:3.0:1787508615.286638:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:230618:x1874324480114944:12345-0@lo:101:mdt00_006.0 00010000:00010000:3.0:1787508615.286658:0:202231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.286675:0:202231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34108 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f340ec expref: -99 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.286696:0:202231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33f1e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1e7 expref: 10 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.286705:0:202231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f33f87 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae203 expref: 582 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.286714:0:202231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34108 lrc: 5/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f340ec expref: 9 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.286743:0:202231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f33f87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae203 expref: 582 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.286758:0:202231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f33f87 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae203 expref: 582 pid: 202228 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508615.286791:0:202231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091c9458a80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480115072:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508615.286854:0:202231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33f1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1e7 expref: 10 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.286865:0:202231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33f1e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1e7 expref: 10 pid: 209004 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508615.286874:0:202231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbe300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480115200:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508615.286896:0:202231:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9f00 going to sleep for 11 seconds 00000100:00080000:1.0:1787508615.287041:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787508615.297443:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.297479:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509525376 00000100:00100000:2.0:1787508615.297488:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509525376 00010000:00010000:2.0:1787508615.297526:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f33f87 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae203 expref: 583 pid: 202228 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.297564:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27863 00000100:00100000:2.0:1787508615.297573:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:2402:x1874324509525376:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508615.297586:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508615.297592:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f33f87 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae203 expref: 583 pid: 202228 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.297606:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f33f87 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae203 expref: 583 pid: 202228 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.297627:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.297634:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34108 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f340ec expref: 9 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.297644:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508615.297697:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:2402:x1874324509525376:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 124us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.297704:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27863 00000100:00100000:2.0:1787508615.297747:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.297769:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509525504 00000100:00100000:2.0:1787508615.297773:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509525504 00010000:00010000:2.0:1787508615.297801:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33f1e lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1e7 expref: 11 pid: 209004 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.297830:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27864 00000100:00100000:2.0:1787508615.297838:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce780e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2402:x1874324509525504:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508615.297847:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508615.297851:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33f1e lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1e7 expref: 11 pid: 209004 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.297861:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33f1e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1e7 expref: 11 pid: 209004 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.297873:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.297877:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34108 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f340ec expref: 9 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.297901:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34108 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xb126349c40f340ec expref: 9 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.297910:0:202212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34108 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xb126349c40f340ec expref: 9 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.297976:0:202212:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34108 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f340ec expref: 9 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.297990:0:202212:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce780380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:202212:1874324480115328:0@lo:105: 00000100:00100000:2.0:1787508615.298033:0:202212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.298071:0:202212:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787508615.298088:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480115328 00000100:00100000:2.0:1787508615.298092:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480115328 00000100:00100000:2.0:1787508615.298118:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18166 00000100:00100000:2.0:1787508615.298123:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce782680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:202212:x1874324480115328:12345-0@lo:105: 00010000:00010000:2.0:1787508615.298136:0:229363:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa000/0xb126349c40f340ec lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34108 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.298146:0:229363:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa000/0xb126349c40f340ec lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34108 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.298154:0:229363:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa000/0xb126349c40f340ec lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34108 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.298161:0:229363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa000/0xb126349c40f340ec lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f34108 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.298168:0:229363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa000/0xb126349c40f340ec lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f34108 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.298176:0:229363:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa000/0xb126349c40f340ec lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f34108 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.298341:0:229363:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090cd2aa000) 00000100:00100000:2.0:1787508615.298376:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce782680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:202212:x1874324480115328:12345-0@lo:105: Request processed in 252us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.298383:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18166 00000100:00100000:2.0:1787508615.298423:0:202212:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce780380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:202212:1874324480115328:0@lo:105: 00010000:00010000:2.0:1787508615.298449:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508615.298470:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce780e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2402:x1874324509525504:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 633us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.298476:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27864 00000100:00100000:2.0:1787508615.298544:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1787508615.299878:0:202231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0c00/0xb126349c40f33f87 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae203 expref: 582 pid: 202228 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508615.299904:0:202231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091c9458a80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480115072:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508615.299920:0:202231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f33f1e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae1e7 expref: 10 pid: 209004 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508615.299929:0:202231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbe300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480115200:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508615.299987:0:202231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34108 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f340ec expref: 9 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.299998:0:202231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.300001:0:202231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.300005:0:202231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ea00, rc 0) 00000100:00100000:3.0:1787508615.300075:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:230618:x1874324480114944:12345-0@lo:101:mdt00_006.0 Request processed in 13438us (14485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.300083:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29713 00000100:00100000:2.0:1787508615.300334:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788d500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480114944:0@lo:101:mdt00_006.0 00010000:00010000:2.0:1787508615.300353:0:230618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa000/0xb126349c40f340ec lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34108 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787508615.300376:0:230618:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787508615.300418:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f3410f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.300425:0:230618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f3410f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.300445:0:230618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f3410f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.300465:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788d500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480115456:0@lo:101:mdt00_006.0 00000100:00100000:2.0:1787508615.300504:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.300538:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8900 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.301306:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480115456 00000100:00100000:3.0:1787508615.301319:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480115456 00000100:00100000:3.0:1787508615.301390:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29714 00000100:00100000:3.0:1787508615.301399:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:230618:x1874324480115456:12345-0@lo:101:mdt00_006.0 00010000:00010000:3.0:1787508615.301415:0:225829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.301446:0:225829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34116 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f3410f expref: -99 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.301471:0:225829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34116 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f3410f expref: 10 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.301484:0:225829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34116 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3410f expref: 10 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.301492:0:225829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090ccb87b00) 00010000:00010000:3.0:1787508615.301494:0:225829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.301498:0:225829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f000, rc 0) 00000100:00100000:3.0:1787508615.301543:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:230618:x1874324480115456:12345-0@lo:101:mdt00_006.0 Request processed in 145us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.301549:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29714 00000100:00100000:1.0:1787508615.301730:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509525632 00000100:00100000:1.0:1787508615.301736:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509525632 00000100:00100000:1.0:1787508615.301916:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93856 00000100:00100000:1.0:1787508615.301926:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336075:x1874324509525632:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508615.301936:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.301980:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f3411d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae288 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.302040:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948c400/0xb126349c40f34124 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.302052:0:203348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34108 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f340ec expref: 9 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.302060:0:203348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948c400/0xb126349c40f34124 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.302088:0:203348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34108 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f340ec expref: 9 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.302100:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6ac4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:203348:1874324480115584:0@lo:104: 00000100:00100000:1.0:1787508615.302138:0:203348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508615.302176:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3f11240 going to sleep for 11 seconds 00000100:00100000:2.0:1787508615.302362:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788d500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480115456:0@lo:101:mdt00_006.0 00010000:00010000:2.0:1787508615.302381:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f3410f lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34116 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.302391:0:230618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f3410f lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34116 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787508615.302411:0:230618:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1787508615.302460:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a98380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480115712:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1787508615.302490:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.302515:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787508615.302765:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480115712 00000100:00100000:1.0:1787508615.302770:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480115712 00000100:00100000:1.0:1787508615.303058:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29715 00000100:00100000:1.0:1787508615.303068:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:230618:x1874324480115712:12345-0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1787508615.303142:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:230618:x1874324480115712:12345-0@lo:1000:mdt00_006.0 Request processed in 76us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.303384:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480115584 00000100:00100000:3.0:1787508615.303390:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480115584 00000100:00100000:3.0:1787508615.303428:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18167 00000100:00100000:3.0:1787508615.303445:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:203348:x1874324480115584:12345-0@lo:104: 00010000:00010000:3.0:1787508615.303458:0:202210:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa000/0xb126349c40f340ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f34108 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.303517:0:202210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787508615.303524:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:203348:x1874324480115584:12345-0@lo:104: Request processed in 80us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.303530:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18167 00010000:00010000:3.0:1787508615.303571:0:226765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787508615.303578:0:226765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa000/0xb126349c40f340ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f34108 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.303586:0:226765:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9090cd2aa000 is referenced, will be cancelled later 00010000:00010000:3.0:1787508615.303589:0:226765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa000/0xb126349c40f340ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f34108 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.303598:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508615.303600:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508615.303602:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508615.303864:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29715 00000100:00100000:1.0:1787508615.303904:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6ac4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:203348:1874324480115584:0@lo:104: 00010000:00010000:1.0:1787508615.303920:0:203348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948c400/0xb126349c40f34124 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.304071:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a98380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480115712:0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1787508615.304128:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6ac4700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480115840:0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1787508615.304163:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508615.304282:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3f11780 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.304317:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480115840 00000100:00100000:3.0:1787508615.304323:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480115840 00000100:00100000:3.0:1787508615.304453:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29716 00000100:00100000:3.0:1787508615.304462:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6ac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:230618:x1874324480115840:12345-0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1787508615.304586:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6ac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:230618:x1874324480115840:12345-0@lo:1000:mdt00_006.0 Request processed in 125us (422us total) trans 0 rc 1/1 00000100:00100000:3.0:1787508615.304594:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29716 00000100:00100000:1.0:1787508615.304653:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6ac4700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480115840:0@lo:1000:mdt00_006.0 00010000:00010000:1.0:1787508615.304709:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c948d800/0xb126349c40f3412b lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.304717:0:230618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c948d800/0xb126349c40f3412b lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.304727:0:230618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c948d800/0xb126349c40f3412b lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.304739:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6ac4700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480115968:0@lo:101:mdt00_006.0 00000100:00100000:1.0:1787508615.304762:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508615.304977:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3f11240 going to sleep for 11 seconds 00000100:00100000:2.0:1787508615.305065:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480115968 00000100:00100000:2.0:1787508615.305070:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480115968 00000100:00100000:2.0:1787508615.305105:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29717 00000100:00100000:2.0:1787508615.305113:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:230618:x1874324480115968:12345-0@lo:101:mdt00_006.0 00010000:00010000:2.0:1787508615.305124:0:203182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.305141:0:203182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34132 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f3412b expref: -99 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.305164:0:203182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34044 lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae242 expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.305175:0:203182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34132 lrc: 4/0,0 mode: --/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f3412b expref: 11 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.305211:0:203182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34044 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae242 expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.305225:0:203182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34044 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae242 expref: 583 pid: 202227 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.305236:0:203182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9b800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480116096:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508615.305300:0:203182:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8900 going to sleep for 11 seconds 00000100:00100000:2.0:1787508615.309107:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.309535:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509525760 00000100:00100000:1.0:1787508615.309545:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509525760 00010000:00010000:1.0:1787508615.309586:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34044 lrc: 5/0,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae242 expref: 584 pid: 202227 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.309627:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27865 00000100:00100000:1.0:1787508615.309637:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:2400:x1874324509525760:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508615.309654:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508615.309662:0:229383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34044 lrc: 5/0,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae242 expref: 584 pid: 202227 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.309676:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34044 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae242 expref: 584 pid: 202227 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.309698:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d3:0x0].0x0 (ffff9090d36fd800) 00010000:00010000:1.0:1787508615.309704:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34132 lrc: 3/0,0 mode: --/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f3412b expref: 11 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.309715:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34132 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xb126349c40f3412b expref: 11 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.309729:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34132 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xb126349c40f3412b expref: 11 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.309763:0:229383:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34132 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3412b expref: 11 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.309792:0:229383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6ac5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:229383:1874324480116224:0@lo:105: 00000100:00100000:1.0:1787508615.309843:0:229383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508615.309884:0:229383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3f11780 going to sleep for 11 seconds 00000100:00100000:1.0:1787508615.309903:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480116224 00000100:00100000:1.0:1787508615.309907:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480116224 00000100:00100000:1.0:1787508615.309936:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18168 00000100:00100000:1.0:1787508615.309973:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:229383:x1874324480116224:12345-0@lo:105: 00010000:00010000:1.0:1787508615.309986:0:229363:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c948d800/0xb126349c40f3412b lrc: 4/0,1 mode: --/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34132 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.309996:0:229363:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c948d800/0xb126349c40f3412b lrc: 4/0,1 mode: --/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34132 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.310005:0:229363:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c948d800/0xb126349c40f3412b lrc: 4/0,1 mode: --/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34132 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.310013:0:229363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c948d800/0xb126349c40f3412b lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f34132 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.310020:0:229363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c948d800/0xb126349c40f3412b lrc: 5/0,1 mode: EX/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f34132 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.310028:0:229363:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c948d800/0xb126349c40f3412b lrc: 5/0,1 mode: EX/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f34132 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.310043:0:229363:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090c948d800) 00000100:00100000:1.0:1787508615.310078:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:229383:x1874324480116224:12345-0@lo:105: Request processed in 106us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.310086:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18168 00000100:00100000:1.0:1787508615.310128:0:229383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6ac5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:229383:1874324480116224:0@lo:105: 00010000:00010000:1.0:1787508615.310143:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508615.310197:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:2400:x1874324509525760:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 561us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.310204:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27865 00010000:00010000:3.0:1787508615.311848:0:203182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34044 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae242 expref: 583 pid: 202227 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508615.311874:0:203182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9b800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480116096:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508615.311906:0:203182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34132 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3412b expref: 11 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.311916:0:203182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d3:0x0].0x0 (ffff9090d36fd800) 00010000:00010000:3.0:1787508615.311918:0:203182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508615.311922:0:203182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab600, rc 0) 00000100:00100000:3.0:1787508615.312019:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:230618:x1874324480115968:12345-0@lo:101:mdt00_006.0 Request processed in 6907us (7255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.312027:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29717 00000100:00100000:2.0:1787508615.312171:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6ac4700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480115968:0@lo:101:mdt00_006.0 00010000:00010000:2.0:1787508615.312200:0:230618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c948d800/0xb126349c40f3412b lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34132 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.312237:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa400/0xb126349c40f34139 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.312250:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa400/0xb126349c40f34139 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.312260:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa400/0xb126349c40f34139 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.312279:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f34140 lrc: 3/0,1 mode: --/EX res: [0x240000bd1:0x292:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.312287:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f34140 lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x292:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.312294:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f34140 lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x292:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.312325:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34147 lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.312332:0:230618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34147 lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x0 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.312340:0:230618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34147 lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.312370:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a99180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480116352:0@lo:101:mdt00_006.0 00000100:00100000:2.0:1787508615.312407:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.312449:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.312611:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480116352 00000100:00100000:3.0:1787508615.312618:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480116352 00000100:00100000:3.0:1787508615.312668:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29718 00000100:00100000:3.0:1787508615.312678:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:230618:x1874324480116352:12345-0@lo:101:mdt00_006.0 00010000:00010000:3.0:1787508615.312694:0:202232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.312707:0:202232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3414e lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f34147 expref: -99 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.312726:0:202232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f340a6 lrc: 2/0,0 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3409f expref: 12 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.312735:0:202232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3414e lrc: 4/0,0 mode: --/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f34147 expref: 12 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.312759:0:202232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f340a6 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f3409f expref: 12 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508615.312770:0:202232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbe300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:202232:1874324480116480:0@lo:104: 00000100:00100000:3.0:1787508615.312812:0:202232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508615.312837:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480116480 00000100:00100000:3.0:1787508615.312840:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480116480 00000100:00100000:3.0:1787508615.312862:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18169 00000100:00100000:3.0:1787508615.312868:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091c9458a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:202232:x1874324480116480:12345-0@lo:104: 00010000:00010000:3.0:1787508615.312878:0:202210:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c96e4e00/0xb126349c40f3409f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f340a6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.312918:0:202210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787508615.312923:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091c9458a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:202232:x1874324480116480:12345-0@lo:104: Request processed in 55us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.312929:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18169 00000100:00100000:3.0:1787508615.312986:0:202232:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.312997:0:202232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbe300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:202232:1874324480116480:0@lo:104: 00010000:00010000:3.0:1787508615.313013:0:202232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3414e lrc: 3/0,0 mode: --/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34147 expref: 12 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.313021:0:202232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x288:0x0].0x0 (ffff9090d9e7b900) 00010000:00010000:3.0:1787508615.313023:0:202232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787508615.313027:0:202232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3414e lrc: 3/0,0 mode: --/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34147 expref: 12 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.313035:0:202232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3414e lrc: 3/0,0 mode: --/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34147 expref: 12 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.313041:0:202232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fc00, rc 0) 00000100:00100000:3.0:1787508615.313063:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:230618:x1874324480116352:12345-0@lo:101:mdt00_006.0 Request processed in 388us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.313072:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29718 00000100:00100000:2.0:1787508615.313305:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a99180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480116352:0@lo:101:mdt00_006.0 00010000:00010000:2.0:1787508615.313318:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34147 lrc: 4/0,1 mode: --/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3414e expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.313326:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34147 lrc: 4/0,1 mode: --/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3414e expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.313521:0:202215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508615.313529:0:202215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c96e4e00/0xb126349c40f3409f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f340a6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.313538:0:202215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4e00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:0.0:1787508615.313544:0:202215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c96e4e00/0xb126349c40f3409f lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f340a6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508615.313553:0:202215:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c96e4e00/0xb126349c40f3409f lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f340a6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.313580:0:202215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c96e4e00/0xb126349c40f3409f lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f340a6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.313586:0:202215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787508615.313613:0:202215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c96e4e00/0xb126349c40f3409f lrc: 1/0,0 mode: --/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f340a6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.313626:0:202215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c96e4e00/0xb126349c40f3409f lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f340a6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.313638:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508615.313640:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508615.313641:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508615.313648:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787508615.313658:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480116608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508615.313688:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.313748:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480116608 00000100:00100000:2.0:1787508615.313752:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480116608 00010000:00010000:2.0:1787508615.313771:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f340a6 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f3409f expref: 12 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.313805:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27866 00000100:00100000:2.0:1787508615.313811:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+12:3619:x1874324480116608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508615.313820:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1787508615.315449:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944077 is committed 00010000:00010000:2.0:1787508615.315547:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f340a6 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x288:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f3409f expref: 11 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.315565:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x288:0x0].0x0 (ffff9090d9e7b900) 00010000:00010000:2.0:1787508615.315571:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3414e lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34147 expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.315582:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3414e lrc: 2/0,0 mode: EX/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f34147 expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.315591:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3414e lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f34147 expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.315631:0:202211:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3414e lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34147 expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.315644:0:202211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:202211:1874324480116736:0@lo:105: 00000100:00100000:2.0:1787508615.315693:0:202211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.315735:0:202211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.315778:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480116736 00000100:00100000:3.0:1787508615.315784:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480116736 00000100:00100000:3.0:1787508615.315825:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18170 00000100:00100000:3.0:1787508615.315832:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:202211:x1874324480116736:12345-0@lo:105: 00010000:00010000:3.0:1787508615.315842:0:229363:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34147 lrc: 5/0,1 mode: --/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3414e expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.315853:0:229363:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34147 lrc: 5/0,1 mode: --/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3414e expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.315862:0:229363:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34147 lrc: 5/0,1 mode: --/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3414e expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.315869:0:229363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34147 lrc: 5/0,1 mode: EX/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f3414e expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.315876:0:229363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34147 lrc: 6/0,1 mode: EX/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f3414e expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.315883:0:229363:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34147 lrc: 6/0,1 mode: EX/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f3414e expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.315992:0:229363:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090cd2ab000) 00000100:00100000:3.0:1787508615.316037:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:202211:x1874324480116736:12345-0@lo:105: Request processed in 205us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.316047:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18170 00000100:00100000:2.0:1787508615.316108:0:202211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:202211:1874324480116736:0@lo:105: 00010000:00010000:2.0:1787508615.316123:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508615.316158:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:3619:x1874324480116608:12345-0@lo:103:ldlm_bl.0 Request processed in 2347us (2469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.316166:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27866 00000100:00100000:3.0:1787508615.316282:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480116608:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508615.316463:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34147 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3414e expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.316473:0:230618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34147 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3414e expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508615.317510:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480116864:0@lo:403:mdt00_006.0 00000100:00100000:0.0:1787508615.317576:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508615.317662:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9ff2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.317704:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480116864 00000100:00100000:3.0:1787508615.317711:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480116864 00000100:00100000:3.0:1787508615.317806:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29719 00000100:00100000:3.0:1787508615.317815:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:230618:x1874324480116864:12345-0@lo:403:mdt00_006.0 00000100:00100000:3.0:1787508615.319681:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:230618:x1874324480116864:12345-0@lo:403:mdt00_006.0 Request processed in 1859us (2096us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.319695:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29719 00000100:00100000:0.0:1787508615.319818:0:230618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944077 gen 2 00000004:00080000:0.0:1787508615.319824:0:230618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944077 committed transno 12884944077 00000100:00100000:0.0:1787508615.319850:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480116864:0@lo:403:mdt00_006.0 00000040:00080000:0.0:1787508615.320846:0:230618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xf:0x0].47, 664 off81416 00000040:00080000:0.0:1787508615.321053:0:230618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x5:0x0].590, 744 off747840 00000004:00080000:0.0:1787508615.321060:0:230618:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d9ff2c00 with version 13606 00000004:00080000:2.0:1787508615.321350:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13606 rpc_version 13606 00000020:00100000:2.0:1787508615.321385:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787508615.321395:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091f9a9b100 x1874324480117120/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1808/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787508615.321418:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9b100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480117120:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508615.321488:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.321827:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787508615.321897:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480117120 00000100:00100000:1.0:1787508615.321904:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480117120 00000100:00100000:1.0:1787508615.321978:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29720 00000100:00100000:1.0:1787508615.321987:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:202961:x1874324480117120:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508615.322394:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:202961:x1874324480117120:12345-0@lo:1000:osp_up0-1.0 Request processed in 408us (905us total) trans 12884944078 rc 0/0 00000100:00100000:1.0:1787508615.322403:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29720 00000100:00100000:1.0:1787508615.322474:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9b100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480117120:0@lo:1000:osp_up0-1.0 00000004:00200000:1.0:1787508615.322507:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d3:0x0]: returning size 4096 00010000:00010000:1.0:1787508615.322529:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f34140 lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x292:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.322539:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f34140 lrc: 2/0,0 mode: EX/EX res: [0x240000bd1:0x292:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.322548:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f34140 lrc: 3/0,0 mode: EX/EX res: [0x240000bd1:0x292:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.322554:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.322558:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f34140 lrc: 3/0,0 mode: EX/EX res: [0x240000bd1:0x292:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.322566:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f34140 lrc: 4/0,0 mode: EX/EX res: [0x240000bd1:0x292:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.322583:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x292:0x0].0x0 (ffff9090ccb87400) 00010000:00010000:1.0:1787508615.322586:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787508615.322590:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f34140 lrc: 2/0,0 mode: --/EX res: [0x240000bd1:0x292:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.322596:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f34140 lrc: 0/0,0 mode: --/EX res: [0x240000bd1:0x292:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.322611:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34147 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3414e expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.322619:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34147 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f3414e expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.322626:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34147 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f3414e expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.322646:0:230618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787508615.322655:0:230618:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x288:0x0] 00010000:00010000:1.0:1787508615.322663:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa400/0xb126349c40f34139 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.322670:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa400/0xb126349c40f34139 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.322676:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa400/0xb126349c40f34139 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.322680:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.322683:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa400/0xb126349c40f34139 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.322689:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa400/0xb126349c40f34139 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.322696:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d3:0x0].0x0 (ffff9090ccb87500) 00010000:00010000:1.0:1787508615.322698:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.322701:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa400/0xb126349c40f34139 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.322707:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa400/0xb126349c40f34139 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.322715:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c948d800/0xb126349c40f3412b lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34132 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.322722:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c948d800/0xb126349c40f3412b lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f34132 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.322729:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c948d800/0xb126349c40f3412b lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f34132 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.322753:0:230618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1787508615.322760:0:230618:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787508615.322764:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa000/0xb126349c40f340ec lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f34108 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.322772:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa000/0xb126349c40f340ec lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xb126349c40f34108 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.322790:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa000/0xb126349c40f340ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xb126349c40f34108 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.322802:0:230618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000004:00080000:1.0:1787508615.322804:0:230618:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787508615.322809:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f3410f lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34116 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.322816:0:230618:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f3410f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34116 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.322877:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336073:x1874324509524992:12345-192.168.201.30@tcp:36:rm.0 Request processed in 37540us (39133us total) trans 8589962014 rc 0/0 00000100:00100000:1.0:1787508615.322885:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93854 00010000:00010000:1.0:1787508615.326260:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787508615.326277:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa000/0xb126349c40f340ec lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f34108 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.326292:0:204785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa000 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:1.0:1787508615.326299:0:204785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa000/0xb126349c40f340ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f34108 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508615.326310:0:204785:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa000/0xb126349c40f340ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f34108 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.326370:0:204785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa000/0xb126349c40f340ec lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f34108 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.326377:0:204785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787508615.326405:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa000/0xb126349c40f340ec lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f34108 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.326412:0:204785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa000/0xb126349c40f340ec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f34108 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.326429:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787508615.326443:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34147 lrc: 2/0,0 mode: EX/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xb126349c40f3414e expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.326448:0:204785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab000 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:1.0:1787508615.326452:0:204785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34147 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xb126349c40f3414e expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508615.326459:0:204785:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34147 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xb126349c40f3414e expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.326474:0:204785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34147 lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f3414e expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.326484:0:204785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787508615.326499:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34147 lrc: 1/0,0 mode: --/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f3414e expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.326506:0:204785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34147 lrc: 0/0,0 mode: --/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f3414e expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.326521:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787508615.326526:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c948d800/0xb126349c40f3412b lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xb126349c40f34132 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.326532:0:204785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c948d800 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:1.0:1787508615.326535:0:204785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c948d800/0xb126349c40f3412b lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xb126349c40f34132 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508615.326542:0:204785:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c948d800/0xb126349c40f3412b lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xb126349c40f34132 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.326559:0:204785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c948d800/0xb126349c40f3412b lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f34132 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.326565:0:204785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787508615.326571:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c948d800/0xb126349c40f3412b lrc: 1/0,0 mode: --/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f34132 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.326577:0:204785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090c948d800/0xb126349c40f3412b lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f34132 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.326591:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508615.326592:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508615.326594:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508615.326611:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6ac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480117376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508615.326683:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508615.326730:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787508615.326736:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6ac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480117504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508615.326756:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508615.326800:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787508615.326808:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6ac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480117248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508615.326833:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508615.326869:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480117376 00000100:00100000:1.0:1787508615.326876:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480117376 00000100:00100000:1.0:1787508615.326921:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480117504 00000100:00100000:1.0:1787508615.326924:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480117504 00000100:00100000:1.0:1787508615.326959:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480117248 00000100:00100000:1.0:1787508615.326961:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480117248 00010000:00010000:1.0:1787508615.326973:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34108 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f340ec expref: 13 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.326991:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27867 00000100:00100000:1.0:1787508615.326999:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+13:3618:x1874324480117248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508615.327012:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508615.327030:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34108 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f340ec expref: 13 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.327045:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.327050:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948c400/0xb126349c40f34124 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.327062:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948c400/0xb126349c40f34124 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.327069:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948c400/0xb126349c40f34124 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.327091:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508615.327125:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+12:3618:x1874324480117248:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.327132:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27867 00000100:00100000:1.0:1787508615.327148:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9786 00000100:00100000:1.0:1787508615.327154:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6ac5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+11:3616:x1874324480117376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508615.327164:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508615.327175:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3414e lrc: 0/0,0 mode: --/EX res: [0x2000013a2:0x288:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f34147 expref: 11 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.327183:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x288:0x0].0x0 (ffff9090d9e7b900) 00010000:00010000:1.0:1787508615.327190:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508615.327215:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6ac5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+10:3616:x1874324480117376:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.327221:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9786 00000100:00100000:1.0:1787508615.327233:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9787 00000100:00100000:1.0:1787508615.327238:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3616:x1874324480117504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508615.327245:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508615.327254:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34132 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f3412b expref: 9 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.327264:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d3:0x0].0x0 (ffff9090d36fd800) 00010000:00010000:1.0:1787508615.327271:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508615.327291:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3616:x1874324480117504:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.327297:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9787 00010000:00010000:1.0:1787508615.327342:0:203348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948c400/0xb126349c40f34124 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.327350:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948c400/0xb126349c40f34124 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508615.327404:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508615.327408:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508615.327442:0:203348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948c400/0xb126349c40f34124 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.327473:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25e00/0xb126349c40f3411d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae288 expref: 583 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.327487:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948c400/0xb126349c40f34124 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae288 expref: 582 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.327495:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.327497:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508615.327500:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c948c400, rc 0) 00000100:00100000:1.0:1787508615.327538:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336075:x1874324509525632:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 25615us (28994us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.327545:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93856 00000100:00100000:1.0:1787508615.327586:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6ac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480117248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508615.327610:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6ac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480117504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508615.327618:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6ac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480117376:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508615.331375:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508615.332264:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508615.332605:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.332672:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509525888 00000100:00100000:2.0:1787508615.332681:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509525888 00000100:00100000:2.0:1787508615.332740:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93857 00000100:00100000:2.0:1787508615.332750:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:336076:x1874324509525888:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508615.332771:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.332801:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34155 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae28f expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.332868:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3415c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.332881:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3415c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.332892:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3415c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508615.332966:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508615.332970:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508615.332992:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3415c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.333016:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34155 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae28f expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.333035:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3415c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae28f expref: 11 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.333044:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.333046:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508615.333050:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab200, rc 0) 00000100:00100000:2.0:1787508615.333107:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336076:x1874324509525888:12345-192.168.201.30@tcp:101:rm.0 Request processed in 358us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.333114:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93857 00000100:00100000:2.0:1787508615.336253:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.336381:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509526016 00000100:00100000:1.0:1787508615.336392:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509526016 00000100:00100000:1.0:1787508615.336465:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93858 00000100:00100000:1.0:1787508615.336476:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336075:x1874324509526016:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508615.336497:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.336519:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f34163 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae296 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.336592:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3416a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.336606:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3416a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.336616:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3416a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.336631:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f34171 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.336638:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f34171 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.336645:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f34171 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.336713:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3416a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.336721:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3416a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.336727:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3416a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.336734:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3416a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.336739:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.336744:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3416a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.336751:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3416a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.336763:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.336766:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.336770:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3416a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.336776:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3416a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.336787:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f34171 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.336793:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f34171 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.336799:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f34171 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.336804:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.336807:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f34171 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.336813:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f34171 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.336820:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090c6406000) 00010000:00010000:1.0:1787508615.336822:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.336825:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f34171 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.336831:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f34171 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.336860:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f34163 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae296 expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.336870:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.336872:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508615.336875:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f34163 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae296 expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.336885:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4c00, rc 0) 00000100:00100000:1.0:1787508615.336981:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336075:x1874324509526016:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 505us (738us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508615.336991:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93858 00000100:00100000:1.0:1787508615.340161:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.340258:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509526144 00000100:00100000:3.0:1787508615.340270:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509526144 00000100:00100000:3.0:1787508615.340333:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93859 00000100:00100000:3.0:1787508615.340353:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6ac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336075:x1874324509526144:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508615.340373:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.340396:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34178 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae29d expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.340468:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3417f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.340482:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3417f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.340493:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3417f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.340508:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34186 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.340515:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34186 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.340522:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34186 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.340582:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3417f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.340589:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3417f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.340595:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3417f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.340601:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3417f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.340607:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fa00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.340611:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3417f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.340618:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3417f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.340631:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.340633:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.340638:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3417f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.340645:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3417f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.340662:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34186 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.340667:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34186 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.340672:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34186 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.340678:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.340680:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34186 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.340686:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34186 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.340692:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090ccb87a00) 00010000:00010000:3.0:1787508615.340694:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.340697:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34186 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.340703:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34186 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.340737:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34178 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae29d expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.340747:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.340749:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508615.340753:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34178 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae29d expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.340762:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fe00, rc 0) 00000100:00100000:3.0:1787508615.340831:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6ac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336075:x1874324509526144:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 489us (683us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508615.340838:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93859 00000100:00100000:2.0:1787508615.343922:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.344077:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509526272 00000100:00100000:1.0:1787508615.344092:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509526272 00000100:00100000:1.0:1787508615.344174:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93860 00000100:00100000:1.0:1787508615.344195:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336076:x1874324509526272:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508615.344220:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.344248:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f3418d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae2a4 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.344353:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f34194 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.344367:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f34194 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.344379:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f34194 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.344397:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3419b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.344405:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3419b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.344412:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3419b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.344478:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f34194 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.344487:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f34194 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.344493:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f34194 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.344500:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f34194 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.344506:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4a00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.344511:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f34194 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.344518:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f34194 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.344531:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.344534:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.344539:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f34194 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.344545:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f34194 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.344561:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3419b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.344568:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3419b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.344573:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3419b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.344578:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.344582:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3419b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.344587:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3419b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.344594:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090ce78a400) 00010000:00010000:1.0:1787508615.344596:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.344598:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3419b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.344604:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3419b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.344637:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f3418d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae2a4 expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.344647:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.344650:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508615.344653:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f3418d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae2a4 expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.344662:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5200, rc 0) 00000100:00100000:1.0:1787508615.344738:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336076:x1874324509526272:12345-192.168.201.30@tcp:101:rm.0 Request processed in 545us (827us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508615.344746:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93860 00000100:00100000:2.0:1787508615.348152:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.349604:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509526400 00000100:00100000:3.0:1787508615.349617:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509526400 00000100:00100000:2.0:1787508615.349788:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93861 00000100:00100000:2.0:1787508615.349803:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336076:x1874324509526400:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508615.349824:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.349844:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f341a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae2ab expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.349911:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f341a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.349925:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f341a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.349936:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f341a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.349985:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f341b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.349993:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f341b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.350000:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f341b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.350053:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f341a9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.350060:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f341a9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.350066:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f341a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.350072:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f341a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.350077:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.350081:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f341a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.350087:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f341a9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.350099:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.350102:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.350106:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f341a9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.350113:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f341a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.350127:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f341b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.350133:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f341b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.350138:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f341b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.350142:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.350144:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f341b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.350153:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f341b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.350161:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090d36fd700) 00010000:00010000:2.0:1787508615.350163:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.350166:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f341b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.350172:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f341b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.350216:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f341a2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae2ab expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.350226:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.350229:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508615.350233:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f341a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae2ab expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.350241:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abc00, rc 0) 00000100:00100000:2.0:1787508615.350300:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336076:x1874324509526400:12345-192.168.201.30@tcp:101:rm.0 Request processed in 502us (2161us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508615.350307:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93861 00000100:00100000:2.0:1787508615.353538:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.353607:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509526528 00000100:00100000:3.0:1787508615.353618:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509526528 00000100:00100000:3.0:1787508615.353681:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93862 00000100:00100000:3.0:1787508615.353691:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336076:x1874324509526528:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508615.353712:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.353733:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f341b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae2b2 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.353813:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f341be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.353827:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f341be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.353838:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f341be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.353852:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f341c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.353858:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f341c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.353865:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f341c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.353917:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f341be lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.353924:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f341be lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.353930:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f341be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.353936:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f341be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.353984:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.353989:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f341be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.353997:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f341be lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.354009:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.354012:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.354016:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f341be lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.354022:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f341be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.354033:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f341c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.354039:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f341c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.354044:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f341c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.354049:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.354051:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f341c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.354057:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f341c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.354062:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090ccb87200) 00010000:00010000:3.0:1787508615.354064:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.354066:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f341c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.354072:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f341c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.354100:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f341b7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae2b2 expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.354111:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.354113:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508615.354117:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f341b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae2b2 expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.354131:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f200, rc 0) 00000100:00100000:3.0:1787508615.354200:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336076:x1874324509526528:12345-192.168.201.30@tcp:101:rm.0 Request processed in 510us (672us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508615.354207:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93862 00000100:00100000:3.0:1787508615.359320:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.359371:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.359489:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509526912 00000100:00100000:1.0:1787508615.359500:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509526912 00000100:00100000:1.0:1787508615.359561:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509526784 00000100:00100000:1.0:1787508615.359565:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509526784 00000100:00100000:1.0:1787508615.359592:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93863 00000100:00100000:1.0:1787508615.359602:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336075:x1874324509526912:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508615.359623:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.359647:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f341cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae2c0 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.359721:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f341d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.359735:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f341d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.359745:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f341d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.359760:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f341da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.359768:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f341da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.359775:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f341da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.359846:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f341d3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.359854:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f341d3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.359865:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f341d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.359872:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f341d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.359877:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.359882:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f341d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.359889:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f341d3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.359903:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.359905:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.359910:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f341d3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.359916:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f341d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.359932:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f341da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.359964:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f341da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.359971:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f341da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.359976:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.359979:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f341da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.359985:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f341da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.359992:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090ce78ac00) 00010000:00010000:1.0:1787508615.359995:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.359998:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f341da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.360003:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f341da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.360035:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f341cc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae2c0 expref: 583 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.360045:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.360047:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508615.360051:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f341cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae2c0 expref: 583 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.360060:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a600, rc 0) 00000100:00100000:1.0:1787508615.360125:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336075:x1874324509526912:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 523us (814us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508615.360132:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93863 00000100:00100000:1.0:1787508615.360256:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93864 00000100:00100000:1.0:1787508615.360266:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4855880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336076:x1874324509526784:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508615.360276:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.360286:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f341e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae2b9 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.360330:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f341e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.360340:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f341e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.360355:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f341e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.360368:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f341ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.360375:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f341ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.360382:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f341ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.360410:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f341e8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.360416:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f341e8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.360421:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f341e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.360426:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f341e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.360447:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.360450:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f341e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.360456:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f341e8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.360464:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.360466:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.360469:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f341e8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.360474:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f341e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.360484:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f341ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.360490:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f341ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.360495:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f341ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.360500:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.360502:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f341ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.360507:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f341ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.360518:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090c6406000) 00010000:00010000:1.0:1787508615.360520:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.360523:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f341ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.360529:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f341ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.360553:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f341e1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae2b9 expref: 12 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.360561:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.360563:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508615.360567:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f341e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae2b9 expref: 12 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.360574:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247be00, rc 0) 00000100:00100000:1.0:1787508615.360602:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4855880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336076:x1874324509526784:12345-192.168.201.30@tcp:101:rm.0 Request processed in 338us (1230us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508615.360608:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93864 00000100:00100000:3.0:1787508615.367233:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.367269:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.367296:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509527040 00000100:00100000:3.0:1787508615.367306:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509527040 00000100:00100000:3.0:1787508615.367360:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509527296 00000100:00100000:3.0:1787508615.367364:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509527296 00000100:00100000:3.0:1787508615.367385:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93865 00000100:00100000:3.0:1787508615.367394:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336076:x1874324509527040:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508615.367415:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.367446:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f341f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae2c7 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.367510:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f341fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.367526:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f341fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.367537:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f341fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.367548:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34204 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.367557:0:205405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34116 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3410f expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.367566:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34204 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.367598:0:205405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34116 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f3410f expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508615.367614:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d4856680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480117632:0@lo:104: 00000100:00100000:3.0:1787508615.367668:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508615.367703:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9600 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.367728:0:202210:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787508615.367738:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480117632 00000100:00100000:3.0:1787508615.367742:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480117632 00000100:00100000:3.0:1787508615.367769:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18171 00000100:00100000:3.0:1787508615.367775:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d08b1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:205405:x1874324480117632:12345-0@lo:104: 00010000:00010000:3.0:1787508615.367787:0:202210:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f3410f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f34116 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.367835:0:202210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787508615.367841:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d08b1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:205405:x1874324480117632:12345-0@lo:104: Request processed in 66us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.367848:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18171 00010000:00010000:3.0:1787508615.367900:0:202215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787508615.367907:0:202215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f3410f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f34116 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.367920:0:202215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aaa00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:3.0:1787508615.367926:0:202215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f3410f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f34116 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508615.367935:0:202215:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f3410f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f34116 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.367989:0:202215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f3410f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f34116 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.367996:0:202215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787508615.368012:0:202215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f3410f lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f34116 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.368019:0:202215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f3410f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f34116 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.368037:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508615.368039:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508615.368041:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508615.368063:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d4856680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480117632:0@lo:104: 00010000:00010000:3.0:1787508615.368080:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34204 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.368185:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93866 00000100:00100000:1.0:1787508615.368195:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336075:x1874324509527296:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508615.368205:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.368215:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3420b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae2ce expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.368268:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f34212 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.368279:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f34212 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.368287:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f34212 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.368302:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34219 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.368309:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.368315:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.368379:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f34212 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.368386:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f34212 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.368393:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f34212 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.368398:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f34212 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.368404:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.368408:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f34212 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.368415:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f34212 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.368425:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.368428:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.368444:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f34212 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.368450:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f34212 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.368461:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.368467:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34219 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.368473:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34219 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.368478:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.368481:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34219 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.368487:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34219 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.368495:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3e9f33b0 (ffff9090ce78a400) 00010000:00010000:1.0:1787508615.368497:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.368500:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34219 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.368505:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34219 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.368540:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3420b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae2ce expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.368548:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.368550:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508615.368554:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3420b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae2ce expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.368563:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ae00, rc 0) 00000100:00100000:1.0:1787508615.368619:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336075:x1874324509527296:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 425us (1348us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508615.368626:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93866 00000100:00100000:1.0:1787508615.368650:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787508615.368662:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091c9458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480117760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508615.368700:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508615.368739:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480117760 00000100:00100000:1.0:1787508615.368744:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480117760 00010000:00010000:1.0:1787508615.368764:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34116 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f3410f expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.368786:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27868 00000100:00100000:1.0:1787508615.368792:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3619:x1874324480117760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508615.368803:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1787508615.376321:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944078 is committed 00010000:00010000:2.0:1787508615.376464:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34116 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f3410f expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.376489:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090ccb87b00) 00010000:00010000:2.0:1787508615.376495:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34204 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.376506:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.376514:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34204 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.376551:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508615.376636:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480117760:12345-0@lo:103:ldlm_bl.0 Request processed in 7842us (7933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.376646:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27868 00010000:00010000:3.0:1787508615.376714:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.376723:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.376797:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f341fd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.376805:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f341fd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.376812:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f341fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.376818:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f341fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.376824:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.376828:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f341fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.376835:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f341fd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.376846:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.376849:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.376853:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f341fd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.376858:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f341fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.376869:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34204 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.376875:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34204 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.376881:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34204 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.376886:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fa00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.376888:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34204 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.376894:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34204 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.376901:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090ccb87b00) 00010000:00010000:3.0:1787508615.376903:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.376906:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34204 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.376912:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34204 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.377009:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f341f6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae2c7 expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.377019:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.377021:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.377025:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f341f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae2c7 expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.377034:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fe00, rc 0) 00000100:00100000:3.0:1787508615.377092:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336076:x1874324509527040:12345-192.168.201.30@tcp:101:rm.0 Request processed in 9699us (9871us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508615.377105:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93865 00000100:00100000:1.0:1787508615.377577:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091c9458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480117760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787508615.379998:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.380084:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509527552 00000100:00100000:1.0:1787508615.380095:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509527552 00000100:00100000:1.0:1787508615.380151:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93867 00000100:00100000:1.0:1787508615.380162:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091c9458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336075:x1874324509527552:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508615.380195:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.380218:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f34220 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae2d5 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.380303:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34227 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.380317:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34227 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.380328:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34227 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.380355:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3422e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.380363:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3422e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.380370:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3422e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.380442:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34227 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.380450:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34227 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.380456:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34227 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.380463:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34227 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.380470:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.380475:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34227 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.380483:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34227 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.380495:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.380498:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.380503:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34227 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.380509:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34227 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.380524:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3422e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.380529:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3422e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.380534:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3422e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.380538:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.380541:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3422e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.380549:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3422e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.380555:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ad43c78 (ffff9090d171fa00) 00010000:00010000:1.0:1787508615.380557:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.380559:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3422e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.380564:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3422e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.380592:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f34220 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae2d5 expref: 583 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.380601:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.380604:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508615.380607:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f34220 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae2d5 expref: 583 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.380615:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247be00, rc 0) 00000100:00100000:1.0:1787508615.380682:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091c9458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336075:x1874324509527552:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 520us (744us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508615.380689:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93867 00000100:00100000:2.0:1787508615.387088:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.387658:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509527808 00000100:00100000:3.0:1787508615.387670:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509527808 00000100:00100000:3.0:1787508615.387737:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93868 00000100:00100000:3.0:1787508615.387747:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c819ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336075:x1874324509527808:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508615.387769:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.387801:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34235 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae2dc expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.387871:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3423c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.387884:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3423c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.387894:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3423c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.387907:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34243 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.387913:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34243 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.387918:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34243 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.388002:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3423c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.388010:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3423c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.388015:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3423c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.388021:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3423c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.388027:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.388030:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3423c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.388037:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3423c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.388048:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.388052:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.388056:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3423c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.388063:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3423c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.388076:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34243 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.388082:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34243 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.388088:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34243 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.388093:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.388096:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34243 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.388102:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34243 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.388109:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbfff8436 (ffff9090ccb87200) 00010000:00010000:3.0:1787508615.388112:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.388114:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34243 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.388120:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34243 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.388153:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34235 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae2dc expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.388163:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.388165:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508615.388168:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34235 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae2dc expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.388542:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fc00, rc 0) 00000100:00100000:3.0:1787508615.388658:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c819ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336075:x1874324509527808:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 910us (1578us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508615.388666:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93868 00000100:00100000:1.0:1787508615.407296:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.407928:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509528064 00000100:00100000:2.0:1787508615.407962:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509528064 00000100:00100000:2.0:1787508615.408033:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93869 00000100:00100000:2.0:1787508615.408044:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6ac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336075:x1874324509528064:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508615.408066:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.408090:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f3424a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae2e3 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.408198:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34251 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.408212:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34251 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.408224:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34251 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.408245:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34258 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.408253:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34258 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.408260:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34258 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.408328:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34251 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.408335:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34251 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.408552:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34251 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.408560:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34251 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.408567:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.408571:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34251 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.408578:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34251 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.408592:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.408595:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.408600:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34251 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.408607:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34251 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.408622:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34258 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.408629:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34258 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.408634:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34258 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.408639:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.408642:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34258 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.408648:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34258 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.408655:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x594a0ca2 (ffff9090d36fd700) 00010000:00010000:2.0:1787508615.408658:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.408661:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34258 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.408667:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34258 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.408700:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f3424a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae2e3 expref: 583 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.408716:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.408719:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508615.408722:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f3424a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae2e3 expref: 583 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.408731:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab400, rc 0) 00000100:00100000:2.0:1787508615.409537:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6ac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336075:x1874324509528064:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1489us (2246us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508615.409547:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93869 00000100:00100000:2.0:1787508615.418560:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.418657:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509528320 00000100:00100000:3.0:1787508615.418670:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509528320 00000100:00100000:3.0:1787508615.418737:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93870 00000100:00100000:3.0:1787508615.418748:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c819ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336075:x1874324509528320:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508615.418769:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.418907:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3425f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae2ea expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.419035:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34266 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.419050:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34266 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.419062:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34266 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.419077:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3426d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.419085:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3426d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.419091:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3426d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.419154:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34266 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.419162:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34266 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.419168:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34266 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.419175:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34266 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.419318:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.419322:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34266 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.419330:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34266 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.419342:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.419346:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.419423:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34266 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.419441:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34266 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.419455:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3426d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.419461:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3426d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.419468:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3426d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.419473:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.419476:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3426d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.419485:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3426d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.419493:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe67841 (ffff9090ccb87200) 00010000:00010000:3.0:1787508615.419496:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.419498:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3426d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.419504:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f3426d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.419536:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3425f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae2ea expref: 583 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.419546:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.419548:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508615.419552:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3425f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae2ea expref: 583 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.419561:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fc00, rc 0) 00000100:00100000:3.0:1787508615.419662:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c819ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336075:x1874324509528320:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 916us (1111us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508615.419670:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93870 00000100:00100000:2.0:1787508615.433673:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.434279:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509528576 00000100:00100000:1.0:1787508615.434293:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509528576 00000100:00100000:1.0:1787508615.434509:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93871 00000100:00100000:1.0:1787508615.434522:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336075:x1874324509528576:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508615.434545:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.434568:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34274 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae2f1 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.434654:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3427b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.434671:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3427b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.434684:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3427b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.434699:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34282 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.434706:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34282 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.434712:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34282 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.434771:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3427b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.434794:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3427b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.434801:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3427b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.434807:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3427b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.434813:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.434817:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3427b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.434823:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3427b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.434836:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.434839:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.434843:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3427b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.434849:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3427b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.434863:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34282 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.434868:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34282 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.434873:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34282 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.434878:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.434880:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34282 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.434886:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34282 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.434896:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090d171fa00) 00010000:00010000:1.0:1787508615.434898:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.434901:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34282 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.434907:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34282 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.434984:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34274 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae2f1 expref: 583 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.434995:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.434997:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508615.435002:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34274 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae2f1 expref: 583 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.435011:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b000, rc 0) 00000100:00100000:1.0:1787508615.435074:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336075:x1874324509528576:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 555us (1413us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508615.435082:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93871 00000100:00100000:2.0:1787508615.447046:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.447205:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509528832 00000100:00100000:3.0:1787508615.447216:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509528832 00000100:00100000:3.0:1787508615.447282:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93872 00000100:00100000:3.0:1787508615.447293:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336075:x1874324509528832:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508615.447319:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.447351:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34289 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae2f8 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.447441:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34290 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.447456:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34290 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.447468:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34290 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.447485:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34297 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.447492:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34297 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.447499:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34297 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.447564:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34290 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.447571:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34290 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.447577:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34290 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.447584:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34290 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.447591:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.447595:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34290 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.447601:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34290 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.447613:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.447616:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.447620:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34290 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.447626:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34290 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.447640:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34297 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.447647:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34297 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.447652:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34297 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.447658:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.447661:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34297 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.447666:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34297 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.447676:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x90ba0166 (ffff9090ccb87200) 00010000:00010000:3.0:1787508615.447679:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.447681:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34297 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.447687:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34297 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.447719:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34289 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae2f8 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.447730:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.447732:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508615.447736:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34289 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae2f8 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.447745:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fc00, rc 0) 00000100:00100000:3.0:1787508615.447810:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336075:x1874324509528832:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 518us (773us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508615.447818:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93872 00000100:00100000:0.0:1787508615.459423:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.459608:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509529088 00000100:00100000:2.0:1787508615.459621:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509529088 00000100:00100000:2.0:1787508615.459688:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93873 00000100:00100000:2.0:1787508615.459701:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336075:x1874324509529088:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508615.459724:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.459749:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f3429e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae2ff expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.459839:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f342a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.459852:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f342a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.459862:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f342a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.459876:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f342ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.459884:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f342ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.459890:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f342ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.459982:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f342a5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.459990:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f342a5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.459996:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f342a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.460002:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f342a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.460008:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.460013:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f342a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.460020:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f342a5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.460033:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.460036:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.460040:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f342a5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.460047:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f342a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.460061:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f342ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.460067:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f342ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.460073:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f342ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.460078:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.460081:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f342ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.460087:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f342ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.460094:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaf3dc4c9 (ffff9090d36fd700) 00010000:00010000:2.0:1787508615.460096:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.460099:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f342ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.460104:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f342ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.460138:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f3429e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae2ff expref: 583 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.460153:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.460155:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508615.460160:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f3429e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae2ff expref: 583 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.460169:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aae00, rc 0) 00000100:00100000:2.0:1787508615.460240:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336075:x1874324509529088:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 541us (827us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508615.460248:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93873 00000100:00100000:2.0:1787508615.471671:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.472545:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509529216 00000100:00100000:1.0:1787508615.472557:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509529216 00000100:00100000:1.0:1787508615.472625:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93874 00000100:00100000:1.0:1787508615.472635:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336075:x1874324509529216:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508615.472656:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.472679:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f342b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae306 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.472747:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f342ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.472761:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f342ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.472773:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f342ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.472799:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f342c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.472806:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f342c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.472813:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f342c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.472877:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f342ba lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.472884:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f342ba lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.472891:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f342ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.472897:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f342ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.472903:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.472908:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f342ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.472915:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f342ba lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.472927:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.472930:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.472934:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f342ba lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.472987:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f342ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.473000:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f342c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.473005:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f342c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.473011:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f342c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.473015:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.473019:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f342c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.473024:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f342c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.473031:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d171fa00) 00010000:00010000:1.0:1787508615.473033:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.473037:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f342c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.473043:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f342c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.473072:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f342b3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae306 expref: 583 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.473082:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.473084:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.473087:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f342b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae306 expref: 583 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.473096:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ae00, rc 0) 00000100:00100000:1.0:1787508615.473154:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336075:x1874324509529216:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 519us (1489us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508615.473162:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93874 00000100:00100000:1.0:1787508615.481420:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.481680:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509529472 00000100:00100000:2.0:1787508615.481690:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509529472 00000100:00100000:2.0:1787508615.481754:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93875 00000100:00100000:2.0:1787508615.481765:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6ac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336075:x1874324509529472:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:2.0:1787508615.481837:0:203348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508615.481866:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948c400/0xb126349c40f34124 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae288 expref: 582 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.481890:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.481896:0:203348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508615.482008:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f342c8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.482023:0:203348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3415c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae28f expref: 10 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.482036:0:203348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f342c8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.482071:0:203348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3415c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae28f expref: 10 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.482085:0:203348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3415c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae28f expref: 10 pid: 202226 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.482099:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:203348:1874324480117888:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508615.482191:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787508615.491423:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508615.491476:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.491794:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509529600 00000100:00100000:1.0:1787508615.491805:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509529600 00010000:00010000:1.0:1787508615.491846:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3415c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae28f expref: 11 pid: 202226 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.491891:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27869 00000100:00100000:1.0:1787508615.491900:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2402:x1874324509529600:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508615.491916:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508615.491923:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3415c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae28f expref: 11 pid: 202226 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.491959:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3415c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae28f expref: 11 pid: 202226 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.491984:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.491989:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f342c8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.492000:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f342c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.492006:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f342c8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.492026:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508615.492078:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2402:x1874324509529600:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 178us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.492086:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27869 00010000:00010000:2.0:1787508615.493166:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3415c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae28f expref: 10 pid: 202226 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.493259:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:203348:1874324480117888:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508615.493288:0:203348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f342c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.493298:0:203348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f342c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.493304:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f342c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.493331:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f342cf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.493341:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f342cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.493351:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f342cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508615.494747:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509529728 00000100:00100000:3.0:1787508615.494758:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509529728 00000100:00100000:3.0:1787508615.494818:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93876 00000100:00100000:3.0:1787508615.494829:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:336082:x1874324509529728:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508615.494847:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.494866:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f342d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae30d expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.494928:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f342dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.494954:0:202227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f342c8 lrc: 2/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.494961:0:202227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f342dd lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.494980:0:202227:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f342c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.494993:0:202227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f342dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787508615.495710:0:203348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1:0x0].1783, 2168 off1837176 00000040:00080000:2.0:1787508615.496037:0:203348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x1:0x0].1789, 2368 off2042056 00000004:00080000:2.0:1787508615.496045:0:203348:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d22c8e40 with version 3460 00000004:00080000:1.0:1787508615.496137:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3460 rpc_version 3460 00000020:00100000:1.0:1787508615.496249:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787508615.496261:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091e6ac4e00 x1874324480118144/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4232/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787508615.496285:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6ac4e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480118144:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787508615.496367:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508615.496407:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3f11780 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.496551:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480118144 00000100:00100000:3.0:1787508615.496558:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480118144 00000100:00100000:3.0:1787508615.496599:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29721 00000100:00100000:3.0:1787508615.496607:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:202248:x1874324480118144:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787508615.497149:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:202248:x1874324480118144:12345-0@lo:1000:osp_up1-0.0 Request processed in 540us (780us total) trans 8589962015 rc 0/0 00000100:00100000:2.0:1787508615.497157:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29721 00000100:00100000:1.0:1787508615.497371:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6ac4e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480118144:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1787508615.497537:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f342e4 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x125b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.497553:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f342e4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.497565:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f342e4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.497584:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f342eb lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x171:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.497595:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f342eb lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x171:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.497602:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f342eb lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x171:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.497634:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8fa00/0xb126349c40f342f2 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.497642:0:203348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8fa00/0xb126349c40f342f2 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.497652:0:203348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8fa00/0xb126349c40f342f2 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508615.497667:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d4856680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:203348:1874324480118272:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1787508615.497700:0:203348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508615.497765:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787508615.497886:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480118272 00000100:00100000:2.0:1787508615.497893:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480118272 00000100:00100000:2.0:1787508615.498093:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29722 00000100:00100000:2.0:1787508615.498103:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:203348:x1874324480118272:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787508615.498119:0:203182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.498137:0:203182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f342f9 lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f342f2 expref: -99 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.498157:0:203182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f342f9 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f342f2 expref: 11 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.498169:0:203182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f342f9 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f342f2 expref: 11 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.498284:0:203182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x169:0x0].0x0 (ffff9090d36fd300) 00010000:00010000:2.0:1787508615.498288:0:203182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.498291:0:203182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab000, rc 0) 00000100:00100000:2.0:1787508615.498371:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:203348:x1874324480118272:12345-0@lo:101:mdt00_003.0 Request processed in 270us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.498378:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29722 00000100:00100000:3.0:1787508615.498425:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d4856680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:203348:1874324480118272:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1787508615.498450:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8fa00/0xb126349c40f342f2 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f342f9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.498459:0:203348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8fa00/0xb126349c40f342f2 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f342f9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508615.498482:0:203348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000caff3862 reply state 0000000064980388 transno 12884944079 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f342eb lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x171:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.498492:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f342eb lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x171:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.498499:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x171:0x0].0x0 (ffff9090ccb87b00) 00010000:00010000:3.0:1787508615.498501:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508615.498503:0:203348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787508615.498509:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8fa00/0xb126349c40f342f2 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f342f9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.498517:0:203348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8fa00/0xb126349c40f342f2 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f342f9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787508615.498526:0:203348:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd2:0x169:0x0] 00000004:00010000:3.0:1787508615.498532:0:203348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000caff3862 reply state 0000000064980388 transno 12884944079 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f342e4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.498540:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f342e4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x125b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.498545:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125b:0x0].0x0 (ffff9090ccb87200) 00010000:00010000:3.0:1787508615.498548:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508615.498549:0:203348:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787508615.498554:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125b:0x0]: returning size 4096 00010000:00010000:3.0:1787508615.498563:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f342c8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.498569:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f342c8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.498574:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f342c8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.498581:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f342c8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.498587:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.498591:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f342c8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.498598:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f342c8 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.498607:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.498609:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.498612:0:203348:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f342dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.498620:0:203348:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f342dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.498626:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f342dd lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.498689:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f342c8 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.498697:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f342c8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508615.498712:0:203348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000caff3862 reply state 0000000064980388 transno 12884944079 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f342cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.498720:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f342cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.498725:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd700) 00010000:00010000:3.0:1787508615.498728:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508615.498730:0:203348:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1787508615.498814:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6ac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336075:x1874324509529472:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 17049us (17404us total) trans 12884944079 rc 0/0 00000100:00100000:3.0:1787508615.498821:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93875 00010000:00010000:0.0:1787508615.499266:0:202227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f342dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.499276:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f342dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508615.499323:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787508615.499327:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508615.499343:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f342dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.499370:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f342d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae30d expref: 12 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.499384:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f342dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae30d expref: 11 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.499391:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508615.499393:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508615.499396:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e400, rc 0) 00000100:00100000:0.0:1787508615.499482:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336082:x1874324509529728:12345-192.168.201.30@tcp:101:rm.0 Request processed in 4654us (8004us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508615.499489:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93876 00000100:00100000:1.0:1787508615.508457:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.508538:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509529856 00000100:00100000:3.0:1787508615.508549:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509529856 00000100:00100000:3.0:1787508615.508608:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93877 00000100:00100000:3.0:1787508615.508619:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336083:x1874324509529856:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1787508615.508642:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.508664:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34300 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae314 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.508727:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34307 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.508740:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34307 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.508751:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34307 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508615.508809:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508615.508813:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508615.508833:0:205405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34307 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.508857:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34300 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae314 expref: 585 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.508878:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34307 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae314 expref: 584 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.508887:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.508890:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508615.508894:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e600, rc 0) 00000100:00100000:3.0:1787508615.508995:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336083:x1874324509529856:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 378us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.509003:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93877 00000100:00100000:0.0:1787508615.515143:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.515285:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509529984 00000100:00100000:3.0:1787508615.515295:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509529984 00000100:00100000:3.0:1787508615.515366:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93878 00000100:00100000:3.0:1787508615.515376:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336082:x1874324509529984:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508615.515397:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.515417:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3430e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae31b expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.515490:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34315 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.515504:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34315 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.515514:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34315 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.515530:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3431c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.515537:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3431c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.515543:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3431c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.515602:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34315 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.515610:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34315 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.515616:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34315 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.515623:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34315 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.515628:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ea00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.515633:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34315 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.515639:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34315 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.515650:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.515652:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.515657:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34315 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.515662:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34315 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.515677:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3431c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.515682:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3431c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.515688:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3431c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.515693:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.515696:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3431c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.515701:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3431c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.515708:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090ccb87900) 00010000:00010000:3.0:1787508615.515710:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.515712:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3431c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.515718:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3431c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.515745:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3430e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae31b expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.515755:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.515757:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508615.515761:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3430e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae31b expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.515770:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f800, rc 0) 00000100:00100000:3.0:1787508615.515834:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336082:x1874324509529984:12345-192.168.201.30@tcp:101:rm.0 Request processed in 459us (702us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508615.515841:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93878 00000100:00100000:2.0:1787508615.519862:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.519908:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.520529:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509530112 00000100:00100000:1.0:1787508615.520544:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509530112 00000100:00100000:1.0:1787508615.520607:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509530240 00000100:00100000:1.0:1787508615.520610:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509530240 00000100:00100000:1.0:1787508615.520650:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93879 00000100:00100000:1.0:1787508615.520661:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336082:x1874324509530112:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508615.520683:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.520704:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34323 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae322 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.520769:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3432a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.520797:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3432a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.520808:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3432a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.520822:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34331 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.520830:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34331 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.520837:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34331 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.520891:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3432a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.520898:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3432a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.520909:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3432a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.520915:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3432a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.520920:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.520924:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3432a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.520931:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3432a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.520971:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.520974:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.520979:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3432a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.520986:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3432a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.520999:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34331 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.521005:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34331 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.521010:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34331 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.521014:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.521017:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34331 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.521023:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34331 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.521030:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090d171fa00) 00010000:00010000:1.0:1787508615.521032:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.521035:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34331 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.521040:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34331 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.521068:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34323 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae322 expref: 12 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.521078:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.521080:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508615.521084:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34323 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae322 expref: 12 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.521093:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b600, rc 0) 00000100:00100000:1.0:1787508615.521154:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336082:x1874324509530112:12345-192.168.201.30@tcp:101:rm.0 Request processed in 495us (1302us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508615.521161:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93879 00000100:00100000:0.0:1787508615.521332:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93880 00000100:00100000:0.0:1787508615.521356:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336083:x1874324509530240:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508615.521367:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508615.521378:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f34338 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae329 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.521408:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3433f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.521418:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3433f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.521426:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3433f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.521451:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34346 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.521458:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34346 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.521465:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34346 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.521495:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3433f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.521502:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3433f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.521508:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3433f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.521513:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3433f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.521518:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508615.521521:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3433f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.521527:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3433f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.521536:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508615.521539:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508615.521542:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3433f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.521548:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3433f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.521557:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34346 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.521563:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34346 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.521568:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34346 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.521572:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508615.521575:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34346 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.521582:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34346 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.521588:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090c9878100) 00010000:00010000:0.0:1787508615.521590:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508615.521593:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34346 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.521598:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34346 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.521618:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f34338 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae329 expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.521627:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508615.521629:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508615.521633:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f34338 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae329 expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.521641:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6e00, rc 0) 00000100:00100000:0.0:1787508615.521665:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336083:x1874324509530240:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 325us (1757us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508615.521672:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93880 00000100:00100000:1.0:1787508615.527508:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.527613:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.527739:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509530496 00000100:00100000:2.0:1787508615.527750:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509530496 00000100:00100000:2.0:1787508615.527831:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509530624 00000100:00100000:2.0:1787508615.527835:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509530624 00000100:00100000:2.0:1787508615.527873:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93881 00000100:00100000:2.0:1787508615.527885:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336082:x1874324509530496:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508615.527910:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.527933:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f3434d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae330 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.528037:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34354 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.528053:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34354 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.528066:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34354 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.528081:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3435b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.528090:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3435b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.528096:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3435b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.528160:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34354 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.528169:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34354 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508615.528654:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93882 00000100:00100000:0.0:1787508615.528670:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336083:x1874324509530624:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508615.528681:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508615.528692:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34362 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae337 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.528732:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34369 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.528848:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34354 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.528857:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34354 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.529145:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34369 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.529160:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34369 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.529257:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.529263:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34354 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.529273:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34354 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.529286:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.529290:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.529295:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34354 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.529302:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34354 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.529319:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3435b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.529325:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3435b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.529333:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3435b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.529415:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34370 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.529424:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34370 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.529444:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34370 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.529491:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34369 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.529498:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34369 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.529504:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34369 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.529510:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34369 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.529516:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508615.529519:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34369 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.529525:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34369 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.529534:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508615.529537:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508615.529541:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34369 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.529546:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34369 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.529556:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34370 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.529563:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34370 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.529568:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34370 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.529573:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508615.529576:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34370 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.529582:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34370 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.529589:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090c9878b00) 00010000:00010000:0.0:1787508615.529592:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508615.529595:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34370 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.529602:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34370 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.529637:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34362 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae337 expref: 585 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.529649:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508615.529651:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508615.529655:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34362 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae337 expref: 585 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.529665:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6800, rc 0) 00010000:00010000:2.0:1787508615.529914:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.529919:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3435b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.529926:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3435b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.529936:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090d36fd900) 00010000:00010000:2.0:1787508615.529961:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.529965:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3435b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.529972:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3435b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.530005:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f3434d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae330 expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.530015:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.530018:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508615.530021:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f3434d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae330 expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.530030:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa200, rc 0) 00000100:00100000:0.0:1787508615.530095:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336083:x1874324509530624:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 1429us (2479us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508615.530104:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93882 00000100:00100000:2.0:1787508615.530270:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336082:x1874324509530496:12345-192.168.201.30@tcp:101:rm.0 Request processed in 2385us (2774us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508615.530280:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93881 00000100:00100000:3.0:1787508615.536844:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.536916:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.536978:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509530752 00000100:00100000:1.0:1787508615.536989:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509530752 00000100:00100000:1.0:1787508615.537046:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509530880 00000100:00100000:1.0:1787508615.537049:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509530880 00000100:00100000:1.0:1787508615.537081:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93883 00000100:00100000:1.0:1787508615.537092:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336082:x1874324509530752:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508615.537115:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.537137:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34377 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae33e expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.537211:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f3437e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.537226:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f3437e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.537236:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f3437e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.537247:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f34385 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.537254:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f34385 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.537259:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f34385 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.537363:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3438c lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x125b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.537371:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3438c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.537384:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3438c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508615.537475:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125b:0x0]: returning size 4096 00000004:00200000:1.0:1787508615.537480:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1787508615.537501:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3438c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.537515:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f3437e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.537523:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f3437e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.537529:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f3437e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.537536:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f3437e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.537541:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.537546:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f3437e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.537554:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f3437e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.537567:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.537570:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.537574:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f3437e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.537584:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f3437e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.537597:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f34385 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.537603:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f34385 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.537609:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f34385 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.537614:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.537616:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f34385 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.537621:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f34385 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.537627:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd700) 00010000:00010000:1.0:1787508615.537629:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.537632:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f34385 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.537636:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f34385 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.537658:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34377 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae33e expref: 13 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.537675:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3438c lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae33e expref: 12 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.537683:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125b:0x0].0x0 (ffff9090ccb87200) 00010000:00010000:1.0:1787508615.537685:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508615.537688:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a200, rc 0) 00000100:00100000:2.0:1787508615.537805:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93884 00000100:00100000:2.0:1787508615.537816:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336083:x1874324509530880:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1787508615.537824:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.537834:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34393 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae345 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.537863:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3439a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.537871:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3439a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.537878:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3439a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.537891:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f343a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.537898:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f343a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.537903:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f343a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.537924:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3439a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.537930:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3439a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.537960:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3439a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.537965:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3439a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.537970:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.537973:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3439a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.537978:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3439a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.537986:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.537988:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.537990:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3439a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.537996:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3439a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.538005:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f343a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.538011:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f343a1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.538016:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f343a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.538021:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.538024:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f343a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.538030:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f343a1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.538035:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090d36fdb00) 00010000:00010000:2.0:1787508615.538037:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.538040:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f343a1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.538045:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f343a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.538068:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34393 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae345 expref: 585 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.538077:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.538079:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508615.538082:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34393 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae345 expref: 585 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.538089:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa600, rc 0) 00000100:00100000:1.0:1787508615.539252:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336082:x1874324509530752:12345-192.168.201.30@tcp:101:rm.0 Request processed in 2152us (2408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.539263:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93883 00000100:00100000:2.0:1787508615.539388:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336083:x1874324509530880:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 1573us (2469us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508615.539395:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93884 00000100:00100000:1.0:1787508615.543594:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.543640:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508615.543786:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509531008 00000100:00100000:0.0:1787508615.543796:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509531008 00000100:00100000:0.0:1787508615.543852:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509531264 00000100:00100000:0.0:1787508615.543856:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509531264 00000100:00100000:0.0:1787508615.543935:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93885 00000100:00100000:0.0:1787508615.543961:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336082:x1874324509531008:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508615.543981:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508615.544002:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f343a8 lrc: 2/0,0 mode: --/CR res: [0x2000013a0:0x171:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae34c expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544061:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f343af lrc: 3/1,0 mode: --/PR res: [0x2000013a0:0x171:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544075:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f343af lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544086:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f343af lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508615.544143:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a0:0x171:0x0]: returning size 4096 00000004:00200000:0.0:1787508615.544148:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508615.544198:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f343a8 lrc: 0/0,0 mode: --/CR res: [0x2000013a0:0x171:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae34c expref: 14 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544216:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f343af lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae34c expref: 13 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544225:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x171:0x0].0x0 (ffff9090ccb87b00) 00010000:00010000:0.0:1787508615.544228:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508615.544231:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7e00, rc 0) 00000100:00100000:0.0:1787508615.544291:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336082:x1874324509531008:12345-192.168.201.30@tcp:101:rm.0 Request processed in 332us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508615.544299:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93885 00000100:00100000:0.0:1787508615.544318:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93886 00000100:00100000:0.0:1787508615.544326:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336083:x1874324509531264:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508615.544334:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508615.544357:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f343b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae353 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544404:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f343bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544414:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f343bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544421:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f343bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544445:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f343c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544453:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f343c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544459:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f343c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544507:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f343bd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544515:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f343bd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544522:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f343bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544528:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f343bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544534:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508615.544539:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f343bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544547:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f343bd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544556:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508615.544559:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508615.544562:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f343bd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544569:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f343bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544579:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f343c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544585:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f343c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544591:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f343c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544596:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508615.544599:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f343c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544606:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f343c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544612:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090c9878b00) 00010000:00010000:0.0:1787508615.544614:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508615.544617:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f343c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544623:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f343c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544646:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f343b6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae353 expref: 585 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544659:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508615.544661:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508615.544664:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f343b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae353 expref: 585 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.544671:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7c00, rc 0) 00000100:00100000:0.0:1787508615.544694:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336083:x1874324509531264:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 369us (1053us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508615.544701:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93886 00000100:00100000:0.0:1787508615.549923:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.550014:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509531392 00000100:00100000:1.0:1787508615.550023:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509531392 00000100:00100000:1.0:1787508615.550082:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93887 00000100:00100000:1.0:1787508615.550092:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336082:x1874324509531392:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508615.550120:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.550142:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f343cb lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x169:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae35a expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.550210:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f343d2 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.550224:0:205405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f342f9 lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f342f2 expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.550233:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f343d2 lrc: 4/1,0 mode: --/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.550269:0:205405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f342f9 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f342f2 expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.550286:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc877480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:205405:1874324480118400:0@lo:104: 00000100:00100000:1.0:1787508615.550352:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508615.550394:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cbe40e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787508615.550411:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480118400 00000100:00100000:1.0:1787508615.550414:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480118400 00000100:00100000:1.0:1787508615.550452:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18172 00000100:00100000:1.0:1787508615.550458:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc875c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:205405:x1874324480118400:12345-0@lo:104: 00010000:00010000:1.0:1787508615.550470:0:202209:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8fa00/0xb126349c40f342f2 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f342f9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.550513:0:202209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787508615.550518:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc875c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:205405:x1874324480118400:12345-0@lo:104: Request processed in 61us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.550525:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18172 00010000:00010000:1.0:1787508615.550545:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787508615.550551:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8fa00/0xb126349c40f342f2 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f342f9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.550559:0:204785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fa00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:1.0:1787508615.550564:0:204785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8fa00/0xb126349c40f342f2 lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f342f9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508615.550574:0:204785:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8fa00/0xb126349c40f342f2 lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f342f9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.550602:0:204785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8fa00/0xb126349c40f342f2 lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f342f9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.550608:0:204785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787508615.550624:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8fa00/0xb126349c40f342f2 lrc: 1/0,0 mode: --/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f342f9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.550632:0:204785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8fa00/0xb126349c40f342f2 lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f342f9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.550649:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508615.550651:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508615.550652:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508615.550661:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480118528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508615.550685:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508615.550714:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480118528 00000100:00100000:1.0:1787508615.550717:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480118528 00010000:00010000:1.0:1787508615.550732:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f342f9 lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f342f2 expref: 11 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.550752:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27870 00000100:00100000:1.0:1787508615.550757:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc877100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+11:3619:x1874324480118528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508615.550765:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787508615.551127:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc877480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:205405:1874324480118400:0@lo:104: 00010000:00010000:1.0:1787508615.551149:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f343d2 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508615.553077:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508615.553891:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509531520 00000100:00100000:0.0:1787508615.553904:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509531520 00000100:00100000:0.0:1787508615.553985:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93888 00000100:00100000:0.0:1787508615.553995:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336083:x1874324509531520:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508615.554014:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508615.554034:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f343d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae361 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.554096:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f343e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.554110:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f343e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.554122:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f343e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.554138:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f343e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.554145:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f343e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.554151:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f343e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.554252:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f343ee lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x125b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.554261:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f343ee lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.554268:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f343ee lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508615.554357:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125b:0x0]: returning size 4096 00000004:00200000:0.0:1787508615.554363:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1787508615.554384:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f343ee lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.554399:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f343e0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.554405:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f343e0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.554411:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f343e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.554422:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f343e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.554439:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7a00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508615.554444:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f343e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.554451:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f343e0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.554463:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508615.554467:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508615.554472:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f343e0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.554477:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f343e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.554491:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f343e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.554496:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f343e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.554501:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f343e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.554505:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508615.554507:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f343e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.554517:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f343e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.554524:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd700) 00010000:00010000:0.0:1787508615.554527:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508615.554530:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f343e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.554535:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f343e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.554560:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f343d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae361 expref: 586 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.554574:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f343ee lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae361 expref: 585 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.554581:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125b:0x0].0x0 (ffff9090ccb87200) 00010000:00010000:0.0:1787508615.554584:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508615.554586:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6000, rc 0) 00000100:00100000:0.0:1787508615.554652:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:336083:x1874324509531520:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 659us (1584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508615.554659:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93888 00000001:00080000:1.0:1787508615.556467:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589962015 is committed 00000001:00080000:1.0:1787508615.556482:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589962014 is committed 00000001:00080000:1.0:1787508615.556506:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589962013 is committed 00000020:00080000:1.0:1787508615.556512:0:202955:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9090d1d88180 refcount 2 committed 0 result 0 batchid 4294998381 00000020:00080000:1.0:1787508615.556516:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521e00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d1d88e40 00000020:00080000:1.0:1787508615.556520:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a2:0x5:0x0].589 00000020:00080000:1.0:1787508615.556522:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090ce62a800 00000020:00080000:1.0:1787508615.556525:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd1:0xf:0x0].46 00000020:00080000:1.0:1787508615.556545:0:202955:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9090d3f11900 refcount 2 committed 0 result 0 batchid 4294998380 00000020:00080000:1.0:1787508615.556548:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cbc97f00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d3f11240 00000020:00080000:1.0:1787508615.556551:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a2:0x5:0x0].588 00000020:00080000:1.0:1787508615.556553:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cbc97600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090d7420200 00000020:00080000:1.0:1787508615.556556:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd1:0xf:0x0].45 00000020:00080000:1.0:1787508615.556563:0:202955:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 4294998379 batchid updated 00000020:00080000:0.0:1787508615.556680:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294998381 committed batchid 4294998379 00000004:00080000:0.0:1787508615.556794:0:202975:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d9ff2180 with version 13607 00000020:00080000:0.0:1787508615.556806:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294998379 cancel update log [0x2000013a2:0x5:0x0].587: rc = 0 00000020:00080000:0.0:1787508615.556845:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294998379 cancel update log [0x240000bd1:0xf:0x0].44: rc = 0 00000020:00080000:0.0:1787508615.556854:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998379 00010000:00010000:3.0:1787508615.556919:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e800/0xb126349c40f33f25 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.556929:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e800/0xb126349c40f33f25 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.556936:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e800/0xb126349c40f33f25 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.556973:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.556979:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e800/0xb126349c40f33f25 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.556986:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e800/0xb126349c40f33f25 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.557003:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d3:0x0].0x0 (ffff9090ccb87500) 00010000:00010000:3.0:1787508615.557006:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.557011:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e800/0xb126349c40f33f25 lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.557021:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e800/0xb126349c40f33f25 lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.557034:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f33f2c lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x292:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.557040:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f33f2c lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x292:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.557046:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f33f2c lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x292:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.557050:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.557053:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f33f2c lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x292:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.557059:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f33f2c lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x292:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.557066:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x292:0x0].0x0 (ffff9090ccb87400) 00010000:00010000:3.0:1787508615.557069:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.557072:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f33f2c lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x292:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.557077:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f33f2c lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x292:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.557091:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f34091 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.557097:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f34091 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.557103:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f34091 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.557108:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.557111:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f34091 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.557116:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f34091 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.557124:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d3:0x0].0x0 (ffff9090ccb87500) 00010000:00010000:3.0:1787508615.557126:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508615.557129:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f34091 lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.557134:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f34091 lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x13d3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.557148:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f34098 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.557155:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f34098 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.557161:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f34098 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.557166:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.557169:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f34098 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.557192:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f34098 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.557199:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x292:0x0].0x0 (ffff9090ccb87400) 00010000:00010000:3.0:1787508615.557201:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508615.557204:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f34098 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.557210:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f34098 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x292:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787508615.559342:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13607 rpc_version 13607 00000020:00100000:0.0:1787508615.559402:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787508615.559415:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091f9ac7480 x1874324480118784/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787508615.559470:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac7480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480118784:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787508615.559554:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508615.559595:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9ff2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.559866:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480118784 00000100:00100000:3.0:1787508615.559876:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480118784 00000100:00100000:0.0:1787508615.560066:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.560607:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29723 00000100:00100000:3.0:1787508615.560620:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d5739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:202961:x1874324480118784:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508615.560840:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d5739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:202961:x1874324480118784:12345-0@lo:1000:osp_up0-1.0 Request processed in 224us (1285us total) trans 12884944080 rc 0/0 00000100:00100000:3.0:1787508615.560849:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29723 00000100:00100000:3.0:1787508615.560877:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509531648 00000100:00100000:3.0:1787508615.560882:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509531648 00000100:00100000:3.0:1787508615.560909:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93889 00000100:00100000:3.0:1787508615.560915:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce62e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:336083:x1874324509531648:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1787508615.560924:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.560958:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f343f5 lrc: 2/0,0 mode: --/CR res: [0x2000013a0:0x171:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae368 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.561013:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f343fc lrc: 3/1,0 mode: --/PR res: [0x2000013a0:0x171:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.561028:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f343fc lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.561039:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f343fc lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508615.561084:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a0:0x171:0x0]: returning size 4096 00000004:00200000:3.0:1787508615.561089:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787508615.561124:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f343f5 lrc: 0/0,0 mode: --/CR res: [0x2000013a0:0x171:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae368 expref: 587 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.561141:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f343fc lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae368 expref: 586 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.561149:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x171:0x0].0x0 (ffff9090ccb87b00) 00010000:00010000:3.0:1787508615.561152:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508615.561156:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fc00, rc 0) 00000100:00100000:3.0:1787508615.561266:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce62e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336083:x1874324509531648:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 349us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.561273:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93889 00000100:00100000:3.0:1787508615.563080:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508615.563292:0:202961:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944078 gen 2 00000004:00080000:0.0:1787508615.563298:0:202961:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944078 committed transno 12884944078 00000020:00080000:0.0:1787508615.563304:0:202961:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9090d9ff29c0 refcount 2 committed 0 result 0 batchid 4294998382 00000020:00080000:0.0:1787508615.563309:0:202961:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cd2caf00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d9ff2c00 00000020:00080000:0.0:1787508615.563312:0:202961:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a2:0x5:0x0].590 00000020:00080000:0.0:1787508615.563315:0:202961:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cd2ca100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090cc49b400 00000020:00080000:0.0:1787508615.563318:0:202961:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd1:0xf:0x0].47 00000100:00100000:0.0:1787508615.563362:0:202961:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9091f9ac7480 x1874324480118784/t12884944080(12884944080) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1787508631 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787508615.563382:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac7480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480118784:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787508615.563414:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509531776 00000100:00100000:0.0:1787508615.563419:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509531776 00000100:00100000:0.0:1787508615.563476:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93890 00000100:00100000:0.0:1787508615.563485:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:336083:x1874324509531776:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508615.563503:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508615.563520:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6200/0xb126349c40f34403 lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x169:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae36f expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.563569:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f3440a lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.563581:0:202226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f3440a lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.563590:0:202226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f3440a lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787508615.563725:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294998382 committed batchid 4294998379 00000020:00080000:3.0:1787508615.563774:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998379 00010000:00010000:2.0:1787508615.563839:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f342f9 lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f342f2 expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.563856:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x169:0x0].0x0 (ffff9090d36fd300) 00010000:00010000:2.0:1787508615.563861:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f343d2 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.563869:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f343d2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.563875:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f343d2 lrc: 4/1,0 mode: PR/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.563883:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f3440a lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.563889:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f3440a lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.563894:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f3440a lrc: 4/1,0 mode: PR/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.563970:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508615.564023:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc877100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480118528:12345-0@lo:103:ldlm_bl.0 Request processed in 13265us (13336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.564031:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27870 00000100:00100000:3.0:1787508615.564114:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480118528:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508615.564171:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f343d2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.564188:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f343d2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508615.564235:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd2:0x169:0x0]: returning size 4096 00000004:00200000:1.0:1787508615.564239:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787508615.564275:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f343cb lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x169:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae35a expref: 7 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.564288:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f343d2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae35a expref: 6 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.564297:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x169:0x0].0x0 (ffff9090d36fd300) 00010000:00010000:1.0:1787508615.564299:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508615.564302:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b200, rc 0) 00000100:00100000:1.0:1787508615.564466:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336082:x1874324509531392:12345-192.168.201.30@tcp:101:rm.0 Request processed in 14374us (14550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.564472:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93887 00000100:00100000:3.0:1787508615.567153:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.567365:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509532032 00000100:00100000:2.0:1787508615.567375:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509532032 00000100:00100000:2.0:1787508615.567447:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93891 00000100:00100000:2.0:1787508615.567458:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d15ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336082:x1874324509532032:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508615.567478:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.567498:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34411 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae376 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508615.567645:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125b:0x0]: returning size 4096 00010000:00010000:2.0:1787508615.567743:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34411 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae376 expref: 15 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.567757:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.567760:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508615.567766:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34411 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae376 expref: 15 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.567781:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab200, rc 0) 00000100:00100000:2.0:1787508615.567843:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d15ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336082:x1874324509532032:12345-192.168.201.30@tcp:101:rm.0 Request processed in 386us (698us total) trans 12884944081 rc 301/301 00000100:00100000:2.0:1787508615.567850:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93891 00010000:00010000:0.0:1787508615.571720:0:202226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f3440a lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.571739:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f3440a lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508615.571812:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd2:0x169:0x0]: returning size 4096 00000004:00200000:0.0:1787508615.571819:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508615.571874:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6200/0xb126349c40f34403 lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x169:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae36f expref: 642 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.571896:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f3440a lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae36f expref: 641 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.571907:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x169:0x0].0x0 (ffff9090d36fd300) 00010000:00010000:0.0:1787508615.571911:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508615.571915:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6e00, rc 0) 00000100:00100000:0.0:1787508615.572279:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+641:336083:x1874324509531776:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 8792us (9203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508615.572293:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93890 00000100:00100000:0.0:1787508615.573885:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.577059:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508615.577189:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509532416 00000100:00100000:0.0:1787508615.577200:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509532416 00000100:00100000:0.0:1787508615.577269:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93892 00000100:00100000:0.0:1787508615.577281:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d15ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336083:x1874324509532416:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:0.0:1787508615.577348:0:209004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508615.577377:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f343ee lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x125b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae361 expref: 586 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.577395:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125b:0x0].0x0 (ffff9090ccb87200) 00010000:00010000:0.0:1787508615.577400:0:209004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508615.577422:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3441f lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x125b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.577447:0:209004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3438c lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x125b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae33e expref: 13 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.577456:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3441f lrc: 4/0,1 mode: --/PW res: [0x2000013a4:0x125b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.577486:0:209004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3438c lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae33e expref: 13 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.577500:0:209004:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3438c lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x125b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae33e expref: 13 pid: 202227 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508615.577518:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce62ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480118912:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508615.577604:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9ff2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787508615.580159:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509532160 00000100:00100000:2.0:1787508615.580247:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509532160 00000100:00100000:3.0:1787508615.581058:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.581157:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce62ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480118912:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508615.581189:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3441f lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x125b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.581350:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509532544 00000100:00100000:2.0:1787508615.581356:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509532544 00010000:00010000:2.0:1787508615.581395:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3438c lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x125b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae33e expref: 15 pid: 202227 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.581446:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27871 00000100:00100000:2.0:1787508615.581455:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2401:x1874324509532544:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508615.581472:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508615.581479:0:229383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3438c lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x125b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae33e expref: 15 pid: 202227 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.581492:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3438c lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae33e expref: 15 pid: 202227 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.581519:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3438c lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x125b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae33e expref: 15 pid: 202227 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.581536:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125b:0x0].0x0 (ffff9090ccb87200) 00010000:00010000:2.0:1787508615.581541:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3441f lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x125b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.581551:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3441f lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.581559:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3441f lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x125b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.581581:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508615.581627:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2401:x1874324509532544:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 172us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.581636:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27871 00010000:00010000:2.0:1787508615.581661:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3441f lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.581668:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3441f lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.581696:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34426 lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x171:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.581707:0:209004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f343af lrc: 2/0,0 mode: PR/PR res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae34c expref: 13 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.581720:0:209004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f343fc lrc: 2/0,0 mode: PR/PR res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae368 expref: 585 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.581728:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34426 lrc: 5/0,1 mode: --/PW res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.581756:0:209004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f343fc lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae368 expref: 585 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.581769:0:209004:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f343fc lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae368 expref: 585 pid: 209004 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.581796:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480119040:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508615.581851:0:209004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f343af lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae34c expref: 13 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.581860:0:209004:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f343af lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae34c expref: 13 pid: 202226 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.581869:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480119168:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508615.581892:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090ca6db600 going to sleep for 11 seconds 00000100:00100000:0.0:1787508615.585732:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15410 00000100:00100000:0.0:1787508615.585749:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce62f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336082:x1874324509532160:12345-192.168.201.30@tcp:37:rm.0 00000100:00100000:2.0:1787508615.586887:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.586912:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509532672 00000100:00100000:2.0:1787508615.586920:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509532672 00010000:00010000:2.0:1787508615.586971:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f343fc lrc: 5/0,0 mode: PR/PR res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae368 expref: 586 pid: 209004 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.587008:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27872 00000100:00100000:2.0:1787508615.587017:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:2403:x1874324509532672:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508615.587029:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508615.587035:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f343fc lrc: 5/0,0 mode: PR/PR res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae368 expref: 586 pid: 209004 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.587048:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f343fc lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae368 expref: 586 pid: 209004 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.587070:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x171:0x0].0x0 (ffff9090ccb87b00) 00010000:00010000:2.0:1787508615.587076:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34426 lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.587085:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34426 lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.587092:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508615.587127:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:2403:x1874324509532672:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 110us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.587134:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27872 00010000:00010000:0.0:1787508615.588536:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f343fc lrc: 0/0,0 mode: --/PR res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae368 expref: 585 pid: 209004 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508615.588556:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480119040:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508615.588568:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480119168:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508615.588592:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34426 lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508615.591535:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce62f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336082:x1874324509532160:12345-192.168.201.30@tcp:37:rm.0 Request processed in 5778us (17647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508615.591550:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15410 00000100:00100000:0.0:1787508615.596673:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508615.596711:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.596787:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509532800 00000100:00100000:3.0:1787508615.596797:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509532800 00000100:00100000:3.0:1787508615.596855:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15411 00000100:00100000:3.0:1787508615.596864:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce62c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336082:x1874324509532800:12345-192.168.201.30@tcp:37:rm.0 00000100:00100000:1.0:1787508615.597932:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509532928 00000100:00100000:1.0:1787508615.597965:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509532928 00010000:00010000:1.0:1787508615.597995:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f343af lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae34c expref: 13 pid: 202226 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.598028:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27873 00000100:00100000:1.0:1787508615.598035:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce62fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2400:x1874324509532928:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508615.598049:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508615.598055:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f343af lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae34c expref: 13 pid: 202226 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.598070:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f343af lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae34c expref: 13 pid: 202226 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.598090:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f343af lrc: 0/0,0 mode: --/PR res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae34c expref: 13 pid: 202226 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.598106:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x171:0x0].0x0 (ffff9090ccb87b00) 00010000:00010000:1.0:1787508615.598111:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34426 lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.598120:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34426 lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.598128:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34426 lrc: 4/0,1 mode: PW/PW res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.598150:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508615.598188:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce62fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2400:x1874324509532928:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 153us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.598195:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27873 00010000:00010000:0.0:1787508615.598644:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34426 lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.598653:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34426 lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.598696:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6000/0xb126349c40f3442d lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.598703:0:209004:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6000/0xb126349c40f3442d lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x0 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.598713:0:209004:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6000/0xb126349c40f3442d lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508615.598731:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce62dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:209004:1874324480119296:0@lo:101:mdt00_005.0 00000100:00100000:0.0:1787508615.598777:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508615.598803:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9ff2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787508615.598857:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480119296 00000100:00100000:2.0:1787508615.598862:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480119296 00000100:00100000:2.0:1787508615.598899:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29724 00000100:00100000:2.0:1787508615.598906:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce62ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:209004:x1874324480119296:12345-0@lo:101:mdt00_005.0 00010000:00010000:2.0:1787508615.598918:0:225829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.598932:0:225829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f34434 lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f3442d expref: -99 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.598968:0:225829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f343d2 lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae35a expref: 7 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.598977:0:225829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f3440a lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae36f expref: 640 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.598985:0:225829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f34434 lrc: 5/0,0 mode: --/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f3442d expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.599006:0:225829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f3440a lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae36f expref: 640 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.599018:0:225829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f3440a lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae36f expref: 640 pid: 202226 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.599029:0:225829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999e300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:225829:1874324480119424:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508615.599076:0:225829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f343d2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae35a expref: 7 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.599085:0:225829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f343d2 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae35a expref: 7 pid: 205405 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.599094:0:225829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999f800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:225829:1874324480119552:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508615.599108:0:225829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090ca6db6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787508615.603184:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce62c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336082:x1874324509532800:12345-192.168.201.30@tcp:37:rm.0 Request processed in 6310us (6509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.603199:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15411 00000100:00100000:2.0:1787508615.606285:0:225829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999e300 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:225829:1874324480119424:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508615.606300:0:225829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999f800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:225829:1874324480119552:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508615.606336:0:225829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f34434 lrc: 3/0,0 mode: --/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3442d expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.606358:0:225829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x169:0x0].0x0 (ffff9090d36fd300) 00010000:00010000:2.0:1787508615.606361:0:225829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508615.606366:0:225829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f34434 lrc: 3/0,0 mode: --/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3442d expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.606377:0:225829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f34434 lrc: 3/0,0 mode: --/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3442d expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.606384:0:225829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aba00, rc 0) 00000100:00100000:2.0:1787508615.606449:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce62ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:209004:x1874324480119296:12345-0@lo:101:mdt00_005.0 Request processed in 7542us (7670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.606458:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29724 00000100:00100000:0.0:1787508615.606550:0:209004:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589962015 gen 2 00000004:00080000:0.0:1787508615.606556:0:209004:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589962006 committed transno 8589962015 00000020:00080000:0.0:1787508615.606562:0:209004:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9090d9ff2240 refcount 2 committed 0 result 0 batchid 8589961986 00000020:00080000:0.0:1787508615.606566:0:209004:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d9ff2f00 00000020:00080000:0.0:1787508615.606570:0:209004:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd2:0x1:0x0].1788 00000020:00080000:0.0:1787508615.606572:0:209004:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090ca672400 00000020:00080000:0.0:1787508615.606575:0:209004:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1:0x0].1781 00000004:00080000:0.0:1787508615.606602:0:209004:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589962007 committed transno 8589962015 00000004:00080000:0.0:1787508615.606613:0:209004:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589962009 committed transno 8589962015 00000004:00080000:0.0:1787508615.606623:0:209004:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589962010 committed transno 8589962015 00000004:00080000:0.0:1787508615.606633:0:209004:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589962015 committed transno 8589962015 00000100:00100000:0.0:1787508615.606647:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce62dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:209004:1874324480119296:0@lo:101:mdt00_005.0 00010000:00010000:0.0:1787508615.606662:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6000/0xb126349c40f3442d lrc: 4/0,1 mode: --/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34434 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.606672:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6000/0xb126349c40f3442d lrc: 4/0,1 mode: --/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34434 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787508615.606736:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589961986 committed batchid 8589961985 00000020:00080000:1.0:1787508615.606804:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961985 00000100:00100000:0.0:1787508615.608112:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.608448:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509533056 00000100:00100000:2.0:1787508615.608459:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509533056 00010000:00010000:2.0:1787508615.608497:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f3440a lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae36f expref: 641 pid: 202226 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.608541:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27874 00000100:00100000:2.0:1787508615.608552:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde3d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+641:2401:x1874324509533056:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508615.608569:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508615.608575:0:229383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f3440a lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae36f expref: 641 pid: 202226 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.608588:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f3440a lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae36f expref: 641 pid: 202226 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.608609:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f3440a lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae36f expref: 641 pid: 202226 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.608624:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x169:0x0].0x0 (ffff9090d36fd300) 00010000:00010000:2.0:1787508615.608631:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f34434 lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3442d expref: 5 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.608640:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f34434 lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3442d expref: 5 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.608646:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508615.608705:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde3d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2401:x1874324509533056:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 155us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.608712:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27874 00000100:00100000:3.0:1787508615.613812:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.613859:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.613983:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509533312 00000100:00100000:2.0:1787508615.613995:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509533312 00000100:00100000:2.0:1787508615.614048:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15412 00000100:00100000:2.0:1787508615.614060:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336082:x1874324509533312:12345-192.168.201.30@tcp:35:rm.0 00000100:00100000:2.0:1787508615.614294:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336082:x1874324509533312:12345-192.168.201.30@tcp:35:rm.0 Request processed in 235us (493us total) trans 12884944082 rc 0/0 00000100:00100000:2.0:1787508615.614302:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15412 00000100:00100000:1.0:1787508615.614393:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509533440 00000100:00100000:1.0:1787508615.614398:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509533440 00010000:00010000:1.0:1787508615.614424:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f343d2 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae35a expref: 6 pid: 205405 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.614469:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27875 00000100:00100000:1.0:1787508615.614477:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2401:x1874324509533440:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508615.614489:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508615.614496:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f343d2 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae35a expref: 6 pid: 205405 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.614516:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f343d2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae35a expref: 6 pid: 205405 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.614538:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f343d2 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae35a expref: 6 pid: 205405 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.614553:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x169:0x0].0x0 (ffff9090d36fd300) 00010000:00010000:1.0:1787508615.614560:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f34434 lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3442d expref: 5 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.614572:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f34434 lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f3442d expref: 5 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.614581:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f34434 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f3442d expref: 5 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.614612:0:205406:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f34434 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3442d expref: 5 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.614627:0:205406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc877480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:205406:1874324480119680:0@lo:105: 00000100:00100000:1.0:1787508615.614671:0:205406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508615.614707:0:205406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3f11780 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.614807:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480119680 00000100:00100000:3.0:1787508615.614812:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480119680 00000100:00100000:3.0:1787508615.614847:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18173 00000100:00100000:3.0:1787508615.614854:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc874700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:205406:x1874324480119680:12345-0@lo:105: 00010000:00010000:3.0:1787508615.614866:0:202210:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6000/0xb126349c40f3442d lrc: 5/0,1 mode: --/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34434 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.614876:0:202210:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6000/0xb126349c40f3442d lrc: 5/0,1 mode: --/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34434 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.614885:0:202210:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6000/0xb126349c40f3442d lrc: 5/0,1 mode: --/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34434 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.614894:0:202210:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6000/0xb126349c40f3442d lrc: 5/0,1 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f34434 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.614901:0:202210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6000/0xb126349c40f3442d lrc: 6/0,1 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f34434 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.614909:0:202210:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6000/0xb126349c40f3442d lrc: 6/0,1 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f34434 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.614982:0:202210:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d56f6000) 00000100:00100000:3.0:1787508615.615022:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc874700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:205406:x1874324480119680:12345-0@lo:105: Request processed in 169us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.615029:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18173 00000100:00100000:3.0:1787508615.615069:0:205406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc877480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001_UUID:205406:1874324480119680:0@lo:105: 00010000:00010000:3.0:1787508615.615086:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508615.615110:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2401:x1874324509533440:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 634us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.615117:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27875 00010000:00010000:1.0:1787508615.615210:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6000/0xb126349c40f3442d lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34434 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.615220:0:209004:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6000/0xb126349c40f3442d lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34434 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787508615.615494:0:209004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1:0x0].1784, 344 off1837520 00000040:00080000:1.0:1787508615.615564:0:209004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x1:0x0].1790, 552 off2042608 00000004:00080000:1.0:1787508615.615571:0:209004:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d3f11240 with version 3461 00000004:00080000:1.0:1787508615.615587:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3461 rpc_version 3461 00000020:00100000:1.0:1787508615.615613:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787508615.615623:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090cc874000 x1874324480119936/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1528/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787508615.615645:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc874000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480119936:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787508615.615689:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508615.615709:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d0a39b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.615830:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480119936 00000100:00100000:3.0:1787508615.615836:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480119936 00000100:00100000:3.0:1787508615.615915:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29725 00000100:00100000:3.0:1787508615.615924:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:202248:x1874324480119936:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787508615.616100:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:202248:x1874324480119936:12345-0@lo:1000:osp_up1-0.0 Request processed in 177us (410us total) trans 8589962016 rc 0/0 00000100:00100000:3.0:1787508615.616108:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29725 00000100:00100000:1.0:1787508615.617205:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc874000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480119936:0@lo:1000:osp_up1-0.0 00000004:00010000:0.0:1787508615.617352:0:209004:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2d72c93 reply state 0000000073d6ff3a transno 12884944083 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34426 lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.617372:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34426 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.617382:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x171:0x0].0x0 (ffff9090ccb87b00) 00010000:00010000:0.0:1787508615.617385:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787508615.617389:0:209004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787508615.617397:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6000/0xb126349c40f3442d lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34434 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.617405:0:209004:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6000/0xb126349c40f3442d lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34434 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787508615.617416:0:209004:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd2:0x169:0x0] 00000004:00010000:0.0:1787508615.617434:0:209004:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2d72c93 reply state 0000000073d6ff3a transno 12884944083 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3441f lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.617444:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3441f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x125b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.617450:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125b:0x0].0x0 (ffff9090ccb87200) 00010000:00010000:0.0:1787508615.617452:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787508615.617454:0:209004:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1787508615.617463:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125b:0x0]: returning size 4096 00000100:00100000:0.0:1787508615.617554:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d15ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336083:x1874324509532416:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 40273us (40505us total) trans 12884944083 rc 0/0 00000100:00100000:0.0:1787508615.617566:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93892 00000100:00100000:3.0:1787508615.621979:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508615.622195:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509533568 00000100:00100000:0.0:1787508615.622209:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509533568 00000100:00100000:0.0:1787508615.622279:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93893 00000100:00100000:0.0:1787508615.622289:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336082:x1874324509533568:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508615.622316:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508615.622351:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3443b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae37d expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.622441:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34442 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.622458:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34442 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.622472:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34442 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.622486:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34449 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.622494:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34449 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.622501:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34449 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.622613:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34450 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x125b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.622626:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34450 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.622634:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34450 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508615.622716:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125b:0x0]: returning size 4096 00000004:00200000:0.0:1787508615.622721:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1787508615.622742:0:203348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34450 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.622755:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34442 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.622761:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34442 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.622767:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34442 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.622773:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34442 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.623045:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508615.623050:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34442 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.623058:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34442 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.623070:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508615.623074:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508615.623078:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34442 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.623084:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34442 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.623097:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34449 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.623102:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34449 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.623107:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34449 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.623111:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508615.623113:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34449 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.623119:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34449 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.623125:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd700) 00010000:00010000:0.0:1787508615.623127:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508615.623130:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34449 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.623135:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34449 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.623163:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f3443b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae37d expref: 15 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.623188:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34450 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae37d expref: 14 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.623196:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125b:0x0].0x0 (ffff9090ccb87200) 00010000:00010000:0.0:1787508615.623198:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508615.623201:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7800, rc 0) 00000100:00100000:0.0:1787508615.623262:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336082:x1874324509533568:12345-192.168.201.30@tcp:101:rm.0 Request processed in 975us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508615.623271:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93893 00000100:00100000:1.0:1787508615.630674:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.631470:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509533824 00000100:00100000:2.0:1787508615.631483:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509533824 00000100:00100000:2.0:1787508615.631550:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93894 00000100:00100000:2.0:1787508615.631560:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336082:x1874324509533824:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1787508615.631616:0:230618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787508615.631645:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34450 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x125b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae37d expref: 14 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.631667:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125b:0x0].0x0 (ffff9090ccb87200) 00010000:00010000:2.0:1787508615.631680:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f342dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae30d expref: 13 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.631691:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.631694:0:230618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508615.631716:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34457 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.631729:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34307 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae314 expref: 585 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.631738:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34457 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.631771:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34307 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae314 expref: 585 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.631809:0:230618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34307 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae314 expref: 585 pid: 205405 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.631825:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999d180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480120064:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508615.631916:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090ca6dbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.634826:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999d180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480120064:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508615.634862:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34457 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.637594:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.637697:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509533952 00000100:00100000:2.0:1787508615.637707:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509533952 00010000:00010000:2.0:1787508615.637747:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34307 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae314 expref: 586 pid: 205405 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.637789:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27876 00000100:00100000:2.0:1787508615.637800:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc875500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:2400:x1874324509533952:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508615.637815:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508615.637822:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34307 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae314 expref: 586 pid: 205405 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.637836:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34307 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae314 expref: 586 pid: 205405 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.637858:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34307 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae314 expref: 586 pid: 205405 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.637877:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.637882:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34457 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.637897:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34457 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.637904:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34457 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.637961:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508615.638019:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc875500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:2400:x1874324509533952:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 220us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.638028:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27876 00010000:00010000:3.0:1787508615.639860:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34457 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.639875:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34457 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.639906:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3445e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.639922:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3445e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.639934:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3445e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.640120:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34465 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x125b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.640129:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34465 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x125b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.640135:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34465 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x125b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.640153:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3446c lrc: 3/0,1 mode: --/EX res: [0x2000013a0:0x171:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.640159:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3446c lrc: 3/0,1 mode: EX/EX res: [0x2000013a0:0x171:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.640165:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3446c lrc: 3/0,1 mode: EX/EX res: [0x2000013a0:0x171:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.640199:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8ea00/0xb126349c40f34473 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.640205:0:230618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8ea00/0xb126349c40f34473 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x0 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.640217:0:230618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8ea00/0xb126349c40f34473 lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508615.640238:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d9b9b480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:230618:1874324480120192:0@lo:101:mdt00_006.0 00000100:00100000:3.0:1787508615.640301:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508615.640403:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787508615.641130:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480120192 00000100:00100000:2.0:1787508615.641139:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480120192 00000100:00100000:2.0:1787508615.641209:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29726 00000100:00100000:2.0:1787508615.641219:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:230618:x1874324480120192:12345-0@lo:101:mdt00_006.0 00010000:00010000:2.0:1787508615.641245:0:203182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.641263:0:203182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f3447a lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f34473 expref: -99 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.641286:0:203182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f34434 lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3442d expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.641295:0:203182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f3447a lrc: 4/0,0 mode: --/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f34473 expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.641321:0:203182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f34434 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f3442d expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.641334:0:203182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999f800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:203182:1874324480120320:0@lo:104: 00000100:00100000:2.0:1787508615.641387:0:203182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.641417:0:203182:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090ca6db780 going to sleep for 11 seconds 00000100:00100000:1.0:1787508615.641529:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480120320 00000100:00100000:1.0:1787508615.641534:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480120320 00000100:00100000:1.0:1787508615.641573:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18174 00000100:00100000:1.0:1787508615.641581:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:203182:x1874324480120320:12345-0@lo:104: 00010000:00010000:1.0:1787508615.641592:0:202209:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6000/0xb126349c40f3442d lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f34434 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.641645:0:202209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787508615.641652:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:203182:x1874324480120320:12345-0@lo:104: Request processed in 71us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.641658:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18174 00000100:00100000:1.0:1787508615.641695:0:203182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999f800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:203182:1874324480120320:0@lo:104: 00010000:00010000:1.0:1787508615.641720:0:203182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f3447a lrc: 3/0,0 mode: --/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34473 expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.641729:0:203182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x169:0x0].0x0 (ffff9090d36fd300) 00010000:00010000:1.0:1787508615.641732:0:203182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787508615.641735:0:203182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f3447a lrc: 3/0,0 mode: --/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34473 expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.641743:0:203182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f3447a lrc: 3/0,0 mode: --/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34473 expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.641751:0:203182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab600, rc 0) 00000100:00100000:1.0:1787508615.641783:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:230618:x1874324480120192:12345-0@lo:101:mdt00_006.0 Request processed in 566us (1482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.641790:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29726 00010000:00010000:2.0:1787508615.642201:0:202214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787508615.642208:0:202214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6000/0xb126349c40f3442d lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f34434 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.642216:0:202214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6000 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:2.0:1787508615.642221:0:202214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6000/0xb126349c40f3442d lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f34434 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508615.642229:0:202214:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6000/0xb126349c40f3442d lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f34434 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.642255:0:202214:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6000/0xb126349c40f3442d lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f34434 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.642262:0:202214:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787508615.642292:0:202214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6000/0xb126349c40f3442d lrc: 1/0,0 mode: --/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f34434 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.642299:0:202214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6000/0xb126349c40f3442d lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f34434 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.642312:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508615.642314:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508615.642316:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508615.642361:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787508615.642375:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480120448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508615.642411:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.642632:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480120448 00000100:00100000:2.0:1787508615.642637:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480120448 00010000:00010000:2.0:1787508615.642657:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f34434 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f3442d expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.642695:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27877 00000100:00100000:2.0:1787508615.642703:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce62dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+8:3617:x1874324480120448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508615.642713:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787508615.643741:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d9b9b480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:230618:1874324480120192:0@lo:101:mdt00_006.0 00010000:00010000:3.0:1787508615.643765:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8ea00/0xb126349c40f34473 lrc: 4/0,1 mode: --/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3447a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.643792:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8ea00/0xb126349c40f34473 lrc: 4/0,1 mode: --/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3447a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.644356:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508615.644486:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509534080 00000100:00100000:0.0:1787508615.644494:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509534080 00000100:00100000:0.0:1787508615.644544:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93895 00000100:00100000:0.0:1787508615.644553:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:336084:x1874324509534080:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508615.644577:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508615.644595:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f34481 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae384 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.644656:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34488 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.644668:0:202226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34457 lrc: 2/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.644675:0:202226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34488 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.644691:0:202226:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34457 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.644701:0:202226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34488 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787508615.645556:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589962016 is committed 00000020:00080000:0.0:1787508615.645567:0:202955:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 4294998382 batchid updated 00000020:00080000:0.0:1787508615.645572:0:202955:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 4294998381 batchid updated 00000020:00080000:3.0:1787508615.645634:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998382 00000004:00080000:3.0:1787508615.645693:0:202975:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d01c9f00 with version 13608 00000020:00080000:3.0:1787508615.645708:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294998380 cancel update log [0x2000013a2:0x5:0x0].588: rc = 0 00000020:00080000:3.0:1787508615.645796:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294998380 cancel update log [0x240000bd1:0xf:0x0].45: rc = 0 00000004:00080000:3.0:1787508615.645820:0:202975:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d01c9300 with version 13609 00000020:00080000:3.0:1787508615.645823:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294998381 cancel update log [0x2000013a2:0x5:0x0].589: rc = 0 00000020:00080000:3.0:1787508615.645843:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294998381 cancel update log [0x240000bd1:0xf:0x0].46: rc = 0 00000004:00080000:3.0:1787508615.645863:0:202975:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d74d93c0 with version 13610 00000020:00080000:3.0:1787508615.645866:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294998382 cancel update log [0x2000013a2:0x5:0x0].590: rc = 0 00000020:00080000:3.0:1787508615.645885:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294998382 cancel update log [0x240000bd1:0xf:0x0].47: rc = 0 00000020:00080000:3.0:1787508615.645891:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998382 00010000:00010000:2.0:1787508615.646100:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f34434 lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x169:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f3442d expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.646118:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x169:0x0].0x0 (ffff9090d36fd300) 00010000:00010000:2.0:1787508615.646123:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f3447a lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34473 expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.646133:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f3447a lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f34473 expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.646141:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f3447a lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f34473 expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.646291:0:229383:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f3447a lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34473 expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.646310:0:229383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:229383:1874324480120576:0@lo:105: 00000100:00100000:2.0:1787508615.646386:0:229383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.646444:0:229383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090ca6db780 going to sleep for 11 seconds 00000004:00080000:0.0:1787508615.646604:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13608 rpc_version 13608 00000020:00100000:0.0:1787508615.646627:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787508615.646635:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090ce62fb80 x1874324480120832/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787508615.646652:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce62fb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480120832:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787508615.646688:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508615.646717:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9ff2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.646879:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480120576 00000100:00100000:3.0:1787508615.646888:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480120576 00000100:00100000:3.0:1787508615.646965:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18175 00000100:00100000:3.0:1787508615.646975:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:229383:x1874324480120576:12345-0@lo:105: 00010000:00010000:3.0:1787508615.646987:0:202210:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8ea00/0xb126349c40f34473 lrc: 5/0,1 mode: --/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3447a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.646997:0:202210:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8ea00/0xb126349c40f34473 lrc: 5/0,1 mode: --/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3447a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.647007:0:202210:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8ea00/0xb126349c40f34473 lrc: 5/0,1 mode: --/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3447a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.647015:0:202210:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8ea00/0xb126349c40f34473 lrc: 5/0,1 mode: EX/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f3447a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.647022:0:202210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8ea00/0xb126349c40f34473 lrc: 6/0,1 mode: EX/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f3447a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.647030:0:202210:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8ea00/0xb126349c40f34473 lrc: 6/0,1 mode: EX/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f3447a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.647133:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480120832 00000100:00100000:2.0:1787508615.647138:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480120832 00000100:00100000:2.0:1787508615.647169:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29727 00000100:00100000:2.0:1787508615.647187:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:202961:x1874324480120832:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508615.647334:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202961:x1874324480120832:12345-0@lo:1000:osp_up0-1.0 Request processed in 146us (644us total) trans 12884944084 rc 0/0 00000100:00100000:2.0:1787508615.647352:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29727 00000100:00100000:2.0:1787508615.647398:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce62fb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480120832:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1787508615.647410:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13609 rpc_version 13609 00000020:00100000:2.0:1787508615.647422:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787508615.647439:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090c999ea00 x1874324480121088/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787508615.647453:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999ea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480121088:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508615.647480:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.647503:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090ca6dbf00 going to sleep for 11 seconds 00010000:00010000:3.0:1787508615.647608:0:202210:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090e4c8ea00) 00000100:00100000:3.0:1787508615.647652:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:229383:x1874324480120576:12345-0@lo:105: Request processed in 679us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.647659:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18175 00000100:00100000:3.0:1787508615.647681:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480121088 00000100:00100000:3.0:1787508615.647685:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480121088 00000100:00100000:3.0:1787508615.647706:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29728 00000100:00100000:3.0:1787508615.647711:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:202961:x1874324480121088:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508615.647801:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:202961:x1874324480121088:12345-0@lo:1000:osp_up0-1.0 Request processed in 88us (320us total) trans 12884944085 rc 0/0 00000100:00100000:3.0:1787508615.647808:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29728 00000100:00100000:3.0:1787508615.647839:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999ea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480121088:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1787508615.647845:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13610 rpc_version 13610 00000020:00100000:3.0:1787508615.647856:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787508615.647860:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d9b99f80 x1874324480121344/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787508615.647872:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d9b99f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480121344:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508615.647894:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508615.647908:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9000 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.647917:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480121344 00000100:00100000:3.0:1787508615.647919:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480121344 00000100:00100000:3.0:1787508615.647937:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29729 00000100:00100000:3.0:1787508615.647970:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:202961:x1874324480121344:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508615.648034:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:202961:x1874324480121344:12345-0@lo:1000:osp_up0-1.0 Request processed in 64us (139us total) trans 12884944086 rc 0/0 00000100:00100000:3.0:1787508615.648040:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29729 00000100:00100000:3.0:1787508615.648068:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d9b99f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480121344:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508615.648738:0:229383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001_UUID:229383:1874324480120576:0@lo:105: 00010000:00010000:2.0:1787508615.648756:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508615.648802:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce62dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+6:3617:x1874324480120448:12345-0@lo:103:ldlm_bl.0 Request processed in 6101us (6391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.648810:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27877 00000100:00100000:0.0:1787508615.649306:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480120448:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508615.649591:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8ea00/0xb126349c40f34473 lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3447a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.649604:0:230618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8ea00/0xb126349c40f34473 lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3447a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.650505:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc877800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:230618:1874324480121472:0@lo:403:mdt00_006.0 00000100:00100000:1.0:1787508615.650565:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508615.650590:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d0a39000 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.650737:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480121472 00000100:00100000:3.0:1787508615.650745:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480121472 00000100:00100000:3.0:1787508615.650996:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29730 00000100:00100000:3.0:1787508615.651006:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:230618:x1874324480121472:12345-0@lo:403:mdt00_006.0 00000100:00100000:3.0:1787508615.655183:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:230618:x1874324480121472:12345-0@lo:403:mdt00_006.0 Request processed in 4159us (4598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.655198:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29730 00000100:00100000:1.0:1787508615.655471:0:230618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589962016 gen 2 00000004:00080000:1.0:1787508615.655478:0:230618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589962016 committed transno 8589962016 00000100:00100000:1.0:1787508615.655511:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc877800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:230618:1874324480121472:0@lo:403:mdt00_006.0 00000040:00080000:1.0:1787508615.657494:0:230618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1:0x0].1785, 664 off1838184 00000040:00080000:1.0:1787508615.657711:0:230618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x1:0x0].1791, 744 off2043352 00000004:00080000:1.0:1787508615.657719:0:230618:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d0a39000 with version 3462 00000004:00080000:2.0:1787508615.658850:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3462 rpc_version 3462 00000020:00100000:2.0:1787508615.658897:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787508615.658909:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090c999f800 x1874324480121728/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1448/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787508615.658934:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999f800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480121728:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787508615.659143:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.659238:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3f11240 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.659491:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480121728 00000100:00100000:3.0:1787508615.659500:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480121728 00000100:00100000:3.0:1787508615.659595:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29731 00000100:00100000:3.0:1787508615.659606:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:202248:x1874324480121728:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787508615.659895:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:202248:x1874324480121728:12345-0@lo:1000:osp_up1-0.0 Request processed in 290us (751us total) trans 8589962017 rc 0/0 00000100:00100000:3.0:1787508615.659903:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29731 00000100:00100000:2.0:1787508615.660027:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999f800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480121728:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1787508615.660374:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125b:0x0]: returning size 4096 00010000:00010000:0.0:1787508615.660399:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3446c lrc: 3/0,1 mode: EX/EX res: [0x2000013a0:0x171:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660410:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3446c lrc: 2/0,0 mode: EX/EX res: [0x2000013a0:0x171:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660417:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3446c lrc: 3/0,0 mode: EX/EX res: [0x2000013a0:0x171:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660423:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508615.660440:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3446c lrc: 3/0,0 mode: EX/EX res: [0x2000013a0:0x171:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660447:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3446c lrc: 4/0,0 mode: EX/EX res: [0x2000013a0:0x171:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660463:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x171:0x0].0x0 (ffff9090ccb87b00) 00010000:00010000:0.0:1787508615.660466:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787508615.660471:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3446c lrc: 2/0,0 mode: --/EX res: [0x2000013a0:0x171:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660477:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3446c lrc: 0/0,0 mode: --/EX res: [0x2000013a0:0x171:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660493:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8ea00/0xb126349c40f34473 lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3447a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660501:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8ea00/0xb126349c40f34473 lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f3447a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660508:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8ea00/0xb126349c40f34473 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f3447a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660537:0:230618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787508615.660547:0:230618:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd2:0x169:0x0] 00010000:00010000:0.0:1787508615.660555:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34465 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x125b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660562:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34465 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x125b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660567:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34465 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x125b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660572:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508615.660575:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34465 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x125b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660581:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34465 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x125b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660589:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125b:0x0].0x0 (ffff9090ccb87200) 00010000:00010000:0.0:1787508615.660592:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787508615.660594:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34465 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x125b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660601:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34465 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x125b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660617:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34457 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660623:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34457 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660629:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34457 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660634:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34457 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660639:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508615.660641:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34457 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660650:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34457 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660657:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508615.660659:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508615.660662:0:230618:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34488 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660670:0:230618:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34488 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660676:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34488 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660699:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34457 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660706:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34457 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508615.660718:0:230618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002334ccd5 reply state 0000000091e6d72f transno 12884944087 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3445e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660729:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3445e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660735:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd700) 00010000:00010000:0.0:1787508615.660737:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787508615.660740:0:230618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787508615.660775:0:202226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34488 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660786:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34488 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508615.660830:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787508615.660833:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508615.660849:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34488 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660878:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f34481 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae384 expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660893:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34488 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae384 expref: 586 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.660899:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508615.660901:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508615.660903:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7600, rc 0) 00000100:00100000:0.0:1787508615.660988:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509534080:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 16435us (16635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508615.660995:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93895 00000100:00100000:0.0:1787508615.661031:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336082:x1874324509533824:12345-192.168.201.30@tcp:36:rm.0 Request processed in 29473us (30369us total) trans 12884944087 rc 0/0 00000100:00100000:0.0:1787508615.661038:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93894 00010000:00010000:2.0:1787508615.661181:0:226765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787508615.661189:0:226765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8ea00/0xb126349c40f34473 lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xb126349c40f3447a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.661196:0:226765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ea00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:2.0:1787508615.661200:0:226765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8ea00/0xb126349c40f34473 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xb126349c40f3447a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508615.661207:0:226765:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8ea00/0xb126349c40f34473 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xb126349c40f3447a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.661234:0:226765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8ea00/0xb126349c40f34473 lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f3447a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.661240:0:226765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787508615.661267:0:226765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8ea00/0xb126349c40f34473 lrc: 1/0,0 mode: --/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f3447a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.661274:0:226765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8ea00/0xb126349c40f34473 lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f3447a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.661290:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508615.661291:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508615.661293:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508615.661437:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480121856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508615.661488:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.661573:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480121856 00000100:00100000:2.0:1787508615.661581:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480121856 00000100:00100000:2.0:1787508615.661635:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9788 00000100:00100000:2.0:1787508615.661643:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+7:3617:x1874324480121856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508615.661653:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508615.661670:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab600/0xb126349c40f3447a lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x169:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f34473 expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.661683:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x169:0x0].0x0 (ffff9090d36fd300) 00010000:00010000:2.0:1787508615.661690:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508615.661724:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1874324480121856:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.661731:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9788 00000100:00100000:2.0:1787508615.661764:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480121856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787508615.672368:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.672760:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509534208 00000100:00100000:1.0:1787508615.672772:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509534208 00000100:00100000:1.0:1787508615.672853:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93896 00000100:00100000:1.0:1787508615.672864:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509534208:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508615.672885:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.672909:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3448f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae38b expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.673004:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f34496 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.673020:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f34496 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.673032:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f34496 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.673048:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3449d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.673055:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3449d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.673061:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3449d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.673119:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f34496 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.673127:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f34496 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.673134:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f34496 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.673141:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f34496 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.673146:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.673151:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f34496 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.673157:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f34496 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.673240:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.673245:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.673251:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f34496 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.673257:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f34496 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.673273:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3449d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.673279:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3449d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.673285:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3449d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.673291:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247bc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.673294:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3449d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.673299:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3449d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.673307:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090d171fa00) 00010000:00010000:1.0:1787508615.673309:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.673311:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3449d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.673317:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3449d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.673421:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3448f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae38b expref: 587 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.673441:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.673443:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508615.673447:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3448f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae38b expref: 587 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.673457:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b200, rc 0) 00000100:00100000:1.0:1787508615.673600:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509534208:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 736us (1242us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508615.673607:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93896 00000100:00100000:0.0:1787508615.676524:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.678707:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509534336 00000100:00100000:1.0:1787508615.678722:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509534336 00000100:00100000:1.0:1787508615.678884:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93897 00000100:00100000:1.0:1787508615.678896:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336085:x1874324509534336:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508615.678921:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.678973:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f344a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae392 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.679039:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f344ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.679054:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f344ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.679064:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f344ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508615.679111:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508615.679115:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508615.679135:0:203348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f344ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.679158:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f344a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae392 expref: 16 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.679175:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f344ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae392 expref: 15 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.679197:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.679200:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508615.679204:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b800, rc 0) 00000100:00100000:1.0:1787508615.679267:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336085:x1874324509534336:12345-192.168.201.30@tcp:101:rm.0 Request processed in 373us (2752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.679273:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93897 00000100:00100000:0.0:1787508615.679724:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508615.682760:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.682881:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509534464 00000100:00100000:2.0:1787508615.682891:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509534464 00000100:00100000:2.0:1787508615.682972:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93898 00000100:00100000:2.0:1787508615.682982:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509534464:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508615.683004:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.683024:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f344b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae399 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.683085:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f344b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.683099:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f344b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.683109:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f344b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.683122:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f344c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.683132:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f344c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.683137:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f344c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.683259:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f344b9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.683268:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f344b9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.683275:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f344b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.683282:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f344b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.683288:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.683293:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f344b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.683300:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f344b9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.683312:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.683315:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.683319:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f344b9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.683326:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f344b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.683412:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f344c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.683420:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f344c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.683435:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f344c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.683441:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.683444:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f344c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.683450:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f344c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.683458:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090d36fdb00) 00010000:00010000:2.0:1787508615.683461:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.683463:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f344c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.683469:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f344c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.683504:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f344b2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae399 expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.683513:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.683516:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508615.683519:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f344b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae399 expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.683529:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aba00, rc 0) 00000100:00100000:2.0:1787508615.683592:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509534464:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 611us (3869us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508615.683600:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93898 00000100:00100000:1.0:1787508615.686353:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509534592 00000100:00100000:1.0:1787508615.686368:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509534592 00000100:00100000:1.0:1787508615.686439:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93899 00000100:00100000:1.0:1787508615.686450:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336085:x1874324509534592:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508615.686471:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.686491:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f344c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae3a0 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.686556:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f344ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.686571:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f344ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.686582:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f344ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.686597:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f344d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.686605:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f344d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.686612:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f344d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.686663:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f344ce lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.686671:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f344ce lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.686677:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f344ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.686683:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f344ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.686689:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.686693:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f344ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.686701:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f344ce lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.686712:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.686715:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.686719:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f344ce lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.686726:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f344ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.686740:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f344d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.686746:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f344d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.686752:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f344d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.686757:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.686760:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f344d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.686766:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f344d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.686773:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090d171f700) 00010000:00010000:1.0:1787508615.686775:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.687137:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f344d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.687144:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f344d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.687257:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f344c7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae3a0 expref: 16 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.687269:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.687272:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508615.687275:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f344c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae3a0 expref: 16 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.687286:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ac00, rc 0) 00000100:00100000:1.0:1787508615.687446:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336085:x1874324509534592:12345-192.168.201.30@tcp:101:rm.0 Request processed in 996us (4693us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508615.687454:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93899 00000100:00100000:2.0:1787508615.687932:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.688142:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509534720 00000100:00100000:1.0:1787508615.688150:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509534720 00000100:00100000:1.0:1787508615.688200:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93900 00000100:00100000:1.0:1787508615.688209:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509534720:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508615.688224:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.688237:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f344dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae3a7 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.688285:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f344e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.688296:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f344e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.688306:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f344e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.688319:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f344ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.688326:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f344ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.688333:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f344ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.688386:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f344e3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.688393:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f344e3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.688398:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f344e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.688405:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f344e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.688410:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.688414:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f344e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.688421:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f344e3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.688441:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.688444:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.688448:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f344e3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.688454:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f344e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.688464:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f344ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.688469:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f344ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.688474:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f344ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.688479:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.688482:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f344ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.688491:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f344ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.688498:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090d171f600) 00010000:00010000:1.0:1787508615.688500:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.688503:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f344ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.688509:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f344ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.688533:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f344dc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae3a7 expref: 587 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.688542:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.688544:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508615.688547:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f344dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae3a7 expref: 587 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.688555:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a400, rc 0) 00000100:00100000:1.0:1787508615.688601:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509534720:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 392us (670us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508615.688608:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93900 00000100:00100000:0.0:1787508615.693608:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.695127:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.695924:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509534848 00000100:00100000:1.0:1787508615.695958:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509534848 00000100:00100000:0.0:1787508615.696033:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509535104 00000100:00100000:0.0:1787508615.696037:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509535104 00000100:00100000:0.0:1787508615.696077:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93901 00000100:00100000:0.0:1787508615.696087:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336085:x1874324509534848:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508615.696109:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508615.696132:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f344f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae3ae expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696209:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f344f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696223:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f344f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696234:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f344f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696250:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f344ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696257:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f344ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696263:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f344ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696319:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f344f8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696331:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f344f8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696349:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f344f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696355:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f344f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696360:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508615.696365:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f344f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696372:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f344f8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696384:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508615.696387:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508615.696391:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f344f8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696397:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f344f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696407:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f344ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696412:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f344ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696417:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f344ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696422:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508615.696435:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f344ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696442:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f344ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696449:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090c6913a00) 00010000:00010000:0.0:1787508615.696451:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508615.696454:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f344ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696459:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f344ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696490:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f344f1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae3ae expref: 16 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696499:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508615.696502:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508615.696505:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f344f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae3ae expref: 16 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696514:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7a00, rc 0) 00000100:00100000:0.0:1787508615.696586:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336085:x1874324509534848:12345-192.168.201.30@tcp:101:rm.0 Request processed in 500us (2987us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508615.696594:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93901 00000100:00100000:0.0:1787508615.696613:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93902 00000100:00100000:0.0:1787508615.696620:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509535104:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508615.696629:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508615.696638:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34506 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae3b5 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696679:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3450d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696688:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3450d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696695:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3450d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696707:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34514 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696712:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34514 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696718:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34514 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696743:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3450d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696750:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3450d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696755:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3450d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696764:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3450d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.696768:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508615.696771:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3450d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.698217:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3450d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.698244:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508615.698247:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508615.698252:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3450d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.698258:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3450d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.698274:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34514 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.698280:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34514 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.698286:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34514 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.698291:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508615.698295:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34514 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.698305:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34514 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.698311:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xce5b6a33 (ffff9090c6913600) 00010000:00010000:0.0:1787508615.698313:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508615.698316:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34514 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.698321:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34514 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.698376:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34506 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae3b5 expref: 587 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.698386:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508615.698388:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508615.698391:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34506 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae3b5 expref: 587 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.698399:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6000, rc 0) 00000100:00100000:0.0:1787508615.698540:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509535104:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1919us (3419us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508615.698549:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93902 00000100:00100000:2.0:1787508615.706126:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.706170:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.706247:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509535488 00000100:00100000:1.0:1787508615.706258:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509535488 00000100:00100000:1.0:1787508615.706312:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509535360 00000100:00100000:1.0:1787508615.706316:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509535360 00000100:00100000:1.0:1787508615.706359:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93903 00000100:00100000:1.0:1787508615.706369:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336085:x1874324509535488:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508615.706389:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.706410:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3451b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae3c3 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.706493:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34522 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.706507:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34522 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.706519:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34522 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.706533:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34529 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.706540:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34529 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.706546:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34529 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.706604:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34522 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.706611:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34522 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.706617:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34522 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.706625:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34522 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.706631:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.706635:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34522 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.706643:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34522 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.706656:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.706659:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.706663:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34522 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.706669:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34522 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.706681:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34529 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.706686:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34529 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.706692:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34529 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.706697:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.706700:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34529 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.706710:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34529 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.706718:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090d171f600) 00010000:00010000:1.0:1787508615.706720:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.706722:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34529 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.706728:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34529 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.706757:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3451b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae3c3 expref: 16 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.706767:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.706770:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508615.706773:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3451b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae3c3 expref: 16 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508615.706919:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93904 00000100:00100000:0.0:1787508615.706931:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509535360:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508615.706978:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508615.706988:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34530 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae3bc expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.707036:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34537 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.707045:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34537 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.707053:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34537 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.707066:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3453e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.707071:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3453e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.707077:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3453e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.707108:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34537 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.707114:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34537 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.707119:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34537 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.707124:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34537 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.707128:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508615.707131:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34537 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.707136:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34537 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.707145:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508615.707147:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508615.707150:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34537 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.707155:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34537 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.707163:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3453e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.707168:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3453e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.707173:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3453e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.707177:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508615.707179:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3453e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.707184:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3453e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.707190:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaf7dd568 (ffff9090c6913600) 00010000:00010000:0.0:1787508615.707192:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508615.707195:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3453e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.707201:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3453e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.707224:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34530 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae3bc expref: 587 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.707232:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508615.707234:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508615.707238:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34530 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae3bc expref: 587 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.707246:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6000, rc 0) 00000100:00100000:0.0:1787508615.707306:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509535360:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 379us (1134us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508615.707313:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93904 00010000:00010000:1.0:1787508615.707401:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a400, rc 0) 00000100:00100000:1.0:1787508615.707436:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336085:x1874324509535488:12345-192.168.201.30@tcp:101:rm.0 Request processed in 1058us (1649us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508615.707442:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93903 00000100:00100000:3.0:1787508615.713163:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.713214:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.713306:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509535744 00000100:00100000:1.0:1787508615.713318:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509535744 00000100:00100000:1.0:1787508615.713384:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509536000 00000100:00100000:1.0:1787508615.713390:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509536000 00000100:00100000:1.0:1787508615.713433:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93905 00000100:00100000:1.0:1787508615.713444:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336085:x1874324509535744:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508615.713468:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.713490:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f34545 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae3ca expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.713574:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3454c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.713588:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3454c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.713600:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3454c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.713615:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34553 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.713623:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34553 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.713629:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34553 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.713683:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3454c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.713690:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3454c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.713696:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3454c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.713706:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3454c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.713712:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.713717:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3454c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.713724:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3454c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.713736:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.713739:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.713744:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3454c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.713750:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3454c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.713763:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34553 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.713768:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34553 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.713774:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34553 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.713778:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.713781:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34553 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.713790:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34553 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.713797:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090d171f700) 00010000:00010000:1.0:1787508615.713799:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.713801:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34553 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.713807:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34553 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.713839:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f34545 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae3ca expref: 16 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.713849:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.713851:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508615.713855:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f34545 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae3ca expref: 16 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.713864:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ac00, rc 0) 00000100:00100000:3.0:1787508615.713969:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93906 00000100:00100000:3.0:1787508615.713979:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9b98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509536000:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508615.713988:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.713996:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f3455a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae3d1 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.714029:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34561 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.714037:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34561 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.714045:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34561 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.714057:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34568 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.714064:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34568 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.714070:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34568 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.714101:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34561 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.714108:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34561 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.714113:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34561 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.714119:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34561 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.714125:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ea00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.714127:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34561 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.714133:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34561 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.714141:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.714144:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.714147:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34561 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.714153:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34561 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.714164:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34568 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.714170:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34568 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.714177:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34568 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.714182:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.714185:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34568 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.714191:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34568 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.714197:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3e9f33b0 (ffff9090ccb87400) 00010000:00010000:3.0:1787508615.714200:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.714202:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34568 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.714208:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34568 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.714230:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f3455a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae3d1 expref: 587 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.714238:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.714240:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508615.714244:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f3455a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae3d1 expref: 587 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.714252:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f000, rc 0) 00000100:00100000:1.0:1787508615.715186:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336085:x1874324509535744:12345-192.168.201.30@tcp:101:rm.0 Request processed in 1729us (2021us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508615.715196:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93905 00000100:00100000:3.0:1787508615.715312:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9b98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509536000:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1334us (2097us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508615.715319:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93906 00000100:00100000:3.0:1787508615.724580:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.724664:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.725075:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509536128 00000100:00100000:1.0:1787508615.725086:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509536128 00000100:00100000:2.0:1787508615.725301:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509536384 00000100:00100000:2.0:1787508615.725306:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509536384 00000100:00100000:2.0:1787508615.725349:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93907 00000100:00100000:2.0:1787508615.725360:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336085:x1874324509536128:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508615.725380:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.725399:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f3456f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae3d8 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.725472:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34576 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.725488:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34576 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.725499:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34576 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.725511:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3457d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.725519:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3457d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.725526:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3457d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.725581:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34576 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.725588:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34576 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.725594:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34576 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.725600:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34576 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.725605:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.725609:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34576 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.725617:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34576 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.725629:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.725632:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.725637:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34576 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.725643:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34576 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.725656:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3457d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.725662:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3457d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.725668:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3457d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.725673:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.725675:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3457d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.725680:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3457d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.725686:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd700) 00010000:00010000:2.0:1787508615.725689:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.725691:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3457d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.725696:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3457d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.725720:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f3456f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae3d8 expref: 16 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.725731:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.725733:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.725737:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f3456f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae3d8 expref: 16 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.725745:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab400, rc 0) 00000100:00100000:2.0:1787508615.726037:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:336085:x1874324509536128:12345-192.168.201.30@tcp:101:rm.0 Request processed in 677us (1465us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508615.726044:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93907 00000100:00100000:2.0:1787508615.726069:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93908 00000100:00100000:2.0:1787508615.726077:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509536384:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508615.726087:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.726100:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34584 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae3df expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.726145:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3458b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.726155:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3458b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.726163:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3458b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.726253:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34592 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.726262:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34592 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.726270:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34592 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.726303:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3458b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.726310:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3458b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.726315:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3458b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.726321:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3458b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.726325:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.726328:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3458b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.726335:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3458b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.726343:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.726346:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.726349:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3458b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.726355:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3458b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.726364:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34592 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.726371:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34592 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.726378:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34592 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.726383:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.726385:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34592 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.726391:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34592 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.726399:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ad43c78 (ffff9090d36fdb00) 00010000:00010000:2.0:1787508615.726401:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.726404:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34592 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.726410:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34592 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.726448:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34584 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae3df expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.726457:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.726460:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508615.726463:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34584 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae3df expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.726472:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab800, rc 0) 00000100:00100000:2.0:1787508615.726499:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509536384:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 424us (1835us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508615.726510:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93908 00000100:00100000:2.0:1787508615.736544:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508615.736758:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509536640 00000100:00100000:0.0:1787508615.736768:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509536640 00000100:00100000:0.0:1787508615.736842:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93909 00000100:00100000:0.0:1787508615.736853:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509536640:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508615.736874:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508615.736896:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34599 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae3e6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.737026:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f345a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.737046:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f345a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.737058:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f345a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.737073:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f345a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.737080:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f345a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.737087:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f345a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.737154:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f345a0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.737161:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f345a0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.737182:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f345a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.737190:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f345a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.737196:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508615.737201:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f345a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.737208:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f345a0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.737221:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508615.737224:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508615.737229:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f345a0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.737236:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f345a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.737251:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f345a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.737257:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f345a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.737263:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f345a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.737278:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508615.737281:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f345a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.737288:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f345a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.737295:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbfff8436 (ffff9090c6913600) 00010000:00010000:0.0:1787508615.737297:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508615.737300:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f345a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.737306:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f345a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.737346:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34599 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae3e6 expref: 587 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.737357:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508615.737359:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508615.737362:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34599 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae3e6 expref: 587 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.737372:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6000, rc 0) 00000100:00100000:0.0:1787508615.737450:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509536640:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 598us (917us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508615.737457:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93909 00010000:00010000:3.0:1787508615.738258:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508615.744831:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.745030:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509536896 00000100:00100000:3.0:1787508615.745043:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509536896 00000100:00100000:3.0:1787508615.745157:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93910 00000100:00100000:3.0:1787508615.745170:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509536896:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508615.745193:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.745214:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f345ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae3ed expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.745297:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f345b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.745312:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f345b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.745323:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f345b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.745339:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f345bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.745350:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f345bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.745356:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f345bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.745415:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f345b5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.745432:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f345b5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.745438:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f345b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.745444:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f345b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.745449:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.745453:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f345b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.745460:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f345b5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.745472:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.745475:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.745480:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f345b5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.745487:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f345b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.745501:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f345bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.745508:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f345bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.745513:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f345bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.745519:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ea00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.745521:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f345bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.745528:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f345bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.745535:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x594a0ca2 (ffff9090ccb87400) 00010000:00010000:3.0:1787508615.745538:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.745540:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f345bc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.745546:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f345bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.745580:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f345ae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae3ed expref: 587 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.745591:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.745593:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508615.745598:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f345ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae3ed expref: 587 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.745608:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f000, rc 0) 00000100:00100000:3.0:1787508615.745684:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509536896:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 515us (862us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508615.745691:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93910 00000100:00100000:3.0:1787508615.750550:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.750619:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509537152 00000100:00100000:1.0:1787508615.750630:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509537152 00000100:00100000:1.0:1787508615.750695:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93911 00000100:00100000:1.0:1787508615.750704:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9b9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509537152:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508615.750725:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.750747:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f345c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae3f4 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.750891:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f345ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.750908:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f345ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.750920:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f345ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.750935:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f345d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.750964:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f345d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.750972:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f345d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.751033:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f345ca lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.751041:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f345ca lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.751048:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f345ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.751059:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f345ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.751066:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.751070:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f345ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.751078:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f345ca lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.751090:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.751094:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.751098:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f345ca lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.751105:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f345ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.751118:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f345d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.751124:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f345d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.751130:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f345d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.751135:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.751137:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f345d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.751147:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f345d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.751155:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe67841 (ffff9090d171f700) 00010000:00010000:1.0:1787508615.751157:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.751170:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f345d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.751183:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f345d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.751219:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f345c3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae3f4 expref: 587 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.751230:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.751232:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508615.751236:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f345c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae3f4 expref: 587 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.751245:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ac00, rc 0) 00000100:00100000:1.0:1787508615.751318:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9b9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509537152:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 614us (778us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508615.751325:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93911 00000100:00100000:0.0:1787508615.757286:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.757589:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509537408 00000100:00100000:2.0:1787508615.757600:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509537408 00000100:00100000:2.0:1787508615.757668:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93912 00000100:00100000:2.0:1787508615.757679:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509537408:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508615.757701:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.757722:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f345d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae3fb expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.757800:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f345df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.757815:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f345df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.757826:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f345df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.757841:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f345e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.757849:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f345e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.757856:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f345e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.757913:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f345df lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.757922:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f345df lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.757929:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f345df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.757936:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f345df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.757984:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.757990:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f345df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.757997:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f345df lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.758011:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.758014:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.758018:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f345df lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.758025:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f345df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.758040:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f345e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.758047:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f345e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.758054:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f345e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.758060:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.758063:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f345e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.758069:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f345e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.758077:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090d36fdb00) 00010000:00010000:2.0:1787508615.758080:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.758082:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f345e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.758088:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f345e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.758124:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f345d8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae3fb expref: 587 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.758134:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.758136:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508615.758140:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f345d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae3fb expref: 587 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.758150:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab800, rc 0) 00000100:00100000:2.0:1787508615.758206:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509537408:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 529us (931us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508615.758684:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93912 00000100:00100000:0.0:1787508615.775773:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.775889:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509537664 00000100:00100000:1.0:1787508615.775900:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509537664 00000100:00100000:1.0:1787508615.776008:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93913 00000100:00100000:1.0:1787508615.776020:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509537664:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508615.776045:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.776065:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f345ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae402 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.776137:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f345f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.776151:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f345f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.776162:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f345f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.776175:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f345fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.776182:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f345fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.776188:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f345fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.776254:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f345f4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.776261:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f345f4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.776267:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f345f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.776274:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f345f4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.776280:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.776285:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f345f4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.776292:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f345f4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.776304:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.776307:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.776311:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f345f4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.776317:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f345f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.776332:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f345fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.776349:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f345fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.776354:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f345fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.776359:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.776362:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f345fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.776367:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f345fb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.776378:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x90ba0166 (ffff9090d171f700) 00010000:00010000:1.0:1787508615.776380:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.776382:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f345fb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.776388:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f345fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.776417:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f345ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae402 expref: 587 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.776437:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.776439:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508615.776443:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f345ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae402 expref: 587 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.776452:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ac00, rc 0) 00000100:00100000:1.0:1787508615.776505:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509537664:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 489us (745us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508615.776513:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93913 00000100:00100000:3.0:1787508615.795022:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508615.795116:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509537920 00000100:00100000:0.0:1787508615.795128:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509537920 00000100:00100000:0.0:1787508615.795200:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93914 00000100:00100000:0.0:1787508615.795218:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509537920:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508615.795239:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508615.795260:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34602 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae409 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.795347:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34609 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.795362:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34609 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.795374:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34609 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.795390:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34610 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.795396:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34610 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.795403:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34610 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.795471:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34609 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.795478:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34609 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.795483:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34609 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.795490:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34609 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.795496:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508615.795501:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34609 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.795508:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34609 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.795521:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508615.795524:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508615.795529:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34609 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.795535:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34609 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.795548:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34610 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.795553:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34610 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.795558:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34610 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.795563:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508615.795566:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34610 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.795572:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34610 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.795578:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaf3dc4c9 (ffff9090c6913600) 00010000:00010000:0.0:1787508615.795581:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508615.795583:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34610 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.795590:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34610 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.795620:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34602 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae409 expref: 587 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.795630:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508615.795632:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508615.795636:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34602 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae409 expref: 587 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.795645:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6200, rc 0) 00000100:00100000:0.0:1787508615.795711:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509537920:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 502us (699us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508615.795718:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93914 00000100:00100000:0.0:1787508615.814672:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.814796:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509538048 00000100:00100000:1.0:1787508615.814807:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509538048 00000100:00100000:1.0:1787508615.814873:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93915 00000100:00100000:1.0:1787508615.814885:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509538048:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508615.814906:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.814929:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f34617 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae410 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.815036:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3461e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.815052:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3461e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.815063:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3461e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.815075:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34625 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.815083:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34625 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.815089:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34625 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.815153:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3461e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.815161:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3461e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.815167:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3461e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.815173:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3461e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.815178:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.815183:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3461e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.815190:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3461e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.815203:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.815206:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.815834:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3461e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.815844:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3461e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.815861:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34625 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.815868:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34625 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.815874:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34625 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.815880:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.815883:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34625 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.815889:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34625 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.815900:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd700) 00010000:00010000:1.0:1787508615.815903:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.815907:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34625 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.815913:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34625 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.815993:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f34617 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae410 expref: 587 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.816004:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.816007:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.816010:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f34617 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae410 expref: 587 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.816019:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ac00, rc 0) 00000100:00100000:1.0:1787508615.816095:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336084:x1874324509538048:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1211us (1433us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508615.816103:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93915 00000100:00100000:2.0:1787508615.832901:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.833076:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509538304 00000100:00100000:1.0:1787508615.833088:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509538304 00000100:00100000:1.0:1787508615.833166:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93916 00000100:00100000:1.0:1787508615.833177:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:336084:x1874324509538304:12345-192.168.201.30@tcp:36:lfs.0 00000100:00100000:1.0:1787508615.833297:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc874000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480121984:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787508615.833365:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508615.833405:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d0a399c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.833541:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480121984 00000100:00100000:3.0:1787508615.833548:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480121984 00000100:00100000:3.0:1787508615.833589:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29732 00000100:00100000:3.0:1787508615.833596:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:205405:x1874324480121984:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508615.833688:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:205405:x1874324480121984:12345-0@lo:1000:mdt00_004.0 Request processed in 92us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.833696:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29732 00000100:00100000:2.0:1787508615.833884:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc874000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480121984:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508615.833929:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480122112:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508615.833988:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.834003:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3f11300 going to sleep for 11 seconds 00000100:00100000:0.0:1787508615.834053:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480122112 00000100:00100000:0.0:1787508615.834057:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480122112 00000100:00100000:0.0:1787508615.834090:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29733 00000100:00100000:0.0:1787508615.834098:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:205405:x1874324480122112:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508615.834188:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:205405:x1874324480122112:12345-0@lo:1000:mdt00_004.0 Request processed in 92us (199us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787508615.834196:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29733 00000100:00100000:2.0:1787508615.834290:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480122112:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1787508615.834347:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aba00/0xb126349c40f3462c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.834359:0:205405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aba00/0xb126349c40f3462c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.834369:0:205405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aba00/0xb126349c40f3462c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.834380:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480122240:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1787508615.834401:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.834433:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cf7080c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.834544:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480122240 00000100:00100000:3.0:1787508615.834549:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480122240 00000100:00100000:3.0:1787508615.834581:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29734 00000100:00100000:3.0:1787508615.834587:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:205405:x1874324480122240:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1787508615.834597:0:202232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.834611:0:202232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34633 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f3462c expref: -99 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.834633:0:202232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34488 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae384 expref: 585 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.834643:0:202232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f344ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae392 expref: 14 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.834651:0:202232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34633 lrc: 5/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f3462c expref: 11 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.834681:0:202232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f344ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae392 expref: 14 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.834696:0:202232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f344ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae392 expref: 14 pid: 203348 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508615.834707:0:202232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb39180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:202232:1874324480122368:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508615.834798:0:202232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34488 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae384 expref: 585 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.834807:0:202232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34488 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae384 expref: 585 pid: 202226 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508615.834815:0:202232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb3a680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:202232:1874324480122496:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508615.834838:0:202232:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9180 going to sleep for 11 seconds 00000100:00100000:1.0:1787508615.840910:0:202232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb39180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:202232:1874324480122368:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508615.840925:0:202232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb3a680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:202232:1874324480122496:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508615.841005:0:202232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34633 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3462c expref: 11 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.841018:0:202232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.841021:0:202232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.841025:0:202232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34633 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3462c expref: 11 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.841037:0:202232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f000, rc 0) 00000100:00100000:1.0:1787508615.841104:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:205405:x1874324480122240:12345-0@lo:101:mdt00_004.0 Request processed in 6515us (6699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.841113:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29734 00000100:00100000:2.0:1787508615.841304:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480122240:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1787508615.841323:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aba00/0xb126349c40f3462c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34633 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.841334:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aba00/0xb126349c40f3462c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34633 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508615.841444:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.841519:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.842230:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.842338:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509538432 00000100:00100000:2.0:1787508615.842347:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509538432 00010000:00010000:2.0:1787508615.842382:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f344ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae392 expref: 15 pid: 203348 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508615.842457:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509538688 00000100:00100000:0.0:1787508615.842462:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509538688 00000100:00100000:0.0:1787508615.842507:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93917 00000100:00100000:0.0:1787508615.842516:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:336091:x1874324509538688:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508615.842532:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508615.842551:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f3463a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae417 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.842616:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34641 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.842629:0:202226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34633 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3462c expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.842637:0:202226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34641 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.842675:0:202226:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34633 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xb126349c40f3462c expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.842685:0:202226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34641 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.843036:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509538560 00000100:00100000:1.0:1787508615.843042:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509538560 00010000:00010000:1.0:1787508615.843064:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34488 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae384 expref: 586 pid: 202226 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.843137:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27878 00000100:00100000:1.0:1787508615.843146:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:2401:x1874324509538432:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508615.843157:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508615.843164:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f344ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae392 expref: 17 pid: 203348 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.843177:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f344ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae392 expref: 17 pid: 203348 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.843194:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f344ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae392 expref: 17 pid: 203348 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.843208:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.843212:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34641 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.843221:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34633 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xb126349c40f3462c expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.843228:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34641 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.843234:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508615.843301:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:2401:x1874324509538432:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 157us (2537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.843308:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27878 00000100:00100000:1.0:1787508615.843326:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27879 00000100:00100000:1.0:1787508615.843332:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:2401:x1874324509538560:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508615.843340:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508615.843345:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34488 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae384 expref: 586 pid: 202226 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.843355:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34488 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae384 expref: 586 pid: 202226 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.843368:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34488 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae384 expref: 586 pid: 202226 timeout: 13686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.843383:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.843387:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34641 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.843394:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34633 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xb126349c40f3462c expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.843402:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34633 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xb126349c40f3462c expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.843409:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34633 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60080000000020 nid: 0@lo remote: 0xb126349c40f3462c expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.843417:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34641 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.843433:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34641 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.843455:0:202213:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34633 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xb126349c40f3462c expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.843470:0:202213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc876a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:202213:1874324480122752:0@lo:105: 00000100:00100000:1.0:1787508615.843516:0:202213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508615.843555:0:202213:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d0a39a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787508615.843574:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480122752 00000100:00100000:1.0:1787508615.843578:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480122752 00000100:00100000:1.0:1787508615.843609:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18176 00000100:00100000:1.0:1787508615.843617:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc877b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:202213:x1874324480122752:12345-0@lo:105: 00010000:00010000:1.0:1787508615.843627:0:202209:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aba00/0xb126349c40f3462c lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34633 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.843635:0:202209:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aba00/0xb126349c40f3462c lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34633 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.843643:0:202209:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aba00/0xb126349c40f3462c lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34633 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.843651:0:202209:0:(ldlm_lockd.c:2058:ldlm_handle_cp_callback()) ### completion AST includes blocking AST ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aba00/0xb126349c40f3462c lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xb126349c40f34633 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.843658:0:202209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aba00/0xb126349c40f3462c lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xb126349c40f34633 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.843664:0:202209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aba00/0xb126349c40f3462c lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11480400000000 nid: local remote: 0xb126349c40f34633 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.843671:0:202209:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aba00/0xb126349c40f3462c lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1480400000000 nid: local remote: 0xb126349c40f34633 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.843690:0:202209:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090cd2aba00) 00000100:00100000:1.0:1787508615.843721:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc877b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:202213:x1874324480122752:12345-0@lo:105: Request processed in 104us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.843726:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18176 00000100:00100000:1.0:1787508615.843762:0:202213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc876a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:202213:1874324480122752:0@lo:105: 00010000:00010000:1.0:1787508615.843774:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508615.844690:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:2401:x1874324509538560:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1351us (3164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.844703:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27879 00010000:00010000:1.0:1787508615.844760:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aba00/0xb126349c40f3462c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f34633 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.844770:0:205405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aba00/0xb126349c40f3462c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f34633 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787508615.844895:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787508615.844932:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34648 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.844957:0:205405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34648 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.844968:0:205405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34648 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.844986:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc876a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480122880:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1787508615.845025:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508615.845050:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d0a39a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787508615.845100:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480122880 00000100:00100000:1.0:1787508615.845106:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480122880 00000100:00100000:1.0:1787508615.845143:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29735 00000100:00100000:1.0:1787508615.845150:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:205405:x1874324480122880:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1787508615.845163:0:202231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.845177:0:202231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3464f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f34648 expref: -99 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.845202:0:202231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f342cf lrc: 2/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.845209:0:202231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3445e lrc: 2/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.845218:0:202231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3464f lrc: 5/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f34648 expref: 12 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.845232:0:202231:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3445e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:1.0:1787508615.845260:0:202231:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:1.0:1787508615.845303:0:202231:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f342cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:1.0:1787508615.845316:0:202231:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:1.0:1787508615.845329:0:202231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3464f lrc: 3/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34648 expref: 12 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.845338:0:202231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd700) 00010000:00010000:1.0:1787508615.845341:0:202231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.845344:0:202231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3464f lrc: 3/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34648 expref: 12 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.845352:0:202231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a200, rc 0) 00000100:00100000:1.0:1787508615.845382:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:205405:x1874324480122880:12345-0@lo:101:mdt00_004.0 Request processed in 233us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.845390:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29735 00000100:00100000:1.0:1787508615.845728:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc876a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480122880:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1787508615.845743:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34648 lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3464f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.845751:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34648 lrc: 4/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3464f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787508615.847530:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944087 is committed 00000001:00080000:1.0:1787508615.847546:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944086 is committed 00000001:00080000:1.0:1787508615.847563:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944083 is committed 00000020:00080000:1.0:1787508615.847567:0:202206:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9090d3f11780 refcount 2 committed 0 result 0 batchid 8589961988 00000020:00080000:1.0:1787508615.847572:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521b00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d3f11240 00000020:00080000:1.0:1787508615.847575:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd2:0x1:0x0].1790 00000020:00080000:1.0:1787508615.847578:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090cdbf8800 00000020:00080000:1.0:1787508615.847581:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1:0x0].1784 00000020:00080000:1.0:1787508615.847591:0:202206:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8589961986 batchid updated 00000020:00080000:1.0:1787508615.847599:0:202206:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9090d22c8300 refcount 2 committed 0 result 0 batchid 8589961987 00000020:00080000:1.0:1787508615.847602:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cbc97500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d22c8e40 00000020:00080000:1.0:1787508615.847605:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd2:0x1:0x0].1789 00000020:00080000:1.0:1787508615.847607:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cbc97d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090d7421e00 00000020:00080000:1.0:1787508615.847610:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1:0x0].1783 00000020:00080000:1.0:1787508615.847622:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589961988 committed batchid 8589961986 00000004:00080000:1.0:1787508615.847731:0:202262:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d0a39a80 with version 3463 00000020:00080000:1.0:1787508615.847741:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589961986 cancel update log [0x240000bd2:0x1:0x0].1788: rc = 0 00000020:00080000:1.0:1787508615.847785:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589961986 cancel update log [0x2000013a0:0x1:0x0].1781: rc = 0 00000020:00080000:1.0:1787508615.847792:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961986 00000004:00080000:1.0:1787508615.847812:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3463 rpc_version 3463 00000020:00100000:1.0:1787508615.847842:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787508615.847853:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090cc874000 x1874324480123136/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787508615.847876:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc874000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480123136:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787508615.847965:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508615.847993:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d0a39480 going to sleep for 11 seconds 00000100:00100000:1.0:1787508615.848013:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480123136 00000100:00100000:1.0:1787508615.848020:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480123136 00000100:00100000:1.0:1787508615.848063:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29736 00000100:00100000:1.0:1787508615.848072:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed03d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:202248:x1874324480123136:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787508615.848204:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed03d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:202248:x1874324480123136:12345-0@lo:1000:osp_up1-0.0 Request processed in 133us (239us total) trans 8589962018 rc 0/0 00000100:00100000:1.0:1787508615.848213:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29736 00010000:00010000:3.0:1787508615.848501:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f342cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848512:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f342cf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848520:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f342cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848525:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.848530:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f342cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848537:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f342cf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848552:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd700) 00010000:00010000:3.0:1787508615.848554:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.848559:0:3603:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3464f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34648 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848569:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f342cf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848575:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f342cf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848589:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f342e4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x125b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848595:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f342e4 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x125b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848600:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f342e4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x125b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848609:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.848612:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f342e4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x125b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848617:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f342e4 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x125b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848624:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125b:0x0].0x0 (ffff9090ccb87200) 00010000:00010000:3.0:1787508615.848626:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.848629:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f342e4 lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x125b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848634:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f342e4 lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x125b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848643:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f342eb lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x171:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848649:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f342eb lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a0:0x171:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848654:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f342eb lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x171:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848659:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.848662:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f342eb lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x171:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848667:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f342eb lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a0:0x171:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848678:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x171:0x0].0x0 (ffff9090ccb87b00) 00010000:00010000:3.0:1787508615.848680:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.848682:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f342eb lrc: 2/0,0 mode: --/TXN res: [0x2000013a0:0x171:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848687:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f342eb lrc: 0/0,0 mode: --/TXN res: [0x2000013a0:0x171:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848698:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3441f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x125b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848703:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3441f lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x125b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848707:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3441f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x125b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848712:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.848714:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3441f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x125b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848719:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3441f lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x125b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848724:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125b:0x0].0x0 (ffff9090ccb87200) 00010000:00010000:3.0:1787508615.848726:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508615.848728:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3441f lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x125b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848734:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3441f lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x125b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848751:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34426 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848757:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34426 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848762:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34426 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848766:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.848768:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34426 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848774:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34426 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848780:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x171:0x0].0x0 (ffff9090ccb87b00) 00010000:00010000:3.0:1787508615.848782:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508615.848785:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34426 lrc: 2/0,0 mode: --/TXN res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.848790:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34426 lrc: 0/0,0 mode: --/TXN res: [0x2000013a0:0x171:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508615.848991:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc874000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480123136:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1787508615.849645:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3445e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.849655:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3445e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.849661:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3445e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.849667:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.849670:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3445e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.849676:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3445e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.849687:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd700) 00010000:00010000:2.0:1787508615.849690:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.849695:0:3602:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3464f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34648 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.849705:0:3602:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3464f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f34648 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.849714:0:3602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3464f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f34648 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.849750:0:3602:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3464f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34648 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.849765:0:3602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3602:1874324480123264:0@lo:105: 00000100:00100000:2.0:1787508615.849810:0:3602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.849887:0:3602:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cf7080c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.849932:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480123264 00000100:00100000:3.0:1787508615.850313:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480123264 00000100:00100000:2.0:1787508615.850533:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18177 00000100:00100000:2.0:1787508615.850542:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:3602:x1874324480123264:12345-0@lo:105: 00010000:00010000:2.0:1787508615.850553:0:202210:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34648 lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3464f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.850563:0:202210:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34648 lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3464f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.850573:0:202210:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34648 lrc: 5/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3464f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.850582:0:202210:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34648 lrc: 5/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f3464f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.850589:0:202210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34648 lrc: 6/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f3464f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.850596:0:202210:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34648 lrc: 6/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f3464f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.850620:0:202210:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d247ac00) 00000100:00100000:2.0:1787508615.850671:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:3602:x1874324480123264:12345-0@lo:105: Request processed in 130us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.850678:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18177 00000100:00100000:3.0:1787508615.850738:0:3602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3602:1874324480123264:0@lo:105: 00010000:00010000:3.0:1787508615.850757:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3445e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.850764:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3445e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.850822:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34648 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3464f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.850832:0:205405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34648 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3464f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787508615.850852:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1787508615.850893:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc876a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480123392:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787508615.850926:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508615.850981:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9091d83eb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.851038:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480123392 00000100:00100000:3.0:1787508615.851043:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480123392 00000100:00100000:3.0:1787508615.851079:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29737 00000100:00100000:3.0:1787508615.851086:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480123392:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508615.851154:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480123392:12345-0@lo:1000:mdt00_004.0 Request processed in 69us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.851161:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29737 00000100:00100000:3.0:1787508615.851192:0:205405:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944086 gen 2 00000004:00080000:3.0:1787508615.851198:0:205405:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944080 committed transno 12884944086 00000004:00080000:3.0:1787508615.851212:0:205405:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944084 committed transno 12884944086 00000004:00080000:3.0:1787508615.851225:0:205405:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944085 committed transno 12884944086 00000004:00080000:3.0:1787508615.851234:0:205405:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944086 committed transno 12884944086 00000100:00100000:3.0:1787508615.851244:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc876a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480123392:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508615.851291:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb39500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480123520:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508615.851319:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508615.851348:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9840 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.851362:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480123520 00000100:00100000:3.0:1787508615.851365:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480123520 00000100:00100000:3.0:1787508615.851391:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29738 00000100:00100000:3.0:1787508615.851396:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480123520:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508615.851503:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480123520:12345-0@lo:1000:mdt00_004.0 Request processed in 106us (182us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787508615.851511:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29738 00000100:00100000:3.0:1787508615.851540:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb39500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480123520:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508615.851608:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb39500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480123648:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508615.851632:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508615.851652:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480123648 00000100:00100000:3.0:1787508615.851656:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480123648 00000100:00100000:3.0:1787508615.851676:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29739 00000100:00100000:3.0:1787508615.851682:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480123648:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508615.851729:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480123648:12345-0@lo:1000:mdt00_004.0 Request processed in 46us (95us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787508615.851734:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29739 00000100:00100000:3.0:1787508615.851753:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9840 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.851764:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb39500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480123648:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508615.851807:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb39500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480123776:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508615.851828:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508615.851841:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9840 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.851853:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480123776 00000100:00100000:3.0:1787508615.851856:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480123776 00000100:00100000:3.0:1787508615.851877:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29740 00000100:00100000:3.0:1787508615.851883:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480123776:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508615.851930:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480123776:12345-0@lo:1000:mdt00_004.0 Request processed in 47us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.851936:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29740 00000100:00100000:3.0:1787508615.851993:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb39500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480123776:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508615.852031:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb39500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480123904:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508615.852054:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508615.852067:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9840 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.852077:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480123904 00000100:00100000:3.0:1787508615.852079:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480123904 00000100:00100000:3.0:1787508615.852096:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29741 00000100:00100000:3.0:1787508615.852101:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480123904:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508615.852150:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480123904:12345-0@lo:1000:mdt00_004.0 Request processed in 48us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.852156:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29741 00000100:00100000:3.0:1787508615.852178:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb39500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480123904:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508615.852207:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb39500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480124032:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508615.852228:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508615.852244:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480124032 00000100:00100000:3.0:1787508615.852246:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480124032 00000100:00100000:3.0:1787508615.852264:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29742 00000100:00100000:3.0:1787508615.852269:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480124032:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508615.852307:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480124032:12345-0@lo:1000:mdt00_004.0 Request processed in 37us (78us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.852314:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29742 00000100:00100000:3.0:1787508615.852330:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9840 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.852340:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb39500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480124032:0@lo:1000:mdt00_004.0 00000040:00080000:3.0:1787508615.853384:0:205405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xf:0x0].48, 2168 off83584 00000040:00080000:3.0:1787508615.853486:0:205405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x5:0x0].591, 2368 off750208 00000004:00080000:3.0:1787508615.853491:0:205405:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d74d93c0 with version 13611 00000004:00080000:3.0:1787508615.853505:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13611 rpc_version 13611 00000020:00100000:3.0:1787508615.853535:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787508615.853544:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091ffb39500 x1874324480124288/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787508615.853562:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb39500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480124288:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508615.853611:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508615.853631:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9480 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.853647:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480124288 00000100:00100000:3.0:1787508615.853652:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480124288 00000100:00100000:3.0:1787508615.853683:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29743 00000100:00100000:3.0:1787508615.853690:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202961:x1874324480124288:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508615.854298:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:202961:x1874324480124288:12345-0@lo:1000:osp_up0-1.0 Request processed in 605us (683us total) trans 12884944088 rc 0/0 00000100:00100000:3.0:1787508615.854306:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29743 00000100:00100000:3.0:1787508615.854363:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb39500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480124288:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1787508615.855148:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab400/0xb126349c40f34656 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.855171:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab400/0xb126349c40f34656 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.855182:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab400/0xb126349c40f34656 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.855201:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa800/0xb126349c40f3465d lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x293:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.855208:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa800/0xb126349c40f3465d lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x293:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.855215:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa800/0xb126349c40f3465d lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x293:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.855249:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab600/0xb126349c40f34664 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.855256:0:205405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab600/0xb126349c40f34664 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.855717:0:205405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab600/0xb126349c40f34664 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.855745:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480124416:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1787508615.855806:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.855990:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cf708900 going to sleep for 11 seconds 00000100:00100000:0.0:1787508615.856313:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480124416 00000100:00100000:0.0:1787508615.856322:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480124416 00000100:00100000:0.0:1787508615.856475:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29744 00000100:00100000:0.0:1787508615.856486:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:205405:x1874324480124416:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1787508615.856509:0:202232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508615.856528:0:202232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3466b lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f34664 expref: -99 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.856553:0:202232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3466b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f34664 expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.856565:0:202232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3466b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34664 expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.856578:0:202232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x289:0x0].0x0 (ffff9090c6913600) 00010000:00010000:0.0:1787508615.856580:0:202232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508615.856585:0:202232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6e00, rc 0) 00000100:00100000:0.0:1787508615.856641:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:205405:x1874324480124416:12345-0@lo:101:mdt00_004.0 Request processed in 157us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508615.856647:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29744 00000100:00100000:2.0:1787508615.856724:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480124416:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1787508615.856738:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab600/0xb126349c40f34664 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3466b expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.856748:0:205405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab600/0xb126349c40f34664 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3466b expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508615.856772:0:205405:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f4b6a38 reply state 00000000cd2a0ff4 transno 8589962019 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa800/0xb126349c40f3465d lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x293:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.856784:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa800/0xb126349c40f3465d lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x293:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.856790:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x293:0x0].0x0 (ffff9090d36fd300) 00010000:00010000:2.0:1787508615.856792:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787508615.856795:0:205405:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787508615.856801:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab600/0xb126349c40f34664 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3466b expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.856808:0:205405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab600/0xb126349c40f34664 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3466b expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787508615.856818:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x289:0x0] 00000004:00010000:2.0:1787508615.856823:0:205405:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f4b6a38 reply state 00000000cd2a0ff4 transno 8589962019 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab400/0xb126349c40f34656 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.856829:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab400/0xb126349c40f34656 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.856834:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d4:0x0].0x0 (ffff9090d36fdb00) 00010000:00010000:2.0:1787508615.856836:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787508615.856838:0:205405:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1787508615.856844:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d4:0x0]: returning size 4096 00000004:00080000:2.0:1787508615.856852:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787508615.856860:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aba00/0xb126349c40f3462c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f34633 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.856866:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aba00/0xb126349c40f3462c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xb126349c40f34633 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.856872:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aba00/0xb126349c40f3462c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xb126349c40f34633 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.856897:0:205405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000004:00080000:2.0:1787508615.856901:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787508615.856905:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34648 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3464f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.856911:0:205405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34648 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3464f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.857000:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+642:336084:x1874324509538304:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 23824us (24109us total) trans 8589962019 rc 0/0 00000100:00100000:2.0:1787508615.857007:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93916 00010000:00010000:1.0:1787508615.860735:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787508615.860750:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aba00/0xb126349c40f3462c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f34633 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.860764:0:204785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aba00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:1.0:1787508615.860770:0:204785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aba00/0xb126349c40f3462c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f34633 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508615.860780:0:204785:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aba00/0xb126349c40f3462c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f34633 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.860830:0:204785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aba00/0xb126349c40f3462c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f34633 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.860837:0:204785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787508615.860864:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aba00/0xb126349c40f3462c lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f34633 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.860871:0:204785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aba00/0xb126349c40f3462c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f34633 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.860888:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508615.860890:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508615.860891:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508615.860912:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc874a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480124544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508615.860997:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.861114:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480124544 00000100:00100000:2.0:1787508615.861122:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480124544 00010000:00010000:2.0:1787508615.861155:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34633 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000000000020 nid: 0@lo remote: 0xb126349c40f3462c expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.861195:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27880 00000100:00100000:2.0:1787508615.861206:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde3d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+10:3618:x1874324480124544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508615.861219:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508615.861228:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### wasn't waiting ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34633 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f3462c expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.861248:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34633 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000020 nid: 0@lo remote: 0xb126349c40f3462c expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.861260:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.861266:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34641 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.861276:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34641 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.861283:0:202212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34641 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.861311:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508615.861358:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde3d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3618:x1874324480124544:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.861366:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27880 00010000:00010000:3.0:1787508615.861677:0:202226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34641 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.861686:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34641 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508615.861737:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508615.861741:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508615.861762:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34641 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.861793:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f3463a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae417 expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.861809:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34641 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae417 expref: 11 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.861822:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.861825:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508615.861828:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6800, rc 0) 00000100:00100000:3.0:1787508615.861885:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336091:x1874324509538688:12345-192.168.201.30@tcp:101:rm.0 Request processed in 19370us (19658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.861892:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93917 00000100:00100000:1.0:1787508615.862587:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc874a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480124544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508615.865328:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.865408:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509538816 00000100:00100000:2.0:1787508615.865418:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509538816 00000100:00100000:2.0:1787508615.865491:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93918 00000100:00100000:2.0:1787508615.865504:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336091:x1874324509538816:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508615.865524:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.865545:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f34672 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae41e expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.865620:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f34679 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.865635:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f34679 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.865646:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f34679 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.865658:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34680 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.865669:0:203348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3464f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34648 expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.865678:0:203348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34680 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.865714:0:203348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3464f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f34648 expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.865731:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:203348:1874324480124672:0@lo:104: 00000100:00100000:2.0:1787508615.865802:0:203348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.865852:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cf708540 going to sleep for 11 seconds 00000100:00100000:3.0:1787508615.865970:0:202209:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787508615.865984:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480124672 00000100:00100000:3.0:1787508615.865987:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480124672 00000100:00100000:3.0:1787508615.866019:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18178 00000100:00100000:3.0:1787508615.866026:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:203348:x1874324480124672:12345-0@lo:104: 00010000:00010000:3.0:1787508615.866037:0:202209:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34648 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f3464f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.866090:0:202209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787508615.866097:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:203348:x1874324480124672:12345-0@lo:104: Request processed in 71us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508615.866104:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18178 00010000:00010000:2.0:1787508615.866254:0:202214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787508615.866261:0:202214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34648 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f3464f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.866270:0:202214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:2.0:1787508615.866295:0:202214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34648 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f3464f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508615.866303:0:202214:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34648 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f3464f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.866333:0:202214:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34648 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3464f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.866340:0:202214:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787508615.866360:0:202214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34648 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3464f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.866367:0:202214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34648 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3464f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.866384:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508615.866386:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508615.866388:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508615.866399:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480124800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787508615.866439:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.866490:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:203348:1874324480124672:0@lo:104: 00010000:00010000:2.0:1787508615.866506:0:203348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34680 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.866556:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480124800 00000100:00100000:1.0:1787508615.866561:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480124800 00010000:00010000:1.0:1787508615.866582:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3464f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f34648 expref: 9 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508615.866611:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27881 00000100:00100000:1.0:1787508615.866619:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3619:x1874324480124800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508615.866628:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1787508615.869066:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944088 is committed 00000020:00080000:1.0:1787508615.869083:0:202206:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8589961988 batchid updated 00010000:00010000:1.0:1787508615.869156:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3464f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f34648 expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.869175:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd700) 00010000:00010000:1.0:1787508615.869181:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34680 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.869192:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34680 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.869200:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34680 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.869226:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508615.869317:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3619:x1874324480124800:12345-0@lo:103:ldlm_bl.0 Request processed in 2697us (2875us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.869327:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27881 00000100:00100000:2.0:1787508615.869548:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787508615.869563:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480124928:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787508615.869606:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.869652:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480124928 00000100:00100000:2.0:1787508615.869660:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480124928 00000100:00100000:2.0:1787508615.869715:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1625 00000100:00100000:2.0:1787508615.869723:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480124928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787508615.869753:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75854400 pending 0 free 3884056576 avail 3652534272 00000100:00100000:2.0:1787508615.869806:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480124928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.869812:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1625 00000100:00080000:2.0:1787508615.869831:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787508615.869865:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480124800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787508615.869902:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480124928:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787508615.869921:0:203348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34680 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.869930:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34680 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.870069:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:203348:1874324480125056:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787508615.870100:0:203348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.870127:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480125056 00000100:00100000:2.0:1787508615.870132:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480125056 00000100:00100000:2.0:1787508615.870161:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29745 00000100:00100000:2.0:1787508615.870168:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:203348:x1874324480125056:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787508615.870233:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:203348:x1874324480125056:12345-0@lo:1000:mdt00_003.0 Request processed in 65us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.870240:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29745 00000100:00100000:2.0:1787508615.870260:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cf708c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787508615.870275:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:203348:1874324480125056:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787508615.870317:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34687 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.870330:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34687 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787508615.870547:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961988 00000004:00080000:0.0:1787508615.870599:0:202262:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d9ff2b40 with version 3464 00000020:00080000:0.0:1787508615.870611:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589961987 cancel update log [0x240000bd2:0x1:0x0].1789: rc = 0 00000020:00080000:0.0:1787508615.870687:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589961987 cancel update log [0x2000013a0:0x1:0x0].1783: rc = 0 00000004:00080000:0.0:1787508615.870713:0:202262:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d9ff2180 with version 3465 00000020:00080000:0.0:1787508615.870716:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589961988 cancel update log [0x240000bd2:0x1:0x0].1790: rc = 0 00000020:00080000:0.0:1787508615.870737:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589961988 cancel update log [0x2000013a0:0x1:0x0].1784: rc = 0 00000020:00080000:0.0:1787508615.870743:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961988 00000004:00080000:0.0:1787508615.870756:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3464 rpc_version 3464 00000020:00100000:0.0:1787508615.870776:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787508615.870798:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090c9684000 x1874324480125312/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787508615.870814:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9684000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480125312:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787508615.870849:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508615.870873:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9ff2240 going to sleep for 11 seconds 00010000:00010000:2.0:1787508615.871019:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34687 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508615.871045:0:203348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34687 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.871058:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f34679 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.871065:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f34679 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.871072:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f34679 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.871079:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f34679 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.871085:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.871089:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f34679 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.871096:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f34679 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.871109:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.871112:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.871117:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f34679 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.871131:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f34679 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.871146:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34680 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.871152:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34680 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.871158:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34680 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.871163:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.871166:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34680 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.871172:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34680 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.871180:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd700) 00010000:00010000:2.0:1787508615.871182:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.871186:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34680 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.871191:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34680 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.871232:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f34672 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae41e expref: 13 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.871246:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34687 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae41e expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.871253:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d4:0x0].0x0 (ffff9090d36fd600) 00010000:00010000:2.0:1787508615.871255:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508615.871257:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa200, rc 0) 00000100:00100000:2.0:1787508615.871308:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336091:x1874324509538816:12345-192.168.201.30@tcp:101:rm.0 Request processed in 5806us (5990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.871316:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93918 00000100:00100000:2.0:1787508615.874653:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480125312 00000100:00100000:2.0:1787508615.874669:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480125312 00000100:00100000:2.0:1787508615.874730:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29746 00000100:00100000:2.0:1787508615.874740:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:202248:x1874324480125312:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787508615.874979:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:202248:x1874324480125312:12345-0@lo:1000:osp_up1-0.0 Request processed in 239us (4127us total) trans 8589962020 rc 0/0 00000100:00100000:2.0:1787508615.874988:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29746 00000100:00100000:1.0:1787508615.875167:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9684000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480125312:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787508615.875180:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3465 rpc_version 3465 00000020:00100000:1.0:1787508615.875204:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787508615.875212:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090cc875880 x1874324480125568/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787508615.875234:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc875880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480125568:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787508615.875272:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508615.875300:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9091d83eb540 going to sleep for 11 seconds 00000100:00100000:2.0:1787508615.878543:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480125568 00000100:00100000:2.0:1787508615.878559:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480125568 00000100:00100000:2.0:1787508615.878633:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29747 00000100:00100000:2.0:1787508615.878644:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:202248:x1874324480125568:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787508615.878854:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:202248:x1874324480125568:12345-0@lo:1000:osp_up1-0.0 Request processed in 211us (3580us total) trans 8589962021 rc 0/0 00000100:00100000:2.0:1787508615.878862:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29747 00000100:00100000:0.0:1787508615.882213:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc875880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480125568:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787508615.882839:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480125696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508615.882913:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508615.883206:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480125696 00000100:00100000:0.0:1787508615.883213:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480125696 00000100:00100000:0.0:1787508615.883285:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1626 00000100:00100000:0.0:1787508615.883294:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480125696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787508615.883317:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75854400 pending 0 free 3884056576 avail 3652534272 00000100:00080000:3.0:1787508615.883381:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508615.885171:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480125696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1869us (2249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508615.885184:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1626 00000100:00100000:0.0:1787508615.885333:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508615.885387:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.887061:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480125696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787508615.889165:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509538944 00000100:00100000:2.0:1787508615.889180:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509538944 00000100:00100000:2.0:1787508615.889251:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509539072 00000100:00100000:2.0:1787508615.889254:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509539072 00000100:00100000:2.0:1787508615.889289:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93919 00000100:00100000:2.0:1787508615.889299:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:336091:x1874324509538944:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508615.889316:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.889346:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f3468e lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae425 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.889400:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f34695 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.889413:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f34695 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.889434:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f34695 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508615.889527:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d4:0x0]: returning size 4096 00000004:00200000:2.0:1787508615.889532:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787508615.889564:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f3468e lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae425 expref: 7 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.889582:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f34695 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae425 expref: 6 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.889590:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d4:0x0].0x0 (ffff9090d36fdb00) 00010000:00010000:2.0:1787508615.889593:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508615.889596:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aac00, rc 0) 00000100:00100000:2.0:1787508615.889650:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336091:x1874324509538944:12345-192.168.201.30@tcp:101:rm.0 Request processed in 353us (4320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.889661:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93919 00000100:00100000:2.0:1787508615.889678:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93920 00000100:00100000:2.0:1787508615.889684:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+581:336092:x1874324509539072:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1787508615.889691:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.889700:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3469c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae42c expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.889729:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f346a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.889739:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f346a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.889747:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f346a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508615.889768:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508615.889771:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508615.890897:0:209004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f346a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.890929:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3469c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae42c expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.890964:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f346a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae42c expref: 582 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.890972:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.890975:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508615.890978:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aba00, rc 0) 00000100:00100000:2.0:1787508615.891019:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336092:x1874324509539072:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 1335us (5632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.891025:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93920 00000100:00100000:0.0:1787508615.895902:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.896149:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509539200 00000100:00100000:3.0:1787508615.896160:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509539200 00000100:00100000:3.0:1787508615.896226:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93921 00000100:00100000:3.0:1787508615.896237:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336092:x1874324509539200:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1787508615.896258:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.896281:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f346aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae433 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.896365:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f346b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.896381:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f346b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.896393:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f346b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.896409:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f346b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.896416:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f346b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.896434:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f346b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.896494:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f346b1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.896501:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f346b1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.896507:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f346b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.896513:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f346b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.896518:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.896523:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f346b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.896530:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f346b1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.896542:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.896545:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.896549:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f346b1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.896555:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f346b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.896571:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f346b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.896577:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f346b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.896583:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f346b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.896588:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508615.896591:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f346b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.896597:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f346b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.896604:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090ccb87b00) 00010000:00010000:3.0:1787508615.896607:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508615.896610:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f346b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.896615:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f346b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.896648:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f346aa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae433 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.896659:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508615.896661:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508615.896664:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f346aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae433 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.896673:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f800, rc 0) 00000100:00100000:3.0:1787508615.896732:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336092:x1874324509539200:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 497us (840us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508615.896739:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93921 00000100:00100000:1.0:1787508615.903320:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.903514:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509539328 00000100:00100000:2.0:1787508615.903525:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509539328 00000100:00100000:2.0:1787508615.903589:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93922 00000100:00100000:2.0:1787508615.903600:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336091:x1874324509539328:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508615.903620:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.903641:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa600/0xb126349c40f346bf lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x293:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae43a expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.903703:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f346c6 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x293:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.903718:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f346c6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.903729:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f346c6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508615.904079:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x293:0x0]: returning size 4096 00000004:00200000:2.0:1787508615.904085:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787508615.904130:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa600/0xb126349c40f346bf lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x293:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae43a expref: 8 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.904149:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f346c6 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae43a expref: 7 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.904163:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x293:0x0].0x0 (ffff9090d36fd300) 00010000:00010000:2.0:1787508615.904165:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508615.904169:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab200, rc 0) 00000100:00100000:2.0:1787508615.904230:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:336091:x1874324509539328:12345-192.168.201.30@tcp:101:rm.0 Request processed in 631us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.904239:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93922 00000100:00100000:0.0:1787508615.906880:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508615.906925:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.907064:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509539456 00000100:00100000:3.0:1787508615.907074:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509539456 00000100:00100000:3.0:1787508615.907119:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509539584 00000100:00100000:3.0:1787508615.907122:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509539584 00000100:00100000:3.0:1787508615.907142:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93923 00000100:00100000:3.0:1787508615.907150:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336091:x1874324509539456:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508615.907182:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508615.907203:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f346cd lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x289:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae441 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.907264:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f346d4 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x289:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.907279:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3466b lrc: 2/0,0 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34664 expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.907287:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f346d4 lrc: 4/1,0 mode: --/PR res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.907322:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3466b lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f34664 expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508615.907350:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb38380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480125824:0@lo:104: 00000100:00100000:3.0:1787508615.907400:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508615.907448:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787508615.907632:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93924 00000100:00100000:1.0:1787508615.907643:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336092:x1874324509539584:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508615.907652:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.907664:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f346db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae448 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.907702:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f346e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.907712:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f346e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.907723:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f346e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.907737:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f346e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.907743:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f346e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.907754:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f346e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.907816:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f346e2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.907824:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f346e2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.907830:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f346e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.907837:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f346e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.907844:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.907848:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f346e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.907856:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f346e2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.907869:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.907872:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.907877:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f346e2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.907883:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f346e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.907896:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f346e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.907903:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f346e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.907909:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f346e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.907914:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.907917:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f346e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.907923:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f346e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.907931:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090d171ff00) 00010000:00010000:1.0:1787508615.907933:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.907936:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f346e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.907982:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f346e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.908013:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f346db lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae448 expref: 583 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.908022:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.908025:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508615.908029:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f346db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae448 expref: 583 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.908043:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b800, rc 0) 00000100:00100000:1.0:1787508615.908101:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336092:x1874324509539584:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 461us (1174us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508615.908109:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93924 00000100:00100000:0.0:1787508615.908378:0:229386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480125824 00000100:00100000:0.0:1787508615.908384:0:229386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480125824 00000100:00100000:0.0:1787508615.908437:0:229386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18179 00000100:00100000:0.0:1787508615.908446:0:229386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:230618:x1874324480125824:12345-0@lo:104: 00010000:00010000:0.0:1787508615.908458:0:229386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab600/0xb126349c40f34664 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f3466b expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.908530:0:229386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787508615.908536:0:229386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:230618:x1874324480125824:12345-0@lo:104: Request processed in 92us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508615.908543:0:229386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18179 00010000:00010000:0.0:1787508615.908561:0:226765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508615.908567:0:226765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab600/0xb126349c40f34664 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f3466b expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.908574:0:226765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab600 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:0.0:1787508615.908579:0:226765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab600/0xb126349c40f34664 lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f3466b expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508615.908588:0:226765:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab600/0xb126349c40f34664 lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f3466b expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.908612:0:226765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab600/0xb126349c40f34664 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3466b expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.908619:0:226765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787508615.908640:0:226765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab600/0xb126349c40f34664 lrc: 1/0,0 mode: --/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3466b expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.908647:0:226765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab600/0xb126349c40f34664 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3466b expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508615.908664:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508615.908666:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508615.908668:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508615.908680:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480125952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508615.908711:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.908847:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480125952 00000100:00100000:2.0:1787508615.908853:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480125952 00010000:00010000:2.0:1787508615.908873:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3466b lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f34664 expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.908903:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27882 00000100:00100000:2.0:1787508615.908910:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+7:3618:x1874324480125952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508615.908920:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787508615.910525:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb38380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480125824:0@lo:104: 00010000:00010000:1.0:1787508615.910553:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f346d4 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508615.916304:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.916409:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509539712 00000100:00100000:1.0:1787508615.916429:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509539712 00000100:00100000:1.0:1787508615.916488:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93925 00000100:00100000:1.0:1787508615.916507:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336092:x1874324509539712:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508615.916528:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.916546:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f346f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae44f expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.916614:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f346f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.916628:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f346f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.916638:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f346f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.916651:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f346fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.916662:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f346fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.916668:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f346fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.916721:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f346f7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.916729:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f346f7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.916735:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f346f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.916742:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f346f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.916748:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.916752:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f346f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.916760:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f346f7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.916772:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.916775:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.916779:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f346f7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.916784:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f346f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.916796:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f346fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.916802:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f346fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.916806:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f346fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.916811:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.916814:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f346fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.916819:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f346fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.916826:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090ce78ac00) 00010000:00010000:1.0:1787508615.916828:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.916830:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f346fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.916835:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f346fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.916863:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f346f0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae44f expref: 583 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.916874:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.916876:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508615.916880:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f346f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae44f expref: 583 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.916887:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b800, rc 0) 00000100:00100000:1.0:1787508615.916979:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336092:x1874324509539712:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 474us (689us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508615.916986:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93925 00010000:00010000:2.0:1787508615.917730:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3466b lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f34664 expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.917748:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x289:0x0].0x0 (ffff9090c6913600) 00010000:00010000:2.0:1787508615.917754:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f346d4 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.917762:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f346d4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.917768:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f346d4 lrc: 4/1,0 mode: PR/PR res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.917807:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508615.917866:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480125952:12345-0@lo:103:ldlm_bl.0 Request processed in 8956us (9154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.917876:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27882 00000100:00100000:0.0:1787508615.917998:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480125952:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508615.918037:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f346d4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.918046:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f346d4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508615.918093:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a2:0x289:0x0]: returning size 4096 00000004:00200000:1.0:1787508615.918099:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787508615.918134:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f346cd lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x289:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae441 expref: 14 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.918149:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f346d4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae441 expref: 13 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.918156:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x289:0x0].0x0 (ffff9090c6913600) 00010000:00010000:1.0:1787508615.918158:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508615.918161:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e200, rc 0) 00000100:00100000:1.0:1787508615.918375:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336091:x1874324509539456:12345-192.168.201.30@tcp:101:rm.0 Request processed in 11224us (11507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.918383:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93923 00000100:00100000:0.0:1787508615.927257:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.928013:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509539968 00000100:00100000:2.0:1787508615.928025:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509539968 00000100:00100000:2.0:1787508615.928083:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93926 00000100:00100000:2.0:1787508615.928092:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336092:x1874324509539968:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1787508615.928114:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.928137:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34705 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae456 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.930539:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f3470c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.930561:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f3470c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.930574:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f3470c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.930591:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34713 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.930598:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34713 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.930605:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34713 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.930668:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f3470c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.930676:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f3470c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.930682:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f3470c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.930688:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f3470c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.930695:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aaa00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.930700:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f3470c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.930707:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f3470c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.930721:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.930724:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.930728:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f3470c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.930734:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f3470c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.930749:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34713 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.930756:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34713 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.930762:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34713 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.930767:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508615.930770:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34713 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.930776:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34713 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.930784:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090d36fd700) 00010000:00010000:2.0:1787508615.930786:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508615.930789:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34713 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.930796:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34713 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.930840:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34705 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae456 expref: 583 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.930852:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508615.930854:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508615.930858:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34705 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae456 expref: 583 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.930868:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa600, rc 0) 00000100:00100000:2.0:1787508615.930973:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336092:x1874324509539968:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 2879us (3725us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508615.930986:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93926 00000100:00100000:0.0:1787508615.935324:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.937407:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509540224 00000100:00100000:2.0:1787508615.937435:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509540224 00000100:00100000:2.0:1787508615.937507:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93927 00000100:00100000:2.0:1787508615.937519:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:336091:x1874324509540224:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508615.937543:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.937571:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa400/0xb126349c40f3471a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae45d expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508615.937751:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d4:0x0]: returning size 4096 00010000:00010000:2.0:1787508615.937860:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa400/0xb126349c40f3471a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae45d expref: 9 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.937876:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d36fda00) 00010000:00010000:2.0:1787508615.937879:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508615.937884:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa400/0xb126349c40f3471a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae45d expref: 9 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.937901:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa400, rc 0) 00000100:00100000:2.0:1787508615.938008:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336091:x1874324509540224:12345-192.168.201.30@tcp:101:rm.0 Request processed in 491us (2696us total) trans 8589962022 rc 301/301 00000100:00100000:2.0:1787508615.938016:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93927 00000100:00100000:3.0:1787508615.943809:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.943863:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508615.944023:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509540480 00000100:00100000:0.0:1787508615.944035:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509540480 00000100:00100000:0.0:1787508615.944104:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15413 00000100:00100000:0.0:1787508615.944116:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336091:x1874324509540480:12345-192.168.201.30@tcp:37:rm.0 00000100:00100000:1.0:1787508615.945228:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509540352 00000100:00100000:1.0:1787508615.945237:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509540352 00000100:00100000:1.0:1787508615.945281:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93928 00000100:00100000:1.0:1787508615.945289:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336092:x1874324509540352:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508615.945303:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.945323:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f34728 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae464 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.945380:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3472f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.945393:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3472f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.945403:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3472f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.945417:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34736 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.945442:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34736 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.945450:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34736 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.945645:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f3473d lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.945654:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f3473d lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.945660:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f3473d lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508615.945684:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f3473d lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.945697:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3472f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.945703:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3472f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.945709:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3472f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.945715:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3472f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.945720:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.945724:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3472f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.945731:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3472f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.945741:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508615.945744:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.945748:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3472f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.945754:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f3472f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.945766:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34736 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.945772:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34736 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.945777:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34736 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.945782:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508615.945784:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34736 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.945790:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34736 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.945796:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090ce78ac00) 00010000:00010000:1.0:1787508615.945798:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508615.945801:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34736 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.945806:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34736 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.945833:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f34728 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae464 expref: 584 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.945845:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f3473d lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae464 expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.945853:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d4:0x0].0x0 (ffff9090d36fd600) 00010000:00010000:1.0:1787508615.945854:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508615.945857:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a600, rc 0) 00000100:00100000:1.0:1787508615.945896:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336092:x1874324509540352:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 608us (2099us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.945903:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93928 00000100:00100000:0.0:1787508615.952111:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336091:x1874324509540480:12345-192.168.201.30@tcp:37:rm.0 Request processed in 7986us (8235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508615.952126:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15413 00000100:00100000:3.0:1787508615.954582:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508615.954812:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509540608 00000100:00100000:1.0:1787508615.954823:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509540608 00000100:00100000:1.0:1787508615.954891:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93929 00000100:00100000:1.0:1787508615.954901:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+642:336092:x1874324509540608:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508615.954926:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508615.954983:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f34744 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae46b expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.955042:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247bc00/0xb126349c40f3474b lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.955057:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247bc00/0xb126349c40f3474b lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.955081:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247bc00/0xb126349c40f3474b lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508615.955184:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d4:0x0]: returning size 4096 00000004:00200000:1.0:1787508615.955212:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787508615.955249:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f34744 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae46b expref: 644 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.955268:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247bc00/0xb126349c40f3474b lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae46b expref: 643 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508615.955281:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d4:0x0].0x0 (ffff9090d36fdb00) 00010000:00010000:1.0:1787508615.955284:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508615.955288:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247bc00, rc 0) 00000100:00100000:1.0:1787508615.955343:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+643:336092:x1874324509540608:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 443us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508615.955350:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93929 00000100:00100000:2.0:1787508615.957152:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.957244:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509540736 00000100:00100000:3.0:1787508615.957254:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509540736 00000100:00100000:3.0:1787508615.957310:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15414 00000100:00100000:3.0:1787508615.957320:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde31c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336091:x1874324509540736:12345-192.168.201.30@tcp:37:rm.0 00000100:00100000:3.0:1787508615.962400:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.962505:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509540864 00000100:00100000:2.0:1787508615.962519:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509540864 00000100:00100000:2.0:1787508615.962605:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93930 00000100:00100000:2.0:1787508615.962616:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+643:336092:x1874324509540864:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1787508615.962643:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.962668:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa600/0xb126349c40f34752 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x293:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae472 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.962742:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f34759 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x293:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.962757:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f34759 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.962771:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f34759 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508615.962830:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x293:0x0]: returning size 4096 00000004:00200000:2.0:1787508615.962836:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787508615.962876:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa600/0xb126349c40f34752 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x293:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae472 expref: 645 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.962899:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f34759 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae472 expref: 644 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.962909:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x293:0x0].0x0 (ffff9090d36fd300) 00010000:00010000:2.0:1787508615.962912:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508615.962916:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abe00, rc 0) 00000100:00100000:2.0:1787508615.963019:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:336092:x1874324509540864:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 404us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.963027:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93930 00000100:00100000:0.0:1787508615.968818:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde31c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336091:x1874324509540736:12345-192.168.201.30@tcp:37:rm.0 Request processed in 11486us (11662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508615.968833:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15414 00000100:00100000:3.0:1787508615.975888:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.976004:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.976565:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509540992 00000100:00100000:2.0:1787508615.976577:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509540992 00000100:00100000:2.0:1787508615.976637:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93931 00000100:00100000:2.0:1787508615.976648:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336092:x1874324509540992:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1787508615.976669:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.976692:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f34760 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x289:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae479 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.976754:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34767 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x289:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.976769:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34767 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.976782:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34767 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508615.976827:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a2:0x289:0x0]: returning size 4096 00000004:00200000:2.0:1787508615.976832:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787508615.976870:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f34760 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x289:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae479 expref: 585 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.976890:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34767 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae479 expref: 584 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.976898:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x289:0x0].0x0 (ffff9090c6913600) 00010000:00010000:2.0:1787508615.976901:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508615.976905:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abc00, rc 0) 00000100:00100000:2.0:1787508615.976986:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336092:x1874324509540992:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 340us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.976993:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93931 00000100:00100000:1.0:1787508615.977091:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509541248 00000100:00100000:1.0:1787508615.977096:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509541248 00000100:00100000:1.0:1787508615.977129:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15415 00000100:00100000:1.0:1787508615.977136:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336091:x1874324509541248:12345-192.168.201.30@tcp:35:rm.0 00000100:00100000:1.0:1787508615.977302:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:336091:x1874324509541248:12345-192.168.201.30@tcp:35:rm.0 Request processed in 166us (1297us total) trans 8589962023 rc 0/0 00000100:00100000:1.0:1787508615.977310:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15415 00000100:00100000:3.0:1787508615.980269:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508615.980445:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509541376 00000100:00100000:2.0:1787508615.980457:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509541376 00000100:00100000:2.0:1787508615.980518:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9789 00000100:00100000:2.0:1787508615.980528:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2401:x1874324509541376:12345-192.168.201.30@tcp:103:rm.0 00010000:00010000:2.0:1787508615.980544:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508615.980571:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34687 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae41e expref: 13 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.980593:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d4:0x0].0x0 (ffff9090d36fd600) 00010000:00010000:2.0:1787508615.980598:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508615.980662:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2401:x1874324509541376:12345-192.168.201.30@tcp:103:rm.0 Request processed in 135us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508615.980670:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9789 00000100:00100000:0.0:1787508615.981895:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508615.981980:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508615.982046:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509541632 00000100:00100000:3.0:1787508615.982054:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509541632 00000100:00100000:3.0:1787508615.982101:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509541888 00000100:00100000:3.0:1787508615.982105:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509541888 00000100:00100000:3.0:1787508615.982131:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93932 00000100:00100000:3.0:1787508615.982141:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:336092:x1874324509541632:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:3.0:1787508615.982204:0:230618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508615.982226:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247bc00/0xb126349c40f3474b lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae46b expref: 644 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.982242:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d4:0x0].0x0 (ffff9090d36fdb00) 00010000:00010000:3.0:1787508615.982247:0:230618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508615.982274:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f3476e lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.982287:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f34695 lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae425 expref: 9 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.982296:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f3476e lrc: 4/0,1 mode: --/PW res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.982444:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f34695 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae425 expref: 9 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508615.982462:0:230618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f34695 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae425 expref: 9 pid: 209004 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508615.982478:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b00700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:230618:1874324480126080:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508615.982555:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9480 going to sleep for 11 seconds 00000100:00100000:2.0:1787508615.982856:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93933 00000100:00100000:2.0:1787508615.982868:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4861850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:336091:x1874324509541888:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1787508615.982904:0:203348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508615.982914:0:203348:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f34695 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae425 expref: 9 pid: 209004 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.982928:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d4:0x0].0x0 (ffff9090d36fdb00) 00010000:00010000:2.0:1787508615.982932:0:203348:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f3476e lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.982957:0:203348:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f3476e lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.982966:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f3476e lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.982981:0:203348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508615.983014:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34775 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.983022:0:203348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34775 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.983031:0:203348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34775 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.983046:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480126208:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1787508615.983086:0:203348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508615.983118:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480126208 00000100:00100000:2.0:1787508615.983122:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480126208 00000100:00100000:2.0:1787508615.983156:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29748 00000100:00100000:2.0:1787508615.983163:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:203348:x1874324480126208:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787508615.983179:0:225829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508615.983193:0:225829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f3477c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f34775 expref: -99 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.983211:0:225829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34641 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae417 expref: 11 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.983220:0:225829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f346a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae42c expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.983227:0:225829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f3477c lrc: 5/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f34775 expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.983252:0:225829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f346a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae42c expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.983265:0:225829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f346a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae42c expref: 583 pid: 209004 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.983275:0:225829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf2a00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480126336:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508615.983317:0:225829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34641 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae417 expref: 11 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508615.983326:0:225829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34641 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae417 expref: 11 pid: 202226 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508615.983335:0:225829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf0e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480126464:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508615.983355:0:225829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cf708000 going to sleep for 11 seconds 00000100:00100000:2.0:1787508615.983367:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cf708540 going to sleep for 11 seconds 00000100:00100000:3.0:1787508616.007623:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:1.0:1787508616.007866:0:230618:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.30@tcp) returned -22 from blocking AST (req@000000005f3a82ca x1874324480126080) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f34695 lrc: 1/0,0 mode: --/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae425 expref: 9 pid: 209004 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.007888:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f34695 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae425 expref: 9 pid: 209004 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508616.007911:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b00700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:230618:1874324480126080:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508616.007934:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d4:0x0].0x0 (ffff9090d36fdb00) 00010000:00010000:1.0:1787508616.007990:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f3476e lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.008004:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f3476e lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.008009:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f3476e lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.008042:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f34783 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x293:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.008055:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f346c6 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae43a expref: 8 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.008064:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f34759 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae472 expref: 643 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.008071:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f34783 lrc: 5/0,1 mode: --/PW res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.008124:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f34759 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae472 expref: 643 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.008138:0:230618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f34759 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae472 expref: 643 pid: 203348 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508616.008153:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc876680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:230618:1874324480126592:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508616.008243:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f346c6 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae43a expref: 8 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.008258:0:230618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f346c6 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae43a expref: 8 pid: 203348 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508616.008277:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc875c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:230618:1874324480126720:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508616.008304:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9091d83eb180 going to sleep for 11 seconds 00000100:00100000:0.0:1787508616.008508:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509542016 00000100:00100000:0.0:1787508616.008516:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509542016 00010000:00010000:0.0:1787508616.008568:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f346a3 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae42c expref: 584 pid: 209004 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508616.008603:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27883 00000100:00100000:0.0:1787508616.008614:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:2400:x1874324509542016:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508616.008628:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508616.008634:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f346a3 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae42c expref: 584 pid: 209004 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.008647:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f346a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae42c expref: 584 pid: 209004 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.008664:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508616.008671:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f3477c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f34775 expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.008683:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508616.008710:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:2400:x1874324509542016:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 99us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508616.008718:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27883 00010000:00010000:2.0:1787508616.008975:0:225829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f346a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae42c expref: 583 pid: 209004 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508616.008992:0:225829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf2a00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480126336:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508616.009006:0:225829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf0e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480126464:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508616.009030:0:225829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f3477c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34775 expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.009044:0:225829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508616.009047:0:225829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508616.009050:0:225829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f3477c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34775 expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.009057:0:225829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa000, rc 0) 00000100:00100000:2.0:1787508616.009122:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:203348:x1874324480126208:12345-0@lo:101:mdt00_003.0 Request processed in 25959us (26035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508616.009129:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29748 00000100:00100000:0.0:1787508616.009238:0:203348:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944088 gen 2 00000004:00080000:0.0:1787508616.009244:0:203348:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944088 committed transno 12884944088 00000100:00100000:0.0:1787508616.009278:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480126208:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787508616.009294:0:203348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34775 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3477c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.009303:0:203348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34775 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3477c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787508616.009587:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508616.009680:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508616.009743:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509542144 00000100:00100000:0.0:1787508616.009750:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509542144 00010000:00010000:0.0:1787508616.009790:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34641 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae417 expref: 12 pid: 202226 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508616.009820:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27884 00000100:00100000:0.0:1787508616.009828:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2400:x1874324509542144:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508616.009838:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508616.009843:0:225839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34641 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae417 expref: 12 pid: 202226 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.009854:0:225839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34641 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae417 expref: 12 pid: 202226 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.009872:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34641 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae417 expref: 12 pid: 202226 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.009884:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508616.009888:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f3477c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34775 expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.009898:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f3477c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f34775 expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.009905:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f3477c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f34775 expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.009935:0:225839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f3477c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34775 expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508616.009973:0:225839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:225839:1874324480126848:0@lo:105: 00000100:00100000:0.0:1787508616.010008:0:225839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508616.010046:0:225839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9ff2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787508616.010109:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480126848 00000100:00100000:3.0:1787508616.010114:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480126848 00000100:00100000:3.0:1787508616.010152:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18180 00000100:00100000:3.0:1787508616.010161:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:225839:x1874324480126848:12345-0@lo:105: 00010000:00010000:3.0:1787508616.010171:0:202209:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34775 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3477c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.010180:0:202209:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34775 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3477c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.010189:0:202209:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34775 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3477c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.010196:0:202209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34775 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f3477c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.010203:0:202209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34775 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f3477c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.010211:0:202209:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34775 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f3477c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.010227:0:202209:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090cd2ab000) 00000100:00100000:3.0:1787508616.010373:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:225839:x1874324480126848:12345-0@lo:105: Request processed in 106us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508616.010381:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18180 00000100:00100000:0.0:1787508616.010515:0:225839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:225839:1874324480126848:0@lo:105: 00010000:00010000:0.0:1787508616.010529:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508616.010572:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2400:x1874324509542144:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 745us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508616.010579:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27884 00010000:00010000:0.0:1787508616.010601:0:203348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34775 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3477c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.010614:0:203348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34775 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3477c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787508616.010633:0:203348:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787508616.010667:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7c00/0xb126349c40f3478a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.010675:0:203348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7c00/0xb126349c40f3478a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.010686:0:203348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7c00/0xb126349c40f3478a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508616.010702:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480126976:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1787508616.010737:0:203348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508616.010762:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9ff2c00 going to sleep for 11 seconds 00000100:00080000:1.0:1787508616.010834:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508616.010879:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480126976 00000100:00100000:2.0:1787508616.010884:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480126976 00000100:00100000:2.0:1787508616.010921:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29749 00000100:00100000:2.0:1787508616.010929:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:203348:x1874324480126976:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787508616.010973:0:202231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508616.010989:0:202231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34791 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f3478a expref: -99 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.011010:0:202231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34791 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f3478a expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.011023:0:202231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34791 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3478a expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.011030:0:202231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fda00) 00010000:00010000:2.0:1787508616.011033:0:202231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508616.011035:0:202231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa200, rc 0) 00000100:00100000:2.0:1787508616.011072:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:203348:x1874324480126976:12345-0@lo:101:mdt00_003.0 Request processed in 143us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508616.011077:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29749 00000100:00100000:0.0:1787508616.012097:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480126976:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787508616.012117:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7c00/0xb126349c40f3478a lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34791 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.012129:0:203348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7c00/0xb126349c40f3478a lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34791 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787508616.012150:0:203348:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1787508616.012199:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ace680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480127104:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787508616.012243:0:203348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508616.012287:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9ff2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787508616.012460:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480127104 00000100:00100000:2.0:1787508616.012467:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480127104 00000100:00100000:2.0:1787508616.012517:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29750 00000100:00100000:2.0:1787508616.012526:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:203348:x1874324480127104:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787508616.012610:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:203348:x1874324480127104:12345-0@lo:1000:mdt00_003.0 Request processed in 84us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508616.012617:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29750 00000100:00100000:1.0:1787508616.012683:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ace680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480127104:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787508616.012727:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc874700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480127232:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787508616.012756:0:203348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508616.012780:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9091d83eba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787508616.013084:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc876680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:230618:1874324480126592:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508616.013110:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc875c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:230618:1874324480126720:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508616.013129:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f34783 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508616.013252:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480127232 00000100:00100000:2.0:1787508616.013258:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480127232 00000100:00100000:2.0:1787508616.013299:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29751 00000100:00100000:2.0:1787508616.013307:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:203348:x1874324480127232:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787508616.013437:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:203348:x1874324480127232:12345-0@lo:1000:mdt00_003.0 Request processed in 130us (679us total) trans 0 rc 1/1 00000100:00100000:2.0:1787508616.013444:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29751 00000100:00100000:3.0:1787508616.013563:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc874700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480127232:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1787508616.013629:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34798 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.013637:0:203348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34798 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.013647:0:203348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34798 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508616.013662:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b01880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480127360:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1787508616.013691:0:203348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508616.013718:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787508616.013989:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480127360 00000100:00100000:0.0:1787508616.013995:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480127360 00000100:00100000:0.0:1787508616.014027:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29752 00000100:00100000:0.0:1787508616.014034:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:203348:x1874324480127360:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787508616.014046:0:225829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508616.014063:0:225829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3479f lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f34798 expref: -99 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.014084:0:225829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f3473d lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae464 expref: 582 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.014095:0:225829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3479f lrc: 4/0,0 mode: --/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f34798 expref: 9 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.014120:0:225829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f3473d lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae464 expref: 582 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.014131:0:225829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f3473d lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae464 expref: 582 pid: 202227 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508616.014143:0:225829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9acd500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480127488:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508616.014211:0:225829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9ff2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508616.016234:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508616.016289:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508616.016350:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509542272 00000100:00100000:1.0:1787508616.016360:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509542272 00010000:00010000:1.0:1787508616.016430:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f346c6 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae43a expref: 9 pid: 203348 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508616.016464:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509542400 00000100:00100000:1.0:1787508616.016468:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509542400 00010000:00010000:1.0:1787508616.016487:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f34759 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae472 expref: 644 pid: 203348 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508616.016511:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27885 00000100:00100000:1.0:1787508616.016521:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2400:x1874324509542272:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508616.016537:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508616.016543:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f346c6 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae43a expref: 9 pid: 203348 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.016555:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f346c6 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae43a expref: 9 pid: 203348 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.016579:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f346c6 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae43a expref: 9 pid: 203348 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.016596:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x293:0x0].0x0 (ffff9090d36fd300) 00010000:00010000:1.0:1787508616.016601:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f34783 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.016610:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f34783 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.016615:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508616.016666:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2400:x1874324509542272:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 146us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508616.016674:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27885 00000100:00100000:1.0:1787508616.016690:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27886 00000100:00100000:1.0:1787508616.016697:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde3c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:2401:x1874324509542400:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508616.016704:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508616.016709:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f34759 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae472 expref: 644 pid: 203348 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.016719:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f34759 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae472 expref: 644 pid: 203348 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.016736:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f34759 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae472 expref: 644 pid: 203348 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.016744:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x293:0x0].0x0 (ffff9090d36fd300) 00010000:00010000:1.0:1787508616.016747:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f34783 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.016754:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f34783 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.016761:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f34783 lrc: 4/0,1 mode: PW/PW res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.016782:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508616.016801:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde3c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+643:2401:x1874324509542400:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 105us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508616.016808:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27886 00000100:00080000:3.0:1787508616.017023:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787508616.017039:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f34783 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.017048:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f34783 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.017107:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f200/0xb126349c40f347a6 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.017116:0:230618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f200/0xb126349c40f347a6 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x0 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.017126:0:230618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f200/0xb126349c40f347a6 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508616.017146:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b02680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480127616:0@lo:101:mdt00_006.0 00000100:00100000:3.0:1787508616.017186:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508616.017219:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508616.017597:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480127616 00000100:00100000:1.0:1787508616.017603:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480127616 00000100:00100000:1.0:1787508616.017647:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29753 00000100:00100000:1.0:1787508616.017658:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:230618:x1874324480127616:12345-0@lo:101:mdt00_006.0 00010000:00010000:1.0:1787508616.017676:0:203182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508616.017692:0:203182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f347ad lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f347a6 expref: -99 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.017713:0:203182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f346d4 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae441 expref: 10 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.017726:0:203182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34767 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae479 expref: 582 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.017734:0:203182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f347ad lrc: 5/0,0 mode: --/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f347a6 expref: 11 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.017760:0:203182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34767 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae479 expref: 582 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.017771:0:203182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34767 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae479 expref: 582 pid: 209004 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508616.017782:0:203182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc875500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480127744:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508616.017861:0:203182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f346d4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae441 expref: 10 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.017870:0:203182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f346d4 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae441 expref: 10 pid: 230618 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508616.017878:0:203182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc876a00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480127872:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508616.017900:0:203182:0:(client.c:2715:ptlrpc_set_wait()) set ffff9091d83eb540 going to sleep for 11 seconds 00000100:00100000:3.0:1787508616.020293:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508616.021352:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509542528 00000100:00100000:2.0:1787508616.021365:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509542528 00010000:00010000:2.0:1787508616.021415:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f3473d lrc: 5/0,0 mode: PR/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae464 expref: 583 pid: 202227 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508616.021469:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27887 00000100:00100000:2.0:1787508616.021479:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:2402:x1874324509542528:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508616.021495:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508616.021503:0:229383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f3473d lrc: 5/0,0 mode: PR/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae464 expref: 583 pid: 202227 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.021520:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f3473d lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae464 expref: 583 pid: 202227 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.021547:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d4:0x0].0x0 (ffff9090d36fd600) 00010000:00010000:2.0:1787508616.021556:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3479f lrc: 3/0,0 mode: --/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f34798 expref: 11 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.021569:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3479f lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xb126349c40f34798 expref: 11 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.021579:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3479f lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xb126349c40f34798 expref: 11 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.021618:0:229383:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3479f lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34798 expref: 11 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508616.021636:0:229383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:229383:1874324480128000:0@lo:105: 00000100:00100000:2.0:1787508616.021701:0:229383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508616.021743:0:229383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cf708000 going to sleep for 11 seconds 00000100:00100000:1.0:1787508616.021898:0:229386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480128000 00000100:00100000:1.0:1787508616.021903:0:229386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480128000 00000100:00100000:1.0:1787508616.021961:0:229386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18181 00000100:00100000:1.0:1787508616.021969:0:229386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:229383:x1874324480128000:12345-0@lo:105: 00010000:00010000:1.0:1787508616.021981:0:229386:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34798 lrc: 4/0,1 mode: --/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3479f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.021992:0:229386:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34798 lrc: 4/0,1 mode: --/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3479f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.022002:0:229386:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34798 lrc: 4/0,1 mode: --/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3479f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.022011:0:229386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34798 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f3479f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.022018:0:229386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34798 lrc: 5/0,1 mode: EX/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f3479f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.022027:0:229386:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34798 lrc: 5/0,1 mode: EX/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f3479f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.022042:0:229386:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090e4c8e800) 00000100:00100000:1.0:1787508616.022081:0:229386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:229383:x1874324480128000:12345-0@lo:105: Request processed in 113us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508616.022089:0:229386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18181 00010000:00010000:0.0:1787508616.022198:0:225829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f3473d lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae464 expref: 583 pid: 202227 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508616.022215:0:225829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9acd500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480127488:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508616.022240:0:225829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3479f lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34798 expref: 11 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.022250:0:225829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d4:0x0].0x0 (ffff9090d36fd600) 00010000:00010000:0.0:1787508616.022253:0:225829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508616.022255:0:225829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6000, rc 0) 00000100:00100000:0.0:1787508616.022319:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:203348:x1874324480127360:12345-0@lo:101:mdt00_003.0 Request processed in 8284us (8625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508616.022327:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29752 00000100:00100000:1.0:1787508616.022454:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b01880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480127360:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787508616.022469:0:203348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34798 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3479f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.022501:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f347b4 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.022512:0:203348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f3476e lrc: 2/0,1 mode: PW/PW res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.022519:0:203348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f347b4 lrc: 4/0,1 mode: --/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.022532:0:203348:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f3476e lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.022540:0:203348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f347b4 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508616.023416:0:229383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:229383:1874324480128000:0@lo:105: 00010000:00010000:2.0:1787508616.023445:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508616.023503:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:2402:x1874324509542528:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 2025us (3221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508616.023513:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27887 00000100:00100000:3.0:1787508616.023626:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508616.023668:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508616.023875:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509542656 00000100:00100000:1.0:1787508616.023882:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509542656 00010000:00010000:1.0:1787508616.023910:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34767 lrc: 5/0,0 mode: PR/PR res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae479 expref: 582 pid: 209004 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508616.023935:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509542784 00000100:00100000:1.0:1787508616.023963:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509542784 00010000:00010000:1.0:1787508616.023977:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f346d4 lrc: 5/0,0 mode: PR/PR res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae441 expref: 11 pid: 230618 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508616.023996:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27888 00000100:00100000:1.0:1787508616.024004:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:2403:x1874324509542656:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508616.024016:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508616.024021:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34767 lrc: 5/0,0 mode: PR/PR res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae479 expref: 582 pid: 209004 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.024039:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34767 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae479 expref: 582 pid: 209004 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.024063:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x289:0x0].0x0 (ffff9090c6913600) 00010000:00010000:1.0:1787508616.024069:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f347ad lrc: 3/0,0 mode: --/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f347a6 expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.024078:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f347ad lrc: 3/0,0 mode: --/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f347a6 expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.024084:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508616.024124:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:2403:x1874324509542656:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 120us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508616.024131:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27888 00000100:00100000:1.0:1787508616.024144:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27889 00000100:00100000:1.0:1787508616.024151:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2403:x1874324509542784:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508616.024159:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508616.024164:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f346d4 lrc: 5/0,0 mode: PR/PR res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae441 expref: 11 pid: 230618 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.024175:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f346d4 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae441 expref: 11 pid: 230618 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.024187:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x289:0x0].0x0 (ffff9090c6913600) 00010000:00010000:1.0:1787508616.024192:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f347ad lrc: 3/0,0 mode: --/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f347a6 expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.024201:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f347ad lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xb126349c40f347a6 expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.024210:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f347ad lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xb126349c40f347a6 expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.024242:0:202211:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f347ad lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f347a6 expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508616.024255:0:202211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc874700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:202211:1874324480128128:0@lo:105: 00000100:00100000:1.0:1787508616.024304:0:202211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508616.024338:0:202211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9091d83eba80 going to sleep for 11 seconds 00010000:00010000:0.0:1787508616.024556:0:203182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34767 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae479 expref: 581 pid: 209004 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508616.024573:0:203182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc875500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480127744:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508616.024585:0:203182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f346d4 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae441 expref: 11 pid: 230618 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508616.024596:0:203182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc876a00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480127872:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508616.024620:0:203182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f347ad lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f347a6 expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.024629:0:203182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x289:0x0].0x0 (ffff9090c6913600) 00010000:00010000:0.0:1787508616.024633:0:203182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508616.024635:0:203182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b000, rc 0) 00000100:00100000:0.0:1787508616.024685:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:230618:x1874324480127616:12345-0@lo:101:mdt00_006.0 Request processed in 7029us (7498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508616.024692:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29753 00000100:00100000:2.0:1787508616.024769:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b02680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480127616:0@lo:101:mdt00_006.0 00010000:00010000:2.0:1787508616.024787:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f200/0xb126349c40f347a6 lrc: 4/0,1 mode: --/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f347ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.024797:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f200/0xb126349c40f347a6 lrc: 4/0,1 mode: --/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f347ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508616.028183:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480128128 00000100:00100000:3.0:1787508616.028201:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480128128 00000100:00100000:3.0:1787508616.028283:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18182 00000100:00100000:3.0:1787508616.028294:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc875c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:202211:x1874324480128128:12345-0@lo:105: 00010000:00010000:3.0:1787508616.028312:0:202209:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f200/0xb126349c40f347a6 lrc: 5/0,1 mode: --/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f347ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.028325:0:202209:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f200/0xb126349c40f347a6 lrc: 5/0,1 mode: --/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f347ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.028341:0:202209:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f200/0xb126349c40f347a6 lrc: 5/0,1 mode: --/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f347ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.028351:0:202209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f200/0xb126349c40f347a6 lrc: 5/0,1 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f347ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.028359:0:202209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f200/0xb126349c40f347a6 lrc: 6/0,1 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f347ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.028368:0:202209:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f200/0xb126349c40f347a6 lrc: 6/0,1 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f347ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.028409:0:202209:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090e4c8f200) 00010000:00010000:2.0:1787508616.028474:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f200/0xb126349c40f347a6 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f347ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.028485:0:230618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f200/0xb126349c40f347a6 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f347ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508616.028501:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc875c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:202211:x1874324480128128:12345-0@lo:105: Request processed in 209us (4197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508616.028509:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18182 00000040:00080000:2.0:1787508616.028739:0:230618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xf:0x0].49, 344 off83928 00000040:00080000:2.0:1787508616.028816:0:230618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x5:0x0].592, 552 off750760 00000004:00080000:2.0:1787508616.028822:0:230618:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090cf708000 with version 13612 00000100:00100000:0.0:1787508616.028919:0:202211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc874700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:202211:1874324480128128:0@lo:105: 00010000:00010000:0.0:1787508616.028973:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508616.029021:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2403:x1874324509542784:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 4868us (5351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508616.029031:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27889 00000004:00080000:3.0:1787508616.029357:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13612 rpc_version 13612 00000020:00100000:3.0:1787508616.029385:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787508616.029392:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091f9b00000 x1874324480128384/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1784/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787508616.029413:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b00000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480128384:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508616.029469:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508616.029500:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9480 going to sleep for 11 seconds 00000100:00100000:0.0:1787508616.032064:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480128384 00000100:00100000:0.0:1787508616.032082:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480128384 00000100:00100000:0.0:1787508616.032154:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29754 00000100:00100000:0.0:1787508616.032165:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:202961:x1874324480128384:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787508616.032469:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:202961:x1874324480128384:12345-0@lo:1000:osp_up0-1.0 Request processed in 304us (2998us total) trans 12884944089 rc 0/0 00000100:00100000:0.0:1787508616.032477:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29754 00000100:00100000:1.0:1787508616.032697:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b00000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480128384:0@lo:1000:osp_up0-1.0 00000004:00010000:3.0:1787508616.032858:0:230618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006cc06d66 reply state 00000000fdc47a43 transno 8589962024 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f34783 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.032883:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f34783 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.032893:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x293:0x0].0x0 (ffff9090d36fd300) 00010000:00010000:3.0:1787508616.032896:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787508616.032901:0:230618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787508616.032911:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f200/0xb126349c40f347a6 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f347ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.032920:0:230618:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f200/0xb126349c40f347a6 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f347ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787508616.032932:0:230618:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x289:0x0] 00000004:00010000:3.0:1787508616.032965:0:230618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006cc06d66 reply state 00000000fdc47a43 transno 8589962024 ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f3476e lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.032975:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f3476e lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.032981:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d4:0x0].0x0 (ffff9090d36fdb00) 00010000:00010000:3.0:1787508616.032983:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508616.032986:0:230618:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f347b4 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.032997:0:230618:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f347b4 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.033002:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f347b4 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508616.033032:0:230618:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787508616.033044:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d4:0x0]: returning size 4096 00000100:00100000:3.0:1787508616.033128:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:336092:x1874324509541632:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 50988us (51237us total) trans 8589962024 rc 0/0 00000100:00100000:3.0:1787508616.033137:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93932 00010000:00010000:1.0:1787508616.033229:0:203348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f347b4 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.033237:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f347b4 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.033269:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f347bb lrc: 3/0,1 mode: --/EX res: [0x240000bd1:0x293:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.033281:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f347bb lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x293:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.033289:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f347bb lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x293:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.033331:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f347c2 lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.033337:0:203348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f347c2 lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x0 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.033348:0:203348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f347c2 lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508616.033367:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc876680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480128512:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1787508616.033416:0:203348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508616.033467:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9091d83eb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787508616.033683:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480128512 00000100:00100000:0.0:1787508616.033691:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480128512 00000100:00100000:0.0:1787508616.033739:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29755 00000100:00100000:0.0:1787508616.033748:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:203348:x1874324480128512:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787508616.033767:0:225829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508616.033783:0:225829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f347c9 lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f347c2 expref: -99 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.033806:0:225829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f347ad lrc: 2/0,0 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f347a6 expref: 12 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.033817:0:225829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f347c9 lrc: 4/0,0 mode: --/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f347c2 expref: 12 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.033841:0:225829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f347ad lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f347a6 expref: 12 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508616.033857:0:225829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9acd500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480128640:0@lo:104: 00000100:00100000:0.0:1787508616.033889:0:225829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508616.033927:0:225829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9ff2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787508616.034007:0:229386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480128640 00000100:00100000:2.0:1787508616.034012:0:229386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480128640 00000100:00100000:2.0:1787508616.034049:0:229386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18183 00000100:00100000:2.0:1787508616.034057:0:229386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:225829:x1874324480128640:12345-0@lo:104: 00010000:00010000:2.0:1787508616.034069:0:229386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f200/0xb126349c40f347a6 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f347ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.034148:0:229386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787508616.034154:0:229386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:225829:x1874324480128640:12345-0@lo:104: Request processed in 99us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508616.034162:0:229386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18183 00010000:00010000:2.0:1787508616.034184:0:202215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787508616.034191:0:202215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f200/0xb126349c40f347a6 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f347ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.034199:0:202215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f200 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:2.0:1787508616.034206:0:202215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f200/0xb126349c40f347a6 lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f347ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508616.034216:0:202215:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f200/0xb126349c40f347a6 lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f347ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.034243:0:202215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f200/0xb126349c40f347a6 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f347ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.034250:0:202215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787508616.034281:0:202215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f200/0xb126349c40f347a6 lrc: 1/0,0 mode: --/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f347ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.034290:0:202215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8f200/0xb126349c40f347a6 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f347ad expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.034304:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508616.034306:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508616.034308:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508616.034321:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480128768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787508616.034353:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508616.034763:0:225829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9acd500 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480128640:0@lo:104: 00010000:00010000:0.0:1787508616.034785:0:225829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f347c9 lrc: 3/0,0 mode: --/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f347c2 expref: 12 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.034795:0:225829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x289:0x0].0x0 (ffff9090c6913600) 00010000:00010000:0.0:1787508616.034798:0:225829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787508616.034801:0:225829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f347c9 lrc: 3/0,0 mode: --/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f347c2 expref: 12 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508616.034808:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480128768 00010000:00010000:0.0:1787508616.034810:0:225829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f347c9 lrc: 3/0,0 mode: --/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f347c2 expref: 12 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508616.034813:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480128768 00010000:00010000:0.0:1787508616.034817:0:225829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6e00, rc 0) 00010000:00010000:3.0:1787508616.034833:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f347ad lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f347a6 expref: 13 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508616.034855:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27890 00000100:00100000:0.0:1787508616.034861:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+13:203348:x1874324480128512:12345-0@lo:101:mdt00_003.0 Request processed in 1115us (1445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508616.034862:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+13:3619:x1874324480128768:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508616.034867:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29755 00010000:00010000:3.0:1787508616.034871:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787508616.035471:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc876680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480128512:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787508616.035491:0:203348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f347c2 lrc: 4/0,1 mode: --/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f347c9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.035501:0:203348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f347c2 lrc: 4/0,1 mode: --/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f347c9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787508616.041589:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944089 is committed 00010000:00010000:3.0:1787508616.041788:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f347ad lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x289:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f347a6 expref: 11 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.041810:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x289:0x0].0x0 (ffff9090c6913600) 00010000:00010000:3.0:1787508616.041816:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f347c9 lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f347c2 expref: 10 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.041827:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f347c9 lrc: 2/0,0 mode: EX/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f347c2 expref: 10 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.041837:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f347c9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f347c2 expref: 10 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.041884:0:225839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f347c9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f347c2 expref: 10 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508616.041902:0:225839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b01880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:225839:1874324480128896:0@lo:105: 00000100:00100000:3.0:1787508616.041993:0:225839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508616.042047:0:225839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9300 going to sleep for 11 seconds 00000100:00100000:0.0:1787508616.042112:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480128896 00000100:00100000:0.0:1787508616.042120:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480128896 00000100:00100000:0.0:1787508616.042172:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18184 00000100:00100000:0.0:1787508616.042182:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:225839:x1874324480128896:12345-0@lo:105: 00010000:00010000:0.0:1787508616.042193:0:202209:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f347c2 lrc: 5/0,1 mode: --/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f347c9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.042219:0:202209:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f347c2 lrc: 5/0,1 mode: --/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f347c9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.042228:0:202209:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f347c2 lrc: 5/0,1 mode: --/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f347c9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.042235:0:202209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f347c2 lrc: 5/0,1 mode: EX/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f347c9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.042241:0:202209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f347c2 lrc: 6/0,1 mode: EX/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f347c9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.042248:0:202209:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f347c2 lrc: 6/0,1 mode: EX/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f347c9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.042280:0:202209:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d247a800) 00000100:00100000:0.0:1787508616.042330:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:225839:x1874324480128896:12345-0@lo:105: Request processed in 148us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508616.042338:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18184 00010000:00010000:2.0:1787508616.042342:0:203348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f347c2 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f347c9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.042351:0:203348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f347c2 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f347c9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508616.042577:0:225839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b01880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:225839:1874324480128896:0@lo:105: 00010000:00010000:3.0:1787508616.042589:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508616.042629:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+10:3619:x1874324480128768:12345-0@lo:103:ldlm_bl.0 Request processed in 7767us (8276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508616.042637:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27890 00000100:00100000:2.0:1787508616.043043:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480129024:0@lo:403:mdt00_003.0 00000100:00100000:2.0:1787508616.043090:0:203348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508616.043127:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cf708540 going to sleep for 11 seconds 00000100:00100000:3.0:1787508616.043140:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480129024 00000100:00100000:3.0:1787508616.043146:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480129024 00000100:00100000:3.0:1787508616.043194:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29756 00000100:00100000:3.0:1787508616.043202:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:203348:x1874324480129024:12345-0@lo:403:mdt00_003.0 00000100:00100000:0.0:1787508616.043514:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480128768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787508616.045049:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:203348:x1874324480129024:12345-0@lo:403:mdt00_003.0 Request processed in 1840us (1951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508616.045063:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29756 00000100:00100000:0.0:1787508616.045067:0:203348:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944089 gen 2 00000004:00080000:0.0:1787508616.045073:0:203348:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944089 committed transno 12884944089 00000100:00100000:0.0:1787508616.045097:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480129024:0@lo:403:mdt00_003.0 00000100:00100000:3.0:1787508616.045135:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508616.045158:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509542912 00000100:00100000:3.0:1787508616.045164:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509542912 00000100:00100000:3.0:1787508616.045200:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93934 00000100:00100000:3.0:1787508616.045207:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+581:336093:x1874324509542912:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508616.045225:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508616.045250:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f347d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae480 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.045318:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f347d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.045331:0:202226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f3477c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34775 expref: 9 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.045339:0:202226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f347d7 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.045368:0:202226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f3477c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f34775 expref: 9 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508616.045382:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480129152:0@lo:104: 00000100:00100000:3.0:1787508616.045415:0:202226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508616.045462:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9300 going to sleep for 11 seconds 00000100:00100000:3.0:1787508616.045483:0:229386:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787508616.045492:0:229386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480129152 00000100:00100000:3.0:1787508616.045495:0:229386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480129152 00000100:00100000:3.0:1787508616.045521:0:229386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18185 00000100:00100000:3.0:1787508616.045527:0:229386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9f1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:202226:x1874324480129152:12345-0@lo:104: 00010000:00010000:3.0:1787508616.045537:0:229386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34775 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f3477c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.045579:0:229386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787508616.045584:0:229386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9f1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:202226:x1874324480129152:12345-0@lo:104: Request processed in 58us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508616.045590:0:229386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18185 00000100:00100000:3.0:1787508616.045638:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480129152:0@lo:104: 00010000:00010000:3.0:1787508616.045650:0:202226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f347d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.045969:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787508616.045976:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34775 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f3477c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.045984:0:204785:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff9090cd2ab000 is referenced, will be cancelled later 00010000:00010000:1.0:1787508616.045987:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34775 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f3477c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.045994:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508616.045995:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508616.045997:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787508616.048579:0:203348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xf:0x0].50, 664 off84592 00000040:00080000:0.0:1787508616.048756:0:203348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x5:0x0].593, 744 off751504 00000004:00080000:0.0:1787508616.048762:0:203348:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d9ff2cc0 with version 13613 00000004:00080000:1.0:1787508616.048907:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13613 rpc_version 13613 00000020:00100000:1.0:1787508616.050532:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787508616.050550:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090cc876a00 x1874324480129408/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1808/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787508616.050579:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc876a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480129408:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508616.050647:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508616.050685:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9091d83eb180 going to sleep for 11 seconds 00000100:00100000:0.0:1787508616.050775:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480129408 00000100:00100000:0.0:1787508616.050912:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480129408 00000100:00100000:0.0:1787508616.050977:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29757 00000100:00100000:0.0:1787508616.050986:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:202961:x1874324480129408:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787508616.051460:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+11:202961:x1874324480129408:12345-0@lo:1000:osp_up0-1.0 Request processed in 473us (811us total) trans 12884944090 rc 0/0 00000100:00100000:0.0:1787508616.051469:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29757 00000100:00100000:1.0:1787508616.051729:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc876a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480129408:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1787508616.055502:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d4:0x0]: returning size 4096 00010000:00010000:0.0:1787508616.055537:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f347bb lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x293:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.055550:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f347bb lrc: 2/0,0 mode: EX/EX res: [0x240000bd1:0x293:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.055557:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f347bb lrc: 3/0,0 mode: EX/EX res: [0x240000bd1:0x293:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.055563:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247be00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508616.055567:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f347bb lrc: 3/0,0 mode: EX/EX res: [0x240000bd1:0x293:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.055575:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f347bb lrc: 4/0,0 mode: EX/EX res: [0x240000bd1:0x293:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.055591:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x293:0x0].0x0 (ffff9090d36fd300) 00010000:00010000:0.0:1787508616.055593:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787508616.055598:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f347bb lrc: 2/0,0 mode: --/EX res: [0x240000bd1:0x293:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.055604:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f347bb lrc: 0/0,0 mode: --/EX res: [0x240000bd1:0x293:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.055622:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f347c2 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f347c9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.055630:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f347c2 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f347c9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.055638:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f347c2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f347c9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.055669:0:203348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787508616.055681:0:203348:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x289:0x0] 00010000:00010000:0.0:1787508616.055688:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f347b4 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.055694:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f347b4 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.055700:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f347b4 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.055705:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508616.055708:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f347b4 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.055714:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f347b4 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.055721:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d4:0x0].0x0 (ffff9090d36fdb00) 00010000:00010000:0.0:1787508616.055724:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508616.055727:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f347b4 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.055733:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f347b4 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.055741:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34798 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3479f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.055748:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34798 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f3479f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.055755:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34798 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f3479f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.055769:0:203348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787508616.055916:0:226765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787508616.055922:0:226765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f347c2 lrc: 2/0,0 mode: EX/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xb126349c40f347c9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.055930:0:226765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a800 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:1.0:1787508616.055934:0:226765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f347c2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xb126349c40f347c9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508616.055964:0:226765:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f347c2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xb126349c40f347c9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.056000:0:226765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f347c2 lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f347c9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.056007:0:226765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787508616.056030:0:226765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f347c2 lrc: 1/0,0 mode: --/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f347c9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.056037:0:226765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a800/0xb126349c40f347c2 lrc: 0/0,0 mode: --/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f347c9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.056053:0:226765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787508616.056056:0:226765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34798 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xb126349c40f3479f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.056068:0:226765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:1.0:1787508616.056071:0:226765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34798 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xb126349c40f3479f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508616.056078:0:226765:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34798 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xb126349c40f3479f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.056090:0:226765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34798 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f3479f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.056096:0:226765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787508616.056101:0:226765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34798 lrc: 1/0,0 mode: --/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f3479f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.056107:0:226765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34798 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f3479f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.056120:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508616.056121:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508616.056123:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508616.056139:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480129536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508616.056199:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508616.056237:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787508616.056242:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480129664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508616.056262:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787508616.056356:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508616.056373:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480129536 00000100:00100000:2.0:1787508616.056380:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480129536 00000100:00100000:2.0:1787508616.056447:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480129664 00000100:00100000:2.0:1787508616.056451:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480129664 00000100:00100000:2.0:1787508616.056484:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9790 00000100:00100000:2.0:1787508616.056493:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+12:3616:x1874324480129536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508616.056506:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508616.056524:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f347c9 lrc: 0/0,0 mode: --/EX res: [0x2000013a2:0x289:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f347c2 expref: 12 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.056538:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x289:0x0].0x0 (ffff9090c6913600) 00010000:00010000:2.0:1787508616.056546:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508616.056576:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+11:3616:x1874324480129536:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508616.056583:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9790 00000100:00100000:2.0:1787508616.056598:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9791 00000100:00100000:2.0:1787508616.056603:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+10:3616:x1874324480129664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508616.056609:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508616.056618:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f3479f lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f34798 expref: 10 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.056627:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d4:0x0].0x0 (ffff9090d36fd600) 00010000:00010000:2.0:1787508616.056632:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508616.056648:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3616:x1874324480129664:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508616.056653:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9791 00000100:00100000:1.0:1787508616.056789:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480129664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508616.056800:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480129536:0@lo:103:ldlm_bl.0 00000004:00080000:0.0:1787508616.056865:0:203348:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787508616.056881:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34775 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f3477c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.056890:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34775 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xb126349c40f3477c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.056898:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34775 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x11400400000000 nid: local remote: 0xb126349c40f3477c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.056910:0:203348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000004:00080000:0.0:1787508616.056915:0:203348:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787508616.056919:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7c00/0xb126349c40f3478a lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34791 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.056932:0:203348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7c00/0xb126349c40f3478a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34791 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508616.057020:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4861850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336091:x1874324509541888:12345-192.168.201.30@tcp:36:rm.0 Request processed in 74155us (75077us total) trans 8589962025 rc 0/0 00000100:00100000:0.0:1787508616.057028:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93933 00010000:00010000:2.0:1787508616.058056:0:202215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787508616.058066:0:202215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34775 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x13 rrc: 3 type: IBT gid 0 flags: 0x1400400000000 nid: local remote: 0xb126349c40f3477c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.058076:0:202215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab000 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:2.0:1787508616.058082:0:202215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34775 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f3477c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508616.058089:0:202215:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34775 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f3477c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.058124:0:202215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34775 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3477c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.058239:0:202215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787508616.058276:0:202215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34775 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3477c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.058289:0:202215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab000/0xb126349c40f34775 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3477c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.058304:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508616.058306:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508616.058308:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508616.058357:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480129792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508616.058413:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508616.059473:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480129792 00000100:00100000:2.0:1787508616.059484:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480129792 00010000:00010000:2.0:1787508616.059522:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f3477c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f34775 expref: 9 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508616.059567:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27891 00000100:00100000:2.0:1787508616.059577:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde3e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+9:3618:x1874324480129792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508616.059592:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508616.059613:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f3477c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f34775 expref: 9 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.059628:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508616.059632:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f347d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.059643:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f347d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.059650:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f347d7 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.059685:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508616.059746:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde3e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3618:x1874324480129792:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508616.059755:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27891 00000100:00100000:1.0:1787508616.059999:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480129792:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508616.060025:0:202226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f347d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.060033:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f347d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508616.060090:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508616.060094:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508616.060114:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f347d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.060144:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f347d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae480 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.060159:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f347d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae480 expref: 582 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.060167:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508616.060170:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508616.060173:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e600, rc 0) 00000100:00100000:1.0:1787508616.060215:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509542912:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 15008us (15081us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508616.060223:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93934 00000100:00100000:3.0:1787508616.070754:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508616.070926:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509543040 00000100:00100000:1.0:1787508616.070978:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509543040 00000100:00100000:1.0:1787508616.071040:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93935 00000100:00100000:1.0:1787508616.071050:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:336094:x1874324509543040:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508616.071070:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508616.071092:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f347de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae487 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.071156:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f347e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.071170:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f347e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.071181:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f347e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508616.071225:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508616.071228:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508616.071249:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f347e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.071274:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f347de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae487 expref: 12 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.071293:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f347e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae487 expref: 11 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.071302:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508616.071304:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508616.071309:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a000, rc 0) 00000100:00100000:1.0:1787508616.071380:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336094:x1874324509543040:12345-192.168.201.30@tcp:101:rm.0 Request processed in 331us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508616.071387:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93935 00000100:00100000:3.0:1787508616.073006:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508616.073145:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509543168 00000100:00100000:0.0:1787508616.073155:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509543168 00000100:00100000:0.0:1787508616.073216:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93936 00000100:00100000:0.0:1787508616.073225:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509543168:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508616.073245:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508616.073267:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f347ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae48e expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.073329:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f347f3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.073342:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f347f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.073353:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f347f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.073368:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f347fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.073375:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f347fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.073385:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f347fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.073457:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f347f3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.073465:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f347f3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.073472:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f347f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.073479:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f347f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.073485:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508616.073489:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f347f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.073497:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f347f3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.073510:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508616.073513:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508616.073518:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f347f3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.073525:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f347f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.073538:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f347fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.073544:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f347fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.073550:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f347fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.073555:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508616.073558:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f347fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.073565:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f347fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.073571:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090c6913900) 00010000:00010000:0.0:1787508616.073574:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508616.073577:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f347fa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.073583:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f347fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.073614:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f347ec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae48e expref: 583 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.073624:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508616.073626:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508616.073630:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f347ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae48e expref: 583 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.073645:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7800, rc 0) 00000100:00100000:0.0:1787508616.073708:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509543168:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 484us (710us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508616.073715:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93936 00000100:00100000:3.0:1787508616.084185:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508616.084240:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508616.084522:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509543296 00000100:00100000:1.0:1787508616.084533:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509543296 00000100:00100000:1.0:1787508616.084593:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509543424 00000100:00100000:1.0:1787508616.084597:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509543424 00000100:00100000:1.0:1787508616.084628:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93937 00000100:00100000:1.0:1787508616.084639:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509543296:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508616.084660:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508616.084683:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f34801 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae495 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.084749:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f34808 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.084760:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f34808 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.084769:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f34808 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.084791:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3480f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.084799:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3480f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.084806:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3480f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.084862:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f34808 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.084868:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f34808 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.084872:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f34808 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.084876:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f34808 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.084880:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247bc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508616.084883:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f34808 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.084887:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f34808 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.084896:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508616.084898:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508616.084901:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f34808 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.084905:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f34808 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.084915:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3480f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.084919:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3480f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.084923:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3480f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.084926:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508616.084927:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3480f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.084930:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3480f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.084934:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090d171fa00) 00010000:00010000:1.0:1787508616.084935:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508616.084937:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3480f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.084975:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3480f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.084998:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f34801 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae495 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.085005:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508616.085006:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508616.085008:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f34801 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae495 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.085013:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a800, rc 0) 00000100:00100000:1.0:1787508616.085057:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509543296:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 421us (885us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508616.085064:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93937 00000100:00100000:1.0:1787508616.085076:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93938 00000100:00100000:1.0:1787508616.085081:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336094:x1874324509543424:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508616.085086:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508616.085358:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34816 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae49c expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.085396:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3481d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.085404:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3481d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.085412:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3481d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.085433:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34824 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.085441:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34824 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.085447:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34824 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.085476:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3481d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.085483:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3481d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.085493:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3481d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.085499:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3481d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.085504:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508616.085507:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3481d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.085512:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3481d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.085521:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508616.085523:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508616.085526:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3481d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.085532:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3481d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.085541:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34824 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.085547:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34824 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.085553:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34824 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.085558:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508616.085561:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34824 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.085566:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34824 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.085574:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090d171f600) 00010000:00010000:1.0:1787508616.085576:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508616.085579:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34824 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.085583:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34824 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.085606:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34816 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae49c expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.085614:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508616.085616:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508616.085619:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34816 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae49c expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.085626:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a200, rc 0) 00000100:00100000:1.0:1787508616.085752:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336094:x1874324509543424:12345-192.168.201.30@tcp:101:rm.0 Request processed in 668us (1510us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508616.085760:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93938 00000100:00100000:3.0:1787508616.088630:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508616.088740:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509543552 00000100:00100000:2.0:1787508616.088750:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509543552 00000100:00100000:2.0:1787508616.088815:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93939 00000100:00100000:2.0:1787508616.088826:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509543552:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508616.088850:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508616.088869:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f3482b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae4a3 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.088926:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34832 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.089098:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34832 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.089108:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34832 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.089120:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f34839 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.089125:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f34839 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.089130:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f34839 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.089184:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34832 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.089192:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34832 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.089196:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34832 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.089199:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34832 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.089203:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508616.089208:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34832 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.089215:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34832 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.089225:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508616.089228:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508616.089233:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34832 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.089240:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34832 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.089252:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f34839 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.089259:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f34839 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.089264:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f34839 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.089270:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aaa00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508616.089272:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f34839 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.089277:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f34839 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.089284:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090d36fd600) 00010000:00010000:2.0:1787508616.089286:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508616.089289:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f34839 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.089295:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f34839 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.089325:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f3482b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae4a3 expref: 583 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.089334:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508616.089336:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508616.089339:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f3482b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae4a3 expref: 583 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.089348:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa000, rc 0) 00000100:00100000:2.0:1787508616.089415:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509543552:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 590us (796us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508616.089433:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93939 00000100:00100000:3.0:1787508616.092285:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508616.092401:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509543680 00000100:00100000:2.0:1787508616.092414:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509543680 00000100:00100000:2.0:1787508616.092494:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93940 00000100:00100000:2.0:1787508616.092507:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336094:x1874324509543680:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508616.092529:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508616.092552:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34840 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae4aa expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.092618:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34847 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.092631:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34847 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.092642:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34847 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.092657:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f3484e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.092663:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f3484e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.092669:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f3484e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.092722:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34847 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.092730:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34847 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.092736:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34847 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.092742:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34847 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.092747:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508616.092751:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34847 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.092758:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34847 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.092770:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508616.092773:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508616.092789:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34847 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.092797:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34847 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.092813:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f3484e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.092819:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f3484e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.092824:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f3484e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.092829:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508616.092832:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f3484e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.092843:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f3484e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.092851:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090d36fd700) 00010000:00010000:2.0:1787508616.092853:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508616.092856:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f3484e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.092862:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f3484e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.092899:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34840 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae4aa expref: 12 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.092909:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508616.092911:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508616.092916:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34840 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae4aa expref: 12 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.092923:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa600, rc 0) 00000100:00100000:2.0:1787508616.093030:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336094:x1874324509543680:12345-192.168.201.30@tcp:101:rm.0 Request processed in 526us (755us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508616.093038:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93940 00000100:00100000:3.0:1787508616.095188:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508616.095271:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508616.095370:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509543936 00000100:00100000:1.0:1787508616.095381:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509543936 00000100:00100000:1.0:1787508616.095442:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509544064 00000100:00100000:1.0:1787508616.095445:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509544064 00000100:00100000:1.0:1787508616.095473:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93941 00000100:00100000:1.0:1787508616.095484:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509543936:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508616.095506:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508616.095529:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f34855 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae4b1 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.095608:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3485c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.095623:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3485c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.095633:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3485c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.095649:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34863 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.095655:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34863 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.095661:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34863 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.095721:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3485c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.095728:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3485c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.095735:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3485c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.095746:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3485c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.095751:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508616.095753:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3485c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.095759:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3485c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.095768:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508616.095770:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508616.095772:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3485c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.095777:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f3485c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.095803:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34863 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.095809:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34863 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.095814:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34863 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.095819:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508616.095822:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34863 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.095833:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34863 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.095840:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xce5b6a33 (ffff9090d171f700) 00010000:00010000:1.0:1787508616.095843:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508616.095845:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34863 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.095850:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34863 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.095880:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f34855 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae4b1 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.095888:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508616.095889:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508616.095891:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f34855 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae4b1 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.095898:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247bc00, rc 0) 00000100:00100000:1.0:1787508616.095966:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509543936:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 485us (788us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508616.095971:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93941 00000100:00100000:1.0:1787508616.095986:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93942 00000100:00100000:1.0:1787508616.095991:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336094:x1874324509544064:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508616.095997:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508616.096002:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f3486a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae4b8 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.096026:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34871 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.096031:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34871 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.096036:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34871 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.096042:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34878 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.096046:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34878 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.096050:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34878 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.096065:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34871 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.096069:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34871 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.096072:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34871 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.096076:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34871 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.096079:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508616.096082:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34871 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.096086:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34871 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.096090:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508616.096092:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508616.096093:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34871 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.096097:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34871 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.096103:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34878 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.096107:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34878 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.096110:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34878 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.096112:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508616.096114:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34878 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.096117:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34878 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.096120:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090d171ff00) 00010000:00010000:1.0:1787508616.096122:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508616.096124:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34878 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.096127:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34878 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.096140:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f3486a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae4b8 expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.096144:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508616.096146:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508616.096148:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f3486a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae4b8 expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.096153:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247be00, rc 0) 00000100:00100000:1.0:1787508616.096168:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336094:x1874324509544064:12345-192.168.201.30@tcp:101:rm.0 Request processed in 177us (898us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508616.096171:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93942 00000100:00100000:1.0:1787508616.099234:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508616.099310:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509544320 00000100:00100000:2.0:1787508616.099320:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509544320 00000100:00100000:2.0:1787508616.099384:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93943 00000100:00100000:2.0:1787508616.099396:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336094:x1874324509544320:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508616.099428:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508616.099449:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3487f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae4bf expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.099525:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34886 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.099539:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34886 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.099550:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34886 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.099565:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f3488d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.099572:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f3488d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.099579:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f3488d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.099629:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34886 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.099637:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34886 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.099644:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34886 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.099649:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34886 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.099656:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508616.099660:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34886 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.099667:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34886 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.099679:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508616.099681:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508616.099686:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34886 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.099693:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34886 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.099706:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f3488d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.099713:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f3488d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.099719:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f3488d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.099724:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508616.099728:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f3488d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.099735:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f3488d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.099747:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090d36fd500) 00010000:00010000:2.0:1787508616.099750:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508616.099753:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f3488d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.099760:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f3488d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.099796:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3487f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae4bf expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.099808:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508616.099811:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508616.099815:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3487f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae4bf expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.099824:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aba00, rc 0) 00000100:00100000:2.0:1787508616.099886:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336094:x1874324509544320:12345-192.168.201.30@tcp:101:rm.0 Request processed in 492us (662us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508616.099894:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93943 00000100:00100000:3.0:1787508616.102994:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508616.103064:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508616.103224:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509544576 00000100:00100000:1.0:1787508616.103237:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509544576 00000100:00100000:1.0:1787508616.103305:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509544704 00000100:00100000:1.0:1787508616.103309:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509544704 00000100:00100000:1.0:1787508616.103335:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93944 00000100:00100000:1.0:1787508616.103346:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509544576:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508616.103370:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508616.103393:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34894 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae4c6 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.103485:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3489b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.103499:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3489b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.103511:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3489b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.103525:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f348a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.103532:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f348a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.103538:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f348a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.103597:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3489b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.103605:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3489b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.103611:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3489b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508616.103612:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93945 00010000:00010000:1.0:1787508616.103618:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3489b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508616.103621:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336094:x1874324509544704:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508616.103624:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508616.103630:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3489b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.103637:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3489b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.103639:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508616.103648:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f348a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae4cd expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.103651:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508616.103654:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508616.103658:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3489b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.103665:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3489b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.103682:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f348a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.103686:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f348b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.103689:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f348a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.103696:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f348b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.103696:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f348a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.103701:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508616.103705:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f348b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.103705:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f348a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.103711:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f348a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.103715:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f348b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.103718:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaf7dd568 (ffff9090d171f600) 00010000:00010000:1.0:1787508616.103721:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508616.103724:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f348a2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.103725:0:205405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34791 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3478a expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.103731:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f348a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf7dd568 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.103735:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f348b7 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.103760:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34894 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae4c6 expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.103763:0:205405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34791 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f3478a expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.103769:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508616.103771:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508616.103774:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34894 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae4c6 expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.103783:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a200, rc 0) 00000100:00100000:3.0:1787508616.103785:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b01c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480129920:0@lo:104: 00000100:00100000:1.0:1787508616.103913:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509544576:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 568us (970us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508616.103921:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93944 00000100:00100000:3.0:1787508616.104194:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508616.104244:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9300 going to sleep for 11 seconds 00000100:00100000:2.0:1787508616.106065:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480129920 00000100:00100000:2.0:1787508616.106083:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480129920 00000100:00100000:2.0:1787508616.106195:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18186 00000100:00100000:2.0:1787508616.106206:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:205405:x1874324480129920:12345-0@lo:104: 00010000:00010000:2.0:1787508616.106225:0:202209:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7c00/0xb126349c40f3478a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f34791 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.106336:0:202209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787508616.106343:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:205405:x1874324480129920:12345-0@lo:104: Request processed in 140us (2149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508616.106350:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18186 00010000:00010000:1.0:1787508616.107278:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787508616.107289:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7c00/0xb126349c40f3478a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f34791 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.107299:0:204785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7c00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:1.0:1787508616.107305:0:204785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7c00/0xb126349c40f3478a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f34791 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508616.107315:0:204785:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7c00/0xb126349c40f3478a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f34791 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.107363:0:204785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7c00/0xb126349c40f3478a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f34791 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.107369:0:204785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787508616.107394:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7c00/0xb126349c40f3478a lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f34791 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.107401:0:204785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7c00/0xb126349c40f3478a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f34791 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.107432:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508616.107434:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508616.107436:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508616.107445:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787508616.107465:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480130048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508616.107516:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508616.107577:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b01c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480129920:0@lo:104: 00010000:00010000:1.0:1787508616.107598:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f348b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508616.107919:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480130048 00000100:00100000:2.0:1787508616.107926:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480130048 00010000:00010000:2.0:1787508616.108431:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34791 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f3478a expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508616.108515:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27892 00000100:00100000:2.0:1787508616.108526:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:3618:x1874324480130048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508616.108540:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1787508616.110755:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944090 is committed 00010000:00010000:2.0:1787508616.111170:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34791 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f3478a expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.111192:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fda00) 00010000:00010000:2.0:1787508616.111198:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f348b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.111208:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f348b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.111215:0:202212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f348b7 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.111282:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508616.111388:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480130048:12345-0@lo:103:ldlm_bl.0 Request processed in 2862us (3869us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508616.111400:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27892 00000100:00100000:3.0:1787508616.111523:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480130048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508616.112032:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:1.0:1787508616.112143:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f348b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.112153:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f348b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.112213:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f348b0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.112220:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f348b0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.112226:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f348b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.112233:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f348b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.112239:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508616.112244:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f348b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.112252:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f348b0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.112265:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508616.112268:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508616.112271:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f348b0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.112275:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f348b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.112285:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f348b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.112289:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f348b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.112293:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f348b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.112296:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fa00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508616.112299:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f348b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.112302:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f348b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.112306:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fda00) 00010000:00010000:1.0:1787508616.112307:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508616.112309:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f348b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.112312:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f348b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.112360:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f348a9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae4cd expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.112370:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508616.112373:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508616.112376:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f348a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae4cd expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.112385:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fc00, rc 0) 00000100:00100000:1.0:1787508616.112447:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336094:x1874324509544704:12345-192.168.201.30@tcp:101:rm.0 Request processed in 8828us (9381us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508616.112456:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93945 00000100:00100000:1.0:1787508616.112477:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509544960 00000100:00100000:1.0:1787508616.112484:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509544960 00000100:00100000:2.0:1787508616.113008:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93946 00000100:00100000:2.0:1787508616.113022:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509544960:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508616.113041:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508616.113057:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f348be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae4d4 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.113138:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f348c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.113150:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f348c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.113160:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f348c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.113174:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f348cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.113180:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f348cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.113188:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f348cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.113229:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f348c5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.113237:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f348c5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.113246:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f348c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.113252:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f348c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.113256:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508616.113259:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f348c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.113265:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f348c5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.113273:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508616.113275:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508616.113278:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f348c5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.113284:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f348c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.113294:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f348cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.113299:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f348cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.113305:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f348cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.113309:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508616.113312:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f348cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.113317:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f348cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.113323:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3e9f33b0 (ffff9090d36fd500) 00010000:00010000:2.0:1787508616.113325:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508616.114461:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f348cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.114479:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f348cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.114536:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f348be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae4d4 expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.114547:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508616.114550:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508616.114554:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f348be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae4d4 expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.114563:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aba00, rc 0) 00000100:00100000:2.0:1787508616.114721:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509544960:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1702us (2688us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508616.114730:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93946 00000100:00100000:0.0:1787508616.123389:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508616.123453:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509545216 00000100:00100000:3.0:1787508616.123470:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509545216 00000100:00100000:3.0:1787508616.123545:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93947 00000100:00100000:3.0:1787508616.123557:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509545216:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508616.123578:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508616.123602:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f348d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae4db expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.123680:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f348da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.123694:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f348da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.123705:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f348da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.123719:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f348e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.123725:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f348e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.123731:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f348e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.123901:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f348da lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.123910:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f348da lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.123916:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f348da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.123928:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f348da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.123934:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508616.124089:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f348da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.124158:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f348da lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.124170:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508616.124173:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508616.124178:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f348da lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.124185:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f348da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.124201:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f348e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.124207:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f348e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.124212:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f348e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.124216:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508616.124218:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f348e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.124227:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f348e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.124234:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ad43c78 (ffff9090ccb87400) 00010000:00010000:3.0:1787508616.124236:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508616.124239:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f348e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.124244:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f348e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.124276:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f348d3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae4db expref: 583 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.124286:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508616.124288:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508616.124292:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f348d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae4db expref: 583 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.124302:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fe00, rc 0) 00000100:00100000:3.0:1787508616.126257:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509545216:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 2688us (2867us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508616.126269:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93947 00000100:00100000:0.0:1787508616.135737:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508616.135845:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509545472 00000100:00100000:1.0:1787508616.135855:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509545472 00000100:00100000:1.0:1787508616.135917:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93948 00000100:00100000:1.0:1787508616.135928:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509545472:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508616.135981:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508616.136002:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f348e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae4e2 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.136075:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f348ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.136090:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f348ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.136114:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f348ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.136130:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f348f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.136138:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f348f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.136145:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f348f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.136211:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f348ef lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.136219:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f348ef lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.136229:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f348ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.136236:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f348ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.136242:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508616.136246:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f348ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.136253:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f348ef lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.136266:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508616.136269:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508616.136273:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f348ef lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.136279:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f348ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.136292:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f348f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.136297:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f348f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.136303:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f348f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.136307:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508616.136311:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f348f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.136316:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f348f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.136324:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbfff8436 (ffff9090c5b9ef00) 00010000:00010000:1.0:1787508616.136326:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508616.136587:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f348f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.136594:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f348f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.136629:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f348e8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae4e2 expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.136640:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508616.136642:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508616.136646:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f348e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae4e2 expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.136655:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a200, rc 0) 00000100:00100000:1.0:1787508616.136711:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509545472:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 785us (985us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508616.136718:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93948 00000100:00100000:0.0:1787508616.150216:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508616.152028:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509545728 00000100:00100000:2.0:1787508616.152044:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509545728 00000100:00100000:3.0:1787508616.157433:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93949 00000100:00100000:3.0:1787508616.157449:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509545728:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508616.157472:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508616.157495:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f348fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae4e9 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.157576:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34904 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.157591:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34904 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.157602:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34904 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.157617:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3490b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.157624:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3490b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.157630:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3490b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.157691:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34904 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.157698:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34904 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.157704:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34904 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.157710:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34904 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.157716:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508616.157721:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34904 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.157729:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34904 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.157740:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508616.157744:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508616.157748:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34904 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.157755:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34904 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.157769:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3490b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.157775:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3490b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.157798:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3490b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.157803:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508616.157806:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3490b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.157812:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3490b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.157819:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x594a0ca2 (ffff9090ccb87400) 00010000:00010000:3.0:1787508616.157821:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508616.157825:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3490b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.157830:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3490b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.157862:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f348fd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae4e9 expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.157873:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508616.157875:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508616.157879:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f348fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae4e9 expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.157888:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fe00, rc 0) 00000100:00100000:3.0:1787508616.157991:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509545728:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 546us (7786us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508616.158000:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93949 00000100:00100000:0.0:1787508616.165511:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508616.165603:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509545984 00000100:00100000:1.0:1787508616.165614:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509545984 00000100:00100000:1.0:1787508616.165681:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93950 00000100:00100000:1.0:1787508616.165693:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509545984:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508616.165718:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508616.165745:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34912 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae4f0 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.165828:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34919 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.165844:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34919 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.165856:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34919 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.165871:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34920 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.165878:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34920 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.165884:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34920 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.165975:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34919 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.165982:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34919 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.165989:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34919 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.165995:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34919 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.166003:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508616.166007:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34919 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.166016:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34919 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.166029:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508616.166032:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508616.166036:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34919 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.166042:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34919 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.166055:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34920 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.166061:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34920 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.166067:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34920 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.166072:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508616.166074:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34920 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.166080:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34920 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.166091:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfe67841 (ffff9090c5b9ef00) 00010000:00010000:1.0:1787508616.166093:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508616.166096:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34920 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.166101:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34920 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.166132:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34912 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae4f0 expref: 583 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.166141:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508616.166143:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508616.166147:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34912 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae4f0 expref: 583 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.166157:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a200, rc 0) 00000100:00100000:1.0:1787508616.166225:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509545984:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 535us (725us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508616.166233:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93950 00000100:00100000:0.0:1787508616.175672:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508616.175759:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509546240 00000100:00100000:3.0:1787508616.175773:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509546240 00000100:00100000:3.0:1787508616.175845:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93951 00000100:00100000:3.0:1787508616.175856:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509546240:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508616.175878:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508616.175900:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34927 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae4f7 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.176020:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3492e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.176042:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3492e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.176055:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3492e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.176070:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34935 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.176077:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34935 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.176084:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34935 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.176148:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3492e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.176155:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3492e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.176161:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3492e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.176179:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3492e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.176186:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508616.176190:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3492e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.176198:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3492e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.176211:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508616.176214:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508616.176219:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3492e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.176226:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3492e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.176240:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34935 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.176246:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34935 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.176251:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34935 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.176256:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508616.176259:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34935 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.176264:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34935 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.176271:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090ccb87400) 00010000:00010000:3.0:1787508616.176273:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508616.176276:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34935 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.176281:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34935 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.176317:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34927 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae4f7 expref: 583 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.176338:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508616.176340:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508616.176344:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34927 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae4f7 expref: 583 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.176354:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fe00, rc 0) 00000100:00100000:3.0:1787508616.176414:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509546240:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 559us (753us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508616.176431:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93951 00000100:00100000:3.0:1787508616.185046:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508616.185154:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509546496 00000100:00100000:1.0:1787508616.185174:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509546496 00000100:00100000:1.0:1787508616.185233:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93952 00000100:00100000:1.0:1787508616.185244:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509546496:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508616.185264:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508616.185285:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3493c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae4fe expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.185383:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34943 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.185398:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34943 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.185410:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34943 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.185437:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3494a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.185444:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3494a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.185450:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3494a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.185510:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34943 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.185517:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34943 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.185523:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34943 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.185529:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34943 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.185535:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508616.185541:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34943 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.185549:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34943 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.185560:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508616.185563:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508616.185568:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34943 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.185575:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34943 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.185588:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3494a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.185595:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3494a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.185600:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3494a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.185605:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508616.185608:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3494a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.185614:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3494a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.185621:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x90ba0166 (ffff9090c5b9ef00) 00010000:00010000:1.0:1787508616.185623:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508616.185627:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3494a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.185632:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f3494a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.185664:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3493c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae4fe expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.185673:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508616.185676:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508616.185680:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3493c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae4fe expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.185687:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a200, rc 0) 00000100:00100000:1.0:1787508616.185747:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509546496:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 504us (715us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508616.185754:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93952 00000100:00100000:0.0:1787508616.193680:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508616.193776:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509546752 00000100:00100000:3.0:1787508616.193787:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509546752 00000100:00100000:3.0:1787508616.193854:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93953 00000100:00100000:3.0:1787508616.193866:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509546752:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508616.193888:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508616.193909:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34951 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae505 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.194038:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34958 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.194055:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34958 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.194070:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34958 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.194084:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3495f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.194092:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3495f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.194099:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3495f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.194156:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34958 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.194164:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34958 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.194169:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34958 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.194176:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34958 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.194182:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508616.194187:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34958 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.194194:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34958 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.194206:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508616.194209:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508616.194214:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34958 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.194220:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34958 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.194233:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3495f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.194238:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3495f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.194244:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3495f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.194249:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508616.194251:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3495f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.194258:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3495f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.194265:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaf3dc4c9 (ffff9090ccb87400) 00010000:00010000:3.0:1787508616.194267:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508616.194270:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3495f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.194276:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3495f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.194310:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34951 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae505 expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.194321:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508616.194324:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508616.194341:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34951 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae505 expref: 583 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.194351:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fe00, rc 0) 00000100:00100000:3.0:1787508616.194413:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509546752:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 550us (745us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508616.194430:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93953 00000100:00100000:0.0:1787508616.206461:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508616.206620:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509546880 00000100:00100000:2.0:1787508616.206631:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509546880 00000100:00100000:2.0:1787508616.206698:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93954 00000100:00100000:2.0:1787508616.206709:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509546880:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508616.206729:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508616.206750:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34966 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae50c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.206830:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3496d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.206845:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3496d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.206855:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3496d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.206870:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34974 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.206877:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34974 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.206884:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34974 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.206980:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3496d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.206988:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3496d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.206994:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3496d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.207005:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3496d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.207011:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508616.207016:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3496d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.207023:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3496d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.207036:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508616.207039:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508616.207043:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3496d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.207050:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3496d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.207064:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34974 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.207070:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34974 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.207075:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34974 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.207079:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508616.207082:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34974 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.207091:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34974 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.207097:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd500) 00010000:00010000:2.0:1787508616.207099:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508616.207102:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34974 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.207108:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34974 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.207140:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34966 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae50c expref: 583 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.207151:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508616.207153:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508616.207157:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34966 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae50c expref: 583 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.207167:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aba00, rc 0) 00000100:00100000:2.0:1787508616.207223:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509546880:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 515us (772us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508616.207230:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93954 00000100:00100000:0.0:1787508616.215855:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508616.216024:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509547136 00000100:00100000:2.0:1787508616.216036:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509547136 00000100:00100000:2.0:1787508616.216104:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93955 00000100:00100000:2.0:1787508616.216115:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336093:x1874324509547136:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:2.0:1787508616.216186:0:202226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508616.216214:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f347d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae480 expref: 582 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.216234:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508616.216239:0:202226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508616.216313:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3497b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.216338:0:202226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f347e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae487 expref: 10 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.216347:0:202226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3497b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.216384:0:202226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f347e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae487 expref: 10 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.216398:0:202226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f347e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae487 expref: 10 pid: 202227 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508616.216413:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480130176:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508616.220004:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cf7080c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787508616.234465:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508616.235065:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509547264 00000100:00100000:1.0:1787508616.235076:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509547264 00010000:00010000:1.0:1787508616.235120:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f347e5 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae487 expref: 11 pid: 202227 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508616.235161:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27893 00000100:00100000:1.0:1787508616.235179:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2400:x1874324509547264:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508616.235194:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508616.235200:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f347e5 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae487 expref: 11 pid: 202227 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.235219:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f347e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae487 expref: 11 pid: 202227 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.235243:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508616.235248:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3497b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.235257:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3497b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.235265:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3497b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.235282:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508616.235347:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2400:x1874324509547264:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 169us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508616.235354:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27893 00010000:00010000:2.0:1787508616.240788:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f347e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae487 expref: 10 pid: 202227 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508616.240816:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480130176:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508616.240843:0:202226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3497b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.240854:0:202226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3497b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.240859:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3497b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.240886:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34982 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.240897:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34982 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.240906:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34982 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508616.242133:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508616.242269:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509547392 00000100:00100000:3.0:1787508616.242278:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509547392 00000100:00100000:3.0:1787508616.242338:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93956 00000100:00100000:3.0:1787508616.242347:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:336101:x1874324509547392:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508616.242368:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508616.242387:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34989 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae513 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.242458:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34990 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.242472:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3497b lrc: 2/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.242480:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34990 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.242498:0:202228:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3497b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.242509:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34990 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787508616.243066:0:202226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1:0x0].1786, 2168 off1840352 00000040:00080000:2.0:1787508616.243145:0:202226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x1:0x0].1792, 2368 off2045720 00000004:00080000:2.0:1787508616.243153:0:202226:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090cf7080c0 with version 3466 00000004:00080000:1.0:1787508616.243664:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3466 rpc_version 3466 00000020:00100000:1.0:1787508616.243701:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787508616.243711:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090da0bc700 x1874324480130432/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4232/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787508616.243732:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0bc700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480130432:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787508616.244241:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508616.244337:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9091d83eb180 going to sleep for 11 seconds 00000100:00100000:3.0:1787508616.244445:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480130432 00000100:00100000:3.0:1787508616.244453:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480130432 00000100:00100000:3.0:1787508616.244530:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29758 00000100:00100000:3.0:1787508616.244539:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:202248:x1874324480130432:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787508616.245274:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:202248:x1874324480130432:12345-0@lo:1000:osp_up1-0.0 Request processed in 734us (1032us total) trans 8589962026 rc 0/0 00000100:00100000:3.0:1787508616.245284:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29758 00000100:00100000:1.0:1787508616.245428:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0bc700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480130432:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1787508616.245639:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34997 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x125c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.245654:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34997 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.245665:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34997 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.245683:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3499e lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x172:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.245690:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3499e lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x172:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.245697:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3499e lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x172:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.245728:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f349a5 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.245734:0:202226:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f349a5 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.245743:0:202226:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f349a5 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508616.245760:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:202226:1874324480130560:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1787508616.245809:0:202226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508616.246036:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787508616.246122:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480130560 00000100:00100000:2.0:1787508616.246130:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480130560 00000100:00100000:2.0:1787508616.246171:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29759 00000100:00100000:2.0:1787508616.246179:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:202226:x1874324480130560:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1787508616.246193:0:202232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508616.246209:0:202232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f349ac lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f349a5 expref: -99 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.246229:0:202232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f349ac lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f349a5 expref: 11 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.246241:0:202232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f349ac lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f349a5 expref: 11 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.246249:0:202232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x16a:0x0].0x0 (ffff9090d36fd700) 00010000:00010000:2.0:1787508616.246252:0:202232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508616.246255:0:202232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abc00, rc 0) 00000100:00100000:2.0:1787508616.246289:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:202226:x1874324480130560:12345-0@lo:101:mdt00_000.0 Request processed in 111us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508616.246294:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29759 00000100:00100000:0.0:1787508616.246488:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:202226:1874324480130560:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1787508616.246504:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f349a5 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f349ac expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.246513:0:202226:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f349a5 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f349ac expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508616.246534:0:202226:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe1119db reply state 000000008438a12d transno 12884944091 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3499e lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x172:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.246547:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3499e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x172:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.246553:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x172:0x0].0x0 (ffff9090c6913200) 00010000:00010000:0.0:1787508616.246556:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787508616.246559:0:202226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787508616.246564:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f349a5 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f349ac expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.246571:0:202226:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f349a5 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f349ac expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787508616.246581:0:202226:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd2:0x16a:0x0] 00000004:00010000:0.0:1787508616.246586:0:202226:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe1119db reply state 000000008438a12d transno 12884944091 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34997 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.246594:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34997 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x125c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.246600:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125c:0x0].0x0 (ffff9090c6913900) 00010000:00010000:0.0:1787508616.246602:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787508616.246603:0:202226:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1787508616.246608:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125c:0x0]: returning size 4096 00010000:00010000:0.0:1787508616.246619:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3497b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.246625:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3497b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.246631:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3497b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.246638:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3497b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.246643:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508616.246648:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3497b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.246656:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3497b lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.246667:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508616.246669:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508616.246673:0:202226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34990 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.246680:0:202226:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.246686:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34990 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.246714:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3497b lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.246720:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3497b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508616.246734:0:202226:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe1119db reply state 000000008438a12d transno 12884944091 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34982 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.246743:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34982 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.246749:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd500) 00010000:00010000:0.0:1787508616.246751:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787508616.246753:0:202226:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1787508616.246923:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336093:x1874324509547136:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 30808us (31077us total) trans 12884944091 rc 0/0 00000100:00100000:0.0:1787508616.246932:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93955 00010000:00010000:2.0:1787508616.250377:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.250395:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508616.250468:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508616.250473:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508616.250496:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.250531:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34989 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae513 expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.250552:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34990 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae513 expref: 11 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.250561:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508616.250564:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508616.250568:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e800, rc 0) 00000100:00100000:2.0:1787508616.250642:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336101:x1874324509547392:12345-192.168.201.30@tcp:101:rm.0 Request processed in 8294us (8512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508616.250651:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93956 00000100:00100000:3.0:1787508616.253577:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508616.253620:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509547520 00000100:00100000:3.0:1787508616.253629:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509547520 00000100:00100000:3.0:1787508616.253676:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93957 00000100:00100000:3.0:1787508616.253686:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336101:x1874324509547520:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508616.253704:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508616.253724:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f349b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae51a expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.253808:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f349ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.253824:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f349ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.253834:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f349ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.253852:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f349c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.253859:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f349c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.253865:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f349c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.253919:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f349ba lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.253926:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f349ba lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.253932:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f349ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.253968:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f349ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.253974:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508616.253978:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f349ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.253985:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f349ba lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.253998:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508616.254000:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508616.254004:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f349ba lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.254011:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f349ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.254024:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f349c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.254030:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f349c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.254036:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f349c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.254041:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ea00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508616.254043:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f349c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.254049:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f349c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.254055:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090ccb87400) 00010000:00010000:3.0:1787508616.254057:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508616.254060:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f349c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.254065:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f349c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.254091:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f349b3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae51a expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.254106:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508616.254108:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508616.254112:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f349b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae51a expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.254120:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f200, rc 0) 00000100:00100000:3.0:1787508616.254174:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336101:x1874324509547520:12345-192.168.201.30@tcp:101:rm.0 Request processed in 489us (606us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508616.254181:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93957 00000100:00100000:0.0:1787508616.257238:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508616.257445:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509547648 00000100:00100000:3.0:1787508616.257456:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509547648 00000100:00100000:3.0:1787508616.257523:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93958 00000100:00100000:3.0:1787508616.257534:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336101:x1874324509547648:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508616.257555:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508616.257577:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f349c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae521 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.257646:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f349cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.257660:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f349cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.257670:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f349cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.257684:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f349d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.257692:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f349d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.257699:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f349d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.257755:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f349cf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.257762:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f349cf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.257768:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f349cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.257775:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f349cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.257798:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508616.257802:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f349cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.257810:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f349cf lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.257821:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508616.257824:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508616.257828:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f349cf lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.257835:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f349cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.257849:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f349d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.257856:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f349d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.257862:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f349d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.257867:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508616.257870:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f349d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.257877:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f349d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.257884:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090ccb87500) 00010000:00010000:3.0:1787508616.257886:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508616.257889:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f349d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.257895:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f349d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.257925:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f349c8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae521 expref: 12 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.257935:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508616.257937:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508616.257978:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f349c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae521 expref: 12 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.257989:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f000, rc 0) 00000100:00100000:3.0:1787508616.258051:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336101:x1874324509547648:12345-192.168.201.30@tcp:101:rm.0 Request processed in 518us (821us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508616.258058:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93958 00000100:00100000:3.0:1787508616.265988:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508616.266147:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509547776 00000100:00100000:0.0:1787508616.266157:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509547776 00000100:00100000:0.0:1787508616.266228:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93959 00000100:00100000:0.0:1787508616.266239:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336101:x1874324509547776:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508616.266260:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508616.266280:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f349dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae528 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.266353:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f349e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.266368:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f349e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.266379:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f349e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.266394:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f349eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.266401:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f349eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.266408:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f349eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.266473:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f349e4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.266481:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f349e4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.266487:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f349e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.266494:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f349e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.266499:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508616.266504:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f349e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.266512:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f349e4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.266524:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508616.266527:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508616.266532:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f349e4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.266538:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f349e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.266550:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f349eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.266556:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f349eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.266562:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f349eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.266568:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508616.266572:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f349eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.266577:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f349eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.266584:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090c6913400) 00010000:00010000:0.0:1787508616.266586:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508616.266588:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f349eb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.266593:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f349eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.266621:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f349dd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae528 expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.266630:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508616.266632:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508616.266635:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f349dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae528 expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.266643:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7800, rc 0) 00000100:00100000:0.0:1787508616.266702:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336101:x1874324509547776:12345-192.168.201.30@tcp:101:rm.0 Request processed in 465us (763us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508616.266710:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93959 00000100:00100000:0.0:1787508616.270235:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508616.272632:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508616.277301:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509547904 00000100:00100000:2.0:1787508616.277319:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509547904 00000100:00100000:2.0:1787508616.277554:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509548160 00000100:00100000:2.0:1787508616.277559:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509548160 00000100:00100000:1.0:1787508616.277601:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93960 00000100:00100000:1.0:1787508616.277613:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336102:x1874324509547904:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:1.0:1787508616.277642:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508616.277663:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f349f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae52f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.277725:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f349f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.277739:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f349f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.277751:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f349f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508616.277859:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93961 00000100:00100000:3.0:1787508616.277870:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336101:x1874324509548160:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508616.277878:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508616.277888:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34a00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae536 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.277934:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34a07 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.277973:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34a07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.277982:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34a07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.277997:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34a0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.278003:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34a0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.278015:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34a0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.278064:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34a07 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.278070:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34a07 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.278077:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34a07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.278084:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34a07 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.278090:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ea00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508616.278096:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34a07 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.278103:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34a07 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.278115:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508616.278118:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508616.278122:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34a07 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.278128:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34a07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.278142:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34a0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.278149:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34a0e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.278155:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34a0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.278160:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508616.278273:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34a0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.278279:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34a0e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.278287:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090ccb87400) 00010000:00010000:3.0:1787508616.278290:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508616.278292:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34a0e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.278298:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34a0e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.278342:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34a00 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae536 expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.278352:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508616.278355:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508616.278358:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34a00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae536 expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.278372:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f200, rc 0) 00000100:00100000:3.0:1787508616.278495:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336101:x1874324509548160:12345-192.168.201.30@tcp:101:rm.0 Request processed in 627us (5872us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508616.278502:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93961 00000004:00200000:1.0:1787508616.278644:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508616.278648:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508616.278671:0:205405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f349f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.278691:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f349f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae52f expref: 585 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.278704:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f349f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae52f expref: 584 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.278711:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508616.278713:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508616.278715:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ae00, rc 0) 00000100:00100000:1.0:1787508616.278737:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336102:x1874324509547904:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 1128us (8514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508616.278748:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93960 00000100:00100000:0.0:1787508616.285261:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508616.285294:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508616.285475:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509548288 00000100:00100000:2.0:1787508616.285485:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509548288 00000100:00100000:2.0:1787508616.285542:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509548416 00000100:00100000:2.0:1787508616.285545:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509548416 00000100:00100000:2.0:1787508616.285571:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93962 00000100:00100000:2.0:1787508616.285580:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336101:x1874324509548288:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508616.285601:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508616.285621:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34a15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae53d expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.285687:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34a1c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.285701:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34a1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.285711:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34a1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.285722:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34a23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.285729:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34a23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.285736:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34a23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.285841:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34a2a lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.285850:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34a2a lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.285857:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34a2a lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508616.285930:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125c:0x0]: returning size 4096 00000004:00200000:2.0:1787508616.285935:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1787508616.285986:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34a2a lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286000:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34a1c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286007:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34a1c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286014:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34a1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286021:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34a1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286026:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508616.286030:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34a1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286038:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34a1c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286051:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508616.286054:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508616.286058:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34a1c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286065:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34a1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286079:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34a23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286085:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34a23 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286091:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34a23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286096:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508616.286099:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34a23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286105:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34a23 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286111:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd500) 00010000:00010000:2.0:1787508616.286113:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508616.286115:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34a23 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286122:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34a23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286143:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34a15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae53d expref: 13 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286154:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34a2a lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae53d expref: 12 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286174:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125c:0x0].0x0 (ffff9090c6913900) 00010000:00010000:2.0:1787508616.286176:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508616.286179:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aae00, rc 0) 00000100:00100000:2.0:1787508616.286239:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336101:x1874324509548288:12345-192.168.201.30@tcp:101:rm.0 Request processed in 660us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508616.286246:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93962 00000100:00100000:2.0:1787508616.286269:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93963 00000100:00100000:2.0:1787508616.286277:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336102:x1874324509548416:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1787508616.286286:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508616.286296:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34a31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae544 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286335:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f34a38 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286344:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f34a38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286356:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f34a38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286370:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34a3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286376:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34a3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286382:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34a3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286409:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f34a38 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286425:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f34a38 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286430:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f34a38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286435:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f34a38 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286439:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aaa00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508616.286442:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f34a38 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286448:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f34a38 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286455:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508616.286458:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508616.286460:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f34a38 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286466:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f34a38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286475:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34a3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286480:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34a3f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286485:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34a3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286490:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508616.286492:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34a3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286498:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34a3f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286504:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeddcfc6c (ffff9090d36fd600) 00010000:00010000:2.0:1787508616.286506:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508616.286509:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34a3f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286514:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f34a3f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286536:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34a31 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae544 expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286545:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508616.286547:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508616.286550:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34a31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae544 expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.286557:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa000, rc 0) 00000100:00100000:2.0:1787508616.286579:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336102:x1874324509548416:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 303us (1285us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508616.286585:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93963 00000100:00100000:0.0:1787508616.292380:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508616.292472:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508616.292667:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509548544 00000100:00100000:1.0:1787508616.292677:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509548544 00000100:00100000:1.0:1787508616.292731:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509548672 00000100:00100000:1.0:1787508616.292735:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509548672 00000100:00100000:1.0:1787508616.292769:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93964 00000100:00100000:2.0:1787508616.292902:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93965 00000100:00100000:2.0:1787508616.292913:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336102:x1874324509548672:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1787508616.292933:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508616.292970:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f34a46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae552 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.293029:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f34a4d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.293043:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f34a4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.293053:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f34a4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.293066:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34a54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.293077:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34a54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.293083:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34a54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.293138:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f34a4d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.293145:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f34a4d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.293151:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f34a4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.293158:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f34a4d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.293176:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508616.293181:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f34a4d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.293188:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f34a4d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.293200:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508616.293203:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508616.293207:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f34a4d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.293213:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f34a4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.293228:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34a54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.293235:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34a54 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.293241:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34a54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.293246:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508616.293248:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34a54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.293254:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34a54 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.293261:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3491cd4c (ffff9090d36fd100) 00010000:00010000:2.0:1787508616.293263:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508616.293266:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34a54 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.293273:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34a54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.293304:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f34a46 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae552 expref: 585 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.293314:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508616.293317:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508616.293321:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f34a46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae552 expref: 585 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.293342:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aac00, rc 0) 00000100:00100000:2.0:1787508616.293401:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336102:x1874324509548672:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 491us (928us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508616.293409:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93965 00000100:00100000:1.0:1787508616.294073:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:336101:x1874324509548544:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508616.294087:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508616.294101:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34a5b lrc: 2/0,0 mode: --/CR res: [0x2000013a0:0x172:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae54b expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.294135:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34a62 lrc: 3/1,0 mode: --/PR res: [0x2000013a0:0x172:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.294145:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34a62 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.294154:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34a62 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508616.294210:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a0:0x172:0x0]: returning size 4096 00000004:00200000:1.0:1787508616.294215:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787508616.294245:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34a5b lrc: 0/0,0 mode: --/CR res: [0x2000013a0:0x172:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae54b expref: 14 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.294259:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34a62 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae54b expref: 13 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.294267:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x172:0x0].0x0 (ffff9090c6913200) 00010000:00010000:1.0:1787508616.294271:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508616.294273:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b600, rc 0) 00000100:00100000:1.0:1787508616.294310:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336101:x1874324509548544:12345-192.168.201.30@tcp:101:rm.0 Request processed in 1532us (1942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508616.294317:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93964 00000100:00100000:1.0:1787508616.298169:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508616.298311:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509548800 00000100:00100000:3.0:1787508616.298322:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509548800 00000100:00100000:3.0:1787508616.298386:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93966 00000100:00100000:3.0:1787508616.298397:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336102:x1874324509548800:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:3.0:1787508616.298428:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508616.298457:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34a69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae559 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.298536:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34a70 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.298551:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34a70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.298563:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34a70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.298580:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34a77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.298586:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34a77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.298592:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34a77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.298649:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34a70 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.298656:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34a70 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.298663:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34a70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.298670:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34a70 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.298676:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508616.298680:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34a70 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.298687:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34a70 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.298699:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508616.298703:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508616.298707:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34a70 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.298713:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34a70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.298726:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34a77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.298732:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34a77 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.298737:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34a77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.298743:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ea00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508616.298746:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34a77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.298752:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34a77 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.298759:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3735a305 (ffff9090ccb87400) 00010000:00010000:3.0:1787508616.298762:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508616.298765:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34a77 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.298771:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34a77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.298819:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34a69 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae559 expref: 585 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.298830:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508616.298832:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508616.298836:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34a69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae559 expref: 585 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.298846:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f200, rc 0) 00000100:00100000:3.0:1787508616.298921:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336102:x1874324509548800:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 526us (768us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508616.298932:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93966 00000100:00100000:2.0:1787508616.304153:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508616.304244:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509548928 00000100:00100000:3.0:1787508616.304256:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509548928 00000100:00100000:3.0:1787508616.304321:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93967 00000100:00100000:3.0:1787508616.304332:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:336101:x1874324509548928:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508616.304371:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508616.304394:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f34a7e lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae560 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.304478:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f34a85 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.304495:0:209004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f349ac lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f349a5 expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.304504:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f34a85 lrc: 4/1,0 mode: --/PR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.304541:0:209004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f349ac lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f349a5 expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508616.304559:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb39500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:209004:1874324480130688:0@lo:104: 00000100:00100000:3.0:1787508616.304616:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508616.304657:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9480 going to sleep for 11 seconds 00000100:00100000:0.0:1787508616.305080:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480130688 00000100:00100000:0.0:1787508616.305087:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480130688 00000100:00100000:0.0:1787508616.305142:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18187 00000100:00100000:0.0:1787508616.305151:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c92cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:209004:x1874324480130688:12345-0@lo:104: 00010000:00010000:0.0:1787508616.305172:0:202210:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f349a5 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f349ac expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.305251:0:202210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787508616.305258:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c92cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:209004:x1874324480130688:12345-0@lo:104: Request processed in 109us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508616.305265:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18187 00010000:00010000:2.0:1787508616.305424:0:226765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787508616.305433:0:226765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f349a5 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f349ac expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.305442:0:226765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7600 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:2.0:1787508616.305449:0:226765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f349a5 lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f349ac expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508616.305459:0:226765:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f349a5 lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f349ac expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.305494:0:226765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f349a5 lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f349ac expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.305501:0:226765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787508616.305537:0:226765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f349a5 lrc: 1/0,0 mode: --/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f349ac expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.305546:0:226765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f7600/0xb126349c40f349a5 lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f349ac expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.305575:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508616.305577:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508616.305579:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508616.305622:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480130816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508616.305663:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508616.305740:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480130816 00000100:00100000:2.0:1787508616.305746:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480130816 00010000:00010000:2.0:1787508616.305768:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f349ac lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f349a5 expref: 11 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508616.305805:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27894 00000100:00100000:2.0:1787508616.305813:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+11:3616:x1874324480130816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508616.305825:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787508616.307890:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb39500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:209004:1874324480130688:0@lo:104: 00010000:00010000:3.0:1787508616.307919:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f34a85 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787508616.308879:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589962026 is committed 00000001:00080000:0.0:1787508616.308891:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589962025 is committed 00000001:00080000:0.0:1787508616.309238:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589962024 is committed 00000020:00080000:0.0:1787508616.309245:0:202955:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9090cf708a80 refcount 2 committed 0 result 0 batchid 4294998384 00000020:00080000:0.0:1787508616.309250:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cbc97500 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9090cf708000 00000020:00080000:0.0:1787508616.309253:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a2:0x5:0x0].592 00000020:00080000:0.0:1787508616.309256:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cbc97d00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090d9d29400 00000020:00080000:0.0:1787508616.309258:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd1:0xf:0x0].49 00000020:00080000:0.0:1787508616.309283:0:202955:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9090d74d9000 refcount 2 committed 0 result 0 batchid 4294998383 00000020:00080000:0.0:1787508616.309286:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9091d47d0d00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d74d93c0 00000020:00080000:0.0:1787508616.309289:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a2:0x5:0x0].591 00000020:00080000:0.0:1787508616.309291:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9091d47d0800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090e3c8e600 00000020:00080000:0.0:1787508616.309294:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd1:0xf:0x0].48 00000020:00080000:2.0:1787508616.309430:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294998384 committed batchid 4294998382 00000020:00080000:2.0:1787508616.309492:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998382 00010000:00010000:0.0:1787508616.309820:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f349ac lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f349a5 expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.309840:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x16a:0x0].0x0 (ffff9090d36fd700) 00010000:00010000:0.0:1787508616.309846:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f34a85 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.309856:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f34a85 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.309865:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f34a85 lrc: 4/1,0 mode: PR/PR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.309959:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508616.310048:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480130816:12345-0@lo:103:ldlm_bl.0 Request processed in 4234us (4382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508616.310058:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27894 00000100:00100000:1.0:1787508616.310212:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480130816:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787508616.310729:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab400/0xb126349c40f34656 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.310739:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab400/0xb126349c40f34656 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.310747:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab400/0xb126349c40f34656 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.310753:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508616.310758:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab400/0xb126349c40f34656 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.310766:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab400/0xb126349c40f34656 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.310791:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d4:0x0].0x0 (ffff9090d36fdb00) 00010000:00010000:3.0:1787508616.310794:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508616.310797:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab400/0xb126349c40f34656 lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.310803:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab400/0xb126349c40f34656 lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.310815:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa800/0xb126349c40f3465d lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x293:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.310821:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa800/0xb126349c40f3465d lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x293:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.310826:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa800/0xb126349c40f3465d lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x293:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.310831:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508616.310834:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa800/0xb126349c40f3465d lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x293:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.310839:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa800/0xb126349c40f3465d lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x293:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.310845:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x293:0x0].0x0 (ffff9090d36fd300) 00010000:00010000:3.0:1787508616.310847:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508616.310850:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa800/0xb126349c40f3465d lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x293:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.310855:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa800/0xb126349c40f3465d lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x293:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.310869:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f3476e lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.310874:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f3476e lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.310879:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f3476e lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.310884:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508616.310887:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f3476e lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.310892:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f3476e lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.310904:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d4:0x0].0x0 (ffff9090d36fdb00) 00010000:00010000:3.0:1787508616.310906:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508616.310909:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f3476e lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.310914:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f3476e lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x13d4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.310931:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f34783 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.310936:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f34783 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.310971:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f34783 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.310977:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508616.310980:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f34783 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.310986:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f34783 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.310994:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x293:0x0].0x0 (ffff9090d36fd300) 00010000:00010000:3.0:1787508616.310996:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508616.310999:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f34783 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.311004:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f34783 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x293:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.311296:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f34a85 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.311306:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f34a85 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508616.311484:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd2:0x16a:0x0]: returning size 4096 00000004:00200000:2.0:1787508616.311491:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787508616.311540:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f34a7e lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae560 expref: 7 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.311557:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f34a85 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae560 expref: 6 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.311569:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x16a:0x0].0x0 (ffff9090d36fd700) 00010000:00010000:2.0:1787508616.311571:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508616.311573:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fc00, rc 0) 00000100:00100000:2.0:1787508616.311683:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336101:x1874324509548928:12345-192.168.201.30@tcp:101:rm.0 Request processed in 7352us (7540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508616.311693:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93967 00000100:00100000:1.0:1787508616.316445:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508616.316536:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509549184 00000100:00100000:0.0:1787508616.316548:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509549184 00000100:00100000:0.0:1787508616.316618:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93968 00000100:00100000:0.0:1787508616.316630:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336102:x1874324509549184:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508616.316652:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508616.316678:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34a8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae567 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.316762:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34a93 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.316789:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34a93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.316803:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34a93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.316818:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34a9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.316825:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34a9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.316831:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34a9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.316888:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34a93 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.316896:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34a93 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.316903:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34a93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.316909:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34a93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.316914:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508616.316919:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34a93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.316927:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34a93 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.316978:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508616.316982:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508616.316987:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34a93 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.316993:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34a93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.317005:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34a9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.317012:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34a9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.317017:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34a9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.317023:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508616.317026:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34a9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.317032:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34a9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.317039:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x820cea43 (ffff9090ca4e2e00) 00010000:00010000:0.0:1787508616.317041:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508616.317044:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34a9a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.317049:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34a9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.317081:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34a8c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae567 expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.317103:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508616.317106:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508616.317110:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34a8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae567 expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.317120:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7800, rc 0) 00000100:00100000:0.0:1787508616.317186:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336102:x1874324509549184:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 558us (751us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508616.317193:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93968 00000100:00100000:3.0:1787508616.317642:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508616.317688:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509549440 00000100:00100000:2.0:1787508616.317694:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509549440 00000100:00100000:2.0:1787508616.317740:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93969 00000100:00100000:2.0:1787508616.317749:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c92ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336101:x1874324509549440:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508616.317761:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508616.317773:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34aa1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae56e expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508616.317909:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125c:0x0]: returning size 4096 00010000:00010000:2.0:1787508616.318053:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34aa1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae56e expref: 15 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.318063:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508616.318065:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508616.318069:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34aa1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae56e expref: 15 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.318081:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab600, rc 0) 00000100:00100000:2.0:1787508616.318129:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c92ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336101:x1874324509549440:12345-192.168.201.30@tcp:101:rm.0 Request processed in 381us (488us total) trans 12884944092 rc 301/301 00000100:00100000:2.0:1787508616.318136:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93969 00000100:00100000:2.0:1787508616.321813:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508616.321982:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509549568 00000100:00100000:0.0:1787508616.321993:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509549568 00000100:00100000:0.0:1787508616.322057:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93970 00000100:00100000:0.0:1787508616.322069:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336102:x1874324509549568:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508616.322091:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508616.322116:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f34aaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae575 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.322187:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34ab6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.322202:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34ab6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.322214:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34ab6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.322227:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34abd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.322235:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34abd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.322242:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34abd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.322350:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34ac4 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.322359:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34ac4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.322366:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34ac4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508616.322463:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125c:0x0]: returning size 4096 00000004:00200000:0.0:1787508616.322468:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1787508616.322491:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34ac4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.322502:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34ab6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.322509:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34ab6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.322514:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34ab6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.322521:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34ab6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.322530:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508616.322534:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34ab6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.322541:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34ab6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.322553:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508616.322556:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508616.322560:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34ab6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.322566:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34ab6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.322580:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34abd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.322586:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34abd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.322592:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34abd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.322596:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508616.322599:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34abd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.322604:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34abd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.322614:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd500) 00010000:00010000:0.0:1787508616.322616:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508616.322620:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34abd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.322625:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34abd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.322651:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f34aaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae575 expref: 586 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.322665:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34ac4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae575 expref: 585 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.322672:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125c:0x0].0x0 (ffff9090c6913900) 00010000:00010000:0.0:1787508616.322674:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508616.322677:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6000, rc 0) 00000100:00100000:0.0:1787508616.322746:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:336102:x1874324509549568:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 678us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508616.322753:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93970 00000100:00100000:1.0:1787508616.330441:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508616.330530:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509549824 00000100:00100000:0.0:1787508616.330540:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509549824 00000100:00100000:0.0:1787508616.330596:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15416 00000100:00100000:0.0:1787508616.330603:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336101:x1874324509549824:12345-192.168.201.30@tcp:37:rm.0 00000100:00100000:3.0:1787508616.332620:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508616.332718:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509549696 00000100:00100000:2.0:1787508616.332727:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509549696 00000100:00100000:2.0:1787508616.332797:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93971 00000100:00100000:2.0:1787508616.332807:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c92cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:336102:x1874324509549696:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:2.0:1787508616.332826:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508616.332846:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f34acb lrc: 2/0,0 mode: --/CR res: [0x2000013a0:0x172:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae57c expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.332902:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34ad2 lrc: 3/1,0 mode: --/PR res: [0x2000013a0:0x172:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.332916:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34ad2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.332927:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34ad2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508616.333004:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a0:0x172:0x0]: returning size 4096 00000004:00200000:2.0:1787508616.333009:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787508616.333047:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f34acb lrc: 0/0,0 mode: --/CR res: [0x2000013a0:0x172:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae57c expref: 587 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.333066:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34ad2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae57c expref: 586 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.333074:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x172:0x0].0x0 (ffff9090c6913200) 00010000:00010000:2.0:1787508616.333078:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508616.333082:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa000, rc 0) 00000100:00100000:2.0:1787508616.333130:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c92cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336102:x1874324509549696:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 325us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508616.333137:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93971 00000100:00100000:1.0:1787508616.345034:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336101:x1874324509549824:12345-192.168.201.30@tcp:37:rm.0 Request processed in 14415us (14588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508616.345054:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15416 00000100:00100000:1.0:1787508616.345160:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508616.345346:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509549952 00000100:00100000:0.0:1787508616.345357:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509549952 00000100:00100000:0.0:1787508616.345425:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93972 00000100:00100000:0.0:1787508616.345435:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:336102:x1874324509549952:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1787508616.345460:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508616.345482:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f34ad9 lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae583 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.345545:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f34ae0 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.345558:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f34ae0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.345569:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f34ae0 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508616.345620:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd2:0x16a:0x0]: returning size 4096 00000004:00200000:0.0:1787508616.345637:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508616.345678:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6c00/0xb126349c40f34ad9 lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae583 expref: 642 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.345698:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f34ae0 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae583 expref: 641 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.345708:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x16a:0x0].0x0 (ffff9090d36fd700) 00010000:00010000:0.0:1787508616.345710:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508616.345715:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7e00, rc 0) 00000100:00100000:0.0:1787508616.346644:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+641:336102:x1874324509549952:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 1194us (1468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508616.346653:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93972 00000100:00100000:1.0:1787508616.356535:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508616.356650:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509550208 00000100:00100000:3.0:1787508616.356660:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509550208 00000100:00100000:3.0:1787508616.356728:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93973 00000100:00100000:3.0:1787508616.356740:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336102:x1874324509550208:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:3.0:1787508616.356809:0:203348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508616.356839:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34ac4 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae575 expref: 586 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.356859:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125c:0x0].0x0 (ffff9090c6913900) 00010000:00010000:3.0:1787508616.356864:0:203348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508616.356887:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34ae7 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x125c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.356902:0:203348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34a2a lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae53d expref: 13 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.356911:0:203348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34ae7 lrc: 4/0,1 mode: --/PW res: [0x2000013a4:0x125c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.357005:0:203348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34a2a lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae53d expref: 13 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.357020:0:203348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34a2a lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae53d expref: 13 pid: 202227 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508616.357039:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c92cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:203348:1874324480130944:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508616.357117:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9480 going to sleep for 11 seconds 00000100:00100000:2.0:1787508616.360543:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508616.360656:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509550336 00000100:00100000:1.0:1787508616.360666:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509550336 00000100:00100000:1.0:1787508616.361181:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15417 00000100:00100000:1.0:1787508616.361194:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336101:x1874324509550336:12345-192.168.201.30@tcp:37:rm.0 00000100:00100000:1.0:1787508616.365218:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508616.365338:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509550464 00000100:00100000:2.0:1787508616.365348:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509550464 00010000:00010000:2.0:1787508616.365395:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34a2a lrc: 5/0,0 mode: PR/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae53d expref: 14 pid: 202227 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508616.365452:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27895 00000100:00100000:2.0:1787508616.365463:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2401:x1874324509550464:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508616.365480:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508616.365489:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34a2a lrc: 5/0,0 mode: PR/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae53d expref: 14 pid: 202227 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.365504:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34a2a lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae53d expref: 14 pid: 202227 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.365529:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125c:0x0].0x0 (ffff9090c6913900) 00010000:00010000:2.0:1787508616.365535:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34ae7 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x125c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.365545:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34ae7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.365553:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34ae7 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x125c:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.365573:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508616.365628:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2401:x1874324509550464:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 166us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508616.365636:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27895 00010000:00010000:3.0:1787508616.366106:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34a2a lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae53d expref: 13 pid: 202227 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508616.366126:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c92cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:203348:1874324480130944:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508616.366146:0:203348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34ae7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.366156:0:203348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34ae7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.366162:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34ae7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.366191:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34aee lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x172:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.366202:0:203348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34a62 lrc: 2/0,0 mode: PR/PR res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae54b expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.366210:0:203348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34ad2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae57c expref: 585 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.366217:0:203348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34aee lrc: 5/0,1 mode: --/PW res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.366250:0:203348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34ad2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae57c expref: 585 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.366265:0:203348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34ad2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae57c expref: 585 pid: 209004 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508616.366280:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c92cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:203348:1874324480131072:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508616.366422:0:203348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34a62 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae54b expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.366431:0:203348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34a62 lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae54b expref: 12 pid: 205405 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508616.366440:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb39500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:203348:1874324480131200:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508616.366465:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9480 going to sleep for 11 seconds 00000100:00100000:1.0:1787508616.369407:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:336101:x1874324509550336:12345-192.168.201.30@tcp:37:rm.0 Request processed in 8205us (8863us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508616.369433:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15417 00000100:00100000:3.0:1787508616.376715:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508616.376860:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c92cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:203348:1874324480131072:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508616.376877:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb39500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:203348:1874324480131200:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508616.376908:0:203348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34aee lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508616.377018:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508616.377387:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508616.377551:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509550976 00000100:00100000:1.0:1787508616.377558:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509550976 00000100:00100000:1.0:1787508616.377618:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15418 00000100:00100000:1.0:1787508616.377629:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336101:x1874324509550976:12345-192.168.201.30@tcp:35:rm.0 00000100:00100000:1.0:1787508616.377869:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336101:x1874324509550976:12345-192.168.201.30@tcp:35:rm.0 Request processed in 241us (480us total) trans 12884944093 rc 0/0 00000100:00100000:1.0:1787508616.377876:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15418 00000100:00100000:2.0:1787508616.379728:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509550592 00000100:00100000:2.0:1787508616.379755:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509550592 00010000:00010000:2.0:1787508616.379806:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34ad2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae57c expref: 586 pid: 209004 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508616.379853:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509550720 00000100:00100000:2.0:1787508616.379857:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509550720 00010000:00010000:2.0:1787508616.379872:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34a62 lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae54b expref: 14 pid: 205405 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508616.379895:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27896 00000100:00100000:2.0:1787508616.379905:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc620a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:2403:x1874324509550592:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508616.379920:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508616.379926:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34ad2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae57c expref: 586 pid: 209004 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.379959:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34ad2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae57c expref: 586 pid: 209004 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.379980:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34ad2 lrc: 0/0,0 mode: --/PR res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae57c expref: 586 pid: 209004 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.379998:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x172:0x0].0x0 (ffff9090c6913200) 00010000:00010000:2.0:1787508616.380005:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34aee lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.380014:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34aee lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.380021:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508616.380076:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc620a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:2403:x1874324509550592:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 172us (3370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508616.380082:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27896 00000100:00100000:2.0:1787508616.380103:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27897 00000100:00100000:2.0:1787508616.380109:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc620380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2403:x1874324509550720:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508616.380118:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508616.380123:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34a62 lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae54b expref: 14 pid: 205405 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.380133:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34a62 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae54b expref: 14 pid: 205405 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.380145:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34a62 lrc: 0/0,0 mode: --/PR res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae54b expref: 14 pid: 205405 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.380155:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x172:0x0].0x0 (ffff9090c6913200) 00010000:00010000:2.0:1787508616.380171:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34aee lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.380179:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34aee lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.380190:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34aee lrc: 4/0,1 mode: PW/PW res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.380224:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508616.380244:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc620380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2403:x1874324509550720:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 135us (3227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508616.380250:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27897 00010000:00010000:2.0:1787508616.380279:0:203348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34aee lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.380286:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34aee lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.380345:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa200/0xb126349c40f34af5 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.380353:0:203348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa200/0xb126349c40f34af5 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x0 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.380364:0:203348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa200/0xb126349c40f34af5 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508616.380382:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:203348:1874324480131328:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1787508616.380441:0:203348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508616.380472:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3f11240 going to sleep for 11 seconds 00000100:00100000:2.0:1787508616.380489:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480131328 00000100:00100000:2.0:1787508616.380493:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480131328 00000100:00100000:2.0:1787508616.380522:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29760 00000100:00100000:2.0:1787508616.380529:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:203348:x1874324480131328:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787508616.380547:0:202232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508616.380561:0:202232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab800/0xb126349c40f34afc lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f34af5 expref: -99 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.380581:0:202232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f34a85 lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae560 expref: 5 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.380590:0:202232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f34ae0 lrc: 2/0,0 mode: PR/PR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae583 expref: 640 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.380599:0:202232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab800/0xb126349c40f34afc lrc: 5/0,0 mode: --/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f34af5 expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.380619:0:202232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f34ae0 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae583 expref: 640 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.380632:0:202232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f34ae0 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae583 expref: 640 pid: 205405 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508616.380643:0:202232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3c700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:202232:1874324480131456:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508616.380693:0:202232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f34a85 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae560 expref: 5 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.380703:0:202232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f34a85 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae560 expref: 5 pid: 209004 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508616.380712:0:202232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3ca80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:202232:1874324480131584:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508616.380733:0:202232:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3f11300 going to sleep for 11 seconds 00000100:00100000:2.0:1787508616.382491:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508616.382561:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509551104 00000100:00100000:3.0:1787508616.382569:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509551104 00000100:00100000:3.0:1787508616.382621:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93974 00000100:00100000:3.0:1787508616.382631:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:336101:x1874324509551104:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508616.382649:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508616.382670:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34b03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae58a expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.382734:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34b0a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.382757:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34b0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.382766:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34b0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.382778:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34b11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.382785:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34b11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.382791:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34b11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.382885:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34b18 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.382895:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34ae7 lrc: 2/0,1 mode: PW/PW res: [0x2000013a4:0x125c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.382902:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34b18 lrc: 4/1,0 mode: --/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.382917:0:202228:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34ae7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.382928:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34b18 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508616.385611:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508616.385650:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509551360 00000100:00100000:3.0:1787508616.385659:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509551360 00010000:00010000:3.0:1787508616.385700:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f34a85 lrc: 5/0,0 mode: PR/PR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae560 expref: 6 pid: 209004 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508616.385748:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27898 00000100:00100000:3.0:1787508616.385758:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509551360:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508616.385772:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508616.385780:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f34a85 lrc: 5/0,0 mode: PR/PR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae560 expref: 6 pid: 209004 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.385793:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f34a85 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae560 expref: 6 pid: 209004 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.385816:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x16a:0x0].0x0 (ffff9090d36fd700) 00010000:00010000:3.0:1787508616.385823:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab800/0xb126349c40f34afc lrc: 3/0,0 mode: --/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f34af5 expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.385835:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab800/0xb126349c40f34afc lrc: 3/0,0 mode: --/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f34af5 expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.385842:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508616.385892:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509551360:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 135us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508616.385900:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27898 00000100:00100000:3.0:1787508616.385995:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508616.386016:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509551232 00000100:00100000:3.0:1787508616.386019:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509551232 00010000:00010000:3.0:1787508616.386035:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f34ae0 lrc: 5/0,0 mode: PR/PR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae583 expref: 641 pid: 205405 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508616.386057:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27899 00000100:00100000:3.0:1787508616.386064:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc620a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+641:2402:x1874324509551232:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508616.386071:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508616.386076:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f34ae0 lrc: 5/0,0 mode: PR/PR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae583 expref: 641 pid: 205405 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.386087:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f34ae0 lrc: 4/0,0 mode: PR/PR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae583 expref: 641 pid: 205405 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.386099:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x16a:0x0].0x0 (ffff9090d36fd700) 00010000:00010000:3.0:1787508616.386103:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab800/0xb126349c40f34afc lrc: 3/0,0 mode: --/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f34af5 expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.386113:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab800/0xb126349c40f34afc lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xb126349c40f34af5 expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.386121:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab800/0xb126349c40f34afc lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xb126349c40f34af5 expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.386152:0:202213:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab800/0xb126349c40f34afc lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34af5 expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508616.386171:0:202213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc620380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:202213:1874324480131712:0@lo:105: 00000100:00100000:3.0:1787508616.386218:0:202213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508616.386252:0:202213:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9480 going to sleep for 11 seconds 00000100:00100000:3.0:1787508616.386273:0:229386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480131712 00000100:00100000:3.0:1787508616.386277:0:229386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480131712 00000100:00100000:3.0:1787508616.386305:0:229386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18188 00000100:00100000:3.0:1787508616.386311:0:229386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc623100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:202213:x1874324480131712:12345-0@lo:105: 00010000:00010000:3.0:1787508616.386321:0:229386:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa200/0xb126349c40f34af5 lrc: 4/0,1 mode: --/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34afc expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.386330:0:229386:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa200/0xb126349c40f34af5 lrc: 4/0,1 mode: --/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34afc expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.388813:0:229386:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa200/0xb126349c40f34af5 lrc: 4/0,1 mode: --/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34afc expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.388825:0:229386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa200/0xb126349c40f34af5 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f34afc expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.388834:0:229386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa200/0xb126349c40f34af5 lrc: 5/0,1 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f34afc expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.388844:0:229386:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa200/0xb126349c40f34af5 lrc: 5/0,1 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f34afc expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.388871:0:229386:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090cd2aa200) 00000100:00100000:3.0:1787508616.388983:0:229386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc623100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:202213:x1874324480131712:12345-0@lo:105: Request processed in 2669us (2761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508616.388993:0:229386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18188 00000100:00100000:3.0:1787508616.389059:0:202213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc620380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:202213:1874324480131712:0@lo:105: 00010000:00010000:3.0:1787508616.389077:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508616.389117:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc620a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+641:2402:x1874324509551232:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 3052us (3121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508616.389125:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27899 00010000:00010000:2.0:1787508616.391133:0:202232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7e00/0xb126349c40f34ae0 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae583 expref: 640 pid: 205405 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508616.391157:0:202232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3c700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:202232:1874324480131456:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508616.391847:0:202232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f34a85 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae560 expref: 5 pid: 209004 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508616.391865:0:202232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3ca80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:202232:1874324480131584:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508616.391899:0:202232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab800/0xb126349c40f34afc lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34af5 expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.391910:0:202232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x16a:0x0].0x0 (ffff9090d36fd700) 00010000:00010000:2.0:1787508616.391913:0:202232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508616.391916:0:202232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab800, rc 0) 00000100:00100000:2.0:1787508616.392146:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:203348:x1874324480131328:12345-0@lo:101:mdt00_003.0 Request processed in 11615us (11703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508616.392155:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29760 00000100:00100000:1.0:1787508616.393331:0:203348:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589962026 gen 2 00000004:00080000:1.0:1787508616.393340:0:203348:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589962017 committed transno 8589962026 00000020:00080000:1.0:1787508616.393346:0:203348:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9090d0a39180 refcount 2 committed 0 result 0 batchid 8589961989 00000020:00080000:1.0:1787508616.393351:0:203348:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521700 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d0a39000 00000020:00080000:1.0:1787508616.393354:0:203348:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd2:0x1:0x0].1791 00000020:00080000:1.0:1787508616.393357:0:203348:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090cdbf8600 00000020:00080000:1.0:1787508616.393360:0:203348:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1:0x0].1785 00000020:00080000:0.0:1787508616.393408:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589961989 committed batchid 8589961988 00000020:00080000:0.0:1787508616.393495:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961988 00000004:00080000:1.0:1787508616.394707:0:203348:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589962018 committed transno 8589962026 00000004:00080000:1.0:1787508616.394720:0:203348:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589962020 committed transno 8589962026 00000004:00080000:1.0:1787508616.394730:0:203348:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589962021 committed transno 8589962026 00000004:00080000:1.0:1787508616.394749:0:203348:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589962026 committed transno 8589962026 00000100:00100000:1.0:1787508616.394772:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:203348:1874324480131328:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787508616.394801:0:203348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa200/0xb126349c40f34af5 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34afc expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787508616.395217:0:203348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1:0x0].1787, 344 off1840696 00000040:00080000:2.0:1787508616.395282:0:203348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x1:0x0].1793, 552 off2046272 00000004:00080000:2.0:1787508616.395287:0:203348:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d3f11300 with version 3467 00000004:00080000:1.0:1787508616.395407:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3467 rpc_version 3467 00000020:00100000:1.0:1787508616.395455:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787508616.395467:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090da0bc700 x1874324480131968/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1528/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787508616.395494:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0bc700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480131968:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787508616.395565:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508616.395602:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9091d83eb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508616.395673:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480131968 00000100:00100000:3.0:1787508616.395681:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480131968 00000100:00100000:3.0:1787508616.395743:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29761 00000100:00100000:3.0:1787508616.395753:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:202248:x1874324480131968:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787508616.395929:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:202248:x1874324480131968:12345-0@lo:1000:osp_up1-0.0 Request processed in 177us (363us total) trans 8589962027 rc 0/0 00000100:00100000:3.0:1787508616.395937:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29761 00000100:00100000:0.0:1787508616.396406:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0bc700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480131968:0@lo:1000:osp_up1-0.0 00000004:00010000:2.0:1787508616.396486:0:203348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a57dc4f7 reply state 0000000073d6ff3a transno 12884944094 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34aee lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.396506:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34aee lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.396519:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x172:0x0].0x0 (ffff9090c6913200) 00010000:00010000:2.0:1787508616.396522:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787508616.396526:0:203348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787508616.396534:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa200/0xb126349c40f34af5 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34afc expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.396543:0:203348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa200/0xb126349c40f34af5 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34afc expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787508616.396554:0:203348:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd2:0x16a:0x0] 00000004:00010000:2.0:1787508616.396562:0:203348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a57dc4f7 reply state 0000000073d6ff3a transno 12884944094 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34ae7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.396572:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34ae7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x125c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.396578:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125c:0x0].0x0 (ffff9090c6913900) 00010000:00010000:2.0:1787508616.396580:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508616.396583:0:203348:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34b18 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.396592:0:203348:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34b18 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.396599:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34b18 lrc: 4/1,0 mode: PR/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508616.396626:0:203348:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1787508616.396638:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125c:0x0]: returning size 4096 00000100:00100000:2.0:1787508616.396732:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:336102:x1874324509550208:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 39992us (40206us total) trans 12884944094 rc 0/0 00000100:00100000:2.0:1787508616.396749:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93973 00010000:00010000:3.0:1787508616.397124:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34b18 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.397134:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34b18 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508616.397493:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125c:0x0]: returning size 4096 00000004:00200000:3.0:1787508616.397498:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1787508616.397516:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34b18 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.397529:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34b0a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.397540:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34b0a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.397546:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34b0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.397553:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34b0a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.397559:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508616.397564:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34b0a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.397570:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34b0a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.397583:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508616.397585:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508616.397589:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34b0a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.397595:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34b0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.397608:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34b11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.397614:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34b11 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.397619:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34b11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.397624:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508616.397627:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34b11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.397633:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34b11 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.397641:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd500) 00010000:00010000:3.0:1787508616.397643:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508616.397646:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34b11 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.397651:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34b11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.397679:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34b03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae58a expref: 15 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.397693:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34b18 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae58a expref: 14 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.397700:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125c:0x0].0x0 (ffff9090c6913900) 00010000:00010000:3.0:1787508616.397702:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508616.397705:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fa00, rc 0) 00000100:00100000:3.0:1787508616.397831:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336101:x1874324509551104:12345-192.168.201.30@tcp:101:rm.0 Request processed in 15200us (15345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508616.397900:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93974 00000100:00100000:3.0:1787508616.418672:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508616.418990:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509551616 00000100:00100000:0.0:1787508616.419002:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509551616 00000100:00100000:0.0:1787508616.419069:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93975 00000100:00100000:0.0:1787508616.419079:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336101:x1874324509551616:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:0.0:1787508616.419142:0:202227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787508616.419180:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34b18 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x125c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae58a expref: 14 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.419210:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125c:0x0].0x0 (ffff9090c6913900) 00010000:00010000:0.0:1787508616.419222:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34990 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae513 expref: 13 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.419231:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508616.419235:0:202227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508616.419258:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34b1f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.419285:0:202227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f349f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae52f expref: 585 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.419294:0:202227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34b1f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.419329:0:202227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f349f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae52f expref: 585 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.419349:0:202227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f349f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae52f expref: 585 pid: 205405 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508616.419363:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b0aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:202227:1874324480132096:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508616.419475:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8900 going to sleep for 11 seconds 00000100:00100000:2.0:1787508616.439873:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508616.440050:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b0aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:202227:1874324480132096:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508616.440081:0:202227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34b1f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508616.441473:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509551744 00000100:00100000:3.0:1787508616.441490:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509551744 00010000:00010000:3.0:1787508616.441537:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f349f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae52f expref: 586 pid: 205405 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508616.441592:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27900 00000100:00100000:3.0:1787508616.441602:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:2401:x1874324509551744:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508616.441616:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508616.441623:0:225839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f349f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae52f expref: 586 pid: 205405 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.441638:0:225839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f349f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae52f expref: 586 pid: 205405 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.441659:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f349f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae52f expref: 586 pid: 205405 timeout: 13687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.441676:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508616.441681:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34b1f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.441691:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34b1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.441698:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34b1f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.441728:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508616.441795:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:2401:x1874324509551744:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 193us (1932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508616.441803:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27900 00010000:00010000:0.0:1787508616.442027:0:202227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34b1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.442036:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34b1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.442056:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34b26 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.442066:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34b26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.442074:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34b26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.442173:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34b2d lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x125c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.442183:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34b2d lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x125c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.442190:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34b2d lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x125c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.442206:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34b34 lrc: 3/0,1 mode: --/EX res: [0x2000013a0:0x172:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.442213:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34b34 lrc: 3/0,1 mode: EX/EX res: [0x2000013a0:0x172:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.442220:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34b34 lrc: 3/0,1 mode: EX/EX res: [0x2000013a0:0x172:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.442253:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6e00/0xb126349c40f34b3b lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.442260:0:202227:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6e00/0xb126349c40f34b3b lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x0 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.442288:0:202227:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6e00/0xb126349c40f34b3b lrc: 3/0,1 mode: --/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508616.442308:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b0aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:202227:1874324480132224:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1787508616.442361:0:202227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508616.442405:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8900 going to sleep for 11 seconds 00000100:00100000:2.0:1787508616.442564:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480132224 00000100:00100000:2.0:1787508616.442570:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480132224 00000100:00100000:2.0:1787508616.442613:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29762 00000100:00100000:2.0:1787508616.442621:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:202227:x1874324480132224:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1787508616.442640:0:203182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508616.442655:0:203182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa000/0xb126349c40f34b42 lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f34b3b expref: -99 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.442673:0:203182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab800/0xb126349c40f34afc lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34af5 expref: 8 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.442682:0:203182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa000/0xb126349c40f34b42 lrc: 4/0,0 mode: --/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f34b3b expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.442703:0:203182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab800/0xb126349c40f34afc lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f34af5 expref: 8 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508616.442714:0:203182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3c700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:203182:1874324480132352:0@lo:104: 00000100:00100000:2.0:1787508616.442757:0:203182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508616.442793:0:203182:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c9af3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787508616.443539:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480132352 00000100:00100000:0.0:1787508616.443547:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480132352 00000100:00100000:0.0:1787508616.443588:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18189 00000100:00100000:0.0:1787508616.443596:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:203182:x1874324480132352:12345-0@lo:104: 00010000:00010000:0.0:1787508616.443607:0:202210:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa200/0xb126349c40f34af5 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f34afc expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.443684:0:202210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787508616.443690:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:203182:x1874324480132352:12345-0@lo:104: Request processed in 95us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508616.443696:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18189 00000100:00100000:2.0:1787508616.443872:0:203182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3c700 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:203182:1874324480132352:0@lo:104: 00010000:00010000:2.0:1787508616.443896:0:203182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa000/0xb126349c40f34b42 lrc: 3/0,0 mode: --/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34b3b expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.443909:0:203182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x16a:0x0].0x0 (ffff9090d36fd700) 00010000:00010000:2.0:1787508616.443912:0:203182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787508616.443915:0:203182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa000/0xb126349c40f34b42 lrc: 3/0,0 mode: --/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34b3b expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.443923:0:203182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa000/0xb126349c40f34b42 lrc: 3/0,0 mode: --/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34b3b expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.443930:0:203182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa000, rc 0) 00000100:00100000:2.0:1787508616.443997:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:202227:x1874324480132224:12345-0@lo:101:mdt00_001.0 Request processed in 1377us (1636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508616.444004:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29762 00010000:00010000:3.0:1787508616.444070:0:202214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787508616.444077:0:202214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa200/0xb126349c40f34af5 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f34afc expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.444085:0:202214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa200 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:3.0:1787508616.444090:0:202214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa200/0xb126349c40f34af5 lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f34afc expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508616.444098:0:202214:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa200/0xb126349c40f34af5 lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f34afc expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.444127:0:202214:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa200/0xb126349c40f34af5 lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f34afc expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.444133:0:202214:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787508616.444164:0:202214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa200/0xb126349c40f34af5 lrc: 1/0,0 mode: --/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f34afc expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.444171:0:202214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa200/0xb126349c40f34af5 lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x3 rrc: 3 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f34afc expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.444185:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508616.444186:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508616.444188:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508616.444298:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787508616.444312:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480132480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787508616.444344:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508616.444538:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480132480 00000100:00100000:3.0:1787508616.444544:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480132480 00010000:00010000:3.0:1787508616.444566:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab800/0xb126349c40f34afc lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f34af5 expref: 8 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508616.444600:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27901 00000100:00100000:3.0:1787508616.444608:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+8:3616:x1874324480132480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787508616.444620:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787508616.445505:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b0aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:202227:1874324480132224:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1787508616.445527:0:202227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6e00/0xb126349c40f34b3b lrc: 4/0,1 mode: --/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34b42 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.445538:0:202227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6e00/0xb126349c40f34b3b lrc: 4/0,1 mode: --/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34b42 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787508616.454157:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589962027 is committed 00000020:00080000:1.0:1787508616.454178:0:202955:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 4294998384 batchid updated 00010000:00010000:0.0:1787508616.454759:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab800/0xb126349c40f34afc lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x16a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f34af5 expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.454781:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x16a:0x0].0x0 (ffff9090d36fd700) 00010000:00010000:0.0:1787508616.454787:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa000/0xb126349c40f34b42 lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34b3b expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.454798:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa000/0xb126349c40f34b42 lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f34b3b expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.454807:0:202212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa000/0xb126349c40f34b42 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f34b3b expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.454857:0:202212:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa000/0xb126349c40f34b42 lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34b3b expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508616.454878:0:202212:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b08e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:202212:1874324480132608:0@lo:105: 00000100:00100000:0.0:1787508616.454985:0:202212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508616.455026:0:202212:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8900 going to sleep for 11 seconds 00000020:00080000:2.0:1787508616.455214:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998384 00000004:00080000:2.0:1787508616.455286:0:202975:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090c9af3c00 with version 13614 00000020:00080000:2.0:1787508616.455305:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294998383 cancel update log [0x2000013a2:0x5:0x0].591: rc = 0 00000020:00080000:2.0:1787508616.455406:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294998383 cancel update log [0x240000bd1:0xf:0x0].48: rc = 0 00000004:00080000:2.0:1787508616.455441:0:202975:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090c9af3600 with version 13615 00000020:00080000:2.0:1787508616.455445:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294998384 cancel update log [0x2000013a2:0x5:0x0].592: rc = 0 00000020:00080000:2.0:1787508616.455467:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294998384 cancel update log [0x240000bd1:0xf:0x0].49: rc = 0 00000020:00080000:2.0:1787508616.455473:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998384 00000100:00100000:1.0:1787508616.455706:0:229386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480132608 00000100:00100000:1.0:1787508616.455716:0:229386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480132608 00000100:00100000:1.0:1787508616.455782:0:229386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18190 00000100:00100000:1.0:1787508616.455792:0:229386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6350700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:202212:x1874324480132608:12345-0@lo:105: 00010000:00010000:1.0:1787508616.455804:0:229386:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6e00/0xb126349c40f34b3b lrc: 5/0,1 mode: --/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34b42 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.455814:0:229386:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6e00/0xb126349c40f34b3b lrc: 5/0,1 mode: --/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34b42 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.455824:0:229386:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6e00/0xb126349c40f34b3b lrc: 5/0,1 mode: --/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34b42 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.455832:0:229386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6e00/0xb126349c40f34b3b lrc: 5/0,1 mode: EX/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f34b42 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.455840:0:229386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6e00/0xb126349c40f34b3b lrc: 6/0,1 mode: EX/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f34b42 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.455849:0:229386:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6e00/0xb126349c40f34b3b lrc: 6/0,1 mode: EX/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f34b42 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508616.455876:0:229386:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d56f6e00) 00000100:00100000:1.0:1787508616.455927:0:229386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6350700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:202212:x1874324480132608:12345-0@lo:105: Request processed in 137us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508616.455933:0:229386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18190 00010000:00010000:3.0:1787508616.456082:0:202227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6e00/0xb126349c40f34b3b lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34b42 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.456093:0:202227:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6e00/0xb126349c40f34b3b lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34b42 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508616.456777:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc621f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:202227:1874324480132736:0@lo:403:mdt00_001.0 00000100:00100000:3.0:1787508616.456831:0:202227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508616.456865:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9480 going to sleep for 11 seconds 00000100:00100000:1.0:1787508616.457177:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480132736 00000100:00100000:1.0:1787508616.457183:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480132736 00000100:00100000:1.0:1787508616.457237:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29763 00000100:00100000:1.0:1787508616.457245:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:202227:x1874324480132736:12345-0@lo:403:mdt00_001.0 00000004:00080000:0.0:1787508616.458658:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13614 rpc_version 13614 00000020:00100000:0.0:1787508616.458693:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787508616.458703:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d6350000 x1874324480132992/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787508616.458724:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6350000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480132992:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787508616.458783:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508616.458823:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8540 going to sleep for 11 seconds 00000100:00100000:0.0:1787508616.458863:0:202212:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b08e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:202212:1874324480132608:0@lo:105: 00010000:00010000:0.0:1787508616.458886:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508616.458924:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+8:3616:x1874324480132480:12345-0@lo:103:ldlm_bl.0 Request processed in 14316us (14578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508616.458933:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27901 00000100:00100000:3.0:1787508616.459876:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480132992 00000100:00100000:3.0:1787508616.459885:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480132992 00000100:00100000:3.0:1787508616.459926:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29764 00000100:00100000:3.0:1787508616.459937:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:202961:x1874324480132992:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508616.460134:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:202961:x1874324480132992:12345-0@lo:1000:osp_up0-1.0 Request processed in 199us (1350us total) trans 12884944095 rc 0/0 00000100:00100000:3.0:1787508616.460141:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29764 00000100:00100000:3.0:1787508616.460182:0:202961:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944090 gen 2 00000004:00080000:3.0:1787508616.460187:0:202961:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944090 committed transno 12884944090 00000020:00080000:3.0:1787508616.460193:0:202961:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9090d9ff2c00 refcount 2 committed 0 result 0 batchid 4294998385 00000020:00080000:3.0:1787508616.460211:0:202961:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cd2caf00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d9ff2cc0 00000020:00080000:3.0:1787508616.460214:0:202961:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a2:0x5:0x0].593 00000020:00080000:3.0:1787508616.460218:0:202961:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cd2ca300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090cc49b000 00000020:00080000:3.0:1787508616.460221:0:202961:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd1:0xf:0x0].50 00000100:00100000:3.0:1787508616.460246:0:202961:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9090d6350000 x1874324480132992/t12884944095(12884944095) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1787508632 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787508616.460449:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6350000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480132992:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1787508616.460466:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13615 rpc_version 13615 00000020:00100000:3.0:1787508616.460487:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787508616.460493:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090cc622680 x1874324480133248/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787508616.460510:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc622680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480133248:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508616.460548:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508616.460569:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9780 going to sleep for 11 seconds 00000100:00100000:3.0:1787508616.460584:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480133248 00000100:00100000:3.0:1787508616.460589:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480133248 00000100:00100000:3.0:1787508616.460609:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29765 00000100:00100000:3.0:1787508616.460615:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:202961:x1874324480133248:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508616.460696:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202961:x1874324480133248:12345-0@lo:1000:osp_up0-1.0 Request processed in 80us (147us total) trans 12884944096 rc 0/0 00000100:00100000:3.0:1787508616.460703:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29765 00000100:00100000:2.0:1787508616.461480:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc621c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480132480:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1787508616.461511:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294998385 committed batchid 4294998384 00000020:00080000:2.0:1787508616.461551:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998384 00000100:00100000:3.0:1787508616.461719:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc622680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480133248:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508616.464632:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:202227:x1874324480132736:12345-0@lo:403:mdt00_001.0 Request processed in 7376us (7788us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508616.464649:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29763 00000100:00100000:2.0:1787508616.464894:0:202227:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589962027 gen 2 00000004:00080000:2.0:1787508616.464901:0:202227:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589962027 committed transno 8589962027 00000100:00100000:2.0:1787508616.464929:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc621f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:202227:1874324480132736:0@lo:403:mdt00_001.0 00000040:00080000:2.0:1787508616.466016:0:202227:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1:0x0].1788, 952 off1841648 00000040:00080000:2.0:1787508616.466200:0:202227:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x1:0x0].1794, 1032 off2047304 00000004:00080000:2.0:1787508616.466206:0:202227:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090c9af36c0 with version 3468 00000004:00080000:0.0:1787508616.466852:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3468 rpc_version 3468 00000020:00100000:0.0:1787508616.466891:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787508616.466903:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d6350380 x1874324480133504/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1992/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787508616.466930:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6350380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480133504:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787508616.467040:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508616.467084:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8900 going to sleep for 11 seconds 00000100:00100000:3.0:1787508616.469044:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480133504 00000100:00100000:3.0:1787508616.469057:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480133504 00000100:00100000:3.0:1787508616.469119:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29766 00000100:00100000:3.0:1787508616.469129:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:202248:x1874324480133504:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787508616.470068:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:202248:x1874324480133504:12345-0@lo:1000:osp_up1-0.0 Request processed in 936us (3024us total) trans 8589962028 rc 0/0 00000100:00100000:3.0:1787508616.470079:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29766 00000100:00100000:0.0:1787508616.470248:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6350380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480133504:0@lo:1000:osp_up1-0.0 00000004:00200000:3.0:1787508616.470622:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125c:0x0]: returning size 4096 00010000:00010000:3.0:1787508616.470645:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34b34 lrc: 3/0,1 mode: EX/EX res: [0x2000013a0:0x172:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.470655:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34b34 lrc: 2/0,0 mode: EX/EX res: [0x2000013a0:0x172:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.470662:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34b34 lrc: 3/0,0 mode: EX/EX res: [0x2000013a0:0x172:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.470668:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508616.470673:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34b34 lrc: 3/0,0 mode: EX/EX res: [0x2000013a0:0x172:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.470681:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34b34 lrc: 4/0,0 mode: EX/EX res: [0x2000013a0:0x172:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.470700:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x172:0x0].0x0 (ffff9090c6913200) 00010000:00010000:3.0:1787508616.470703:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787508616.470709:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34b34 lrc: 2/0,0 mode: --/EX res: [0x2000013a0:0x172:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.470714:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34b34 lrc: 0/0,0 mode: --/EX res: [0x2000013a0:0x172:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.470730:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6e00/0xb126349c40f34b3b lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34b42 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.471467:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6e00/0xb126349c40f34b3b lrc: 4/0,1 mode: EX/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f34b42 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.471481:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6e00/0xb126349c40f34b3b lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f34b42 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.471548:0:202227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1787508616.471557:0:202227:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd2:0x16a:0x0] 00010000:00010000:3.0:1787508616.471566:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34b2d lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x125c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.471572:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34b2d lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x125c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.471578:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34b2d lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x125c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.471584:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508616.471587:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34b2d lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x125c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.471594:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34b2d lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x125c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.471605:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125c:0x0].0x0 (ffff9090c6913900) 00010000:00010000:3.0:1787508616.471608:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787508616.471611:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34b2d lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x125c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.471618:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34b2d lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x125c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.471638:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34b1f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.471645:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34b1f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.471650:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34b1f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.471655:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34b1f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.471659:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508616.471663:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34b1f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.471668:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34b1f lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.471676:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508616.471678:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508616.471682:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34b1f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.471688:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f34b1f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508616.471698:0:202227:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1564022 reply state 00000000f27e4fe2 transno 12884944097 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34b26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.471709:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34b26 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508616.471716:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd500) 00010000:00010000:3.0:1787508616.471719:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508616.471722:0:202227:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787508616.471820:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:336101:x1874324509551616:12345-192.168.201.30@tcp:36:rm.0 Request processed in 52738us (53156us total) trans 12884944097 rc 0/0 00000100:00100000:3.0:1787508616.471829:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93975 00010000:00010000:2.0:1787508616.476494:0:202215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787508616.476510:0:202215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6e00/0xb126349c40f34b3b lrc: 2/0,0 mode: EX/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xb126349c40f34b42 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.476523:0:202215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6e00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:2.0:1787508616.476530:0:202215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6e00/0xb126349c40f34b3b lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xb126349c40f34b42 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508616.476539:0:202215:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6e00/0xb126349c40f34b3b lrc: 3/0,0 mode: EX/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xb126349c40f34b42 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.476593:0:202215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6e00/0xb126349c40f34b3b lrc: 2/0,0 mode: --/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f34b42 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.476599:0:202215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787508616.476655:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480133632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787508616.476731:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787508616.476872:0:202215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6e00/0xb126349c40f34b3b lrc: 1/0,0 mode: --/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f34b42 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.476880:0:202215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090d56f6e00/0xb126349c40f34b3b lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f34b42 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508616.476908:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508616.476910:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508616.476911:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508616.476980:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480133632 00000100:00100000:0.0:1787508616.476989:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480133632 00000100:00100000:0.0:1787508616.477049:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9792 00000100:00100000:0.0:1787508616.477058:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc622d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+7:3618:x1874324480133632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508616.477070:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508616.477089:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa000/0xb126349c40f34b42 lrc: 0/0,0 mode: --/EX res: [0x240000bd2:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f34b3b expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508616.477104:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x16a:0x0].0x0 (ffff9090d36fd700) 00010000:00010000:0.0:1787508616.477112:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508616.481796:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc622d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1874324480133632:12345-0@lo:103:ldlm_bl.0 Request processed in 4727us (5054us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508616.481812:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9792 00000100:00100000:3.0:1787508616.482005:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480133632:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508616.763146:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508617.402544:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787508617.404301:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480133888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787508617.404373:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508617.404452:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480133888 00000100:00100000:0.0:1787508617.404459:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480133888 00000100:00100000:0.0:1787508617.404516:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1627 00000100:00100000:0.0:1787508617.404526:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480133888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787508617.404572:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16990784 pending 0 free 3910828032 avail 3679305728 00000100:00080000:1.0:1787508617.404583:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787508617.404626:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480133888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508617.404635:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1627 00000100:00100000:1.0:1787508617.404665:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480133888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787508617.407076:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480133760:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787508617.407536:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508617.412977:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480133760 00000100:00100000:0.0:1787508617.412992:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480133760 00000100:00100000:0.0:1787508617.413074:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1628 00000100:00100000:0.0:1787508617.413085:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480133760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787508617.413112:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16990784 pending 0 free 3910828032 avail 3679305728 00000100:00100000:0.0:1787508617.413328:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480133760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 244us (5792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508617.413336:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1628 00000100:00100000:0.0:1787508617.413416:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480133760:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787508617.413437:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787508617.793244:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508618.426626:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787508618.426650:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480134016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787508618.426722:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508618.426861:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480134016 00000100:00100000:0.0:1787508618.426869:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480134016 00000100:00100000:0.0:1787508618.426928:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29767 00000100:00100000:0.0:1787508618.426937:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3616:x1874324480134016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787508618.426995:0:202232:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1441779712 avail 1295540224 00000100:00100000:0.0:1787508618.427047:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3616:x1874324480134016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508618.427054:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29767 00000100:00100000:3.0:1787508618.427167:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480134016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787508618.433483:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480134144:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787508618.433565:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508618.433628:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480134144 00000100:00100000:0.0:1787508618.433635:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480134144 00000100:00100000:0.0:1787508618.433681:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29768 00000100:00100000:0.0:1787508618.433690:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3618:x1874324480134144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787508618.433729:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1442799616 avail 1296560128 00000100:00100000:0.0:1787508618.433773:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:3618:x1874324480134144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508618.433780:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29768 00000100:00100000:0.0:1787508618.433828:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480134144:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787508618.810176:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508618.938412:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79de3f65-4bad-42d0-a46f-842a654b33a0:3619:1874324480134272:0@lo:400:kworker.0 00000100:00100000:0.0:1787508618.938489:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508618.938590:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480134272 00000100:00100000:3.0:1787508618.938598:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480134272 00000100:00100000:3.0:1787508618.938648:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 979 00000100:00100000:3.0:1787508618.938656:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091cbbc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3619:x1874324480134272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508618.940451:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480134656:0@lo:400:kworker.0 00000100:00100000:1.0:1787508618.940511:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508618.940577:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480134656 00000100:00100000:1.0:1787508618.940584:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480134656 00000100:00100000:1.0:1787508618.940626:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2861 00000100:00100000:1.0:1787508618.940634:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480134656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508618.940680:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480134656:12345-0@lo:400:kworker.0 Request processed in 46us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508618.940691:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2861 00000100:00100000:1.0:1787508618.940733:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480134656:0@lo:400:kworker.0 00000100:00100000:1.0:1787508618.940765:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480134528:0@lo:400:kworker.0 00000100:00100000:1.0:1787508618.940792:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508618.940812:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787508618.940817:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480134400:0@lo:400:kworker.0 00000100:00100000:1.0:1787508618.940838:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508618.940863:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480134528 00000100:00100000:1.0:1787508618.940866:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480134528 00000100:00100000:1.0:1787508618.940899:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480134400 00000100:00100000:1.0:1787508618.940901:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480134400 00000100:00100000:1.0:1787508618.940918:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2271 00000100:00100000:1.0:1787508618.940924:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480134528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508618.940981:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480134528:12345-0@lo:400:kworker.0 Request processed in 57us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508618.940987:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2271 00000100:00100000:1.0:1787508618.940998:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2272 00000100:00100000:1.0:1787508618.941003:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480134400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508618.941048:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480134400:12345-0@lo:400:kworker.0 Request processed in 45us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508618.941055:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2272 00000100:00100000:1.0:1787508618.941088:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480134400:0@lo:400:kworker.0 00000100:00100000:1.0:1787508618.941112:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480134528:0@lo:400:kworker.0 00000100:00080000:1.0:1787508618.941149:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508618.941629:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091cbbc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3619:x1874324480134272:12345-0@lo:400:kworker.0 Request processed in 2971us (3136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508618.941639:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 979 00000100:00100000:3.0:1787508618.941964:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480134912:0@lo:400:kworker.0 00000100:00100000:3.0:1787508618.942001:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508618.942311:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787508618.942322:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480134784:0@lo:400:kworker.0 00000100:00100000:1.0:1787508618.942348:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508618.942389:0:230130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480134912 00000100:00100000:1.0:1787508618.942395:0:230130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480134912 00000100:00100000:1.0:1787508618.942431:0:230130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480134784 00000100:00100000:1.0:1787508618.942434:0:230130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480134784 00000100:00100000:1.0:1787508618.942453:0:230130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2273 00000100:00100000:1.0:1787508618.942460:0:230130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc621c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480134912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508618.942645:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79de3f65-4bad-42d0-a46f-842a654b33a0:3619:1874324480134272:0@lo:400:kworker.0 00000100:00080000:0.0:1787508618.942677:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508618.942692:0:208927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2274 00000100:00100000:0.0:1787508618.942699:0:208927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480134784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508618.942734:0:208927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480134784:12345-0@lo:400:kworker.0 Request processed in 36us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508618.942740:0:208927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2274 00000100:00100000:0.0:1787508618.942767:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480134784:0@lo:400:kworker.0 00000100:00100000:0.0:1787508618.942796:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480135040:0@lo:400:kworker.0 00000100:00100000:0.0:1787508618.942821:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508618.942854:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480135040 00000100:00100000:0.0:1787508618.942857:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480135040 00000100:00100000:0.0:1787508618.942883:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2862 00000100:00100000:0.0:1787508618.942889:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480135040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508618.942923:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480135040:12345-0@lo:400:kworker.0 Request processed in 35us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508618.942929:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2862 00000100:00100000:0.0:1787508618.942971:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480135040:0@lo:400:kworker.0 00000100:00100000:1.0:1787508618.943534:0:230130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc621c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480134912:12345-0@lo:400:kworker.0 Request processed in 1072us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508618.943542:0:230130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2273 00000100:00100000:2.0:1787508618.943667:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480135552:0@lo:400:kworker.0 00000100:00100000:2.0:1787508618.943696:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508618.943713:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787508618.943717:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480135424:0@lo:400:kworker.0 00000100:00100000:2.0:1787508618.943732:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508618.943751:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480135552 00000100:00100000:2.0:1787508618.943755:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480135552 00000100:00100000:2.0:1787508618.943781:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480135424 00000100:00100000:2.0:1787508618.943784:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480135424 00000100:00100000:2.0:1787508618.943799:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2863 00000100:00100000:2.0:1787508618.943805:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480135552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508618.943856:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480135552:12345-0@lo:400:kworker.0 Request processed in 50us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508618.943862:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2863 00000100:00100000:2.0:1787508618.943873:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2864 00000100:00100000:2.0:1787508618.943878:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480135424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508618.943898:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480135424:12345-0@lo:400:kworker.0 Request processed in 20us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508618.943903:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2864 00000100:00080000:2.0:1787508618.943914:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787508618.943917:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787508618.943934:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480135424:0@lo:400:kworker.0 00000100:00100000:2.0:1787508618.943959:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480135552:0@lo:400:kworker.0 00000100:00100000:1.0:1787508618.944103:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480135296:0@lo:400:kworker.0 00000100:00100000:0.0:1787508618.944119:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874324480135168:0@lo:400:kworker.0 00000100:00100000:1.0:1787508618.944131:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508618.944169:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508618.944191:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480135296 00000100:00100000:1.0:1787508618.944204:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480135296 00000100:00100000:1.0:1787508618.944240:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480135168 00000100:00100000:1.0:1787508618.944243:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480135168 00000100:00100000:1.0:1787508618.944258:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2865 00000100:00100000:1.0:1787508618.944263:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480135296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508618.944296:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480135296:12345-0@lo:400:kworker.0 Request processed in 32us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508618.944302:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2865 00000100:00100000:1.0:1787508618.944325:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2866 00000100:00100000:1.0:1787508618.944331:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874324480135168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508618.944363:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874324480135168:12345-0@lo:400:kworker.0 Request processed in 33us (194us total) trans 0 rc 0/0 00000100:00080000:2.0:1787508618.944653:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787508618.944656:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787508618.944715:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480134912:0@lo:400:kworker.0 00000100:00100000:1.0:1787508618.947530:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2866 00000100:00100000:1.0:1787508618.947620:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480135296:0@lo:400:kworker.0 00000100:00100000:1.0:1787508618.947677:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874324480135168:0@lo:400:kworker.0 00010000:00010000:2.0:1787508619.836350:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508620.403651:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508620.403703:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508620.403738:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508620.403761:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508620.403791:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508620.403811:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508620.403830:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508620.403852:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508620.403878:0:225838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509552384 00000100:00100000:3.0:1787508620.403887:0:225838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509552384 00000100:00100000:3.0:1787508620.403975:0:225838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2275 00000100:00100000:3.0:1787508620.403987:0:225838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509552384:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508620.404055:0:225838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509552384:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 71us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508620.404063:0:225838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2275 00000100:00100000:3.0:1787508620.404083:0:225838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509552256 00000100:00100000:3.0:1787508620.404086:0:225838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509552256 00000100:00100000:3.0:1787508620.404108:0:225838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509552768 00000100:00100000:3.0:1787508620.404111:0:225838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509552768 00000100:00100000:3.0:1787508620.404129:0:225838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2276 00000100:00100000:3.0:1787508620.404135:0:225838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509552256:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508620.404160:0:225838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509552256:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508620.404167:0:225838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2276 00000100:00100000:3.0:1787508620.404178:0:225838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2277 00000100:00100000:3.0:1787508620.404184:0:225838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2403:x1874324509552768:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508620.404206:0:225838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2403:x1874324509552768:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508620.404213:0:225838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2277 00000100:00100000:0.0:1787508620.404394:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509551872 00000100:00100000:0.0:1787508620.404399:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509551872 00000100:00100000:0.0:1787508620.404436:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 980 00000100:00100000:0.0:1787508620.404443:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091cbbc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509551872:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508620.404471:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091cbbc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509551872:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 28us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508620.404478:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 980 00000100:00100000:2.0:1787508620.404573:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509552128 00000100:00100000:2.0:1787508620.404577:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509552128 00000100:00100000:2.0:1787508620.404614:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509552640 00000100:00100000:2.0:1787508620.404617:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509552640 00000100:00100000:2.0:1787508620.404635:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509552000 00000100:00100000:2.0:1787508620.404638:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509552000 00000100:00100000:2.0:1787508620.404656:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509552512 00000100:00100000:2.0:1787508620.404660:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509552512 00000100:00100000:2.0:1787508620.404675:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2867 00000100:00100000:2.0:1787508620.404682:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2403:x1874324509552128:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508620.404827:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2868 00000100:00100000:0.0:1787508620.404836:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509552640:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508620.404864:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509552640:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 29us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508620.404871:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2868 00000100:00100000:0.0:1787508620.404888:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2869 00000100:00100000:0.0:1787508620.404894:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:2403:x1874324509552000:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508620.404974:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:2403:x1874324509552000:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 79us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508620.404981:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2869 00000100:00100000:0.0:1787508620.404993:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2870 00000100:00100000:0.0:1787508620.405000:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2403:x1874324509552512:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508620.405026:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2403:x1874324509552512:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 27us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508620.405032:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2870 00000100:00080000:0.0:1787508620.405064:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787508620.405068:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508620.405071:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787508620.405073:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508620.405864:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2403:x1874324509552128:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 1177us (2156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508620.405877:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2867 00010000:00010000:1.0:1787508620.858186:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508620.989505:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787508620.989528:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480135680:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787508620.989601:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508620.989666:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480135680 00000100:00100000:3.0:1787508620.989674:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480135680 00000100:00100000:3.0:1787508620.989741:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1629 00000100:00100000:3.0:1787508620.989750:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480135680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787508620.989788:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75854400 pending 0 free 3884056576 avail 3652534272 00000100:00100000:3.0:1787508620.989837:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480135680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508620.989844:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1629 00000100:00080000:0.0:1787508620.989912:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508620.989986:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480135680:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787508620.993026:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480135808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508620.993158:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508620.993353:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480135808 00000100:00100000:0.0:1787508620.993361:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480135808 00000100:00100000:0.0:1787508620.993428:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1630 00000100:00100000:0.0:1787508620.993436:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480135808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787508620.993455:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75854400 pending 0 free 3884056576 avail 3652534272 00000100:00100000:0.0:1787508620.993519:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480135808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508620.993527:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1630 00000100:00100000:3.0:1787508620.993552:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480135808:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787508620.993598:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787508621.886877:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787508622.014140:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944097 is committed 00000001:00080000:3.0:1787508622.014159:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944096 is committed 00000001:00080000:3.0:1787508622.014172:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944094 is committed 00000020:00080000:3.0:1787508622.014177:0:202206:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9090d3f11240 refcount 2 committed 0 result 0 batchid 8589961991 00000020:00080000:3.0:1787508622.014182:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cbc97800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d3f11300 00000020:00080000:3.0:1787508622.014186:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd2:0x1:0x0].1793 00000020:00080000:3.0:1787508622.014189:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cbc97000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090d7420200 00000020:00080000:3.0:1787508622.014192:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1:0x0].1787 00000020:00080000:3.0:1787508622.014205:0:202206:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8589961989 batchid updated 00000020:00080000:3.0:1787508622.014216:0:202206:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9090cf708540 refcount 2 committed 0 result 0 batchid 8589961990 00000020:00080000:3.0:1787508622.014220:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cbc97700 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9090cf7080c0 00000020:00080000:1.0:1787508622.014222:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961989 00000020:00080000:3.0:1787508622.014223:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd2:0x1:0x0].1792 00000020:00080000:3.0:1787508622.014227:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cbc97b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090d9d28600 00000020:00080000:3.0:1787508622.014230:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1:0x0].1786 00010000:00010000:2.0:1787508622.014343:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34b26 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508622.014355:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34b26 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508622.014362:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34b26 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508622.014368:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508622.014372:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34b26 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508622.014382:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34b26 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508622.014405:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd500) 00010000:00010000:2.0:1787508622.014408:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508622.014412:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34b26 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508622.014418:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34b26 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787508622.014459:0:202262:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d9ff2b40 with version 3469 00000020:00080000:1.0:1787508622.014517:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589961989 cancel update log [0x240000bd2:0x1:0x0].1791: rc = 0 00010000:00010000:0.0:1787508622.014548:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34982 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014556:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34982 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014562:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34982 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014566:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508622.014570:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34982 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014575:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34982 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014586:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x34e22964 (ffff9090d36fd500) 00010000:00010000:0.0:1787508622.014588:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508622.014591:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34982 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014597:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34982 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x34e22964 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787508622.014609:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589961989 cancel update log [0x2000013a0:0x1:0x0].1785: rc = 0 00010000:00010000:0.0:1787508622.014618:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34997 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x125c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787508622.014620:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589961991 committed batchid 8589961989 00010000:00010000:0.0:1787508622.014629:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34997 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x125c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014634:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34997 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x125c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014639:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508622.014642:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34997 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x125c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014647:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34997 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x125c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787508622.014648:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961989 00010000:00010000:0.0:1787508622.014659:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125c:0x0].0x0 (ffff9090c6913900) 00010000:00010000:0.0:1787508622.014662:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508622.014666:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34997 lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x125c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014673:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34997 lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x125c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014682:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3499e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x172:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014688:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3499e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a0:0x172:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014693:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3499e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x172:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014698:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508622.014701:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3499e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x172:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014706:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3499e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a0:0x172:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014713:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x172:0x0].0x0 (ffff9090c6913200) 00010000:00010000:0.0:1787508622.014715:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508622.014718:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3499e lrc: 2/0,0 mode: --/TXN res: [0x2000013a0:0x172:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014723:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f3499e lrc: 0/0,0 mode: --/TXN res: [0x2000013a0:0x172:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014734:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34ae7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x125c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014740:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34ae7 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x125c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014746:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34ae7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x125c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014751:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508622.014754:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34ae7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x125c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014760:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34ae7 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x125c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014767:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125c:0x0].0x0 (ffff9090c6913900) 00010000:00010000:0.0:1787508622.014769:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508622.014772:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34ae7 lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x125c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014789:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34ae7 lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x125c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014803:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34aee lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014809:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34aee lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014814:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34aee lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014820:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ea00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508622.014823:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34aee lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014833:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34aee lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014840:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x172:0x0].0x0 (ffff9090c6913200) 00010000:00010000:0.0:1787508622.014842:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508622.014845:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34aee lrc: 2/0,0 mode: --/TXN res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508622.014851:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34aee lrc: 0/0,0 mode: --/TXN res: [0x2000013a0:0x172:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787508622.016017:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589962028 is committed 00000020:00080000:1.0:1787508622.016033:0:202955:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 4294998385 batchid updated 00000020:00080000:3.0:1787508622.016094:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998385 00000004:00080000:3.0:1787508622.016156:0:202975:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d74d9480 with version 13616 00000020:00080000:3.0:1787508622.016175:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294998385 cancel update log [0x2000013a2:0x5:0x0].593: rc = 0 00000020:00080000:3.0:1787508622.016241:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294998385 cancel update log [0x240000bd1:0xf:0x0].50: rc = 0 00000020:00080000:3.0:1787508622.016249:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998385 00000004:00080000:0.0:1787508622.016291:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13616 rpc_version 13616 00000020:00100000:0.0:1787508622.016481:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787508622.016493:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090c9682300 x1874324480136064/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787508622.016517:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9682300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480136064:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787508622.016587:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508622.016633:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9091fd975840 going to sleep for 11 seconds 00000100:00100000:1.0:1787508622.016851:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480136064 00000100:00100000:1.0:1787508622.016860:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480136064 00000100:00100000:1.0:1787508622.016926:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29769 00000100:00100000:1.0:1787508622.016937:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:202961:x1874324480136064:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508622.017106:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:202961:x1874324480136064:12345-0@lo:1000:osp_up0-1.0 Request processed in 169us (517us total) trans 12884944098 rc 0/0 00000100:00100000:1.0:1787508622.017114:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29769 00000004:00080000:2.0:1787508622.018090:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3469 rpc_version 3469 00000020:00100000:2.0:1787508622.018124:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787508622.018133:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d2d3f480 x1874324480136320/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787508622.018152:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3f480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480136320:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787508622.018199:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508622.018243:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d21c4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787508622.018393:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480136320 00000100:00100000:1.0:1787508622.018400:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480136320 00000100:00100000:1.0:1787508622.018447:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29770 00000100:00100000:1.0:1787508622.018456:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:202248:x1874324480136320:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787508622.018499:0:202961:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944096 gen 2 00000004:00080000:0.0:1787508622.018506:0:202961:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944095 committed transno 12884944096 00000004:00080000:0.0:1787508622.018527:0:202961:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944096 committed transno 12884944096 00000100:00100000:0.0:1787508622.018541:0:202961:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9090c9682300 x1874324480136064/t12884944098(12884944098) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1787508638 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787508622.018557:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9682300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480136064:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508622.018625:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:202248:x1874324480136320:12345-0@lo:1000:osp_up1-0.0 Request processed in 169us (425us total) trans 8589962029 rc 0/0 00000100:00100000:1.0:1787508622.018634:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29770 00000100:00100000:0.0:1787508622.018648:0:202248:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589962028 gen 2 00000004:00080000:0.0:1787508622.018653:0:202248:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589962028 committed transno 8589962028 00000020:00080000:0.0:1787508622.018659:0:202248:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9090c9af3900 refcount 2 committed 0 result 0 batchid 8589961992 00000020:00080000:0.0:1787508622.018664:0:202248:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cbc97500 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9090c9af36c0 00000020:00080000:0.0:1787508622.018667:0:202248:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd2:0x1:0x0].1794 00000020:00080000:0.0:1787508622.018669:0:202248:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cbc97d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090d7420a00 00000020:00080000:0.0:1787508622.018672:0:202248:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1:0x0].1788 00000100:00100000:0.0:1787508622.018696:0:202248:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9090d2d3f480 x1874324480136320/t8589962029(8589962029) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1787508638 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787508622.018709:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3f480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480136320:0@lo:1000:osp_up1-0.0 00000020:00080000:1.0:1787508622.018918:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589961992 committed batchid 8589961989 00000020:00080000:1.0:1787508622.018967:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961989 00000100:00100000:1.0:1787508622.523673:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480136448:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787508622.523743:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508622.523816:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480136448 00000100:00100000:1.0:1787508622.523823:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480136448 00000100:00100000:1.0:1787508622.523872:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1631 00000100:00100000:1.0:1787508622.523880:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480136448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787508622.523909:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16990784 pending 0 free 3910828032 avail 3679305728 00000100:00100000:1.0:1787508622.523971:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480136448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508622.523978:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1631 00000100:00080000:1.0:1787508622.523999:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508622.524041:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480136448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787508622.526169:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480136576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787508622.526257:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508622.526818:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480136576 00000100:00100000:0.0:1787508622.526826:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480136576 00000100:00100000:0.0:1787508622.526895:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1632 00000100:00100000:0.0:1787508622.526903:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480136576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787508622.526922:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16990784 pending 0 free 3910828032 avail 3679305728 00000100:00100000:0.0:1787508622.526995:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480136576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508622.527003:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1632 00000100:00080000:2.0:1787508622.527599:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787508622.527712:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480136576:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787508622.907460:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508623.547561:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480136832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787508623.547640:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508623.547702:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787508623.547710:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480136704:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787508623.547733:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508623.556443:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480136832 00000100:00100000:1.0:1787508623.556459:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480136832 00000100:00100000:1.0:1787508623.556528:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480136704 00000100:00100000:1.0:1787508623.556532:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480136704 00000100:00100000:1.0:1787508623.556557:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29771 00000100:00100000:1.0:1787508623.556567:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3619:x1874324480136832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787508623.556614:0:202232:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1442799616 avail 1296560128 00000100:00100000:1.0:1787508623.556711:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3619:x1874324480136832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (9071us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508623.556720:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29771 00000100:00100000:1.0:1787508623.556737:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29772 00000100:00100000:1.0:1787508623.556743:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3619:x1874324480136704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787508623.556762:0:202232:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1441783808 avail 1295544320 00000100:00100000:1.0:1787508623.556792:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3619:x1874324480136704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (9058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508623.556798:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29772 00000100:00100000:1.0:1787508623.556858:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480136704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787508623.556876:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480136832:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1787508623.631126:0:231754:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 92: create remote directory under orphan directory ========================================================== 14:10:22 (1787508622) 00000100:00100000:3.0:1787508623.740526:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508623.740661:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509552896 00000100:00100000:2.0:1787508623.740671:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509552896 00000100:00100000:2.0:1787508623.740752:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93976 00000100:00100000:2.0:1787508623.740762:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+581:336674:x1874324509552896:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508623.740782:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508623.740803:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34b49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae591 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.740868:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34b50 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.740882:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34b50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.740896:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34b50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508623.740969:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508623.740973:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508623.740993:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34b50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.741019:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34b49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae591 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.741036:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34b50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae591 expref: 582 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.741045:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508623.741049:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508623.741052:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab200, rc 0) 00000100:00100000:2.0:1787508623.741108:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336674:x1874324509552896:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 348us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508623.741115:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93976 00000100:00080000:1.0:1787508623.741240:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787508623.754430:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508623.754618:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509553024 00000100:00100000:2.0:1787508623.754627:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509553024 00000100:00100000:2.0:1787508623.754679:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93977 00000100:00100000:2.0:1787508623.754689:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336674:x1874324509553024:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508623.754709:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508623.754728:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34b57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae598 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.754794:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34b5e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.754808:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34b5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.754820:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34b5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.754836:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34b65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.754843:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34b65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.754851:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34b65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.754910:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34b5e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.754917:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34b5e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.754924:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34b5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.754930:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34b5e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.754936:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508623.755060:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34b5e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.755069:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34b5e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.755082:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508623.755085:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508623.755090:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34b5e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.755097:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34b5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.755110:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34b65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.755117:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34b65 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.755124:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34b65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.755130:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508623.755133:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34b65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.755139:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34b65 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.755146:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9ec4e541 (ffff9090c98d9300) 00010000:00010000:2.0:1787508623.755149:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508623.755152:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34b65 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.755158:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34b65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.755189:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34b57 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae598 expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.755199:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508623.755202:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508623.755206:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34b57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae598 expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.755215:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aba00, rc 0) 00000100:00100000:2.0:1787508623.755269:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336674:x1874324509553024:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 581us (849us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508623.755280:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93977 00000100:00100000:2.0:1787508623.775147:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508623.775213:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508623.775251:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509553152 00000100:00100000:2.0:1787508623.775260:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509553152 00000100:00100000:2.0:1787508623.775334:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509553408 00000100:00100000:2.0:1787508623.775338:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509553408 00000100:00100000:2.0:1787508623.775363:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93978 00000100:00100000:2.0:1787508623.775373:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+641:2401:x1874324509553152:12345-192.168.201.30@tcp:41:lfs.0 00000004:00000024:2.0:1787508623.775406:0:205405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1442799616 avail 1296560128 00000100:00100000:2.0:1787508623.776323:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+641:2401:x1874324509553152:12345-192.168.201.30@tcp:41:lfs.0 Request processed in 945us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508623.776333:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93978 00000100:00100000:2.0:1787508623.776362:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93979 00000100:00100000:2.0:1787508623.776371:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:336674:x1874324509553408:12345-192.168.201.30@tcp:36:lfs.0 00000100:00100000:2.0:1787508623.777328:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb60700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480136960:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508623.777395:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508623.777445:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88840 going to sleep for 11 seconds 00000100:00080000:2.0:1787508623.777660:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787508623.778114:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480136960 00000100:00100000:2.0:1787508623.778122:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480136960 00000100:00100000:2.0:1787508623.778167:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29773 00000100:00100000:2.0:1787508623.778175:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:205405:x1874324480136960:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508623.779415:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:205405:x1874324480136960:12345-0@lo:1000:mdt00_004.0 Request processed in 1235us (2015us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508623.779429:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29773 00000100:00100000:2.0:1787508623.780356:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb60700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480136960:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508623.780431:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb60700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480137088:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508623.781348:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508623.781390:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88840 going to sleep for 11 seconds 00000100:00100000:0.0:1787508623.785134:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480137088 00000100:00100000:0.0:1787508623.785149:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480137088 00000100:00100000:0.0:1787508623.785371:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29774 00000100:00100000:0.0:1787508623.785383:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:205405:x1874324480137088:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508623.785566:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:205405:x1874324480137088:12345-0@lo:1000:mdt00_004.0 Request processed in 186us (4221us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787508623.785574:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29774 00000100:00100000:3.0:1787508623.785643:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb60700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480137088:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1787508623.785710:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34b6c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.785721:0:205405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34b6c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.785731:0:205405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34b6c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508623.785748:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480137216:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1787508623.785785:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508623.791488:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cf708000 going to sleep for 11 seconds 00000100:00100000:2.0:1787508623.795176:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480137216 00000100:00100000:2.0:1787508623.795190:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480137216 00000100:00100000:2.0:1787508623.795249:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29775 00000100:00100000:2.0:1787508623.795259:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:205405:x1874324480137216:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1787508623.795280:0:203182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508623.795315:0:203182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34b73 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f34b6c expref: -99 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.795345:0:203182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34b50 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae591 expref: 581 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.795354:0:203182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34b73 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f34b6c expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.795389:0:203182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34b50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae591 expref: 581 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.795403:0:203182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34b50 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae591 expref: 581 pid: 202226 timeout: 13694 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508623.795417:0:203182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb63800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480137344:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508623.795505:0:203182:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88780 going to sleep for 11 seconds 00000100:00100000:0.0:1787508623.804682:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508623.804801:0:203182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb63800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480137344:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508623.804843:0:203182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34b73 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34b6c expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.804858:0:203182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508623.804861:0:203182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508623.804865:0:203182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34b73 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34b6c expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.804877:0:203182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aba00, rc 0) 00000100:00100000:2.0:1787508623.804978:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480137216:12345-0@lo:101:mdt00_004.0 Request processed in 9719us (19190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508623.804987:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29775 00000100:00100000:0.0:1787508623.805441:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480137216:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1787508623.805461:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34b6c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34b73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.805472:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34b6c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34b73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508623.805601:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509553536 00000100:00100000:3.0:1787508623.805610:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509553536 00010000:00010000:3.0:1787508623.805646:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34b50 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae591 expref: 582 pid: 202226 timeout: 13694 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508623.805691:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27902 00000100:00100000:3.0:1787508623.805701:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9681c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:2400:x1874324509553536:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508623.805716:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508623.805722:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34b50 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae591 expref: 582 pid: 202226 timeout: 13694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.805734:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34b50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae591 expref: 582 pid: 202226 timeout: 13694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.805752:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34b50 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae591 expref: 582 pid: 202226 timeout: 13694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.805766:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508623.805770:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34b73 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34b6c expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.805792:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34b73 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f34b6c expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.805801:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34b73 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f34b6c expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.805833:0:205406:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34b73 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34b6c expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508623.805847:0:205406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:205406:1874324480137472:0@lo:105: 00000100:00100000:3.0:1787508623.805896:0:205406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508623.805971:0:205406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cf708240 going to sleep for 11 seconds 00000100:00100000:0.0:1787508623.806219:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480137472 00000100:00100000:0.0:1787508623.806224:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480137472 00000100:00100000:0.0:1787508623.806262:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18191 00000100:00100000:0.0:1787508623.806269:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:205406:x1874324480137472:12345-0@lo:105: 00010000:00010000:0.0:1787508623.806279:0:229363:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34b6c lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34b73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.806298:0:229363:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34b6c lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34b73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.806306:0:229363:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34b6c lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34b73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.806312:0:229363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34b6c lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f34b73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.806319:0:229363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34b6c lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f34b73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.806325:0:229363:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34b6c lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f34b73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.806345:0:229363:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090e4c8e800) 00000100:00100000:0.0:1787508623.806385:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:205406:x1874324480137472:12345-0@lo:105: Request processed in 116us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508623.806392:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18191 00010000:00010000:0.0:1787508623.806413:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34b6c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34b73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.806422:0:205405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34b6c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34b73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787508623.806445:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787508623.806480:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7600/0xb126349c40f34b7a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.806488:0:205405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7600/0xb126349c40f34b7a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.806497:0:205405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7600/0xb126349c40f34b7a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508623.806512:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9683100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480137600:0@lo:101:mdt00_004.0 00000100:00100000:0.0:1787508623.806540:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508623.806557:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d43cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508623.806737:0:205406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:205406:1874324480137472:0@lo:105: 00010000:00010000:3.0:1787508623.806750:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508623.806819:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9681c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+581:2400:x1874324509553536:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1119us (2148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508623.806827:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27902 00000100:00100000:2.0:1787508623.806918:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480137600 00000100:00100000:2.0:1787508623.806923:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480137600 00000100:00100000:2.0:1787508623.806985:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29776 00000100:00100000:2.0:1787508623.806993:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480137600:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1787508623.807009:0:202231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508623.807160:0:202231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34b81 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f34b7a expref: -99 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.807184:0:202231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34b81 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f34b7a expref: 9 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.807264:0:202231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34b81 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34b7a expref: 9 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.807278:0:202231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9ec4e541 (ffff9090c98d9300) 00010000:00010000:2.0:1787508623.807281:0:202231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508623.807295:0:202231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abe00, rc 0) 00000100:00100000:2.0:1787508623.807339:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:205405:x1874324480137600:12345-0@lo:101:mdt00_004.0 Request processed in 347us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508623.807345:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29776 00000100:00100000:2.0:1787508623.807379:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9683100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480137600:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1787508623.807392:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7600/0xb126349c40f34b7a lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34b81 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.807401:0:205405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7600/0xb126349c40f34b7a lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34b81 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787508623.807416:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1787508623.807455:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb63800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480137728:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508623.807485:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508623.807506:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787508623.807521:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480137728 00000100:00100000:2.0:1787508623.807524:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480137728 00000100:00100000:2.0:1787508623.807553:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29777 00000100:00100000:2.0:1787508623.807560:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:205405:x1874324480137728:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508623.807621:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:205405:x1874324480137728:12345-0@lo:1000:mdt00_004.0 Request processed in 62us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508623.807628:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29777 00000100:00100000:2.0:1787508623.807658:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb63800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480137728:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508623.807699:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb63800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480137856:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508623.807722:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508623.807735:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787508623.807748:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480137856 00000100:00100000:2.0:1787508623.807752:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480137856 00000100:00100000:2.0:1787508623.807773:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29778 00000100:00100000:2.0:1787508623.807779:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed03f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:205405:x1874324480137856:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508623.807855:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed03f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:205405:x1874324480137856:12345-0@lo:1000:mdt00_004.0 Request processed in 75us (130us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787508623.807861:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29778 00000100:00100000:2.0:1787508623.809427:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb63800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480137856:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508623.809538:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb63800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480137984:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508623.809640:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508623.809709:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508623.810728:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480137984 00000100:00100000:3.0:1787508623.810738:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480137984 00000100:00100000:3.0:1787508623.810882:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29779 00000100:00100000:3.0:1787508623.810893:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:205405:x1874324480137984:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508623.811307:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb63800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480137984:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508623.811383:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb63800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480138112:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508623.811549:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508623.811615:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508623.811651:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:205405:x1874324480137984:12345-0@lo:1000:mdt00_004.0 Request processed in 760us (2011us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787508623.811660:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29779 00000100:00100000:3.0:1787508623.811680:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480138112 00000100:00100000:3.0:1787508623.811684:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480138112 00000100:00100000:0.0:1787508623.811725:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29780 00000100:00100000:0.0:1787508623.811734:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:205405:x1874324480138112:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508623.811843:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:205405:x1874324480138112:12345-0@lo:1000:mdt00_004.0 Request processed in 109us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508623.811850:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29780 00000100:00100000:2.0:1787508623.812309:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb63800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480138112:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508623.812357:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb63800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480138240:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508623.812383:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508623.812443:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d88cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787508623.812474:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480138240 00000100:00100000:0.0:1787508623.812479:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480138240 00000100:00100000:0.0:1787508623.812543:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29781 00000100:00100000:0.0:1787508623.812551:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:205405:x1874324480138240:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508623.812628:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:205405:x1874324480138240:12345-0@lo:1000:mdt00_004.0 Request processed in 77us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508623.812635:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29781 00000100:00100000:3.0:1787508623.812687:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb63800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480138240:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508623.812728:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4c87480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480138368:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508623.812755:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508623.812915:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cf708c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787508623.813246:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480138368 00000100:00100000:2.0:1787508623.813252:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480138368 00000100:00100000:2.0:1787508623.813325:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29782 00000100:00100000:2.0:1787508623.813334:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:205405:x1874324480138368:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508623.813384:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:205405:x1874324480138368:12345-0@lo:1000:mdt00_004.0 Request processed in 52us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508623.813392:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29782 00000100:00100000:2.0:1787508623.813561:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4c87480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480138368:0@lo:1000:mdt00_004.0 00000040:00080000:2.0:1787508623.815414:0:205405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xf:0x0].51, 2168 off86760 00000040:00080000:2.0:1787508623.815516:0:205405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x5:0x0].595, 2368 off756032 00000004:00080000:2.0:1787508623.815522:0:205405:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d1d88600 with version 13617 00000004:00080000:0.0:1787508623.815619:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13617 rpc_version 13617 00000020:00100000:0.0:1787508623.815659:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787508623.815670:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d0b4ca80 x1874324480138624/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787508623.815693:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4ca80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480138624:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787508623.815759:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508623.815887:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1d43cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508623.815936:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480138624 00000100:00100000:3.0:1787508623.816924:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480138624 00000100:00100000:3.0:1787508623.817010:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29783 00000100:00100000:3.0:1787508623.817150:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:202961:x1874324480138624:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508623.818478:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:202961:x1874324480138624:12345-0@lo:1000:osp_up0-1.0 Request processed in 1454us (2713us total) trans 12884944099 rc 0/0 00000100:00100000:3.0:1787508623.818489:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29783 00000100:00100000:2.0:1787508623.818662:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4ca80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480138624:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1787508623.818898:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f34b88 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.818919:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f34b88 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.818932:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f34b88 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.818986:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f34b8f lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x294:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.818994:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f34b8f lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.819001:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f34b8f lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.819355:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f34b96 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x28a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.819363:0:205405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f34b96 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.819372:0:205405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f34b96 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508623.819390:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4c84700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480138752:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1787508623.819438:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508623.819509:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cf708240 going to sleep for 11 seconds 00000100:00100000:2.0:1787508623.819849:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480138752 00000100:00100000:2.0:1787508623.819857:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480138752 00000100:00100000:2.0:1787508623.819965:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29784 00000100:00100000:2.0:1787508623.819976:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:205405:x1874324480138752:12345-0@lo:101:mdt00_004.0 00010000:00010000:2.0:1787508623.819995:0:202231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508623.820012:0:202231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34b9d lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x28a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f34b96 expref: -99 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.820117:0:202231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34b9d lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f34b96 expref: 11 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.820131:0:202231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34b9d lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34b96 expref: 11 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.820139:0:202231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28a:0x0].0x0 (ffff9090c98d9400) 00010000:00010000:2.0:1787508623.820141:0:202231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508623.820146:0:202231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa800, rc 0) 00000100:00100000:2.0:1787508623.820271:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:205405:x1874324480138752:12345-0@lo:101:mdt00_004.0 Request processed in 222us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508623.820278:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29784 00000100:00100000:3.0:1787508623.820504:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4c84700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480138752:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1787508623.820521:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f34b96 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34b9d expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.820537:0:205405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f34b96 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34b9d expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508623.820557:0:205405:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc2b7a67 reply state 000000008f67bba1 transno 8589962030 ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f34b8f lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.820570:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f34b8f lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.820576:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x294:0x0].0x0 (ffff9090ccb87e00) 00010000:00010000:3.0:1787508623.820578:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508623.820581:0:205405:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787508623.820587:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f34b96 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34b9d expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.820593:0:205405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f34b96 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34b9d expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787508623.820604:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x28a:0x0] 00000004:00010000:3.0:1787508623.820610:0:205405:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc2b7a67 reply state 000000008f67bba1 transno 8589962030 ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f34b88 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.820617:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f34b88 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.820622:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d5:0x0].0x0 (ffff9090ccb87900) 00010000:00010000:3.0:1787508623.820625:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508623.820626:0:205405:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787508623.820632:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d5:0x0]: returning size 4096 00000004:00080000:3.0:1787508623.820641:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1787508623.820649:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34b6c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34b73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.820656:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34b6c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f34b73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.820662:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34b6c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f34b73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.820687:0:205405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1787508623.820692:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1787508623.820697:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7600/0xb126349c40f34b7a lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34b81 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.820706:0:205405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7600/0xb126349c40f34b7a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34b81 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508623.820791:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+642:336674:x1874324509553408:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 44408us (45564us total) trans 8589962030 rc 0/0 00000100:00100000:3.0:1787508623.820799:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93979 00010000:00010000:0.0:1787508623.821027:0:202215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508623.821141:0:202215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34b6c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xb126349c40f34b73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.821149:0:202215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:0.0:1787508623.821154:0:202215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34b6c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xb126349c40f34b73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508623.821162:0:202215:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34b6c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xb126349c40f34b73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.821194:0:202215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34b6c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f34b73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.821272:0:202215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787508623.821305:0:202215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34b6c lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f34b73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.821313:0:202215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e800/0xb126349c40f34b6c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f34b73 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.821325:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508623.821327:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508623.821329:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508623.821343:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480138880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508623.821399:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508623.821452:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480138880 00000100:00100000:0.0:1787508623.821458:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480138880 00000100:00100000:0.0:1787508623.821498:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9793 00000100:00100000:0.0:1787508623.821506:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc621880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+11:3616:x1874324480138880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508623.821518:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508623.821533:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34b73 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f34b6c expref: 11 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.821544:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508623.821548:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508623.821578:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc621880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+10:3616:x1874324480138880:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508623.821585:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9793 00000100:00100000:0.0:1787508623.821616:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480138880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508623.828077:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508623.828150:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509553664 00000100:00100000:3.0:1787508623.828159:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509553664 00000100:00100000:3.0:1787508623.828224:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93980 00000100:00100000:3.0:1787508623.828234:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+581:336537:x1874324509553664:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1787508623.828254:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508623.828275:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34ba4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae59f expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.828357:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34bab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.828371:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34bab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.828381:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34bab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508623.828422:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508623.828425:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508623.828442:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34bab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.828465:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34ba4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae59f expref: 583 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.828481:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34bab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae59f expref: 582 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.828489:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508623.828492:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508623.828496:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fa00, rc 0) 00000100:00100000:3.0:1787508623.828566:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336537:x1874324509553664:12345-192.168.201.30@tcp:101:bash.0 Request processed in 333us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508623.828573:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93980 00000100:00100000:3.0:1787508623.832520:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508623.835620:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509553920 00000100:00100000:2.0:1787508623.835636:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509553920 00000100:00100000:3.0:1787508623.836148:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93981 00000100:00100000:3.0:1787508623.836161:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:336537:x1874324509553920:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1787508623.836182:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508623.836276:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34bb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae5a6 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.836360:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34bb9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.836374:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34bb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.836384:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34bb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.836395:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34bc0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.836405:0:202227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34b81 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34b7a expref: 9 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.836412:0:202227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34bc0 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.836447:0:202227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34b81 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f34b7a expref: 9 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508623.836462:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4c86680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:202227:1874324480139008:0@lo:104: 00000100:00100000:3.0:1787508623.836527:0:202227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508623.838563:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cf708240 going to sleep for 11 seconds 00000100:00100000:2.0:1787508623.838619:0:202209:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787508623.838639:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480139008 00000100:00100000:2.0:1787508623.838646:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480139008 00000100:00100000:2.0:1787508623.838759:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18192 00000100:00100000:2.0:1787508623.838769:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:202227:x1874324480139008:12345-0@lo:104: 00010000:00010000:2.0:1787508623.838793:0:202209:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7600/0xb126349c40f34b7a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f34b81 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.838877:0:202209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787508623.838883:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:202227:x1874324480139008:12345-0@lo:104: Request processed in 116us (2356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508623.838891:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18192 00000100:00100000:3.0:1787508623.839029:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4c86680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:202227:1874324480139008:0@lo:104: 00010000:00010000:3.0:1787508623.839066:0:202227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34bc0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.839332:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787508623.839340:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7600/0xb126349c40f34b7a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f34b81 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.839349:0:204785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7600 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:1.0:1787508623.839355:0:204785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7600/0xb126349c40f34b7a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f34b81 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508623.839364:0:204785:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7600/0xb126349c40f34b7a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f34b81 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.839403:0:204785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7600/0xb126349c40f34b7a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f34b81 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.839410:0:204785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787508623.839446:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7600/0xb126349c40f34b7a lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f34b81 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.839465:0:204785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7600/0xb126349c40f34b7a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f34b81 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.839486:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508623.839488:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508623.839490:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508623.839629:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480139136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787508623.839682:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508623.839761:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480139136 00000100:00100000:1.0:1787508623.839766:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480139136 00010000:00010000:1.0:1787508623.839790:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34b81 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f34b7a expref: 10 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508623.839822:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27903 00000100:00100000:1.0:1787508623.839830:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde3c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3617:x1874324480139136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508623.839839:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1787508623.848206:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944099 is committed 00000020:00080000:1.0:1787508623.848225:0:202206:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8589961992 batchid updated 00000020:00080000:1.0:1787508623.848232:0:202206:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8589961991 batchid updated 00000020:00080000:0.0:1787508623.848310:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961992 00000004:00080000:0.0:1787508623.848381:0:202262:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090cc643900 with version 3470 00000020:00080000:0.0:1787508623.848403:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589961990 cancel update log [0x240000bd2:0x1:0x0].1792: rc = 0 00000020:00080000:0.0:1787508623.848500:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589961990 cancel update log [0x2000013a0:0x1:0x0].1786: rc = 0 00000004:00080000:0.0:1787508623.848524:0:202262:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090cc643e40 with version 3471 00000020:00080000:0.0:1787508623.848528:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589961991 cancel update log [0x240000bd2:0x1:0x0].1793: rc = 0 00000020:00080000:0.0:1787508623.848550:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589961991 cancel update log [0x2000013a0:0x1:0x0].1787: rc = 0 00000004:00080000:0.0:1787508623.848571:0:202262:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d21c4540 with version 3472 00000020:00080000:0.0:1787508623.848574:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589961992 cancel update log [0x240000bd2:0x1:0x0].1794: rc = 0 00000020:00080000:0.0:1787508623.848594:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589961992 cancel update log [0x2000013a0:0x1:0x0].1788: rc = 0 00000020:00080000:0.0:1787508623.848601:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961992 00000004:00080000:2.0:1787508623.848678:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3470 rpc_version 3470 00000020:00100000:2.0:1787508623.848714:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787508623.848725:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091ffb63800 x1874324480139392/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787508623.848749:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb63800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480139392:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787508623.848821:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508623.848858:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c9af3600 going to sleep for 11 seconds 00010000:00010000:0.0:1787508623.849226:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34b81 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f34b7a expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.849245:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9ec4e541 (ffff9090c98d9300) 00010000:00010000:0.0:1787508623.849250:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34bc0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.849260:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.849267:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34bc0 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.849309:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787508623.849413:0:202227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.849421:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508623.849538:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:202227:1874324480139520:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787508623.849570:0:202227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508623.849603:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480139392 00000100:00100000:1.0:1787508623.849610:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480139392 00000100:00100000:1.0:1787508623.849649:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29785 00000100:00100000:1.0:1787508623.849657:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:202248:x1874324480139392:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787508623.849781:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:202248:x1874324480139392:12345-0@lo:1000:osp_up1-0.0 Request processed in 124us (960us total) trans 8589962031 rc 0/0 00000100:00100000:1.0:1787508623.849790:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29785 00000100:00100000:1.0:1787508623.849806:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480139520 00000100:00100000:1.0:1787508623.849810:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480139520 00000100:00100000:1.0:1787508623.849829:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29786 00000100:00100000:1.0:1787508623.849834:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:202227:x1874324480139520:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787508623.849875:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:202227:x1874324480139520:12345-0@lo:1000:mdt00_001.0 Request processed in 40us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508623.849882:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29786 00000100:00100000:1.0:1787508623.849923:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb63800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480139392:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1787508623.849933:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3471 rpc_version 3471 00000020:00100000:1.0:1787508623.849970:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787508623.849977:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091ffb3a300 x1874324480139776/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787508623.849990:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb3a300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480139776:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787508623.850015:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508623.850877:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde3c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3617:x1874324480139136:12345-0@lo:103:ldlm_bl.0 Request processed in 11044us (11192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508623.850888:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27903 00000100:00100000:1.0:1787508623.851136:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9840 going to sleep for 11 seconds 00000100:00100000:2.0:1787508623.851467:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480139136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787508623.851650:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480139776 00000100:00100000:3.0:1787508623.851657:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480139776 00000100:00100000:3.0:1787508623.851692:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29787 00000100:00100000:3.0:1787508623.851701:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:202248:x1874324480139776:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787508623.851872:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:202248:x1874324480139776:12345-0@lo:1000:osp_up1-0.0 Request processed in 171us (1855us total) trans 8589962032 rc 0/0 00000100:00100000:3.0:1787508623.851879:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29787 00000100:00100000:0.0:1787508623.851988:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb3a300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480139776:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787508623.852000:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3472 rpc_version 3472 00000020:00100000:0.0:1787508623.852215:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787508623.852224:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090cc620a80 x1874324480140032/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787508623.852245:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc620a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480140032:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787508623.852280:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508623.852316:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787508623.852359:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480140032 00000100:00100000:3.0:1787508623.852364:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480140032 00000100:00100000:3.0:1787508623.852384:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29788 00000100:00100000:3.0:1787508623.852389:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:202248:x1874324480140032:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787508623.852491:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:202248:x1874324480140032:12345-0@lo:1000:osp_up1-0.0 Request processed in 101us (210us total) trans 8589962033 rc 0/0 00000100:00100000:3.0:1787508623.852498:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29788 00000100:00100000:0.0:1787508623.852615:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc620a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480140032:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787508623.852704:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9ff2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787508623.852721:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:202227:1874324480139520:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787508623.852776:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f34bc7 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.852790:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f34bc7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.852803:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f34bc7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.852819:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34bb9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.852826:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34bb9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.852831:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34bb9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.852838:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34bb9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.852844:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508623.852849:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34bb9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.852856:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34bb9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.852869:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508623.852873:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508623.852878:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34bb9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.852885:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34bb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.852898:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.852905:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34bc0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.852911:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34bc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.852916:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508623.852919:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34bc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.852925:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34bc0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.852933:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9ec4e541 (ffff9090c98d9300) 00010000:00010000:1.0:1787508623.852935:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508623.852967:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34bc0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.852974:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34bc0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.853019:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34bb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5a6 expref: 584 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.853298:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f34bc7 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5a6 expref: 583 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.853306:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d5:0x0].0x0 (ffff9090d9e7b600) 00010000:00010000:1.0:1787508623.853308:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508623.853311:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a800, rc 0) 00000100:00100000:0.0:1787508623.853419:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336537:x1874324509553920:12345-192.168.201.30@tcp:101:bash.0 Request processed in 17259us (20908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508623.853427:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93981 00000100:00100000:0.0:1787508623.865079:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508623.865354:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509554176 00000100:00100000:2.0:1787508623.865365:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509554176 00000100:00100000:2.0:1787508623.865436:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93982 00000100:00100000:2.0:1787508623.865447:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+642:336537:x1874324509554176:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1787508623.865602:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508623.865624:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f34bce lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae5ad expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508623.865787:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d5:0x0]: returning size 4096 00010000:00010000:2.0:1787508623.865901:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f34bce lrc: 1/0,0 mode: --/CR res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5ad expref: 644 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.865916:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d5:0x0].0x0 (ffff9090ccb87900) 00010000:00010000:2.0:1787508623.865919:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508623.865924:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f34bce lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5ad expref: 644 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.866243:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aac00, rc 0) 00000100:00100000:3.0:1787508623.868123:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+643:336537:x1874324509554176:12345-192.168.201.30@tcp:101:bash.0 Request processed in 2668us (3047us total) trans 8589962034 rc 301/301 00000100:00100000:3.0:1787508623.868136:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93982 00000100:00100000:1.0:1787508623.871365:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508623.874635:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509554304 00000100:00100000:3.0:1787508623.874651:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509554304 00000100:00100000:3.0:1787508623.876031:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93983 00000100:00100000:3.0:1787508623.876053:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+643:336537:x1874324509554304:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1787508623.876082:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508623.876106:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f34bdc lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae5b4 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.876171:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f34be3 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x294:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.876184:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f34be3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.876196:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f34be3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508623.876249:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x294:0x0]: returning size 4096 00000004:00200000:3.0:1787508623.876255:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787508623.876305:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f34bdc lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5b4 expref: 645 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.876325:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f34be3 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5b4 expref: 644 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.876333:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x294:0x0].0x0 (ffff9090ccb87e00) 00010000:00010000:3.0:1787508623.876336:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508623.876339:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fc00, rc 0) 00000100:00100000:3.0:1787508623.876406:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:336537:x1874324509554304:12345-192.168.201.30@tcp:101:bash.0 Request processed in 363us (5053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508623.876413:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93983 00000100:00100000:2.0:1787508623.882783:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508623.885653:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509554432 00000100:00100000:3.0:1787508623.885669:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509554432 00000100:00100000:3.0:1787508623.886480:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93984 00000100:00100000:3.0:1787508623.886494:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:336537:x1874324509554432:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1787508623.886517:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508623.886543:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34bea lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae5bb expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.886614:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34bf1 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.886630:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34b9d lrc: 2/0,0 mode: PW/PW res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34b96 expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.886638:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34bf1 lrc: 4/1,0 mode: --/PR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.886674:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34b9d lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f34b96 expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508623.886689:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4c86680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480140160:0@lo:104: 00000100:00100000:3.0:1787508623.886755:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508623.886795:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cf708240 going to sleep for 11 seconds 00000100:00100000:0.0:1787508623.886926:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480140160 00000100:00100000:0.0:1787508623.886933:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480140160 00000100:00100000:0.0:1787508623.887006:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18193 00000100:00100000:0.0:1787508623.887014:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:230618:x1874324480140160:12345-0@lo:104: 00010000:00010000:0.0:1787508623.887041:0:229363:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f34b96 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f34b9d expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.887124:0:229363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787508623.887131:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:230618:x1874324480140160:12345-0@lo:104: Request processed in 119us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508623.887137:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18193 00010000:00010000:0.0:1787508623.887160:0:226765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508623.887167:0:226765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f34b96 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f34b9d expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.887179:0:226765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:0.0:1787508623.887185:0:226765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f34b96 lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f34b9d expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508623.887193:0:226765:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f34b96 lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f34b9d expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.887220:0:226765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f34b96 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f34b9d expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.887227:0:226765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787508623.887245:0:226765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f34b96 lrc: 1/0,0 mode: --/PW res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f34b9d expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.887253:0:226765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f34b96 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f34b9d expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.887272:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508623.887274:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508623.887276:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508623.887466:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480140288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508623.887502:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508623.887567:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4c86680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480140160:0@lo:104: 00010000:00010000:1.0:1787508623.887584:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34bf1 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508623.889201:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480140288 00000100:00100000:0.0:1787508623.889216:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480140288 00010000:00010000:0.0:1787508623.889257:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34b9d lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f34b96 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508623.889315:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27904 00000100:00100000:0.0:1787508623.889324:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+7:3618:x1874324480140288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508623.889340:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508623.897611:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34b9d lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f34b96 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.897634:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28a:0x0].0x0 (ffff9090c98d9400) 00010000:00010000:0.0:1787508623.897640:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34bf1 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.897649:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34bf1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.897657:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34bf1 lrc: 4/1,0 mode: PR/PR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.897692:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787508623.897849:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34bf1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.897859:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34bf1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508623.897916:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a2:0x28a:0x0]: returning size 4096 00000004:00200000:1.0:1787508623.897923:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787508623.898005:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34bea lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5bb expref: 585 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.898036:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34bf1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5bb expref: 584 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.898045:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28a:0x0].0x0 (ffff9090c98d9400) 00010000:00010000:1.0:1787508623.898048:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508623.898807:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f000, rc 0) 00000100:00100000:1.0:1787508623.898884:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336537:x1874324509554432:12345-192.168.201.30@tcp:101:bash.0 Request processed in 12391us (16108us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508623.898894:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93984 00000100:00100000:0.0:1787508623.899336:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480140288:12345-0@lo:103:ldlm_bl.0 Request processed in 10011us (11830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508623.899346:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27904 00000100:00100000:2.0:1787508623.901886:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480140288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508623.913768:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508623.917584:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509554560 00000100:00100000:3.0:1787508623.917599:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509554560 00000100:00100000:3.0:1787508623.917743:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93985 00000100:00100000:3.0:1787508623.917754:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:336537:x1874324509554560:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1787508623.917775:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508623.917800:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f34bf8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae5c2 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.917874:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e800/0xb126349c40f34bff lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.917888:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e800/0xb126349c40f34bff lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.917899:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e800/0xb126349c40f34bff lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508623.918030:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d5:0x0]: returning size 4096 00000004:00200000:3.0:1787508623.918035:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1787508623.918056:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e800/0xb126349c40f34bff lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.918081:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f34bf8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5c2 expref: 646 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.918103:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e800/0xb126349c40f34bff lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5c2 expref: 645 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.918111:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d5:0x0].0x0 (ffff9090ccb87900) 00010000:00010000:3.0:1787508623.918114:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508623.918118:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e800, rc 0) 00000100:00100000:3.0:1787508623.918182:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+645:336537:x1874324509554560:12345-192.168.201.30@tcp:101:bash.0 Request processed in 430us (4425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508623.918189:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93985 00010000:00010000:3.0:1787508623.932473:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508623.933595:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508623.933694:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509554688 00000100:00100000:0.0:1787508623.933705:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509554688 00000100:00100000:0.0:1787508623.933772:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93986 00000100:00100000:0.0:1787508623.933783:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+645:336684:x1874324509554688:12345-192.168.201.30@tcp:101:rmdir.0 00010000:00010000:0.0:1787508623.933805:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508623.933828:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f34c06 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae5c9 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.933890:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f34c0d lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.933904:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f34c0d lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.933914:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f34c0d lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.933929:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6200/0xb126349c40f34c14 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x294:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.933935:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6200/0xb126349c40f34c14 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.934035:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6200/0xb126349c40f34c14 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.934106:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f34c0d lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.934114:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f34c0d lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.934120:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f34c0d lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.934127:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f34c0d lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.934133:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508623.934138:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f34c0d lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.934150:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f34c0d lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.934163:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x294:0x0].0x0 (ffff9090ccb87e00) 00010000:00010000:0.0:1787508623.934166:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508623.934171:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f34c0d lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.934177:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6e00/0xb126349c40f34c0d lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.934191:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6200/0xb126349c40f34c14 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.934198:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6200/0xb126349c40f34c14 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.934203:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6200/0xb126349c40f34c14 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.934208:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508623.934211:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6200/0xb126349c40f34c14 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.934218:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6200/0xb126349c40f34c14 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.934225:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x294:0x0].0xeddcfc6c (ffff9090ca4e2200) 00010000:00010000:0.0:1787508623.934227:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508623.934229:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6200/0xb126349c40f34c14 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x294:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.934235:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6200/0xb126349c40f34c14 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x294:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.934267:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f34c06 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5c9 expref: 646 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.934277:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x294:0x0].0x0 (ffff9090ccb87e00) 00010000:00010000:0.0:1787508623.934279:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508623.934293:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7a00/0xb126349c40f34c06 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5c9 expref: 646 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.934303:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7a00, rc 0) 00000100:00100000:0.0:1787508623.934419:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+645:336684:x1874324509554688:12345-192.168.201.30@tcp:101:rmdir.0 Request processed in 637us (832us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508623.934427:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93986 00000100:00100000:2.0:1787508623.949807:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508623.949928:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509554816 00000100:00100000:3.0:1787508623.949965:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509554816 00000100:00100000:3.0:1787508623.950028:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93987 00000100:00100000:3.0:1787508623.950040:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+645:336684:x1874324509554816:12345-192.168.201.30@tcp:101:rmdir.0 00010000:00010000:3.0:1787508623.950060:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508623.950081:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f34c1b lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae5d0 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.950148:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f34c22 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.950163:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f34c22 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.950174:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f34c22 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.950188:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f34c29 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x294:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.950195:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f34c29 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.950202:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f34c29 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.950245:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f34c22 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.950253:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f34c22 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.950262:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f34c22 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.950268:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f34c22 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.950272:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ea00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508623.950277:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f34c22 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.950297:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f34c22 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.950309:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x294:0x0].0x0 (ffff9090ccb87e00) 00010000:00010000:3.0:1787508623.950312:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508623.950321:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f34c22 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.950327:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f34c22 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.950340:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f34c29 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.950346:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f34c29 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.950352:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f34c29 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.950357:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508623.950360:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f34c29 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.950366:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f34c29 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.950373:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x294:0x0].0x3491cd4c (ffff9090ccb87800) 00010000:00010000:3.0:1787508623.950376:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508623.950379:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f34c29 lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x294:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.950385:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f34c29 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x294:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.950415:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f34c1b lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5d0 expref: 646 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.950424:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x294:0x0].0x0 (ffff9090ccb87e00) 00010000:00010000:3.0:1787508623.950427:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508623.950430:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f34c1b lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5d0 expref: 646 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.950438:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f200, rc 0) 00000100:00100000:3.0:1787508623.950590:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+645:336684:x1874324509554816:12345-192.168.201.30@tcp:101:rmdir.0 Request processed in 551us (793us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508623.950600:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93987 00000100:00100000:2.0:1787508623.957310:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508623.957424:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509554944 00000100:00100000:1.0:1787508623.957437:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509554944 00000100:00100000:1.0:1787508623.957509:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93988 00000100:00100000:1.0:1787508623.957521:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+645:336684:x1874324509554944:12345-192.168.201.30@tcp:101:rmdir.0 00010000:00010000:1.0:1787508623.957544:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508623.957567:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f34c30 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae5d7 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.957636:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f34c37 lrc: 3/1,0 mode: --/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.957650:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f34c37 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.957664:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f34c37 lrc: 3/1,0 mode: CR/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.957680:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b800/0xb126349c40f34c3e lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x294:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.957687:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b800/0xb126349c40f34c3e lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.957693:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b800/0xb126349c40f34c3e lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.957742:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f34c37 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.957749:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f34c37 lrc: 4/1,0 mode: CR/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.957756:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f34c37 lrc: 3/0,0 mode: CR/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.957763:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f34c37 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.957769:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508623.957773:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f34c37 lrc: 4/0,0 mode: CR/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.957781:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f34c37 lrc: 5/0,0 mode: CR/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.957792:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x294:0x0].0x0 (ffff9090ccb87e00) 00010000:00010000:1.0:1787508623.957796:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508623.957801:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f34c37 lrc: 3/0,0 mode: --/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.957807:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ae00/0xb126349c40f34c37 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.957821:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b800/0xb126349c40f34c3e lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.957828:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b800/0xb126349c40f34c3e lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.957834:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b800/0xb126349c40f34c3e lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.957840:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508623.957842:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b800/0xb126349c40f34c3e lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.957853:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b800/0xb126349c40f34c3e lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.957860:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x294:0x0].0x3735a305 (ffff9090d9e7b900) 00010000:00010000:1.0:1787508623.957863:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508623.957865:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b800/0xb126349c40f34c3e lrc: 2/0,0 mode: --/PR res: [0x240000bd1:0x294:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.957871:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b800/0xb126349c40f34c3e lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x294:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.957903:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f34c30 lrc: 1/0,0 mode: --/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5d7 expref: 646 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.957914:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x294:0x0].0x0 (ffff9090ccb87e00) 00010000:00010000:1.0:1787508623.957916:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508623.957920:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f34c30 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x294:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5d7 expref: 646 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.957929:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ac00, rc 0) 00000100:00100000:1.0:1787508623.958036:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+645:336684:x1874324509554944:12345-192.168.201.30@tcp:101:rmdir.0 Request processed in 517us (737us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508623.958043:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93988 00000100:00100000:0.0:1787508623.965686:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508623.965772:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509555200 00000100:00100000:3.0:1787508623.965782:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509555200 00000100:00100000:3.0:1787508623.965838:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93989 00000100:00100000:3.0:1787508623.965848:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336684:x1874324509555200:12345-192.168.201.30@tcp:101:rmdir.0 00010000:00010000:3.0:1787508623.965867:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508623.965886:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34c45 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae5de expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.966083:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34c4c lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.966097:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34c4c lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.966109:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34c4c lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.966122:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34c53 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x28a:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.966129:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34c53 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28a:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.966136:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34c53 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28a:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.966203:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34c4c lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.966210:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34c4c lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.966216:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34c4c lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.966223:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34c4c lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.966230:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508623.966234:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34c4c lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.966240:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34c4c lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.966253:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28a:0x0].0x0 (ffff9090c98d9400) 00010000:00010000:3.0:1787508623.966255:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508623.966260:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34c4c lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.966266:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34c4c lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.966280:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34c53 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28a:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.966296:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34c53 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x28a:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.966300:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34c53 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x28a:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.966306:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ea00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508623.966308:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34c53 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x28a:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.966313:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34c53 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x28a:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.966324:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28a:0x0].0x820cea43 (ffff9090ccb87800) 00010000:00010000:3.0:1787508623.966326:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508623.966328:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34c53 lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x28a:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.966334:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34c53 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x28a:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.966368:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34c45 lrc: 1/0,0 mode: --/CR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5de expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.966378:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28a:0x0].0x0 (ffff9090c98d9400) 00010000:00010000:3.0:1787508623.966380:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508623.966383:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34c45 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5de expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.966392:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f200, rc 0) 00000100:00100000:3.0:1787508623.966581:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc623480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:336684:x1874324509555200:12345-192.168.201.30@tcp:101:rmdir.0 Request processed in 733us (904us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508623.966589:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93989 00000100:00100000:2.0:1787508623.983764:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508623.986324:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508623.986484:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509555328 00000100:00100000:0.0:1787508623.986495:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509555328 00000100:00100000:1.0:1787508623.986555:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509555584 00000100:00100000:1.0:1787508623.986560:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509555584 00000100:00100000:1.0:1787508623.986611:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93990 00000100:00100000:1.0:1787508623.986621:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+645:336684:x1874324509555584:12345-192.168.201.30@tcp:36:rmdir.0 00000100:00100000:0.0:1787508623.986631:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9794 00000100:00100000:0.0:1787508623.986639:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:2401:x1874324509555328:12345-192.168.201.30@tcp:103:rmdir.0 00010000:00010000:0.0:1787508623.986653:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508623.986671:0:203348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508623.986676:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f34bc7 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5a6 expref: 584 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.986683:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e800/0xb126349c40f34bff lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5c2 expref: 645 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.986694:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d5:0x0].0x0 (ffff9090ccb87900) 00010000:00010000:0.0:1787508623.986694:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d5:0x0].0x0 (ffff9090d9e7b600) 00010000:00010000:1.0:1787508623.986698:0:203348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508623.986703:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787508623.986738:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34c5a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.986746:0:203348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34c5a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508623.986755:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:2401:x1874324509555328:12345-192.168.201.30@tcp:103:rmdir.0 Request processed in 117us (3002us total) trans 0 rc 0/0 00010000:00010000:1.0:1787508623.986756:0:203348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34c5a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508623.986763:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9794 00000100:00100000:1.0:1787508623.986776:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb3a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480140416:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1787508623.986815:0:203348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508623.986841:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9000 going to sleep for 11 seconds 00000100:00100000:3.0:1787508623.987407:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480140416 00000100:00100000:3.0:1787508623.987412:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480140416 00000100:00100000:3.0:1787508623.987454:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29789 00000100:00100000:3.0:1787508623.987462:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:203348:x1874324480140416:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1787508623.987472:0:202232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508623.987486:0:202232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34c61 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f34c5a expref: -99 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.987509:0:202232:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34bab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae59f expref: 582 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.987519:0:202232:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34c61 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f34c5a expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.987651:0:202232:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34bab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae59f expref: 582 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508623.987666:0:202232:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34bab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae59f expref: 582 pid: 230618 timeout: 13695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508623.987678:0:202232:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4c87b80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:202232:1874324480140544:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508623.987769:0:202232:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cf708540 going to sleep for 11 seconds 00000100:00100000:0.0:1787508623.991440:0:202232:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4c87b80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:202232:1874324480140544:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508623.991478:0:202232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34c61 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34c5a expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.991491:0:202232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508623.991494:0:202232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508623.991499:0:202232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34c61 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34c5a expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.991509:0:202232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f200, rc 0) 00000100:00100000:0.0:1787508623.991575:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:203348:x1874324480140416:12345-0@lo:101:mdt00_003.0 Request processed in 4113us (4758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508623.991583:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29789 00000100:00100000:1.0:1787508623.991669:0:203348:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944099 gen 2 00000004:00080000:1.0:1787508623.991676:0:203348:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944098 committed transno 12884944099 00000004:00080000:1.0:1787508623.991692:0:203348:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944099 committed transno 12884944099 00000100:00100000:1.0:1787508623.991714:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb3a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480140416:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787508623.991731:0:203348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34c5a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34c61 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.991742:0:203348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34c5a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34c61 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508623.994568:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508623.994735:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509555712 00000100:00100000:3.0:1787508623.994746:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509555712 00010000:00010000:3.0:1787508623.995141:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34bab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae59f expref: 583 pid: 230618 timeout: 13695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508623.995334:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27905 00000100:00100000:0.0:1787508623.995349:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc623100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:2400:x1874324509555712:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508623.995367:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508623.995377:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34bab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae59f expref: 583 pid: 230618 timeout: 13695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.995393:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34bab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae59f expref: 583 pid: 230618 timeout: 13695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.995417:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34bab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae59f expref: 583 pid: 230618 timeout: 13695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.995434:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508623.995441:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34c61 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34c5a expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.995453:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34c61 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f34c5a expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.995462:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34c61 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f34c5a expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.995498:0:202213:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34c61 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34c5a expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508623.995513:0:202213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:202213:1874324480140672:0@lo:105: 00000100:00100000:0.0:1787508623.995569:0:202213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508623.995703:0:202213:0:(client.c:2715:ptlrpc_set_wait()) set ffff9091d80bee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787508623.995740:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480140672 00000100:00100000:1.0:1787508623.995746:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480140672 00000100:00100000:1.0:1787508623.996000:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18194 00000100:00100000:1.0:1787508623.996009:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:202213:x1874324480140672:12345-0@lo:105: 00010000:00010000:1.0:1787508623.996019:0:202210:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34c5a lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34c61 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.996139:0:202210:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34c5a lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34c61 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.996151:0:202210:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34c5a lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34c61 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.996158:0:202210:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34c5a lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f34c61 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.996164:0:202210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34c5a lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f34c61 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.996173:0:202210:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34c5a lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f34c61 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.996302:0:202210:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d247ac00) 00000100:00100000:1.0:1787508623.996359:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:202213:x1874324480140672:12345-0@lo:105: Request processed in 351us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508623.996366:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18194 00000100:00100000:2.0:1787508623.996445:0:202213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:202213:1874324480140672:0@lo:105: 00010000:00010000:2.0:1787508623.996462:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508623.996535:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc623100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:2400:x1874324509555712:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1190us (1977us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508623.996543:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27905 00010000:00010000:0.0:1787508623.996587:0:203348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34c5a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34c61 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.996597:0:203348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34c5a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34c61 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787508623.996617:0:203348:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787508623.996648:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7c00/0xb126349c40f34c68 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.996655:0:203348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7c00/0xb126349c40f34c68 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.996666:0:203348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7c00/0xb126349c40f34c68 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508623.996680:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480140800:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1787508623.996710:0:203348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508623.996770:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9091d80bee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787508623.997596:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480140800 00000100:00100000:2.0:1787508623.997604:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480140800 00000100:00100000:2.0:1787508623.997680:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29790 00000100:00100000:2.0:1787508623.997689:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:203348:x1874324480140800:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1787508623.997704:0:203182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508623.997721:0:203182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34c6f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f34c68 expref: -99 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.997743:0:203182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34c6f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f34c68 expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.997755:0:203182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34c6f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34c68 expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508623.997763:0:203182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9ec4e541 (ffff9090c98d9500) 00010000:00010000:2.0:1787508623.997766:0:203182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508623.997769:0:203182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa600, rc 0) 00000100:00100000:2.0:1787508623.997826:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:203348:x1874324480140800:12345-0@lo:101:mdt00_003.0 Request processed in 138us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508623.997832:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29790 00000100:00100000:1.0:1787508623.997890:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480140800:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787508623.997904:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7c00/0xb126349c40f34c68 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34c6f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.997914:0:203348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7c00/0xb126349c40f34c68 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34c6f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787508623.997929:0:203348:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1787508623.997983:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb39500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480140928:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787508623.998011:0:203348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508623.998367:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9480 going to sleep for 11 seconds 00000100:00100000:0.0:1787508623.998452:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480140928 00000100:00100000:0.0:1787508623.998458:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480140928 00000100:00100000:0.0:1787508623.998498:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29791 00000100:00100000:0.0:1787508623.998506:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:203348:x1874324480140928:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787508623.998571:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:203348:x1874324480140928:12345-0@lo:1000:mdt00_003.0 Request processed in 66us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508623.998577:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29791 00000100:00100000:0.0:1787508623.998606:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb39500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480140928:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787508623.998647:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6353480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480141056:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787508623.998672:0:203348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508623.998685:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d22c8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787508623.998696:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480141056 00000100:00100000:0.0:1787508623.998699:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480141056 00000100:00100000:0.0:1787508623.998713:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29792 00000100:00100000:0.0:1787508623.998718:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:203348:x1874324480141056:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787508623.998987:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:203348:x1874324480141056:12345-0@lo:1000:mdt00_003.0 Request processed in 267us (313us total) trans 0 rc 1/1 00000100:00100000:0.0:1787508623.998994:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29792 00000100:00100000:1.0:1787508623.999081:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6353480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480141056:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787508623.999132:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ae00/0xb126349c40f34c76 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.999141:0:203348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ae00/0xb126349c40f34c76 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.999150:0:203348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ae00/0xb126349c40f34c76 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508623.999162:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb39500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480141184:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1787508623.999186:0:203348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508623.999216:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9300 going to sleep for 11 seconds 00000100:00100000:0.0:1787508623.999402:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480141184 00000100:00100000:0.0:1787508623.999408:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480141184 00000100:00100000:0.0:1787508623.999439:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29793 00000100:00100000:0.0:1787508623.999446:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:203348:x1874324480141184:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787508623.999455:0:202232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508623.999470:0:202232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34c7d lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f34c76 expref: -99 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.999489:0:202232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34c7d lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f34c76 expref: 9 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.999501:0:202232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34c7d lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34c76 expref: 9 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508623.999508:0:202232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d5:0x0].0x0 (ffff9090ca4e2600) 00010000:00010000:0.0:1787508623.999511:0:202232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508623.999514:0:202232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7e00, rc 0) 00000100:00100000:0.0:1787508623.999553:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:203348:x1874324480141184:12345-0@lo:101:mdt00_003.0 Request processed in 106us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508623.999559:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29793 00000100:00100000:1.0:1787508623.999652:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb39500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480141184:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1787508623.999664:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ae00/0xb126349c40f34c76 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34c7d expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.999676:0:203348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ae00/0xb126349c40f34c76 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34c7d expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.999699:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b600/0xb126349c40f34c84 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.999710:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b600/0xb126349c40f34c84 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.999718:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b600/0xb126349c40f34c84 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.999734:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f34c8b lrc: 3/0,1 mode: --/EX res: [0x240000bd1:0x294:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.999744:0:203348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f34be3 lrc: 2/0,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5b4 expref: 644 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.999751:0:203348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f34c8b lrc: 4/0,1 mode: --/EX res: [0x240000bd1:0x294:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.999773:0:203348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f34be3 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5b4 expref: 644 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508623.999859:0:203348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f34be3 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5b4 expref: 644 pid: 205405 timeout: 13695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508623.999871:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb39500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:203348:1874324480141312:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508623.999969:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9300 going to sleep for 11 seconds 00000100:00100000:1.0:1787508624.003690:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508624.004117:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb39500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:203348:1874324480141312:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508624.004148:0:203348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f34c8b lrc: 3/0,1 mode: --/EX res: [0x240000bd1:0x294:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508624.004318:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509555840 00000100:00100000:3.0:1787508624.004326:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509555840 00010000:00010000:3.0:1787508624.004365:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f34be3 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5b4 expref: 645 pid: 205405 timeout: 13695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508624.004443:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27906 00000100:00100000:3.0:1787508624.004454:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c92cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+645:2401:x1874324509555840:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508624.004470:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508624.004477:0:229383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f34be3 lrc: 4/0,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5b4 expref: 645 pid: 205405 timeout: 13695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508624.004490:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f34be3 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x294:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5b4 expref: 645 pid: 205405 timeout: 13695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508624.004511:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fc00/0xb126349c40f34be3 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x294:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5b4 expref: 645 pid: 205405 timeout: 13695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508624.004527:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x294:0x0].0x0 (ffff9090ccb87e00) 00010000:00010000:3.0:1787508624.004532:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f34c8b lrc: 3/0,1 mode: --/EX res: [0x240000bd1:0x294:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508624.004542:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f34c8b lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x294:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508624.004550:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f34c8b lrc: 4/0,1 mode: EX/EX res: [0x240000bd1:0x294:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508624.004577:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508624.004634:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c92cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:2401:x1874324509555840:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 182us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508624.004642:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27906 00010000:00010000:0.0:1787508624.004688:0:203348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f34c8b lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x294:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.004695:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f34c8b lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x294:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.004741:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f34c92 lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x28a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.004747:0:203348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f34c92 lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x28a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.004757:0:203348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f34c92 lrc: 3/0,1 mode: --/EX res: [0x2000013a2:0x28a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508624.004777:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6353b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480141440:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1787508624.004822:0:203348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508624.004851:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9091d83eb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787508624.004868:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480141440 00000100:00100000:0.0:1787508624.004872:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480141440 00000100:00100000:0.0:1787508624.004902:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29794 00000100:00100000:0.0:1787508624.004909:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:203348:x1874324480141440:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787508624.004924:0:202231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508624.004964:0:202231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34c99 lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0x28a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f34c92 expref: -99 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.004984:0:202231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34bf1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5bb expref: 581 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.004993:0:202231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34c99 lrc: 4/0,0 mode: --/EX res: [0x2000013a2:0x28a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f34c92 expref: 10 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.005014:0:202231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34bf1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5bb expref: 581 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.005043:0:202231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34bf1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5bb expref: 581 pid: 230618 timeout: 13695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508624.005055:0:202231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6350000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480141568:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508624.005095:0:202231:0:(client.c:2715:ptlrpc_set_wait()) set ffff9091d83eba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787508624.007406:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508624.007495:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509555968 00000100:00100000:1.0:1787508624.007506:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509555968 00010000:00010000:1.0:1787508624.007542:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34bf1 lrc: 5/0,0 mode: PR/PR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5bb expref: 582 pid: 230618 timeout: 13695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508624.007580:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27907 00000100:00100000:1.0:1787508624.007590:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:2400:x1874324509555968:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508624.007603:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508624.007610:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34bf1 lrc: 5/0,0 mode: PR/PR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5bb expref: 582 pid: 230618 timeout: 13695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.007624:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34bf1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5bb expref: 582 pid: 230618 timeout: 13695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.007645:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28a:0x0].0x0 (ffff9090c98d9400) 00010000:00010000:1.0:1787508624.007652:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34c99 lrc: 3/0,0 mode: --/EX res: [0x2000013a2:0x28a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f34c92 expref: 10 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.007663:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34c99 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x28a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xb126349c40f34c92 expref: 10 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.007671:0:202212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34c99 lrc: 4/0,0 mode: EX/EX res: [0x2000013a2:0x28a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xb126349c40f34c92 expref: 10 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.007702:0:202212:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34c99 lrc: 4/0,0 mode: EX/EX res: [0x2000013a2:0x28a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34c92 expref: 10 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508624.007715:0:202212:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c92cd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:202212:1874324480141696:0@lo:105: 00000100:00100000:1.0:1787508624.007759:0:202212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508624.007802:0:202212:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d74d9300 going to sleep for 11 seconds 00000100:00100000:0.0:1787508624.008037:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480141696 00000100:00100000:0.0:1787508624.008042:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480141696 00000100:00100000:0.0:1787508624.008071:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18195 00000100:00100000:0.0:1787508624.008078:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:202212:x1874324480141696:12345-0@lo:105: 00010000:00010000:0.0:1787508624.008089:0:229363:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f34c92 lrc: 4/0,1 mode: --/EX res: [0x2000013a2:0x28a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34c99 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.008098:0:229363:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f34c92 lrc: 4/0,1 mode: --/EX res: [0x2000013a2:0x28a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34c99 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.008107:0:229363:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f34c92 lrc: 4/0,1 mode: --/EX res: [0x2000013a2:0x28a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34c99 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.008115:0:229363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f34c92 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x28a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f34c99 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.008122:0:229363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f34c92 lrc: 5/0,1 mode: EX/EX res: [0x2000013a2:0x28a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f34c99 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.008129:0:229363:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f34c92 lrc: 5/0,1 mode: EX/EX res: [0x2000013a2:0x28a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f34c99 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.008151:0:229363:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d56f6c00) 00000100:00100000:0.0:1787508624.008200:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:202212:x1874324480141696:12345-0@lo:105: Request processed in 121us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508624.008207:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18195 00010000:00010000:0.0:1787508624.008251:0:202231:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34bf1 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x28a:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5bb expref: 582 pid: 230618 timeout: 13695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508624.008267:0:202231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6350000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480141568:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508624.008298:0:202231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34c99 lrc: 4/0,0 mode: EX/EX res: [0x2000013a2:0x28a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34c92 expref: 10 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.008306:0:202231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28a:0x0].0x0 (ffff9090c98d9400) 00010000:00010000:0.0:1787508624.008309:0:202231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787508624.008312:0:202231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6400, rc 0) 00000100:00100000:0.0:1787508624.008348:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:203348:x1874324480141440:12345-0@lo:101:mdt00_003.0 Request processed in 3440us (3527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508624.008354:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29794 00000100:00100000:0.0:1787508624.008386:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6353b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480141440:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787508624.008401:0:203348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f34c92 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x28a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34c99 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508624.009127:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6353b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480141824:0@lo:403:mdt00_003.0 00000100:00100000:0.0:1787508624.009173:0:203348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508624.009198:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d42c5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787508624.009218:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480141824 00000100:00100000:0.0:1787508624.009222:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480141824 00000100:00100000:0.0:1787508624.009252:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29795 00000100:00100000:0.0:1787508624.009259:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:203348:x1874324480141824:12345-0@lo:403:mdt00_003.0 00000100:00100000:0.0:1787508624.011185:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:203348:x1874324480141824:12345-0@lo:403:mdt00_003.0 Request processed in 1917us (2003us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508624.011200:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29795 00000100:00100000:0.0:1787508624.011263:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6353b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480141824:0@lo:403:mdt00_003.0 00000100:00100000:2.0:1787508624.011367:0:202212:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c92cd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:202212:1874324480141696:0@lo:105: 00010000:00010000:2.0:1787508624.011384:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508624.011433:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+581:2400:x1874324509555968:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 3842us (4034us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508624.011441:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27907 00000004:00080000:0.0:1787508624.012924:0:203348:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x240000bd0:0x13d5:0x0] is inserted into orphan list, open count = 1 00000040:00080000:0.0:1787508624.013083:0:203348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xf:0x0].52, 928 off87688 00000040:00080000:0.0:1787508624.013141:0:203348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x5:0x0].596, 1008 off757040 00000004:00080000:0.0:1787508624.013148:0:203348:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d42c5cc0 with version 13618 00000004:00080000:2.0:1787508624.013262:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13618 rpc_version 13618 00000020:00100000:2.0:1787508624.013306:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787508624.013317:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091f9b02a00 x1874324480142080/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2504/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787508624.013340:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b02a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480142080:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508624.013402:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508624.013474:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c9af3840 going to sleep for 11 seconds 00000100:00100000:0.0:1787508624.013522:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480142080 00000100:00100000:0.0:1787508624.013530:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480142080 00000100:00100000:0.0:1787508624.013624:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29796 00000100:00100000:0.0:1787508624.013635:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:202961:x1874324480142080:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787508624.014036:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:202961:x1874324480142080:12345-0@lo:1000:osp_up0-1.0 Request processed in 401us (632us total) trans 12884944100 rc 0/0 00000100:00100000:0.0:1787508624.014044:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29796 00000100:00100000:3.0:1787508624.014259:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b02a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480142080:0@lo:1000:osp_up0-1.0 00000004:00200000:1.0:1787508624.014336:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d5:0x0]: returning size 4096 00010000:00010000:1.0:1787508624.014359:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f34c8b lrc: 3/0,1 mode: EX/EX res: [0x240000bd1:0x294:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014370:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f34c8b lrc: 2/0,0 mode: EX/EX res: [0x240000bd1:0x294:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014379:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f34c8b lrc: 3/0,0 mode: EX/EX res: [0x240000bd1:0x294:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014384:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508624.014388:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f34c8b lrc: 3/0,0 mode: EX/EX res: [0x240000bd1:0x294:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014396:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f34c8b lrc: 4/0,0 mode: EX/EX res: [0x240000bd1:0x294:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014411:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x294:0x0].0x0 (ffff9090ccb87e00) 00010000:00010000:1.0:1787508624.014414:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787508624.014419:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f34c8b lrc: 2/0,0 mode: --/EX res: [0x240000bd1:0x294:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014424:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f34c8b lrc: 0/0,0 mode: --/EX res: [0x240000bd1:0x294:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014439:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f34c92 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x28a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34c99 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014453:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f34c92 lrc: 4/0,1 mode: EX/EX res: [0x2000013a2:0x28a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f34c99 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014459:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f34c92 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x28a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f34c99 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014490:0:203348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787508624.014498:0:203348:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x28a:0x0] 00010000:00010000:1.0:1787508624.014505:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b600/0xb126349c40f34c84 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014511:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b600/0xb126349c40f34c84 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014517:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b600/0xb126349c40f34c84 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014522:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508624.014525:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b600/0xb126349c40f34c84 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014530:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b600/0xb126349c40f34c84 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014537:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d5:0x0].0x0 (ffff9090ccb87900) 00010000:00010000:1.0:1787508624.014540:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508624.014542:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b600/0xb126349c40f34c84 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014547:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b600/0xb126349c40f34c84 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014557:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ae00/0xb126349c40f34c76 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34c7d expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014563:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ae00/0xb126349c40f34c76 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f34c7d expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014570:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ae00/0xb126349c40f34c76 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f34c7d expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014583:0:203348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1787508624.014589:0:203348:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787508624.014597:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787508624.014602:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f34c92 lrc: 2/0,0 mode: EX/EX res: [0x2000013a2:0x28a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xb126349c40f34c99 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014608:0:204785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6c00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:1.0:1787508624.014612:0:204785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f34c92 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x28a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xb126349c40f34c99 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508624.014620:0:204785:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f34c92 lrc: 3/0,0 mode: EX/EX res: [0x2000013a2:0x28a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xb126349c40f34c99 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014646:0:204785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f34c92 lrc: 2/0,0 mode: --/EX res: [0x2000013a2:0x28a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f34c99 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014653:0:204785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787508624.014678:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f34c92 lrc: 1/0,0 mode: --/EX res: [0x2000013a2:0x28a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f34c99 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014689:0:204785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f6c00/0xb126349c40f34c92 lrc: 0/0,0 mode: --/EX res: [0x2000013a2:0x28a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f34c99 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014704:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787508624.014706:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ae00/0xb126349c40f34c76 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xb126349c40f34c7d expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014712:0:204785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ae00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:1.0:1787508624.014715:0:204785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ae00/0xb126349c40f34c76 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xb126349c40f34c7d expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508624.014722:0:204785:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ae00/0xb126349c40f34c76 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xb126349c40f34c7d expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014736:0:204785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ae00/0xb126349c40f34c76 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f34c7d expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014741:0:204785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787508624.014755:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ae00/0xb126349c40f34c76 lrc: 1/0,0 mode: --/EX res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f34c7d expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014762:0:204785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ae00/0xb126349c40f34c76 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f34c7d expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014773:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508624.014775:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508624.014776:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508624.014790:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480142208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508624.014829:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508624.014873:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480142208 00000100:00100000:1.0:1787508624.014879:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480142208 00000100:00100000:1.0:1787508624.014916:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9795 00000100:00100000:1.0:1787508624.014924:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+11:3619:x1874324480142208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508624.014936:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508624.014986:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34c99 lrc: 0/0,0 mode: --/EX res: [0x2000013a2:0x28a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f34c92 expref: 11 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.014999:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28a:0x0].0x0 (ffff9090c98d9400) 00010000:00010000:1.0:1787508624.015007:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508624.015038:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+10:3619:x1874324480142208:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508624.015045:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9795 00000100:00100000:1.0:1787508624.015077:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480142208:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508624.015103:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34c5a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f34c61 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.015111:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34c5a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f34c61 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.015118:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34c5a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f34c61 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.015131:0:203348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787508624.015136:0:203348:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787508624.015141:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7c00/0xb126349c40f34c68 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34c6f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.015148:0:203348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7c00/0xb126349c40f34c68 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f34c6f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508624.015209:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:336684:x1874324509555584:12345-192.168.201.30@tcp:36:rmdir.0 Request processed in 28588us (28926us total) trans 8589962035 rc 0/0 00000100:00100000:1.0:1787508624.015216:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93990 00010000:00010000:3.0:1787508624.015295:0:202215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787508624.015301:0:202215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34c5a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xb126349c40f34c61 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508624.015313:0:202215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:3.0:1787508624.015317:0:202215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34c5a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xb126349c40f34c61 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508624.015324:0:202215:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34c5a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xb126349c40f34c61 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508624.015345:0:202215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34c5a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f34c61 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508624.015351:0:202215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787508624.015358:0:202215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34c5a lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f34c61 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508624.015364:0:202215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247ac00/0xb126349c40f34c5a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f34c61 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508624.015374:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508624.015375:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508624.015377:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508624.015875:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508624.015891:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480142336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508624.015934:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508624.016137:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4c86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480142464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787508624.016168:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508624.016496:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480142336 00000100:00100000:1.0:1787508624.016503:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480142336 00000100:00100000:3.0:1787508624.016552:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480142464 00000100:00100000:3.0:1787508624.016555:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480142464 00000100:00100000:3.0:1787508624.016590:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9796 00000100:00100000:3.0:1787508624.016598:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde3c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+11:3616:x1874324480142336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787508624.016609:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508624.016628:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34c7d lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f34c76 expref: 11 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508624.016703:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d5:0x0].0x0 (ffff9090ca4e2600) 00010000:00010000:3.0:1787508624.016714:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508624.016766:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde3c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+10:3616:x1874324480142336:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508624.016773:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9796 00000100:00100000:3.0:1787508624.016828:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9797 00000100:00100000:3.0:1787508624.016835:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c92cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+9:3617:x1874324480142464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787508624.016843:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508624.016856:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34c61 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f34c5a expref: 9 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508624.016866:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508624.016869:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508624.016895:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c92cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3617:x1874324480142464:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508624.016902:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9797 00000100:00100000:0.0:1787508624.017775:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480142336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787508624.018083:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4c86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480142464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787508624.045598:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508624.045710:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509556096 00000100:00100000:1.0:1787508624.045721:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509556096 00000100:00100000:1.0:1787508624.045804:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93991 00000100:00100000:1.0:1787508624.045816:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c92cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:336686:x1874324509556096:12345-192.168.201.30@tcp:101:mkdir.0 00010000:00010000:1.0:1787508624.045837:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508624.045861:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34ca0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae5e5 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.045927:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34ca7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.045992:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.046004:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508624.046074:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508624.046079:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508624.046122:0:209004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.046150:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34ca0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5e5 expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.046169:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5e5 expref: 11 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508624.046177:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508624.046180:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508624.046184:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b600, rc 0) 00000100:00100000:1.0:1787508624.046239:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c92cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336686:x1874324509556096:12345-192.168.201.30@tcp:101:mkdir.0 Request processed in 426us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508624.046247:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93991 00000100:00080000:2.0:1787508624.046589:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508624.049680:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508624.049880:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509556224 00000100:00100000:0.0:1787508624.049891:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509556224 00000100:00100000:0.0:1787508624.050265:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93992 00000100:00100000:0.0:1787508624.050277:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336686:x1874324509556224:12345-192.168.201.30@tcp:101:mkdir.0 00010000:00010000:0.0:1787508624.050310:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508624.050333:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34cae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae5ec expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.050399:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34cb5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.050413:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34cb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.050425:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34cb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.050436:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34cbc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.050446:0:202226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34c6f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f34c68 expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.050455:0:202226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34cbc lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.050494:0:202226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34c6f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f34c68 expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508624.050510:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6353b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480142592:0@lo:104: 00000100:00100000:0.0:1787508624.050563:0:202226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508624.050600:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d42c5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787508624.050675:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480142592 00000100:00100000:2.0:1787508624.050680:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480142592 00000100:00100000:2.0:1787508624.050721:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18196 00000100:00100000:2.0:1787508624.050728:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6353480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:202226:x1874324480142592:12345-0@lo:104: 00010000:00010000:2.0:1787508624.050743:0:202209:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7c00/0xb126349c40f34c68 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f34c6f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508624.050807:0:202209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787508624.050813:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6353480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:202226:x1874324480142592:12345-0@lo:104: Request processed in 87us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508624.050820:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18196 00010000:00010000:2.0:1787508624.050845:0:202214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787508624.050850:0:202214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7c00/0xb126349c40f34c68 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f34c6f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508624.050859:0:202214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7c00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:2.0:1787508624.050865:0:202214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7c00/0xb126349c40f34c68 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f34c6f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508624.050874:0:202214:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7c00/0xb126349c40f34c68 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f34c6f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508624.050903:0:202214:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7c00/0xb126349c40f34c68 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f34c6f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508624.050910:0:202214:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787508624.050934:0:202214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7c00/0xb126349c40f34c68 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f34c6f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508624.050970:0:202214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d56f7c00/0xb126349c40f34c68 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f34c6f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508624.050990:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508624.050992:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508624.050994:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508624.051002:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787508624.051014:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480142720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508624.051227:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6353b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480142592:0@lo:104: 00010000:00010000:0.0:1787508624.051244:0:202226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34cbc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508624.051320:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508624.053197:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480142720 00000100:00100000:0.0:1787508624.053213:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480142720 00010000:00010000:0.0:1787508624.053257:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34c6f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f34c68 expref: 8 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508624.053312:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27908 00000100:00100000:0.0:1787508624.053321:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3619:x1874324480142720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508624.053337:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1787508624.063554:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944100 is committed 00010000:00010000:2.0:1787508624.063712:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34c6f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f34c68 expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508624.063734:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9ec4e541 (ffff9090c98d9500) 00010000:00010000:2.0:1787508624.063740:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34cbc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508624.063753:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34cbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508624.063761:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34cbc lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508624.063795:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508624.063892:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480142720:12345-0@lo:103:ldlm_bl.0 Request processed in 10569us (12571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508624.063904:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27908 00000100:00100000:3.0:1787508624.064087:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480142720:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508624.064298:0:202226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34cbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.064307:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34cbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.064374:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34cb5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.064382:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34cb5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.064389:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34cb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.064396:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34cb5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.064402:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508624.064407:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34cb5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.064414:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34cb5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.064426:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508624.064428:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508624.064432:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34cb5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.064438:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34cb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.064448:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34cbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.064453:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34cbc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.064458:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34cbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.064462:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508624.064464:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34cbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.064469:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34cbc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.064476:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9ec4e541 (ffff9090c98d9500) 00010000:00010000:0.0:1787508624.064478:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508624.064481:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34cbc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.064486:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34cbc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9ec4e541 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.064533:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34cae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5ec expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.064543:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508624.064545:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508624.064548:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34cae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5ec expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508624.064557:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7800, rc 0) 00000100:00100000:0.0:1787508624.064619:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:336686:x1874324509556224:12345-192.168.201.30@tcp:101:mkdir.0 Request processed in 14344us (14947us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508624.064626:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93992 00000100:00100000:2.0:1787508624.065020:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787508624.065213:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787508624.065228:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480143232:0@lo:400:kworker.0 00000100:00100000:3.0:1787508624.065289:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508624.068050:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480142976:0@lo:400:kworker.0 00000100:00100000:0.0:1787508624.068148:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508624.068197:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787508624.068204:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480143104:0@lo:400:kworker.0 00000100:00100000:0.0:1787508624.068232:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508624.068296:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480142976 00000100:00100000:0.0:1787508624.068305:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480142976 00000100:00100000:0.0:1787508624.068358:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29797 00000100:00100000:0.0:1787508624.068367:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3616:x1874324480142976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508624.068430:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:3616:x1874324480142976:12345-0@lo:400:kworker.0 Request processed in 64us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508624.068441:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29797 00000100:00100000:0.0:1787508624.068482:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480142976:0@lo:400:kworker.0 00000100:00100000:3.0:1787508624.071925:0:225834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480143232 00000100:00100000:3.0:1787508624.071968:0:225834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480143232 00000100:00100000:3.0:1787508624.072054:0:225834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480143104 00000100:00100000:3.0:1787508624.072059:0:225834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480143104 00000100:00100000:3.0:1787508624.072087:0:225834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2278 00000100:00100000:3.0:1787508624.072100:0:225834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480143232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508624.072212:0:225834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480143232:12345-0@lo:400:kworker.0 Request processed in 116us (6932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508624.072220:0:225834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2278 00000100:00100000:3.0:1787508624.072245:0:225834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2279 00000100:00100000:3.0:1787508624.072251:0:225834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480143104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508624.072296:0:225834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480143104:12345-0@lo:400:kworker.0 Request processed in 46us (4063us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508624.072302:0:225834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2279 00000100:00100000:3.0:1787508624.072345:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480143232:0@lo:400:kworker.0 00000100:00080000:0.0:1787508624.073413:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787508624.073422:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508624.073462:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480143104:0@lo:400:kworker.0 00000100:00100000:3.0:1787508624.073923:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480142848:0@lo:400:kworker.0 00000100:00100000:1.0:1787508624.074319:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480143488:0@lo:400:kworker.0 00000100:00100000:3.0:1787508624.074379:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508624.074379:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508624.074421:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480143360:0@lo:400:kworker.0 00000100:00100000:3.0:1787508624.074505:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480142848 00000100:00100000:3.0:1787508624.074511:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480142848 00000100:00100000:3.0:1787508624.074605:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:3.0:1787508624.074616:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed92f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480142848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508624.074661:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed92f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480142848:12345-0@lo:400:kworker.0 Request processed in 47us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508624.074668:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00100000:2.0:1787508624.080521:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508624.080598:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480142848:0@lo:400:kworker.0 00000100:00100000:0.0:1787508624.080678:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480143360 00000100:00100000:0.0:1787508624.080686:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480143360 00000100:00100000:0.0:1787508624.080742:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2871 00000100:00100000:0.0:1787508624.080750:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480143360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508624.080823:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480143360:12345-0@lo:400:kworker.0 Request processed in 73us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508624.080830:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2871 00000100:00100000:3.0:1787508624.081428:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480143616:0@lo:400:kworker.0 00000100:00100000:3.0:1787508624.081478:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508624.081509:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480143360:0@lo:400:kworker.0 00000100:00100000:0.0:1787508624.082194:0:225833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480143488 00000100:00100000:0.0:1787508624.082274:0:225833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480143488 00000100:00100000:0.0:1787508624.082341:0:225833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480143616 00000100:00100000:0.0:1787508624.082344:0:225833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480143616 00000100:00100000:0.0:1787508624.082368:0:225833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2280 00000100:00100000:0.0:1787508624.082377:0:225833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480143488:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787508624.082454:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787508624.082458:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787508624.083344:0:225833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480143488:12345-0@lo:400:kworker.0 Request processed in 963us (8960us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508624.083354:0:225833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2280 00000100:00100000:0.0:1787508624.083378:0:225833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2281 00000100:00100000:0.0:1787508624.083386:0:225833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480143616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508624.083436:0:225833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480143616:12345-0@lo:400:kworker.0 Request processed in 51us (1957us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508624.083442:0:225833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2281 00000100:00100000:2.0:1787508624.083518:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480143872:0@lo:400:kworker.0 00000100:00100000:2.0:1787508624.083559:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508624.083588:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787508624.083595:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874324480143744:0@lo:400:kworker.0 00000100:00100000:2.0:1787508624.083617:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508624.083636:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874324480144256:0@lo:400:kworker.0 00000100:00100000:2.0:1787508624.083655:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508624.083678:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480143872 00000100:00100000:2.0:1787508624.083683:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480143872 00000100:00100000:2.0:1787508624.083717:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480143744 00000100:00100000:2.0:1787508624.083719:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480143744 00000100:00100000:2.0:1787508624.083733:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480144256 00000100:00100000:2.0:1787508624.083735:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480144256 00000100:00100000:2.0:1787508624.083751:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2872 00000100:00100000:2.0:1787508624.083757:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480143872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508624.083787:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480143872:12345-0@lo:400:kworker.0 Request processed in 30us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508624.083793:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2872 00000100:00100000:2.0:1787508624.083806:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2873 00000100:00100000:2.0:1787508624.083811:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874324480143744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508624.083831:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874324480143744:12345-0@lo:400:kworker.0 Request processed in 20us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508624.083837:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2873 00000100:00100000:2.0:1787508624.083845:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2874 00000100:00100000:2.0:1787508624.083850:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874324480144256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508624.083869:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874324480144256:12345-0@lo:400:kworker.0 Request processed in 19us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508624.083875:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2874 00000100:00080000:2.0:1787508624.083887:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787508624.083890:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508624.083912:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874324480143744:0@lo:400:kworker.0 00000100:00100000:2.0:1787508624.083920:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874324480144256:0@lo:400:kworker.0 00000100:00100000:2.0:1787508624.083927:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480143872:0@lo:400:kworker.0 00000100:00100000:1.0:1787508624.086328:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480143488:0@lo:400:kworker.0 00000100:00100000:1.0:1787508624.086363:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480144000:0@lo:400:kworker.0 00000100:00100000:1.0:1787508624.086418:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508624.086650:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480144128:0@lo:400:kworker.0 00000100:00100000:3.0:1787508624.087187:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508624.089834:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480143616:0@lo:400:kworker.0 00000100:00100000:2.0:1787508624.091152:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480144000 00000100:00100000:2.0:1787508624.091165:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480144000 00000100:00080000:2.0:1787508624.091212:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787508624.091265:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480144128 00000100:00100000:2.0:1787508624.091270:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480144128 00000100:00100000:2.0:1787508624.091315:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2875 00000100:00100000:2.0:1787508624.091325:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480144000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508624.091437:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480144000:12345-0@lo:400:kworker.0 Request processed in 113us (5019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508624.091444:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2875 00000100:00100000:2.0:1787508624.091464:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2876 00000100:00100000:2.0:1787508624.091471:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480144128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508624.091504:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480144128:12345-0@lo:400:kworker.0 Request processed in 34us (4317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508624.091510:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2876 00000100:00080000:2.0:1787508624.091524:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787508624.091900:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480144000:0@lo:400:kworker.0 00000100:00100000:2.0:1787508624.092042:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480144128:0@lo:400:kworker.0 00000100:00100000:0.0:1787508624.107510:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508624.108189:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509556480 00000100:00100000:1.0:1787508624.108202:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509556480 00000100:00100000:1.0:1787508624.108294:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15419 00000100:00100000:1.0:1787508624.108305:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde30050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+644:336537:x1874324509556480:12345-192.168.201.30@tcp:35:bash.0 00000004:00080000:1.0:1787508624.108585:0:202230:0:(mdd_object.c:4014:mdd_close()) Object [0x240000bd0:0x13d5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787508624.108718:0:202230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xf:0x0].53, 440 off88128 00000040:00080000:1.0:1787508624.108913:0:202230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x5:0x0].597, 520 off757560 00000004:00080000:1.0:1787508624.108920:0:202230:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d74d9b40 with version 13619 00000004:00080000:3.0:1787508624.112554:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13619 rpc_version 13619 00000020:00100000:3.0:1787508624.112605:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787508624.112616:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090e4c86680 x1874324480144512/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1224/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787508624.112640:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4c86680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480144512:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508624.112703:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508624.112747:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cf7086c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787508624.112833:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480144512 00000100:00100000:2.0:1787508624.112841:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480144512 00000100:00100000:2.0:1787508624.112903:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29798 00000100:00100000:2.0:1787508624.112911:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:202961:x1874324480144512:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508624.113240:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:202961:x1874324480144512:12345-0@lo:1000:osp_up0-1.0 Request processed in 328us (535us total) trans 12884944101 rc 0/0 00000100:00100000:2.0:1787508624.113247:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29798 00000100:00100000:1.0:1787508624.117399:0:202961:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944100 gen 2 00000004:00080000:1.0:1787508624.117413:0:202961:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944100 committed transno 12884944100 00000100:00100000:1.0:1787508624.117444:0:202961:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9090e4c86680 x1874324480144512/t12884944101(12884944101) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1224/4320 e 0 to 0 dl 1787508640 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787508624.117490:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4c86680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480144512:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508624.117898:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde30050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+645:336537:x1874324509556480:12345-192.168.201.30@tcp:35:bash.0 Request processed in 9591us (10394us total) trans 8589962036 rc 0/0 00000100:00100000:2.0:1787508624.117909:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15419 00010000:00010000:1.0:1787508624.954598:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508625.520427:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508625.520478:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508625.520502:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508625.520525:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508625.520555:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508625.520580:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508625.520602:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508625.520634:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508625.520784:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509556736 00000100:00100000:1.0:1787508625.520796:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509556736 00000100:00100000:1.0:1787508625.520876:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509557248 00000100:00100000:1.0:1787508625.520881:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509557248 00000100:00100000:1.0:1787508625.520900:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509556864 00000100:00100000:1.0:1787508625.520903:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509556864 00000100:00100000:1.0:1787508625.520923:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509557376 00000100:00100000:1.0:1787508625.520926:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509557376 00000100:00100000:1.0:1787508625.520968:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2877 00000100:00100000:1.0:1787508625.520995:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+581:2400:x1874324509556736:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508625.521110:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+581:2400:x1874324509556736:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 118us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508625.521120:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2877 00000100:00100000:1.0:1787508625.521140:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2878 00000100:00100000:1.0:1787508625.521147:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2400:x1874324509557248:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508625.522355:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2879 00000100:00100000:3.0:1787508625.522376:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+645:2400:x1874324509556864:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508625.522860:0:208927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509556992 00000100:00100000:0.0:1787508625.522875:0:208927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509556992 00000100:00100000:0.0:1787508625.522936:0:208927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509557504 00000100:00100000:0.0:1787508625.522959:0:208927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509557504 00000100:00100000:0.0:1787508625.522986:0:208927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509557120 00000100:00100000:0.0:1787508625.522990:0:208927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509557120 00000100:00100000:1.0:1787508625.528644:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2400:x1874324509557248:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 7477us (8120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508625.528664:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2878 00000100:00100000:1.0:1787508625.528722:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2880 00000100:00100000:1.0:1787508625.528739:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509557376:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508625.528935:0:208927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2282 00000100:00100000:0.0:1787508625.528962:0:208927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2400:x1874324509556992:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508625.529424:0:225835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2283 00000100:00100000:2.0:1787508625.529438:0:225835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509557504:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508625.533864:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+645:2400:x1874324509556864:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 11474us (13259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508625.533885:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2879 00000100:00100000:3.0:1787508625.534013:0:226134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2284 00000100:00100000:3.0:1787508625.534033:0:226134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2400:x1874324509557120:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508625.534105:0:226134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2400:x1874324509557120:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 82us (13502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508625.534113:0:226134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2284 00000100:00100000:3.0:1787508625.534210:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509556608 00000100:00100000:3.0:1787508625.534222:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509556608 00000100:00100000:3.0:1787508625.534293:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 982 00000100:00100000:3.0:1787508625.534301:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed92e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2400:x1874324509556608:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508625.534331:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed92e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2400:x1874324509556608:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 31us (13775us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508625.534337:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 982 00000100:00080000:3.0:1787508625.534794:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787508625.534801:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787508625.534805:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787508625.534809:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787508625.540912:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509557376:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 12159us (20256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508625.540933:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2880 00000100:00100000:0.0:1787508625.545268:0:208927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2400:x1874324509556992:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 16282us (24761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508625.545290:0:208927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2282 00000100:00100000:2.0:1787508625.547108:0:225835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509557504:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 17655us (26563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508625.547126:0:225835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2283 00010000:00010000:0.0:1787508625.978240:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508626.109966:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787508626.109991:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480144640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787508626.110061:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508626.110208:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480144640 00000100:00100000:2.0:1787508626.110218:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480144640 00000100:00100000:2.0:1787508626.110295:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1633 00000100:00100000:2.0:1787508626.110305:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480144640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787508626.110333:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75854400 pending 0 free 3884056576 avail 3652534272 00000100:00100000:2.0:1787508626.110381:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480144640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508626.110389:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1633 00000100:00100000:2.0:1787508626.110434:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480144640:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787508626.110489:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508626.130355:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787508626.130377:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4c87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480144768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787508626.130451:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508626.130498:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480144768 00000100:00100000:3.0:1787508626.130505:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480144768 00000100:00100000:3.0:1787508626.130564:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1634 00000100:00100000:3.0:1787508626.130574:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480144768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787508626.130597:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75854400 pending 0 free 3884056576 avail 3652534272 00000100:00100000:3.0:1787508626.130641:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480144768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508626.130649:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1634 00000100:00080000:3.0:1787508626.130673:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508626.130704:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4c87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480144768:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787508627.003280:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508627.642244:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787508627.642266:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480144896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787508627.642328:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508627.642506:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480144896 00000100:00100000:0.0:1787508627.642514:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480144896 00000100:00100000:0.0:1787508627.642573:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1635 00000100:00100000:0.0:1787508627.642582:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480144896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787508627.642608:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16990784 pending 0 free 3910828032 avail 3679305728 00000100:00100000:0.0:1787508627.642650:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480144896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508627.642656:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1635 00000100:00100000:0.0:1787508627.642695:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480144896:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787508627.642754:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787508627.648176:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787508627.648200:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480145024:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787508627.648281:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508627.648427:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480145024 00000100:00100000:2.0:1787508627.648436:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480145024 00000100:00100000:2.0:1787508627.648506:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1636 00000100:00100000:2.0:1787508627.648516:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480145024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787508627.648539:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16990784 pending 0 free 3910828032 avail 3679305728 00000100:00100000:2.0:1787508627.648587:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480145024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508627.648594:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1636 00000100:00080000:3.0:1787508627.648688:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787508627.648722:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480145024:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787508628.028481:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787508628.159756:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589962036 is committed 00000020:00080000:1.0:1787508628.159776:0:202955:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9090d42c50c0 refcount 2 committed 0 result 0 batchid 4294998387 00000020:00080000:1.0:1787508628.159781:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cd2cae00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d42c5cc0 00000020:00080000:1.0:1787508628.159784:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a2:0x5:0x0].596 00000020:00080000:1.0:1787508628.159787:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cd2ca800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090d5458e00 00000020:00080000:1.0:1787508628.159790:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd1:0xf:0x0].52 00010000:00010000:2.0:1787508628.159805:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f34b88 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787508628.159809:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589962033 is committed 00010000:00010000:2.0:1787508628.159823:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f34b88 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508628.159830:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f34b88 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787508628.159832:0:202955:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9090d1d88000 refcount 2 committed 0 result 0 batchid 4294998386 00000020:00080000:1.0:1787508628.159839:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cd9a9d00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d1d88600 00010000:00010000:2.0:1787508628.159842:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e400 already unused, calling callback (ffffffffc19024f0) 00000020:00080000:1.0:1787508628.159843:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a2:0x5:0x0].595 00000020:00080000:1.0:1787508628.159847:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cd9a9100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090c5b9d200 00010000:00010000:2.0:1787508628.159849:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f34b88 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787508628.159851:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd1:0xf:0x0].51 00010000:00010000:2.0:1787508628.159864:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f34b88 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508628.159881:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d5:0x0].0x0 (ffff9090ccb87900) 00010000:00010000:2.0:1787508628.159885:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508628.159890:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f34b88 lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508628.159896:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f34b88 lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x13d5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508628.159916:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f34b8f lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508628.159922:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f34b8f lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508628.159927:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f34b8f lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508628.159931:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508628.159935:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f34b8f lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508628.159981:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f34b8f lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508628.159988:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x294:0x0].0x0 (ffff9090ccb87e00) 00010000:00010000:2.0:1787508628.159991:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508628.159993:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f34b8f lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508628.159999:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f34b8f lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x294:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787508628.160673:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294998387 committed batchid 4294998385 00000020:00080000:3.0:1787508628.160750:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998385 00000100:00100000:2.0:1787508628.666564:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787508628.666589:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480145152:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787508628.666661:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508628.666792:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480145152 00000100:00100000:0.0:1787508628.666802:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480145152 00000100:00100000:0.0:1787508628.666861:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29799 00000100:00100000:0.0:1787508628.666872:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3618:x1874324480145152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787508628.666910:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1441779712 avail 1295540224 00000100:00100000:0.0:1787508628.667012:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3618:x1874324480145152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508628.667019:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29799 00000100:00100000:1.0:1787508628.667248:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480145152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787508628.670481:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480145280:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787508628.670573:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508628.670708:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480145280 00000100:00100000:2.0:1787508628.670716:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480145280 00000100:00100000:2.0:1787508628.670781:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29800 00000100:00100000:2.0:1787508628.670791:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480145280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787508628.670823:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1442783232 avail 1296543744 00000100:00100000:2.0:1787508628.670877:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480145280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508628.670883:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29800 00000100:00100000:0.0:1787508628.671075:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589962033 gen 2 00000004:00080000:0.0:1787508628.671082:0:3616:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589962029 committed transno 8589962033 00000004:00080000:0.0:1787508628.671101:0:3616:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589962031 committed transno 8589962033 00000004:00080000:0.0:1787508628.671119:0:3616:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589962032 committed transno 8589962033 00000004:00080000:0.0:1787508628.671129:0:3616:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589962033 committed transno 8589962033 00000100:00100000:0.0:1787508628.671148:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480145280:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787508629.051511:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508629.181067:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da0bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480145792:0@lo:400:kworker.0 00000100:00100000:2.0:1787508629.181148:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508629.181215:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480146304:0@lo:400:kworker.0 00000100:00100000:2.0:1787508629.181238:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508629.181262:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c993d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480146816:0@lo:400:kworker.0 00000100:00100000:2.0:1787508629.181286:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508629.181308:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1787508629.181313:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480145408:0@lo:400:kworker.0 00000100:00100000:2.0:1787508629.181356:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508629.181377:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874324480145920:0@lo:400:kworker.0 00000100:00100000:2.0:1787508629.181396:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508629.181408:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6390a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874324480146432:0@lo:400:kworker.0 00000100:00100000:2.0:1787508629.181426:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508629.181437:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c993c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874324480146944:0@lo:400:kworker.0 00000100:00100000:2.0:1787508629.181454:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508629.181475:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480145536:0@lo:400:kworker.0 00000100:00100000:2.0:1787508629.181498:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508629.181515:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480146048:0@lo:400:kworker.0 00000100:00100000:2.0:1787508629.181534:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508629.181548:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6391c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874324480146560:0@lo:400:kworker.0 00000100:00100000:2.0:1787508629.181567:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508629.181583:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787508629.181588:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480145664:0@lo:400:kworker.0 00000100:00100000:2.0:1787508629.181607:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508629.181622:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480146176:0@lo:400:kworker.0 00000100:00100000:2.0:1787508629.181640:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508629.181655:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c993ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874324480146688:0@lo:400:kworker.0 00000100:00100000:2.0:1787508629.181673:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508629.181704:0:225838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480145792 00000100:00100000:2.0:1787508629.181712:0:225838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480145792 00000100:00100000:2.0:1787508629.181781:0:225838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480146304 00000100:00100000:2.0:1787508629.181785:0:225838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480146304 00000100:00100000:2.0:1787508629.181805:0:225838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480145664 00000100:00100000:2.0:1787508629.181809:0:225838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480145664 00000100:00100000:2.0:1787508629.181825:0:225838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480146176 00000100:00100000:2.0:1787508629.181828:0:225838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480146176 00000100:00100000:2.0:1787508629.181848:0:225838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2285 00000100:00100000:2.0:1787508629.181857:0:225838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480145792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508629.181907:0:225838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480145792:12345-0@lo:400:kworker.0 Request processed in 50us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508629.181914:0:225838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2285 00000100:00100000:2.0:1787508629.181932:0:225838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2286 00000100:00100000:2.0:1787508629.181958:0:225838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480146304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508629.181987:0:225838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480146304:12345-0@lo:400:kworker.0 Request processed in 49us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508629.181993:0:225838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2286 00000100:00100000:2.0:1787508629.182003:0:225838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2287 00000100:00100000:2.0:1787508629.182009:0:225838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e61d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480145664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508629.182037:0:225838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e61d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480145664:12345-0@lo:400:kworker.0 Request processed in 29us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508629.182042:0:225838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2287 00000100:00100000:2.0:1787508629.182052:0:225838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2288 00000100:00100000:2.0:1787508629.182058:0:225838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e61d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480146176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508629.182082:0:225838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e61d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480146176:12345-0@lo:400:kworker.0 Request processed in 25us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508629.182090:0:225838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2288 00000100:00100000:2.0:1787508629.182110:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480145408 00000100:00100000:2.0:1787508629.182113:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480145408 00000100:00100000:2.0:1787508629.182136:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 983 00000100:00100000:2.0:1787508629.182142:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed92c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480145408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508629.182168:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed92c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480145408:12345-0@lo:400:kworker.0 Request processed in 26us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508629.182174:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 983 00000100:00100000:2.0:1787508629.182210:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480145536 00000100:00100000:2.0:1787508629.182213:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480145536 00000100:00100000:2.0:1787508629.182235:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480146048 00000100:00100000:2.0:1787508629.182237:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480146048 00000100:00100000:2.0:1787508629.182254:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29801 00000100:00100000:2.0:1787508629.182259:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e61d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480145536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508629.182287:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e61d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480145536:12345-0@lo:400:kworker.0 Request processed in 28us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508629.182293:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29801 00000100:00100000:2.0:1787508629.182303:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29802 00000100:00100000:2.0:1787508629.182307:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e61d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3618:x1874324480146048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508629.182330:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e61d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3618:x1874324480146048:12345-0@lo:400:kworker.0 Request processed in 23us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508629.182336:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29802 00000100:00080000:2.0:1787508629.182359:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787508629.182363:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787508629.182405:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480145664:0@lo:400:kworker.0 00000100:00100000:2.0:1787508629.182415:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480146176:0@lo:400:kworker.0 00000100:00100000:2.0:1787508629.182424:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480145536:0@lo:400:kworker.0 00000100:00100000:2.0:1787508629.182432:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480146048:0@lo:400:kworker.0 00000100:00100000:2.0:1787508629.182464:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480145408:0@lo:400:kworker.0 00000100:00100000:2.0:1787508629.182474:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da0bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480145792:0@lo:400:kworker.0 00000100:00100000:2.0:1787508629.182482:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480146304:0@lo:400:kworker.0 00000100:00100000:3.0:1787508629.182602:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480146816 00000100:00100000:3.0:1787508629.182607:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480146816 00000100:00100000:3.0:1787508629.182656:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480145920 00000100:00100000:3.0:1787508629.182659:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480145920 00000100:00100000:3.0:1787508629.182671:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480146432 00000100:00100000:3.0:1787508629.182674:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480146432 00000100:00100000:3.0:1787508629.182684:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480146944 00000100:00100000:3.0:1787508629.182687:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480146944 00000100:00100000:3.0:1787508629.182699:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480146560 00000100:00100000:3.0:1787508629.182702:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480146560 00000100:00100000:3.0:1787508629.182712:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480146688 00000100:00100000:3.0:1787508629.182715:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480146688 00000100:00100000:3.0:1787508629.182729:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2881 00000100:00100000:3.0:1787508629.182735:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480146816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508629.182775:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480146816:12345-0@lo:400:kworker.0 Request processed in 41us (1488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508629.182782:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2881 00000100:00100000:3.0:1787508629.182798:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2882 00000100:00100000:3.0:1787508629.182803:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874324480145920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508629.182829:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874324480145920:12345-0@lo:400:kworker.0 Request processed in 27us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508629.182835:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2882 00000100:00100000:3.0:1787508629.182846:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2883 00000100:00100000:3.0:1787508629.182851:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e61d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874324480146432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508629.182877:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e61d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874324480146432:12345-0@lo:400:kworker.0 Request processed in 26us (1450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508629.182882:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2883 00000100:00100000:3.0:1787508629.182894:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2884 00000100:00100000:3.0:1787508629.182898:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e61d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874324480146944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508629.182923:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e61d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874324480146944:12345-0@lo:400:kworker.0 Request processed in 25us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508629.182928:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2884 00000100:00100000:3.0:1787508629.182960:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2885 00000100:00100000:3.0:1787508629.182967:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e61d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874324480146560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508629.183000:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e61d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874324480146560:12345-0@lo:400:kworker.0 Request processed in 34us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508629.183006:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2885 00000100:00100000:3.0:1787508629.183018:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2886 00000100:00100000:3.0:1787508629.183024:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e61d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874324480146688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508629.183048:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e61d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874324480146688:12345-0@lo:400:kworker.0 Request processed in 25us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508629.183054:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2886 00000100:00100000:3.0:1787508629.183104:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c993ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874324480146688:0@lo:400:kworker.0 00000100:00100000:3.0:1787508629.183114:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6391c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874324480146560:0@lo:400:kworker.0 00000100:00100000:3.0:1787508629.183140:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874324480145920:0@lo:400:kworker.0 00000100:00100000:3.0:1787508629.183150:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6390a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874324480146432:0@lo:400:kworker.0 00000100:00100000:3.0:1787508629.183159:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c993c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874324480146944:0@lo:400:kworker.0 00000100:00100000:3.0:1787508629.183167:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c993d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480146816:0@lo:400:kworker.0 00000100:00080000:2.0:1787508629.183529:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787508629.183534:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1787508629.692553:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944101 is committed 00010000:00010000:0.0:1787508630.075564:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508630.635025:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508630.635077:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508630.635112:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508630.635131:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508630.635145:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508630.635160:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508630.635185:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508630.635205:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508630.635229:0:225832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509558144 00000100:00100000:3.0:1787508630.635237:0:225832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509558144 00000100:00100000:3.0:1787508630.635285:0:225832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509558016 00000100:00100000:3.0:1787508630.635288:0:225832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509558016 00000100:00100000:3.0:1787508630.635303:0:225832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509558528 00000100:00100000:3.0:1787508630.635305:0:225832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509558528 00000100:00100000:3.0:1787508630.635323:0:225832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2289 00000100:00100000:3.0:1787508630.635332:0:225832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6390a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509558144:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508630.635394:0:225832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6390a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509558144:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 62us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508630.635401:0:225832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2289 00000100:00100000:3.0:1787508630.635419:0:225832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2290 00000100:00100000:3.0:1787508630.635424:0:225832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509558016:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508630.635442:0:225832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509558016:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 19us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508630.635448:0:225832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2290 00000100:00100000:3.0:1787508630.635456:0:225832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2291 00000100:00100000:3.0:1787508630.635462:0:225832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2403:x1874324509558528:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508630.635477:0:225832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2403:x1874324509558528:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 16us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508630.635482:0:225832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2291 00000100:00100000:3.0:1787508630.635496:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509557888 00000100:00100000:3.0:1787508630.635499:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509557888 00000100:00100000:3.0:1787508630.635520:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509558400 00000100:00100000:3.0:1787508630.635523:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509558400 00000100:00100000:3.0:1787508630.635535:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509557760 00000100:00100000:3.0:1787508630.635538:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509557760 00000100:00100000:3.0:1787508630.635551:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509558272 00000100:00100000:3.0:1787508630.635553:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509558272 00000100:00100000:3.0:1787508630.635564:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2887 00000100:00100000:3.0:1787508630.635570:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2403:x1874324509557888:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508630.635592:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2403:x1874324509557888:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508630.635598:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2887 00000100:00100000:3.0:1787508630.635608:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2888 00000100:00100000:3.0:1787508630.635613:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6391c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509558400:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508630.635629:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6391c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509558400:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 16us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508630.635635:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2888 00000100:00100000:3.0:1787508630.635643:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2889 00000100:00100000:3.0:1787508630.635648:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+581:2403:x1874324509557760:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508630.635666:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+581:2403:x1874324509557760:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 18us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508630.635671:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2889 00000100:00100000:3.0:1787508630.635679:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2890 00000100:00100000:3.0:1787508630.635684:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2403:x1874324509558272:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508630.635700:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2403:x1874324509558272:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 16us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508630.635709:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2890 00000100:00080000:3.0:1787508630.635727:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787508630.635731:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787508630.635733:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787508630.635735:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508630.638463:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509557632 00000100:00100000:0.0:1787508630.638477:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509557632 00000100:00100000:0.0:1787508630.638534:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 984 00000100:00100000:0.0:1787508630.638543:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed92c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509557632:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508630.638614:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed92c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509557632:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 73us (3599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508630.638621:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 984 00010000:00010000:0.0:1787508631.098360:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508631.226438:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787508631.226463:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e61d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480147072:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787508631.226546:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508631.226594:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480147072 00000100:00100000:2.0:1787508631.226601:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480147072 00000100:00100000:2.0:1787508631.226657:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1637 00000100:00100000:2.0:1787508631.226665:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480147072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787508631.226696:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75854400 pending 0 free 3884056576 avail 3652534272 00000100:00100000:2.0:1787508631.226736:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480147072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508631.226743:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1637 00000100:00080000:2.0:1787508631.226763:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787508631.226799:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e61d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480147072:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787508631.227140:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787508631.227150:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480147200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508631.227193:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508631.227866:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480147200 00000100:00100000:0.0:1787508631.227873:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480147200 00000100:00100000:0.0:1787508631.227930:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1638 00000100:00100000:0.0:1787508631.227938:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480147200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787508631.227975:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75854400 pending 0 free 3884056576 avail 3652534272 00000100:00100000:0.0:1787508631.228017:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480147200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508631.228023:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1638 00000100:00100000:0.0:1787508631.228069:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480147200:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787508631.228219:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:0.0:1787508631.280799:0:231950:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 93: alloc_rr should not allocate on same ost ========================================================== 14:10:30 (1787508630) 00000100:00100000:0.0:1787508631.458105:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508631.459216:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509558656 00000100:00100000:2.0:1787508631.459230:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509558656 00000100:00100000:2.0:1787508631.459299:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93993 00000100:00100000:2.0:1787508631.459313:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+581:337255:x1874324509558656:12345-192.168.201.30@tcp:101:mkdir.0 00010000:00010000:2.0:1787508631.459335:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508631.459361:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f34cc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae5f3 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508631.459426:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34cca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508631.459440:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34cca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508631.459450:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34cca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508631.459504:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508631.459508:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508631.459532:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34cca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508631.459556:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f34cc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5f3 expref: 583 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508631.459571:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34cca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5f3 expref: 582 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508631.459579:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508631.459582:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508631.459585:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abc00, rc 0) 00000100:00100000:2.0:1787508631.459648:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:337255:x1874324509558656:12345-192.168.201.30@tcp:101:mkdir.0 Request processed in 338us (1556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508631.459658:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93993 00000100:00100000:0.0:1787508631.473250:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508631.473419:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509558912 00000100:00100000:3.0:1787508631.473430:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509558912 00000100:00100000:3.0:1787508631.473527:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93994 00000100:00100000:3.0:1787508631.473538:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+582:337255:x1874324509558912:12345-192.168.201.30@tcp:36:mkdir.0 00010000:00010000:3.0:1787508631.473598:0:203348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508631.473624:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34cca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5f3 expref: 582 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.473640:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508631.473644:0:203348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508631.473719:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34cd1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.473732:0:203348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34ca7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5e5 expref: 10 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.473741:0:203348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34cd1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.473772:0:203348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5e5 expref: 10 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.473798:0:203348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34ca7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5e5 expref: 10 pid: 209004 timeout: 13702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508631.473812:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc622a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:203348:1874324480147328:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508631.473910:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c9af39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787508631.477884:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508631.477995:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509559040 00000100:00100000:0.0:1787508631.478006:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509559040 00010000:00010000:0.0:1787508631.478065:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34ca7 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5e5 expref: 11 pid: 209004 timeout: 13702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508631.478090:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc622a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:203348:1874324480147328:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508631.478104:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27909 00000100:00100000:0.0:1787508631.478116:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e61d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2401:x1874324509559040:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508631.478118:0:203348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34cd1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508631.478135:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508631.478144:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34ca7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5e5 expref: 11 pid: 209004 timeout: 13702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508631.478172:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5e5 expref: 11 pid: 209004 timeout: 13702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508631.478196:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34ca7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5e5 expref: 11 pid: 209004 timeout: 13702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508631.478219:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508631.478234:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34cd1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508631.478245:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34cd1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508631.478254:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34cd1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508631.478280:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508631.478301:0:203348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34cd1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.478309:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34cd1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.478333:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34cd8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508631.478338:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e61d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2401:x1874324509559040:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 223us (463us total) trans 0 rc 0/0 00010000:00010000:3.0:1787508631.478347:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34cd8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508631.478351:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27909 00010000:00010000:3.0:1787508631.478362:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34cd8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.478918:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34cdf lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x125d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.478929:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34cdf lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.478936:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34cdf lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508631.478996:0:203348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000faaec4c6 reply state 00000000abb14e99 transno 12884944102 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34cdf lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.479008:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34cdf lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.479015:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125d:0x0].0x0 (ffff9090ccb87100) 00010000:00010000:3.0:1787508631.479018:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508631.479021:0:203348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787508631.479027:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125d:0x0]: returning size 4096 00010000:00010000:3.0:1787508631.479035:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34cd1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.479042:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34cd1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.479048:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34cd1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.479055:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34cd1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.479061:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ea00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508631.479065:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34cd1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.479072:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34cd1 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.479081:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508631.479084:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508631.479087:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34cd1 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.479093:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34cd1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508631.479106:0:203348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000faaec4c6 reply state 00000000abb14e99 transno 12884944102 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34cd8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.479114:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34cd8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.479120:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3955b7c1 (ffff9090ccb87800) 00010000:00010000:3.0:1787508631.479123:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508631.479124:0:203348:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787508631.479189:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:337255:x1874324509558912:12345-192.168.201.30@tcp:36:mkdir.0 Request processed in 5652us (5952us total) trans 12884944102 rc 0/0 00000100:00100000:3.0:1787508631.479197:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93994 00000100:00100000:1.0:1787508631.494041:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508631.494290:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509559168 00000100:00100000:3.0:1787508631.494303:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509559168 00000100:00100000:3.0:1787508631.494365:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93995 00000100:00100000:3.0:1787508631.494377:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:337258:x1874324509559168:12345-192.168.201.30@tcp:101:mkdir.0 00010000:00010000:3.0:1787508631.494399:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508631.494421:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34ce6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae5fa expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.494486:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34ced lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.494501:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34ced lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.494514:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34ced lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508631.494556:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508631.494559:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508631.494581:0:209004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34ced lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.494605:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34ce6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5fa expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.494625:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34ced lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5fa expref: 11 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.494634:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508631.494637:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508631.494640:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f800, rc 0) 00000100:00100000:3.0:1787508631.494712:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:337258:x1874324509559168:12345-192.168.201.30@tcp:101:mkdir.0 Request processed in 337us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508631.494720:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93995 00000100:00100000:1.0:1787508631.499603:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508631.499694:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508631.502329:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509559296 00000100:00100000:3.0:1787508631.502346:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509559296 00000100:00100000:3.0:1787508631.502407:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509559552 00000100:00100000:3.0:1787508631.502410:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509559552 00000100:00100000:3.0:1787508631.502451:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93996 00000100:00100000:3.0:1787508631.502461:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2401:x1874324509559296:12345-192.168.201.30@tcp:41:mkdir.0 00000004:00000024:3.0:1787508631.502499:0:202226:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1441775616 avail 1295536128 00000100:00100000:3.0:1787508631.502582:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2401:x1874324509559296:12345-192.168.201.30@tcp:41:mkdir.0 Request processed in 122us (2988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508631.502592:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93996 00000100:00100000:3.0:1787508631.502613:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93997 00000100:00100000:3.0:1787508631.502620:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:337258:x1874324509559552:12345-192.168.201.30@tcp:36:mkdir.0 00010000:00010000:3.0:1787508631.502660:0:202226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508631.502688:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34ced lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae5fa expref: 11 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.502709:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508631.502714:0:202226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508631.502790:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34cf4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.502804:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34cf4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.502814:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34cf4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.502829:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34cfb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.502836:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34cfb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.502842:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34cfb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.503631:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34d02 lrc: 3/0,1 mode: --/PW res: [0x2000013a3:0x553:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.503647:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34d02 lrc: 3/0,1 mode: PW/PW res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.503655:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34d02 lrc: 3/0,1 mode: PW/PW res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508631.503670:0:202226:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cbaa04cf reply state 00000000cf086d95 transno 12884944103 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34d02 lrc: 3/0,1 mode: PW/PW res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.503680:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34d02 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.503686:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x553:0x0].0x0 (ffff9090ccb87600) 00010000:00010000:3.0:1787508631.503689:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508631.503692:0:202226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787508631.503697:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a3:0x553:0x0]: returning size 4096 00010000:00010000:3.0:1787508631.503707:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34cf4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.503714:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34cf4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.503721:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34cf4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.503727:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34cf4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.503734:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ea00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508631.503739:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34cf4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.503750:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34cf4 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.503760:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508631.503763:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508631.503766:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34cf4 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.503772:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34cf4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508631.503786:0:202226:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cbaa04cf reply state 00000000cf086d95 transno 12884944103 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34cfb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.503794:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34cfb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508631.503801:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x32ef6296 (ffff9090ccb87f00) 00010000:00010000:3.0:1787508631.503803:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508631.503805:0:202226:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787508631.503868:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:337258:x1874324509559552:12345-192.168.201.30@tcp:36:mkdir.0 Request processed in 1245us (4171us total) trans 12884944103 rc 0/0 00000100:00100000:3.0:1787508631.503877:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93997 00010000:00010000:3.0:1787508632.124326:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508632.762278:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480147456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787508632.762348:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508632.762434:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480147456 00000100:00100000:0.0:1787508632.762443:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480147456 00000100:00100000:0.0:1787508632.762506:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1639 00000100:00100000:0.0:1787508632.762517:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc622a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480147456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787508632.762545:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16990784 pending 0 free 3910828032 avail 3679305728 00000100:00100000:0.0:1787508632.762588:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc622a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480147456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508632.762595:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1639 00000100:00100000:0.0:1787508632.762729:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480147584:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787508632.762756:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508632.762821:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480147584 00000100:00100000:2.0:1787508632.762826:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480147584 00000100:00100000:2.0:1787508632.762859:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1640 00000100:00100000:2.0:1787508632.762866:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480147584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787508632.762886:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16990784 pending 0 free 3910828032 avail 3679305728 00000100:00100000:2.0:1787508632.762920:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480147584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508632.762927:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1640 00000100:00100000:2.0:1787508632.762992:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480147584:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787508632.763275:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787508632.763300:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480147456:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787508633.146153:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508633.787257:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787508633.787280:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480147712:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787508633.787346:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508633.787393:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480147712 00000100:00100000:0.0:1787508633.787400:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480147712 00000100:00100000:0.0:1787508633.787447:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29803 00000100:00100000:0.0:1787508633.787455:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480147712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787508633.787488:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1441771520 avail 1295532032 00000100:00100000:0.0:1787508633.787531:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480147712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508633.787539:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29803 00000100:00100000:0.0:1787508633.787579:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944101 gen 2 00000004:00080000:0.0:1787508633.787584:0:3619:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944101 committed transno 12884944101 00000020:00080000:0.0:1787508633.787590:0:3619:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9090d74d9840 refcount 2 committed 0 result 0 batchid 4294998388 00000020:00080000:0.0:1787508633.787594:0:3619:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d74d9b40 00000020:00080000:0.0:1787508633.787598:0:3619:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a2:0x5:0x0].597 00000020:00080000:0.0:1787508633.787601:0:3619:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090ce62b400 00000020:00080000:0.0:1787508633.787604:0:3619:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd1:0xf:0x0].53 00000100:00100000:0.0:1787508633.787635:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480147712:0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1787508633.787650:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294998388 committed batchid 4294998385 00000020:00080000:1.0:1787508633.788680:0:202955:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 4294998387 batchid updated 00000004:00080000:0.0:1787508633.788807:0:202975:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d42c5840 with version 13620 00000020:00080000:0.0:1787508633.788825:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294998386 cancel update log [0x2000013a2:0x5:0x0].595: rc = 0 00000020:00080000:0.0:1787508633.788874:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294998386 cancel update log [0x240000bd1:0xf:0x0].51: rc = 0 00000004:00080000:0.0:1787508633.788894:0:202975:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d42c5e40 with version 13621 00000020:00080000:0.0:1787508633.788897:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294998387 cancel update log [0x2000013a2:0x5:0x0].596: rc = 0 00000020:00080000:0.0:1787508633.788913:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294998387 cancel update log [0x240000bd1:0xf:0x0].52: rc = 0 00000020:00080000:0.0:1787508633.788919:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998387 00000004:00080000:1.0:1787508633.789009:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13620 rpc_version 13620 00000020:00100000:1.0:1787508633.789044:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787508633.789053:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d55a6d80 x1874324480147968/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787508633.789073:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a6d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480147968:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508633.789133:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508633.789165:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9091fd975300 going to sleep for 11 seconds 00000100:00100000:1.0:1787508633.789191:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480147968 00000100:00100000:1.0:1787508633.789199:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480147968 00000100:00100000:1.0:1787508633.789241:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29804 00000100:00100000:1.0:1787508633.789249:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:202961:x1874324480147968:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508633.789369:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:202961:x1874324480147968:12345-0@lo:1000:osp_up0-1.0 Request processed in 121us (236us total) trans 12884944104 rc 0/0 00000100:00100000:1.0:1787508633.789377:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29804 00000100:00100000:1.0:1787508633.789421:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a6d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480147968:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1787508633.789431:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13621 rpc_version 13621 00000020:00100000:1.0:1787508633.789442:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787508633.789446:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d55a6300 x1874324480148224/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787508633.789458:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a6300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480148224:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508633.789481:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508633.789496:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cc643e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787508633.789506:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480148224 00000100:00100000:1.0:1787508633.789510:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480148224 00000100:00100000:1.0:1787508633.789533:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29805 00000100:00100000:1.0:1787508633.789539:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:202961:x1874324480148224:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508633.789611:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:202961:x1874324480148224:12345-0@lo:1000:osp_up0-1.0 Request processed in 72us (128us total) trans 12884944105 rc 0/0 00000100:00100000:1.0:1787508633.789618:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29805 00000100:00100000:1.0:1787508633.789647:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a6300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480148224:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508633.795727:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787508633.795759:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480148352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787508633.795836:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508633.796078:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480148352 00000100:00100000:2.0:1787508633.796086:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480148352 00000100:00100000:2.0:1787508633.796148:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29806 00000100:00100000:2.0:1787508633.796158:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480148352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787508633.796196:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1442783232 avail 1296543744 00000100:00100000:2.0:1787508633.796259:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480148352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508633.796266:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29806 00000100:00100000:0.0:1787508633.796511:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480148352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787508633.927277:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508633.927654:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509559680 00000100:00100000:1.0:1787508633.927666:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509559680 00000100:00100000:1.0:1787508633.927798:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93998 00000100:00100000:1.0:1787508633.927812:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+583:337295:x1874324509559680:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508633.927842:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508633.927875:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f34d09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae601 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508633.927984:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f34d10 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508633.928002:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f34d10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508633.928014:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f34d10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508633.928202:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508633.928206:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508633.928228:0:203348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f34d10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508633.928253:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f34d09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae601 expref: 585 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508633.928271:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f34d10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae601 expref: 584 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508633.928282:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508633.928285:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508633.928289:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ac00, rc 0) 00000100:00100000:1.0:1787508633.928348:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:337295:x1874324509559680:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 540us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508633.928356:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93998 00000100:00080000:3.0:1787508633.931461:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508633.931636:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508633.931721:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509559808 00000100:00100000:3.0:1787508633.931730:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509559808 00000100:00100000:3.0:1787508633.932195:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93999 00000100:00100000:3.0:1787508633.932207:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:337295:x1874324509559808:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508633.932226:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508633.932245:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34d17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae608 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508633.932304:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34d1e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508633.932317:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34d1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508633.932327:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34d1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508633.932337:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34d25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508633.932345:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34d25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508633.932351:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34d25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508633.932444:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34d2c lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508633.932453:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34d2c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508633.932460:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34d2c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508633.932494:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125d:0x0]: returning size 4096 00000004:00200000:3.0:1787508633.932497:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508633.932514:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34d2c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508633.932527:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34d1e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508633.932534:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34d1e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508633.932540:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34d1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508633.932546:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34d1e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508633.932563:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ea00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508633.932567:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34d1e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508633.932574:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34d1e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508633.932586:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508633.932589:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508633.932594:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34d1e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508633.932606:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34d1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508633.932619:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34d25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508633.932625:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34d25 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508633.932632:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34d25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508633.932638:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508633.932640:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34d25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508633.932647:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34d25 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508633.932653:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3955b7c1 (ffff9090ccb87800) 00010000:00010000:3.0:1787508633.932655:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508633.932658:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34d25 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508633.932663:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34d25 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508633.932687:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34d17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae608 expref: 586 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508633.932705:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34d2c lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae608 expref: 585 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508633.932713:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125d:0x0].0x0 (ffff9090ccb87100) 00010000:00010000:3.0:1787508633.932715:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787508633.932718:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fa00, rc 0) 00000100:00100000:3.0:1787508633.932792:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:337295:x1874324509559808:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 572us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508633.932800:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93999 00000100:00100000:1.0:1787508633.937363:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508633.937411:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509560064 00000100:00100000:2.0:1787508633.937422:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509560064 00000100:00100000:2.0:1787508633.937591:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94000 00000100:00100000:2.0:1787508633.937605:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:337295:x1874324509560064:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508633.937634:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508633.937662:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34d33 lrc: 2/0,0 mode: --/CW res: [0x2000013a4:0x125d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae60f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508633.937782:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34d3a lrc: 3/0,1 mode: --/CW res: [0x2000013a4:0x125d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508633.937800:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34d3a lrc: 3/0,1 mode: CW/CW res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508633.937812:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34d3a lrc: 3/0,1 mode: CW/CW res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508633.937830:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34d41 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508633.937837:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34d41 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508633.937843:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34d41 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508633.938309:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34d48 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508633.938319:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34d48 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508633.938328:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34d48 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508633.938338:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125e:0x0]: returning size 0 00010000:00010000:2.0:1787508633.938365:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34d3a lrc: 4/0,1 mode: CW/CW res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508633.938377:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34d3a lrc: 4/0,1 mode: CW/CW res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508633.938384:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34d3a lrc: 3/0,0 mode: CW/CW res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508633.938391:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34d3a lrc: 4/0,0 mode: CW/CW res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508633.938397:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508633.938402:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34d3a lrc: 4/0,0 mode: CW/CW res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508633.938410:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34d3a lrc: 5/0,0 mode: CW/CW res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508633.938424:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125d:0x0].0x0 (ffff9090ccb87100) 00010000:00010000:2.0:1787508633.938428:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508633.938432:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34d3a lrc: 3/0,0 mode: --/CW res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508633.938439:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34d3a lrc: 0/0,0 mode: --/CW res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508633.938454:0:205405:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000421087d2 reply state 000000005aabbe1f transno 12884944106 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34d41 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508633.938596:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34d41 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508633.938606:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125d:0x0].0x2d9800ce (ffff9090cf093100) 00010000:00010000:2.0:1787508633.938609:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787508633.938613:0:205405:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787508633.938649:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34d33 lrc: 0/0,0 mode: --/CW res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae60f expref: 588 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508633.938666:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34d48 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae60f expref: 587 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508633.938674:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125e:0x0].0x0 (ffff9090d3c50f00) 00010000:00010000:2.0:1787508633.938677:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787508633.938679:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aae00, rc 0) 00000100:00100000:2.0:1787508633.941324:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+588:337295:x1874324509560064:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 3711us (3957us total) trans 12884944106 rc 0/0 00000100:00100000:2.0:1787508633.941337:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94000 00000100:00100000:2.0:1787508633.944502:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508633.944864:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509560320 00000100:00100000:0.0:1787508633.944875:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509560320 00000100:00100000:0.0:1787508633.945017:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94001 00000100:00100000:0.0:1787508633.945028:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+588:337295:x1874324509560320:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508633.945050:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508633.945070:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34d56 lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae616 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508633.945222:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34d5d lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x125e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508633.945239:0:202227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34d48 lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae60f expref: 589 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508633.945249:0:202227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34d5d lrc: 4/0,1 mode: --/EX res: [0x2000013a4:0x125e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508633.945287:0:202227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34d48 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae60f expref: 589 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508633.945303:0:202227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34d48 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae60f expref: 589 pid: 205405 timeout: 13704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508633.945317:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69db480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:202227:1874324480148480:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508633.948905:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d42c50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508633.953402:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69db480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:202227:1874324480148480:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508633.953436:0:202227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34d5d lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x125e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508633.953897:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508633.953993:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509560448 00000100:00100000:1.0:1787508633.954002:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509560448 00010000:00010000:1.0:1787508633.954041:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34d48 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae60f expref: 590 pid: 205405 timeout: 13704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508633.954078:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27910 00000100:00100000:1.0:1787508633.954090:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+590:2401:x1874324509560448:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508633.954106:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508633.954124:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34d48 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae60f expref: 590 pid: 205405 timeout: 13704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508633.954138:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34d48 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae60f expref: 590 pid: 205405 timeout: 13704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508633.954159:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34d48 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae60f expref: 590 pid: 205405 timeout: 13704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508633.954178:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125e:0x0].0x0 (ffff9090d3c50f00) 00010000:00010000:1.0:1787508633.954183:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34d5d lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x125e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508633.954193:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34d5d lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x125e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508633.954200:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34d5d lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x125e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508633.954231:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508633.954254:0:202227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34d5d lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x125e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508633.954264:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34d5d lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x125e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508633.954284:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125e:0x0]: returning size 0 00000100:00100000:1.0:1787508633.954288:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+589:2401:x1874324509560448:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 199us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508633.954298:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27910 00000001:00020000:2.0:1787508633.954398:0:202227:0:(lod_qos.c:737:lod_check_and_reserve_ost()) cfs_fail_timeout id 163 sleeping for 2000ms 00010000:00010000:0.0:1787508634.172551:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508634.298573:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480148992:0@lo:400:kworker.0 00000100:00100000:0.0:1787508634.298597:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480148864:0@lo:400:kworker.0 00000100:00100000:1.0:1787508634.298652:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508634.298680:0:226134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480148992 00000100:00100000:0.0:1787508634.298688:0:226134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480148992 00000100:00100000:1.0:1787508634.298692:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480149504:0@lo:400:kworker.0 00000100:00100000:1.0:1787508634.298713:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508634.298727:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874324480150016:0@lo:400:kworker.0 00000100:00100000:0.0:1787508634.298740:0:226134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480149504 00000100:00100000:0.0:1787508634.298743:0:226134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480149504 00000100:00100000:1.0:1787508634.298747:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508634.298768:0:226134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2292 00000100:00100000:0.0:1787508634.298776:0:226134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480148992:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787508634.298786:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508634.298796:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508634.298814:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480149376:0@lo:400:kworker.0 00000100:00100000:0.0:1787508634.298834:0:226134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480148992:12345-0@lo:400:kworker.0 Request processed in 57us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508634.298838:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508634.298842:0:226134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2292 00000100:00100000:1.0:1787508634.298849:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874324480149888:0@lo:400:kworker.0 00000100:00100000:0.0:1787508634.298857:0:226134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480148864 00000100:00100000:0.0:1787508634.298860:0:226134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480148864 00000100:00100000:1.0:1787508634.298866:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508634.298882:0:226134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480149376 00000100:00100000:0.0:1787508634.298885:0:226134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480149376 00000100:00100000:1.0:1787508634.298892:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480150016 00000100:00100000:1.0:1787508634.298895:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480150016 00000100:00100000:1.0:1787508634.298918:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480149888 00000100:00100000:1.0:1787508634.298921:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480149888 00000100:00100000:1.0:1787508634.298960:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2891 00000100:00100000:1.0:1787508634.298967:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874324480150016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508634.299001:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874324480150016:12345-0@lo:400:kworker.0 Request processed in 35us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508634.299007:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2891 00000100:00100000:1.0:1787508634.299021:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2892 00000100:00100000:1.0:1787508634.299027:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874324480149888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508634.299058:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874324480149888:12345-0@lo:400:kworker.0 Request processed in 31us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508634.299064:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2892 00000100:00100000:0.0:1787508634.299068:0:226134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2293 00000100:00100000:0.0:1787508634.299074:0:226134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480149504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508634.299116:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874324480149888:0@lo:400:kworker.0 00000100:00100000:0.0:1787508634.299121:0:226134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480149504:12345-0@lo:400:kworker.0 Request processed in 45us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508634.299122:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480148608:0@lo:400:kworker.0 00000100:00100000:0.0:1787508634.299131:0:226134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2293 00000100:00100000:0.0:1787508634.299147:0:226134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2294 00000100:00100000:0.0:1787508634.299154:0:226134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480148864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508634.299155:0:208927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2295 00000100:00100000:1.0:1787508634.299163:0:208927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f283a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480149376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508634.299170:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508634.299316:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480148736:0@lo:400:kworker.0 00000100:00100000:1.0:1787508634.299359:0:208927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f283a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480149376:12345-0@lo:400:kworker.0 Request processed in 198us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508634.299365:0:208927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2295 00000100:00080000:1.0:1787508634.299394:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787508634.299397:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787508634.299399:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508634.299414:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480148992:0@lo:400:kworker.0 00000100:00100000:1.0:1787508634.299422:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480149504:0@lo:400:kworker.0 00000100:00100000:1.0:1787508634.299431:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874324480150016:0@lo:400:kworker.0 00000100:00100000:1.0:1787508634.299539:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480148864:0@lo:400:kworker.0 00000100:00100000:1.0:1787508634.299547:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480149376:0@lo:400:kworker.0 00000100:00100000:1.0:1787508634.299750:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480148608 00000100:00100000:1.0:1787508634.299754:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480148608 00000100:00100000:1.0:1787508634.299780:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 985 00000100:00100000:1.0:1787508634.299785:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed92fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480148608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508634.299816:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed92fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480148608:12345-0@lo:400:kworker.0 Request processed in 31us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508634.299822:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 985 00000100:00100000:3.0:1787508634.307855:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480148608:0@lo:400:kworker.0 00000100:00100000:3.0:1787508634.307874:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874324480149120:0@lo:400:kworker.0 00000100:00100000:3.0:1787508634.307959:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508634.307997:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874324480149632:0@lo:400:kworker.0 00000100:00100000:3.0:1787508634.308027:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508634.308053:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c818ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874324480150144:0@lo:400:kworker.0 00000100:00100000:3.0:1787508634.308083:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508634.308169:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480149120 00000100:00100000:3.0:1787508634.308176:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480149120 00000100:00100000:3.0:1787508634.308866:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480149632 00000100:00100000:3.0:1787508634.308872:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480149632 00000100:00100000:3.0:1787508634.308904:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480150144 00000100:00100000:3.0:1787508634.308908:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480150144 00000100:00100000:3.0:1787508634.308975:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2893 00000100:00100000:3.0:1787508634.308988:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874324480149120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508634.309069:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874324480149120:12345-0@lo:400:kworker.0 Request processed in 83us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508634.309079:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2893 00000100:00100000:3.0:1787508634.309117:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2894 00000100:00100000:3.0:1787508634.309126:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874324480149632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508634.309165:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874324480149632:12345-0@lo:400:kworker.0 Request processed in 41us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508634.309174:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2894 00000100:00100000:3.0:1787508634.309197:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2895 00000100:00100000:3.0:1787508634.309313:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874324480150144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508634.309357:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874324480150144:12345-0@lo:400:kworker.0 Request processed in 154us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508634.309367:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2895 00000100:00080000:3.0:1787508634.309405:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787508634.309451:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874324480149120:0@lo:400:kworker.0 00000100:00100000:3.0:1787508634.309470:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874324480149632:0@lo:400:kworker.0 00000100:00100000:3.0:1787508634.309487:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c818ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874324480150144:0@lo:400:kworker.0 00000100:00100000:0.0:1787508634.311653:0:226134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480148864:12345-0@lo:400:kworker.0 Request processed in 12488us (12843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508634.311670:0:226134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2294 00000100:00100000:2.0:1787508634.314054:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508634.314128:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480149248:0@lo:400:kworker.0 00000100:00100000:1.0:1787508634.314142:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480148736 00000100:00100000:1.0:1787508634.314153:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480148736 00000100:00100000:2.0:1787508634.314172:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508634.314206:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874324480149760:0@lo:400:kworker.0 00000100:00100000:2.0:1787508634.314231:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508634.314335:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480149760 00000100:00100000:3.0:1787508634.314340:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480149760 00000100:00100000:3.0:1787508634.314401:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2896 00000100:00100000:3.0:1787508634.314411:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874324480149760:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787508634.314417:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787508634.314471:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874324480149760:12345-0@lo:400:kworker.0 Request processed in 61us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508634.314478:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2896 00000100:00100000:2.0:1787508634.314505:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874324480149760:0@lo:400:kworker.0 00000100:00100000:1.0:1787508634.314628:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480149248 00000100:00100000:1.0:1787508634.314632:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480149248 00000100:00100000:1.0:1787508634.314658:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29807 00000100:00100000:1.0:1787508634.314665:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480148736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508634.314691:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29808 00000100:00100000:2.0:1787508634.314700:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3617:x1874324480149248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508634.314706:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480148736:12345-0@lo:400:kworker.0 Request processed in 43us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508634.314712:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29807 00000100:00100000:2.0:1787508634.314734:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3617:x1874324480149248:12345-0@lo:400:kworker.0 Request processed in 36us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508634.314740:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29808 00000100:00100000:2.0:1787508634.314769:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480148736:0@lo:400:kworker.0 00000100:00100000:2.0:1787508634.314779:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480149248:0@lo:400:kworker.0 00000100:00100000:2.0:1787508634.963289:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508634.964509:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509560576 00000100:00100000:3.0:1787508634.964522:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509560576 00000100:00100000:3.0:1787508634.964662:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94002 00000100:00100000:3.0:1787508634.964674:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:337297:x1874324509560576:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508634.964714:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508634.964737:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34d64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae61d expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.964811:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34d6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.964827:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34d6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.964840:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34d6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508634.964887:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508634.964891:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508634.964912:0:209004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34d6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.964935:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34d64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae61d expref: 14 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.965003:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34d6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae61d expref: 13 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.965018:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508634.965021:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508634.965025:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f800, rc 0) 00000100:00100000:3.0:1787508634.965102:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:337297:x1874324509560576:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 421us (1826us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508634.965111:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94002 00000100:00080000:2.0:1787508634.966483:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787508634.984720:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508634.984823:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509560704 00000100:00100000:3.0:1787508634.984834:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509560704 00000100:00100000:3.0:1787508634.984918:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94003 00000100:00100000:3.0:1787508634.984930:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:337297:x1874324509560704:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508634.985342:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508634.985371:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34d72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae624 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.985440:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34d79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.985454:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34d79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.985465:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34d79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.985475:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34d80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.985481:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34d80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.985488:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34d80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.985585:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34d87 lrc: 3/1,0 mode: --/PR res: [0x2000013a3:0x553:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.985594:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34d87 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.985601:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34d87 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508634.985645:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a3:0x553:0x0]: returning size 4096 00000004:00200000:3.0:1787508634.985649:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508634.985671:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34d87 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.985686:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34d79 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.985692:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34d79 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.985698:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34d79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.985704:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34d79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.985709:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ea00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508634.985714:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34d79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.985721:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34d79 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.985732:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508634.985735:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508634.985739:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34d79 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.985745:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34d79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.985760:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34d80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.985766:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34d80 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.985772:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34d80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.985777:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508634.985779:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34d80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.985786:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34d80 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.985792:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x32ef6296 (ffff9090ccb87f00) 00010000:00010000:3.0:1787508634.985795:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508634.985801:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34d80 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.985806:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34d80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.986360:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34d72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae624 expref: 15 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.986379:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34d87 lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae624 expref: 14 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508634.986387:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x553:0x0].0x0 (ffff9090ccb87600) 00010000:00010000:3.0:1787508634.986390:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787508634.986392:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fe00, rc 0) 00000100:00100000:3.0:1787508634.986474:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:337297:x1874324509560704:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1545us (1763us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508634.986483:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94003 00000100:00100000:0.0:1787508634.996271:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508634.996442:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509560960 00000100:00100000:2.0:1787508634.996455:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509560960 00000100:00100000:2.0:1787508634.996521:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94004 00000100:00100000:2.0:1787508634.996533:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:337297:x1874324509560960:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508634.996556:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508634.996579:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34d8e lrc: 2/0,0 mode: --/CW res: [0x2000013a3:0x553:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae62b expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508634.996713:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34d95 lrc: 3/0,1 mode: --/CW res: [0x2000013a3:0x553:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508634.996729:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34d95 lrc: 3/0,1 mode: CW/CW res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508634.996744:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34d95 lrc: 3/0,1 mode: CW/CW res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508634.996762:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34d9c lrc: 3/0,1 mode: --/PW res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508634.996769:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34d9c lrc: 3/0,1 mode: PW/PW res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508634.996774:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34d9c lrc: 3/0,1 mode: PW/PW res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508634.997251:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34da3 lrc: 3/1,0 mode: --/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508634.997276:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34da3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508634.997285:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34da3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508634.997295:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a3:0x554:0x0]: returning size 0 00010000:00010000:2.0:1787508634.997331:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34d95 lrc: 4/0,1 mode: CW/CW res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508634.997338:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34d95 lrc: 4/0,1 mode: CW/CW res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508634.997345:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34d95 lrc: 3/0,0 mode: CW/CW res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508634.997352:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34d95 lrc: 4/0,0 mode: CW/CW res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508634.997359:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508634.997364:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34d95 lrc: 4/0,0 mode: CW/CW res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508634.997372:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34d95 lrc: 5/0,0 mode: CW/CW res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508634.997385:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x553:0x0].0x0 (ffff9090ccb87600) 00010000:00010000:2.0:1787508634.997389:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508634.997393:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34d95 lrc: 3/0,0 mode: --/CW res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508634.997399:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f34d95 lrc: 0/0,0 mode: --/CW res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508634.997414:0:202228:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da7b99fd reply state 00000000ab61e0db transno 12884944107 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34d9c lrc: 3/0,1 mode: PW/PW res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508634.997424:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34d9c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508634.997431:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x553:0x0].0xfbe05a87 (ffff9090c98d9e00) 00010000:00010000:2.0:1787508634.997433:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787508634.997435:0:202228:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787508634.997465:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34d8e lrc: 0/0,0 mode: --/CW res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae62b expref: 17 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508634.997481:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34da3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae62b expref: 16 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508634.997494:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x554:0x0].0x0 (ffff9090c98d9300) 00010000:00010000:2.0:1787508634.997497:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787508634.997500:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa600, rc 0) 00000100:00100000:2.0:1787508634.997579:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:337297:x1874324509560960:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1047us (1320us total) trans 12884944107 rc 0/0 00000100:00100000:2.0:1787508634.997588:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94004 00000100:00100000:1.0:1787508635.005549:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508635.005802:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509561216 00000100:00100000:3.0:1787508635.005814:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509561216 00000100:00100000:3.0:1787508635.005888:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94005 00000100:00100000:3.0:1787508635.005901:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:337297:x1874324509561216:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508635.005928:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508635.005996:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34db1 lrc: 2/0,0 mode: --/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae632 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508635.006137:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34db8 lrc: 3/0,1 mode: --/EX res: [0x2000013a3:0x554:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508635.006152:0:202226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34da3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae62b expref: 18 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508635.006161:0:202226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34db8 lrc: 4/0,1 mode: --/EX res: [0x2000013a3:0x554:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508635.006197:0:202226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34da3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae62b expref: 18 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508635.006212:0:202226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34da3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae62b expref: 18 pid: 202228 timeout: 13706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508635.006224:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b00e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480150272:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508635.006308:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9480 going to sleep for 11 seconds 00000100:00100000:3.0:1787508635.022659:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b00e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480150272:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508635.022696:0:202226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34db8 lrc: 3/0,1 mode: --/EX res: [0x2000013a3:0x554:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508635.032201:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508635.034230:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509561344 00000100:00100000:2.0:1787508635.034244:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509561344 00010000:00010000:2.0:1787508635.034318:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34da3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae62b expref: 19 pid: 202228 timeout: 13706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508635.034362:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27911 00000100:00100000:2.0:1787508635.034371:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+19:2400:x1874324509561344:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508635.034386:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508635.034393:0:225839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34da3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae62b expref: 19 pid: 202228 timeout: 13706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508635.034409:0:225839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34da3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae62b expref: 19 pid: 202228 timeout: 13706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508635.034431:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f34da3 lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae62b expref: 19 pid: 202228 timeout: 13706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508635.038709:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x554:0x0].0x0 (ffff9090c98d9300) 00010000:00010000:2.0:1787508635.038724:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34db8 lrc: 3/0,1 mode: --/EX res: [0x2000013a3:0x554:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508635.038740:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34db8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a3:0x554:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508635.038749:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34db8 lrc: 4/0,1 mode: EX/EX res: [0x2000013a3:0x554:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508635.038796:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508635.038889:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+18:2400:x1874324509561344:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 4512us (6693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508635.038899:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27911 00010000:00010000:1.0:1787508635.042075:0:202226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34db8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a3:0x554:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508635.042104:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34db8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a3:0x554:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508635.042131:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a3:0x554:0x0]: returning size 0 00000001:00020000:1.0:1787508635.042256:0:202226:0:(lod_qos.c:737:lod_check_and_reserve_ost()) cfs_fail_timeout id 163 sleeping for 2000ms 00010000:00010000:0.0:1787508635.194273:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508635.754880:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508635.754974:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508635.755021:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508635.755069:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508635.755246:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509561600 00000100:00100000:3.0:1787508635.755260:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509561600 00000100:00100000:3.0:1787508635.755339:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509562112 00000100:00100000:3.0:1787508635.755343:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509562112 00000100:00100000:3.0:1787508635.755370:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2897 00000100:00100000:3.0:1787508635.755386:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+589:2402:x1874324509561600:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508635.755497:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+589:2402:x1874324509561600:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 115us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508635.755506:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2897 00000100:00100000:3.0:1787508635.755534:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2898 00000100:00100000:3.0:1787508635.755540:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509562112:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508635.755570:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509562112:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 31us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508635.755577:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2898 00000100:00080000:3.0:1787508635.755606:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787508635.755611:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787508635.756212:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508635.756258:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508635.756298:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508635.756367:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509561728 00000100:00100000:3.0:1787508635.756376:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509561728 00000100:00100000:3.0:1787508635.756430:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2899 00000100:00100000:3.0:1787508635.756439:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2402:x1874324509561728:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508635.756486:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2402:x1874324509561728:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 48us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508635.756493:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2899 00000100:00100000:2.0:1787508635.756585:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509561856 00000100:00100000:2.0:1787508635.756590:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509561856 00000100:00100000:2.0:1787508635.756637:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509561984 00000100:00100000:2.0:1787508635.756640:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509561984 00000100:00100000:2.0:1787508635.756660:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509562240 00000100:00100000:2.0:1787508635.756662:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509562240 00000100:00100000:2.0:1787508635.756682:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2296 00000100:00100000:2.0:1787508635.756689:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509561856:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508635.756720:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509561856:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 32us (1782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508635.756727:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2296 00000100:00100000:2.0:1787508635.756739:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2297 00000100:00100000:2.0:1787508635.756744:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509561984:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508635.756765:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509561984:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508635.756771:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2297 00000100:00100000:2.0:1787508635.756781:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2298 00000100:00100000:2.0:1787508635.756788:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509562240:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508635.756924:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509561472 00000100:00100000:3.0:1787508635.756929:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509561472 00000100:00100000:3.0:1787508635.757109:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 986 00000100:00100000:3.0:1787508635.757119:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed92e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509561472:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508635.757147:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed92e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509561472:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 30us (2078us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508635.757153:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 986 00000100:00100000:2.0:1787508635.757328:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509562240:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 540us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508635.757335:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2298 00000100:00080000:1.0:1787508635.757676:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787508635.757682:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787508635.757685:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00020000:2.0:1787508636.052308:0:202227:0:(lod_qos.c:737:lod_check_and_reserve_ost()) cfs_fail_timeout id 163 awake 00000001:00020000:2.0:1787508636.070930:0:202227:0:(lod_qos.c:737:lod_check_and_reserve_ost()) cfs_fail_timeout id 163 sleeping for 2000ms 00010000:00010000:3.0:1787508636.218476:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508636.346489:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480150400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787508636.346616:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508636.346895:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480150528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787508636.346934:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508636.347106:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480150400 00000100:00100000:0.0:1787508636.347118:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480150400 00000100:00100000:0.0:1787508636.347219:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480150528 00000100:00100000:0.0:1787508636.347223:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480150528 00000100:00100000:0.0:1787508636.347245:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1641 00000100:00100000:0.0:1787508636.347256:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480150400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787508636.347298:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75854400 pending 0 free 3884056576 avail 3652534272 00000100:00100000:0.0:1787508636.347363:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480150400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508636.347372:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1641 00000100:00100000:0.0:1787508636.347393:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1642 00000100:00100000:0.0:1787508636.347400:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480150528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787508636.347410:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75854400 pending 0 free 3884056576 avail 3652534272 00000100:00100000:0.0:1787508636.347438:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480150528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508636.347444:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1642 00000100:00100000:3.0:1787508636.347730:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480150400:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787508636.347802:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508636.347833:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480150528:0@lo:13:osp-pre-1-1.0 00000001:00080000:3.0:1787508636.867078:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944107 is committed 00000001:00080000:3.0:1787508636.867097:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944106 is committed 00000001:00080000:3.0:1787508636.867102:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944105 is committed 00010000:00010000:2.0:1787508636.867177:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34cd8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508636.867295:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34cd8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508636.867303:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34cd8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508636.867309:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508636.867314:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34cd8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508636.867322:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34cd8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508636.867339:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3955b7c1 (ffff9090ccb87800) 00010000:00010000:2.0:1787508636.867342:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508636.867348:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34cd8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508636.867354:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34cd8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3955b7c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508636.867386:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34cdf lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508636.867393:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34cdf lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508636.867399:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34cdf lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508636.867404:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508636.867407:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34cdf lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508636.867413:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34cdf lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508636.867425:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125d:0x0].0x0 (ffff9090ccb87100) 00010000:00010000:2.0:1787508636.867429:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508636.867433:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34cdf lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508636.867439:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34cdf lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508636.867446:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34cfb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508636.867458:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34d41 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508636.867467:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34cfb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508636.867471:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34d41 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508636.867482:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34cfb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508636.867486:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34d41 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508636.867495:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508636.867501:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508636.867505:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34cfb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508636.867509:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34d41 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508636.867527:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34cfb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508636.867531:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34d41 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508636.867572:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125d:0x0].0x2d9800ce (ffff9090cf093100) 00010000:00010000:2.0:1787508636.867577:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508636.867581:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34d41 lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508636.867584:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x32ef6296 (ffff9090ccb87f00) 00010000:00010000:2.0:1787508636.867589:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34d41 lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508636.867591:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508636.867599:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34cfb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508636.867609:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f34cfb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x32ef6296 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508636.867636:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34d02 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508636.867642:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34d02 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508636.867648:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34d02 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508636.867654:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508636.867658:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34d02 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508636.867676:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34d02 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508636.867685:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x553:0x0].0x0 (ffff9090ccb87600) 00010000:00010000:0.0:1787508636.867688:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508636.867690:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34d02 lrc: 2/0,0 mode: --/TXN res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508636.867697:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f34d02 lrc: 0/0,0 mode: --/TXN res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508636.867714:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34d9c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508636.867720:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34d9c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508636.867725:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34d9c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508636.867730:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508636.867733:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34d9c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508636.867738:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34d9c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508636.867745:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x553:0x0].0xfbe05a87 (ffff9090c98d9e00) 00010000:00010000:0.0:1787508636.867747:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508636.867750:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34d9c lrc: 2/0,0 mode: --/TXN res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508636.867755:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f34d9c lrc: 0/0,0 mode: --/TXN res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00020000:1.0:1787508637.124413:0:202226:0:(lod_qos.c:737:lod_check_and_reserve_ost()) cfs_fail_timeout id 163 awake 00000001:00020000:1.0:1787508637.124500:0:202226:0:(lod_qos.c:737:lod_check_and_reserve_ost()) cfs_fail_timeout id 163 sleeping for 2000ms 00010000:00010000:0.0:1787508637.246767:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508637.882265:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480150656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787508637.882343:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508637.882583:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480150784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787508637.882619:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508637.882826:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480150656 00000100:00100000:1.0:1787508637.882834:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480150656 00000100:00100000:1.0:1787508637.882892:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480150784 00000100:00100000:1.0:1787508637.882896:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480150784 00000100:00100000:1.0:1787508637.882915:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1643 00000100:00100000:1.0:1787508637.882923:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480150656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787508637.882973:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16990784 pending 0 free 3910828032 avail 3679305728 00000100:00100000:1.0:1787508637.883020:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480150656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508637.883027:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1643 00000100:00100000:1.0:1787508637.883054:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1644 00000100:00100000:1.0:1787508637.883061:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c968ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480150784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787508637.883071:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16990784 pending 0 free 3910828032 avail 3679305728 00000100:00100000:1.0:1787508637.883097:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c968ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480150784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508637.883102:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1644 00000100:00100000:1.0:1787508637.883142:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480150656:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787508637.883210:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787508637.883236:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480150784:0@lo:13:osp-pre-0-1.0 00000001:00020000:2.0:1787508638.154055:0:202227:0:(lod_qos.c:737:lod_check_and_reserve_ost()) cfs_fail_timeout id 163 awake 00000004:00080000:2.0:1787508638.173370:0:202227:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x152a:0x0], index 0: 0 00000004:00080000:2.0:1787508638.173381:0:202227:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1587:0x0], index 1: 0 00010000:00010000:2.0:1787508638.173507:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34d5d lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x125e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508638.173530:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34d5d lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x125e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508638.173539:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34d5d lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x125e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508638.173545:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508638.173550:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34d5d lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x125e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508638.173559:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34d5d lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x125e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508638.173580:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125e:0x0].0x0 (ffff9090d3c50f00) 00010000:00010000:2.0:1787508638.173584:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787508638.173589:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34d5d lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x125e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508638.173594:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34d5d lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x125e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508638.173664:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34d56 lrc: 1/0,0 mode: --/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae616 expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508638.173675:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125d:0x0].0x0 (ffff9090ccb87100) 00010000:00010000:2.0:1787508638.173678:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508638.173682:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34d56 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae616 expref: 585 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508638.173692:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7c00, rc 0) 00000100:00100000:2.0:1787508638.173773:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:337295:x1874324509560320:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 4228745us (4229280us total) trans 12884944108 rc 301/301 00000100:00100000:2.0:1787508638.173781:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94001 00000100:00100000:2.0:1787508638.177601:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508638.177799:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509562496 00000100:00100000:3.0:1787508638.177814:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509562496 00000100:00080000:1.0:1787508638.177865:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787508638.177881:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15420 00000100:00100000:3.0:1787508638.177893:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:337295:x1874324509562496:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1787508638.178248:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:337295:x1874324509562496:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 357us (652us total) trans 12884944109 rc 0/0 00000100:00100000:3.0:1787508638.178257:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15420 00000100:00100000:3.0:1787508638.181093:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508638.181201:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509562624 00000100:00100000:0.0:1787508638.181212:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509562624 00000100:00100000:0.0:1787508638.181307:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94006 00000100:00100000:0.0:1787508638.181319:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c968a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:337295:x1874324509562624:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508638.181357:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508638.181384:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f34dc6 lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae639 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508638.181444:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f34dc6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae639 expref: 586 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508638.181458:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f34dc6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae639 expref: 586 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508638.181476:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125e:0x0].0x0 (ffff9090c6913600) 00010000:00010000:0.0:1787508638.181480:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787508638.181484:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6c00, rc 0) 00000100:00100000:0.0:1787508638.181560:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c968a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:337295:x1874324509562624:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 243us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508638.181567:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94006 00000100:00100000:1.0:1787508638.188187:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508638.188476:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509562880 00000100:00100000:2.0:1787508638.188486:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509562880 00000100:00100000:2.0:1787508638.188545:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15421 00000100:00100000:2.0:1787508638.188555:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:337295:x1874324509562880:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1787508638.188979:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+587:337295:x1874324509562880:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 424us (803us total) trans 12884944110 rc 0/0 00000100:00100000:2.0:1787508638.188988:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15421 00010000:00010000:0.0:1787508638.266284:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508638.906306:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787508638.906331:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480150912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787508638.906402:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508638.907177:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480150912 00000100:00100000:0.0:1787508638.907188:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480150912 00000100:00100000:0.0:1787508638.907248:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29809 00000100:00100000:0.0:1787508638.907258:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480150912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787508638.907301:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1441771520 avail 1295532032 00000100:00100000:0.0:1787508638.907368:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480150912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508638.907375:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29809 00000100:00100000:3.0:1787508638.907555:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944105 gen 2 00000004:00080000:3.0:1787508638.907562:0:3616:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944104 committed transno 12884944105 00000004:00080000:3.0:1787508638.907587:0:3616:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944105 committed transno 12884944105 00000100:00100000:3.0:1787508638.907603:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480150912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787508638.907792:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480151040:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787508638.907842:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508638.908350:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480151040 00000100:00100000:3.0:1787508638.908356:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480151040 00000100:00100000:3.0:1787508638.908402:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29810 00000100:00100000:3.0:1787508638.908410:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480151040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787508638.908434:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1442783232 avail 1296543744 00000100:00100000:3.0:1787508638.908673:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480151040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 263us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508638.908681:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29810 00000100:00100000:1.0:1787508638.908747:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480151040:0@lo:41:osp-pre-1-0.0 00000001:00020000:1.0:1787508639.203101:0:202226:0:(lod_qos.c:737:lod_check_and_reserve_ost()) cfs_fail_timeout id 163 awake 00000004:00080000:1.0:1787508639.203220:0:202226:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1588:0x0], index 1: 0 00000004:00080000:1.0:1787508639.203229:0:202226:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x152b:0x0], index 0: 0 00010000:00010000:1.0:1787508639.203489:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34db8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a3:0x554:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508639.203501:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34db8 lrc: 2/0,0 mode: EX/EX res: [0x2000013a3:0x554:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508639.203508:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34db8 lrc: 3/0,0 mode: EX/EX res: [0x2000013a3:0x554:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508639.203513:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508639.203518:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34db8 lrc: 3/0,0 mode: EX/EX res: [0x2000013a3:0x554:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508639.203647:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34db8 lrc: 4/0,0 mode: EX/EX res: [0x2000013a3:0x554:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508639.203669:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x554:0x0].0x0 (ffff9090c98d9300) 00010000:00010000:1.0:1787508639.203673:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787508639.203679:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34db8 lrc: 2/0,0 mode: --/EX res: [0x2000013a3:0x554:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508639.203685:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34db8 lrc: 0/0,0 mode: --/EX res: [0x2000013a3:0x554:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508639.203754:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34db1 lrc: 1/0,0 mode: --/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae632 expref: 14 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508639.203766:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x553:0x0].0x0 (ffff9090ccb87600) 00010000:00010000:1.0:1787508639.203768:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508639.203773:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34db1 lrc: 0/0,0 mode: --/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae632 expref: 14 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508639.203783:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f000, rc 0) 00000100:00100000:1.0:1787508639.203861:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:337297:x1874324509561216:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 4197962us (4198321us total) trans 12884944111 rc 301/301 00000100:00100000:1.0:1787508639.203871:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94005 00000100:00100000:1.0:1787508639.221182:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508639.221443:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509563136 00000100:00100000:3.0:1787508639.221454:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509563136 00000100:00100000:3.0:1787508639.221529:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15422 00000100:00100000:3.0:1787508639.221542:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:337297:x1874324509563136:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1787508639.221854:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:337297:x1874324509563136:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 306us (674us total) trans 12884944112 rc 0/0 00000100:00100000:3.0:1787508639.221862:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15422 00000100:00080000:1.0:1787508639.222149:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508639.224415:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508639.224499:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509563264 00000100:00100000:3.0:1787508639.224508:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509563264 00000100:00100000:3.0:1787508639.224618:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94007 00000100:00100000:3.0:1787508639.224628:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:337297:x1874324509563264:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508639.224654:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508639.224679:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34dd4 lrc: 2/0,0 mode: --/CR res: [0x2000013a3:0x554:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae640 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508639.224739:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34dd4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a3:0x554:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae640 expref: 15 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508639.224755:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34dd4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a3:0x554:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae640 expref: 15 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508639.224788:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x554:0x0].0x0 (ffff9090ccb87c00) 00010000:00010000:3.0:1787508639.224791:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787508639.224795:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ea00, rc 0) 00000100:00100000:3.0:1787508639.224861:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:337297:x1874324509563264:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 233us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508639.224869:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94007 00000100:00100000:0.0:1787508639.228529:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508639.228637:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509563520 00000100:00100000:3.0:1787508639.228647:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509563520 00000100:00100000:3.0:1787508639.228709:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15423 00000100:00100000:3.0:1787508639.228721:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:337297:x1874324509563520:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1787508639.228987:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:337297:x1874324509563520:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 267us (467us total) trans 12884944113 rc 0/0 00000100:00100000:3.0:1787508639.228997:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15423 00010000:00010000:0.0:1787508639.292297:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508639.423881:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787508639.428875:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480151552:0@lo:400:kworker.0 00000100:00100000:3.0:1787508639.429253:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508639.429329:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480151168:0@lo:400:kworker.0 00000100:00100000:3.0:1787508639.429365:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508639.429412:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480151296:0@lo:400:kworker.0 00000100:00100000:3.0:1787508639.429913:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508639.430107:0:225832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480151552 00000100:00100000:1.0:1787508639.430117:0:225832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480151552 00000100:00100000:1.0:1787508639.430177:0:225832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2299 00000100:00100000:1.0:1787508639.430187:0:225832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480151552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508639.432035:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480151168 00000100:00100000:0.0:1787508639.432045:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480151168 00000100:00100000:1.0:1787508639.432683:0:225832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480151552:12345-0@lo:400:kworker.0 Request processed in 2492us (3426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508639.432696:0:225832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2299 00000100:00100000:1.0:1787508639.432737:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480151680:0@lo:400:kworker.0 00000100:00100000:1.0:1787508639.432797:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508639.432834:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874324480152192:0@lo:400:kworker.0 00000100:00100000:1.0:1787508639.432856:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508639.432875:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874324480152704:0@lo:400:kworker.0 00000100:00100000:1.0:1787508639.432895:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508639.432912:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787508639.432917:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480152064:0@lo:400:kworker.0 00000100:00100000:1.0:1787508639.432955:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508639.432972:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874324480152576:0@lo:400:kworker.0 00000100:00100000:1.0:1787508639.432991:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508639.433028:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480151680 00000100:00100000:1.0:1787508639.433034:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480151680 00000100:00100000:1.0:1787508639.433063:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480152192 00000100:00100000:1.0:1787508639.433066:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480152192 00000100:00100000:1.0:1787508639.433082:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480152704 00000100:00100000:1.0:1787508639.433086:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480152704 00000100:00100000:1.0:1787508639.433110:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480152576 00000100:00100000:3.0:1787508639.433148:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480151808:0@lo:400:kworker.0 00000100:00100000:3.0:1787508639.433181:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508639.433211:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874324480152320:0@lo:400:kworker.0 00000100:00100000:3.0:1787508639.433244:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508639.433257:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787508639.433263:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480151424:0@lo:400:kworker.0 00000100:00100000:3.0:1787508639.433285:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508639.433303:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480151936:0@lo:400:kworker.0 00000100:00100000:3.0:1787508639.433324:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508639.433342:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480152448:0@lo:400:kworker.0 00000100:00100000:3.0:1787508639.433363:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508639.433388:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480151296 00000100:00100000:3.0:1787508639.433392:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480151296 00000100:00100000:3.0:1787508639.433420:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480151808 00000100:00100000:3.0:1787508639.433432:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480151808 00000100:00100000:3.0:1787508639.433452:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29811 00000100:00100000:3.0:1787508639.433459:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c968b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480151296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508639.433511:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c968b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480151296:12345-0@lo:400:kworker.0 Request processed in 51us (3598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508639.433518:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29811 00000100:00100000:3.0:1787508639.433537:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29812 00000100:00100000:3.0:1787508639.433543:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480151808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508639.433569:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480151808:12345-0@lo:400:kworker.0 Request processed in 27us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508639.433575:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29812 00000100:00100000:3.0:1787508639.433591:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480152320 00000100:00100000:3.0:1787508639.433595:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480152320 00000100:00100000:3.0:1787508639.433611:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480152448 00000100:00100000:3.0:1787508639.433613:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480152448 00000100:00100000:3.0:1787508639.433626:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2900 00000100:00100000:3.0:1787508639.433633:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480151680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508639.433667:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480151680:12345-0@lo:400:kworker.0 Request processed in 35us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508639.433674:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2900 00000100:00100000:3.0:1787508639.433686:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2901 00000100:00100000:3.0:1787508639.433692:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874324480152192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508639.433718:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874324480152192:12345-0@lo:400:kworker.0 Request processed in 26us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508639.433726:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2901 00000100:00100000:3.0:1787508639.433738:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2902 00000100:00100000:3.0:1787508639.433745:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874324480152704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508639.433746:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480152576 00000100:00100000:1.0:1787508639.433777:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2903 00000100:00100000:1.0:1787508639.433784:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874324480152320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508639.433818:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874324480152320:12345-0@lo:400:kworker.0 Request processed in 34us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508639.433825:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2903 00000100:00100000:1.0:1787508639.433838:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2904 00000100:00100000:1.0:1787508639.433844:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c968aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480152448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508639.433870:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c968aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480152448:12345-0@lo:400:kworker.0 Request processed in 26us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508639.433877:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2904 00000100:00100000:1.0:1787508639.433887:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2905 00000100:00100000:1.0:1787508639.433893:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874324480152576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508639.433917:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874324480152576:12345-0@lo:400:kworker.0 Request processed in 24us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508639.433923:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2905 00000100:00080000:1.0:1787508639.433971:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787508639.433975:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787508639.433977:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508639.434172:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874324480152704:12345-0@lo:400:kworker.0 Request processed in 427us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508639.434180:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2902 00000100:00100000:3.0:1787508639.434293:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480152064 00000100:00100000:3.0:1787508639.434298:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480152064 00000100:00100000:3.0:1787508639.434341:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480151424 00000100:00100000:3.0:1787508639.434344:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480151424 00000100:00100000:3.0:1787508639.434364:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480151936 00000100:00100000:3.0:1787508639.434367:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480151936 00000100:00100000:3.0:1787508639.434387:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2300 00000100:00100000:3.0:1787508639.434393:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480152064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508639.434489:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480152064:12345-0@lo:400:kworker.0 Request processed in 96us (1547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508639.434496:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2300 00000100:00100000:3.0:1787508639.434510:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2301 00000100:00100000:3.0:1787508639.434516:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c968a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480151424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508639.434544:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c968a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480151424:12345-0@lo:400:kworker.0 Request processed in 29us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508639.434550:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2301 00000100:00100000:3.0:1787508639.434562:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2302 00000100:00100000:3.0:1787508639.434567:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480151936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508639.434590:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480151936:12345-0@lo:400:kworker.0 Request processed in 23us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508639.434599:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2302 00000100:00100000:3.0:1787508639.434649:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480151424:0@lo:400:kworker.0 00000100:00100000:3.0:1787508639.434661:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480151936:0@lo:400:kworker.0 00000100:00100000:3.0:1787508639.434671:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480152448:0@lo:400:kworker.0 00000100:00100000:3.0:1787508639.434680:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480151808:0@lo:400:kworker.0 00000100:00100000:3.0:1787508639.434690:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874324480152320:0@lo:400:kworker.0 00000100:00100000:3.0:1787508639.434699:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480151296:0@lo:400:kworker.0 00000100:00100000:3.0:1787508639.434747:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480152064:0@lo:400:kworker.0 00000100:00100000:3.0:1787508639.434758:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874324480152576:0@lo:400:kworker.0 00000100:00100000:3.0:1787508639.435147:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874324480152192:0@lo:400:kworker.0 00000100:00100000:3.0:1787508639.435163:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874324480152704:0@lo:400:kworker.0 00000100:00100000:3.0:1787508639.435172:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480151680:0@lo:400:kworker.0 00000100:00100000:3.0:1787508639.436197:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480151552:0@lo:400:kworker.0 00000100:00080000:1.0:1787508639.439516:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787508639.439528:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508639.441989:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:0.0:1787508639.442008:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed92d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480151168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508639.442143:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed92d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480151168:12345-0@lo:400:kworker.0 Request processed in 140us (12776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508639.442150:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00100000:1.0:1787508639.442360:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480151168:0@lo:400:kworker.0 00000020:00080000:0.0:1787508639.938866:0:202955:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 4294998388 batchid updated 00000020:00080000:3.0:1787508639.938964:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998388 00000004:00080000:3.0:1787508639.939041:0:202975:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d01c9300 with version 13622 00000020:00080000:3.0:1787508639.939057:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294998388 cancel update log [0x2000013a2:0x5:0x0].597: rc = 0 00000004:00080000:1.0:1787508639.939078:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13622 rpc_version 13622 00000020:00100000:1.0:1787508639.939112:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787508639.939123:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091f9b58380 x1874324480152960/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00080000:3.0:1787508639.939141:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294998388 cancel update log [0x240000bd1:0xf:0x0].53: rc = 0 00000100:00100000:1.0:1787508639.939146:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b58380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480152960:0@lo:1000:osp_up0-1.0 00000020:00080000:3.0:1787508639.939149:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998388 00000100:00100000:1.0:1787508639.939216:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508639.939302:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cc643e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787508639.939341:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480152960 00000100:00100000:3.0:1787508639.939349:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480152960 00000100:00100000:3.0:1787508639.939441:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29813 00000100:00100000:3.0:1787508639.939450:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:202961:x1874324480152960:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508639.939603:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:202961:x1874324480152960:12345-0@lo:1000:osp_up0-1.0 Request processed in 153us (386us total) trans 12884944114 rc 0/0 00000100:00100000:3.0:1787508639.939611:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29813 00000100:00100000:0.0:1787508639.940569:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b58380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480152960:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1787508640.318080:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508640.856348:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508640.856392:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509563776 00000100:00100000:2.0:1787508640.856403:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509563776 00000100:00100000:2.0:1787508640.856482:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94008 00000100:00100000:2.0:1787508640.856493:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+587:337314:x1874324509563776:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508640.856520:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508640.856552:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34ddb lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae647 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508640.856638:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34de2 lrc: 3/1,0 mode: --/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508640.856652:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34de2 lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508640.856663:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34de2 lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508640.856678:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f34de9 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508640.856686:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f34de9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508640.856693:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f34de9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508640.857278:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34de2 lrc: 4/1,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508640.857289:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34de2 lrc: 4/1,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508640.857295:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34de2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508640.857301:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34de2 lrc: 4/0,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508640.857307:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508640.857311:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34de2 lrc: 4/0,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508640.857318:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34de2 lrc: 5/0,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508640.857330:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125d:0x0].0x0 (ffff9090ccb87100) 00010000:00010000:2.0:1787508640.857333:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508640.857337:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34de2 lrc: 3/0,0 mode: --/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508640.857343:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34de2 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508640.857353:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f34de9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508640.857359:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f34de9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508640.857365:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f34de9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508640.857371:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508640.857373:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f34de9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508640.857379:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f34de9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508640.857386:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125d:0x0].0x2d9800ce (ffff9090d36fd900) 00010000:00010000:2.0:1787508640.857388:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508640.857391:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f34de9 lrc: 2/0,0 mode: --/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508640.857397:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f34de9 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508640.857431:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34ddb lrc: 1/0,0 mode: --/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae647 expref: 588 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508640.857442:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125d:0x0].0x0 (ffff9090ccb87100) 00010000:00010000:2.0:1787508640.857443:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508640.857447:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f34ddb lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae647 expref: 588 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508640.857456:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abe00, rc 0) 00000100:00080000:1.0:1787508640.857471:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508640.857559:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+587:337314:x1874324509563776:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1067us (1216us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508640.857568:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94008 00000100:00100000:2.0:1787508640.865498:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508640.867085:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509564032 00000100:00100000:1.0:1787508640.867099:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509564032 00000100:00100000:1.0:1787508640.867156:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94009 00000100:00100000:1.0:1787508640.867162:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+587:337314:x1874324509564032:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508640.867179:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508640.867198:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f34df0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae64e expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508640.867294:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125d:0x0]: returning size 4096 00010000:00010000:1.0:1787508640.867374:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f34df0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae64e expref: 589 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.867385:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508640.867387:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508640.867390:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f34df0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae64e expref: 589 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.867401:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b200, rc 0) 00000100:00100000:1.0:1787508640.867464:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+588:337314:x1874324509564032:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 301us (1976us total) trans 12884944115 rc 301/301 00000100:00100000:1.0:1787508640.867472:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94009 00000100:00100000:0.0:1787508640.872803:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508640.872883:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509564160 00000100:00100000:1.0:1787508640.872898:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509564160 00000100:00100000:1.0:1787508640.872985:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94010 00000100:00100000:1.0:1787508640.873004:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+588:337314:x1874324509564160:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:1.0:1787508640.873083:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34dfe lrc: 3/1,0 mode: --/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873099:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34dfe lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873109:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34dfe lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873123:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34e05 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873127:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34e05 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873131:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34e05 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873194:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34e0c lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873199:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34e0c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873203:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34e0c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508640.873236:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125e:0x0]: returning size 0 00000004:00200000:1.0:1787508640.873240:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508640.873253:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34e0c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873266:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34dfe lrc: 4/1,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873272:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34dfe lrc: 4/1,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873277:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34dfe lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873287:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34dfe lrc: 4/0,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873293:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508640.873297:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34dfe lrc: 4/0,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873304:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34dfe lrc: 5/0,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873314:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125d:0x0].0x0 (ffff9090ccb87100) 00010000:00010000:1.0:1787508640.873317:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508640.873321:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34dfe lrc: 3/0,0 mode: --/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873326:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f34dfe lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873337:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34e05 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873342:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34e05 lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873347:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34e05 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873352:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508640.873354:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34e05 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873364:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34e05 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873371:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125d:0x0].0x2d9800ce (ffff9090cda8af00) 00010000:00010000:1.0:1787508640.873373:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508640.873376:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34e05 lrc: 2/0,0 mode: --/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873381:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34e05 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873394:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34e0c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873401:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34e0c lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873406:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34e0c lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873410:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508640.873412:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34e0c lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873418:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34e0c lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873424:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125e:0x0].0x0 (ffff9090c6913600) 00010000:00010000:1.0:1787508640.873426:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508640.873429:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34e0c lrc: 2/0,0 mode: --/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.873434:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f34e0c lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508640.873509:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+588:337314:x1874324509564160:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 507us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508640.873517:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94010 00000100:00100000:3.0:1787508640.877058:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508640.877095:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508640.877102:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509564416 00000100:00100000:0.0:1787508640.877112:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509564416 00000100:00100000:3.0:1787508640.877123:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508640.877150:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508640.877168:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509564928 00000100:00100000:3.0:1787508640.877169:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508640.877171:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509564928 00000100:00100000:3.0:1787508640.877187:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508640.877194:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509564800 00000100:00100000:0.0:1787508640.877197:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509564800 00000100:00100000:3.0:1787508640.877209:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508640.877218:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2906 00000100:00100000:0.0:1787508640.877228:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c968bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2403:x1874324509564416:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508640.877298:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c968bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2403:x1874324509564416:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 71us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508640.877306:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2906 00000100:00100000:0.0:1787508640.877324:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2907 00000100:00100000:0.0:1787508640.877329:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509564928:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508640.877353:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509564928:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508640.877358:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2907 00000100:00100000:0.0:1787508640.877370:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2908 00000100:00100000:0.0:1787508640.877375:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:2403:x1874324509564800:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508640.877404:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:2403:x1874324509564800:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 29us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508640.877411:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2908 00000100:00080000:0.0:1787508640.877433:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787508640.878022:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509564672 00000100:00100000:1.0:1787508640.878028:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509564672 00000100:00100000:1.0:1787508640.878099:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509564544 00000100:00100000:1.0:1787508640.878102:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509564544 00000100:00080000:0.0:1787508640.878129:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787508640.878132:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508640.878145:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509564288 00000100:00100000:3.0:1787508640.878149:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509564288 00000100:00100000:3.0:1787508640.878180:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 988 00000100:00100000:3.0:1787508640.878188:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed92d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509564288:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508640.878208:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509565056 00000100:00100000:1.0:1787508640.878212:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509565056 00000100:00100000:1.0:1787508640.878234:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2303 00000100:00100000:1.0:1787508640.878241:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c968b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509564672:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508640.878277:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c968b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509564672:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 37us (1181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508640.878282:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2303 00000100:00100000:1.0:1787508640.878296:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2304 00000100:00100000:1.0:1787508640.878302:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c968b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509564544:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508640.878325:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c968b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509564544:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508640.878331:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2304 00000100:00100000:1.0:1787508640.878342:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2305 00000100:00100000:1.0:1787508640.878349:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9688380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2403:x1874324509565056:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508640.878370:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9688380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2403:x1874324509565056:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508640.878377:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2305 00000100:00080000:0.0:1787508640.878425:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508640.878473:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed92d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509564288:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 285us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508640.878481:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 988 00000100:00100000:0.0:1787508640.896056:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508640.896301:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509565312 00000100:00100000:3.0:1787508640.896313:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509565312 00000100:00100000:3.0:1787508640.896374:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15424 00000100:00100000:3.0:1787508640.896384:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+588:337314:x1874324509565312:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1787508640.896721:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+589:337314:x1874324509565312:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 336us (674us total) trans 12884944116 rc 0/0 00000100:00100000:3.0:1787508640.896729:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15424 00000100:00100000:0.0:1787508640.963229:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508640.963612:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509565568 00000100:00100000:3.0:1787508640.963623:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509565568 00000100:00100000:3.0:1787508640.963709:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94011 00000100:00100000:3.0:1787508640.963717:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+589:337317:x1874324509565568:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508640.963746:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508640.963764:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34e13 lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae655 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.963937:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34e1a lrc: 3/1,0 mode: --/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.963983:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34e1a lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.964006:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34e1a lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.964024:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34e21 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.964031:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34e21 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.964037:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34e21 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.964120:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34e1a lrc: 4/1,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.964131:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34e1a lrc: 4/1,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.964136:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34e1a lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.964143:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34e1a lrc: 4/0,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.964149:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508640.964153:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34e1a lrc: 4/0,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.964159:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34e1a lrc: 5/0,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.964168:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125d:0x0].0x0 (ffff9090ccb87100) 00010000:00010000:3.0:1787508640.964170:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508640.964173:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34e1a lrc: 3/0,0 mode: --/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.964177:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34e1a lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.964186:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34e21 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.964189:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34e21 lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.964193:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34e21 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.964197:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508640.964199:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34e21 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.964202:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34e21 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.964206:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125d:0x0].0x2d9800ce (ffff9090ccb87700) 00010000:00010000:3.0:1787508640.964207:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508640.964208:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34e21 lrc: 2/0,0 mode: --/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.964211:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34e21 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.964239:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34e13 lrc: 1/0,0 mode: --/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae655 expref: 590 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.964249:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125d:0x0].0x0 (ffff9090ccb87100) 00010000:00010000:3.0:1787508640.964250:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508640.964253:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34e13 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae655 expref: 590 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.964262:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e600, rc 0) 00000100:00100000:3.0:1787508640.964323:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+589:337317:x1874324509565568:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 607us (1101us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508640.964328:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94011 00000100:00100000:1.0:1787508640.967228:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508640.967324:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509565824 00000100:00100000:0.0:1787508640.967333:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509565824 00000100:00100000:0.0:1787508640.967423:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94012 00000100:00100000:0.0:1787508640.967434:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+589:337317:x1874324509565824:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508640.967453:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508640.967473:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34e28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae65c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.967644:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34e2f lrc: 3/1,0 mode: --/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.967659:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34e2f lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.967669:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34e2f lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508640.967680:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125d:0x0]: returning size 4096 00010000:00010000:0.0:1787508640.967899:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34e28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae65c expref: 592 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.967918:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34e2f lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae65c expref: 591 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.967926:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125d:0x0].0x0 (ffff9090ccb87100) 00010000:00010000:0.0:1787508640.967929:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787508640.967932:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7e00, rc 0) 00000100:00100000:0.0:1787508640.968162:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+591:337317:x1874324509565824:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 729us (942us total) trans 12884944117 rc 0/0 00000100:00100000:0.0:1787508640.968170:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94012 00000100:00100000:1.0:1787508640.970366:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508640.971102:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509565952 00000100:00100000:0.0:1787508640.971115:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509565952 00000100:00100000:1.0:1787508640.971273:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94013 00000100:00100000:1.0:1787508640.971284:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+591:337317:x1874324509565952:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:1.0:1787508640.971363:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f34e3d lrc: 3/1,0 mode: --/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971379:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f34e3d lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971388:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f34e3d lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971402:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34e44 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971409:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34e44 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971415:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34e44 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971486:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34e4b lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971494:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34e4b lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971501:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34e4b lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508640.971552:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x125e:0x0]: returning size 0 00000004:00200000:1.0:1787508640.971564:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508640.971577:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34e4b lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971592:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f34e3d lrc: 4/1,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971599:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f34e3d lrc: 4/1,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971605:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f34e3d lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971612:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f34e3d lrc: 4/0,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971618:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508640.971622:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f34e3d lrc: 4/0,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971629:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f34e3d lrc: 5/0,0 mode: CR/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971642:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125d:0x0].0x0 (ffff9090ccb87100) 00010000:00010000:1.0:1787508640.971645:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508640.971649:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f34e3d lrc: 3/0,0 mode: --/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971656:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f34e3d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971673:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34e44 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971679:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34e44 lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971684:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34e44 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971689:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508640.971692:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34e44 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971697:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34e44 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971704:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125d:0x0].0x2d9800ce (ffff9090cda8af00) 00010000:00010000:1.0:1787508640.971707:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508640.971710:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34e44 lrc: 2/0,0 mode: --/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971716:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34e44 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x125d:0x0].0x2d9800ce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971727:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34e4b lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971733:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34e4b lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971751:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34e4b lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971756:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508640.971758:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34e4b lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971764:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34e4b lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971772:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125e:0x0].0x0 (ffff9090c6913600) 00010000:00010000:1.0:1787508640.971774:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508640.971787:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34e4b lrc: 2/0,0 mode: --/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.971793:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f34e4b lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508640.971881:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+591:337317:x1874324509565952:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 598us (1523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508640.971889:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94013 00000100:00100000:1.0:1787508640.988167:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508640.988284:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509566208 00000100:00100000:3.0:1787508640.988295:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509566208 00000100:00100000:3.0:1787508640.988675:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94014 00000100:00100000:3.0:1787508640.988684:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:337322:x1874324509566208:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508640.988702:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508640.988719:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34e52 lrc: 2/0,0 mode: --/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae663 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.988796:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34e59 lrc: 3/1,0 mode: --/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.988810:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34e59 lrc: 3/1,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.988821:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34e59 lrc: 3/1,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.988835:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34e60 lrc: 3/1,0 mode: --/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.988842:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34e60 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.988849:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34e60 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.988933:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34e59 lrc: 4/1,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.988998:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34e59 lrc: 4/1,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.989006:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34e59 lrc: 3/0,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.989014:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34e59 lrc: 4/0,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.989020:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508640.989025:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34e59 lrc: 4/0,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.989033:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34e59 lrc: 5/0,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.989045:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x553:0x0].0x0 (ffff9090ccb87600) 00010000:00010000:3.0:1787508640.989047:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508640.989051:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34e59 lrc: 3/0,0 mode: --/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.989055:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34e59 lrc: 0/0,0 mode: --/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.989066:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34e60 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.989070:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34e60 lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.989074:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34e60 lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.989077:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508640.989078:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34e60 lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.989085:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34e60 lrc: 4/0,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.989089:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x553:0x0].0xfbe05a87 (ffff9090ccb87700) 00010000:00010000:3.0:1787508640.989090:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508640.989092:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34e60 lrc: 2/0,0 mode: --/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.989095:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34e60 lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.989119:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34e52 lrc: 1/0,0 mode: --/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae663 expref: 17 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.989126:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x553:0x0].0x0 (ffff9090ccb87600) 00010000:00010000:3.0:1787508640.989127:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508640.989129:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34e52 lrc: 0/0,0 mode: --/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae663 expref: 17 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508640.989134:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f200, rc 0) 00000100:00100000:3.0:1787508640.989181:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:337322:x1874324509566208:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 499us (1026us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508640.989186:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94014 00000100:00100000:3.0:1787508640.992454:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508640.992607:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509566464 00000100:00100000:1.0:1787508640.992617:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509566464 00000100:00100000:1.0:1787508640.992712:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94015 00000100:00100000:1.0:1787508640.992721:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:337322:x1874324509566464:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508640.992738:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508640.992759:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34e67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae66a expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508640.992870:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a3:0x553:0x0]: returning size 4096 00010000:00010000:1.0:1787508640.993058:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34e67 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae66a expref: 18 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.993071:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508640.993073:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508640.993076:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34e67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae66a expref: 18 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508640.993086:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b600, rc 0) 00000100:00100000:1.0:1787508640.993131:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:337322:x1874324509566464:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 412us (686us total) trans 12884944118 rc 301/301 00000100:00100000:1.0:1787508640.993136:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94015 00000100:00100000:1.0:1787508640.994911:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508640.995231:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509566592 00000100:00100000:0.0:1787508640.995242:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509566592 00000100:00100000:0.0:1787508640.995297:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94016 00000100:00100000:0.0:1787508640.995307:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:337322:x1874324509566592:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:0.0:1787508640.995375:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34e75 lrc: 3/1,0 mode: --/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995387:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34e75 lrc: 3/1,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995395:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34e75 lrc: 3/1,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995404:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34e7c lrc: 3/1,0 mode: --/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995411:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34e7c lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995415:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34e7c lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995479:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34e83 lrc: 3/1,0 mode: --/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995483:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34e83 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995487:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34e83 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508640.995517:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a3:0x554:0x0]: returning size 0 00000004:00200000:0.0:1787508640.995520:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508640.995539:0:203348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34e83 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995548:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34e75 lrc: 4/1,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995553:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34e75 lrc: 4/1,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995557:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34e75 lrc: 3/0,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995561:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34e75 lrc: 4/0,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995567:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508640.995570:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34e75 lrc: 4/0,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995574:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34e75 lrc: 5/0,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995581:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x553:0x0].0x0 (ffff9090ccb87600) 00010000:00010000:0.0:1787508640.995583:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508640.995586:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34e75 lrc: 3/0,0 mode: --/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995591:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34e75 lrc: 0/0,0 mode: --/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995603:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34e7c lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995609:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34e7c lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995614:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34e7c lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995618:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508640.995621:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34e7c lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995626:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34e7c lrc: 4/0,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995637:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x553:0x0].0xfbe05a87 (ffff9090c6913200) 00010000:00010000:0.0:1787508640.995640:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508640.995643:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34e7c lrc: 2/0,0 mode: --/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995649:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34e7c lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995661:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34e83 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995665:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34e83 lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995669:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34e83 lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995671:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508640.995673:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34e83 lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995676:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34e83 lrc: 4/0,0 mode: PR/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995680:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x554:0x0].0x0 (ffff9090ccb87c00) 00010000:00010000:0.0:1787508640.995681:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508640.995683:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34e83 lrc: 2/0,0 mode: --/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508640.995686:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34e83 lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508640.995800:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:337322:x1874324509566592:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 495us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508640.995806:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94016 00000100:00100000:0.0:1787508640.997636:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508640.997728:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509566848 00000100:00100000:2.0:1787508640.997737:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509566848 00000100:00100000:2.0:1787508640.997834:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15425 00000100:00100000:2.0:1787508640.997845:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde32850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:337322:x1874324509566848:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1787508640.998091:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde32850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+18:337322:x1874324509566848:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 247us (461us total) trans 12884944119 rc 0/0 00000100:00100000:2.0:1787508640.998099:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15425 00000100:00100000:3.0:1787508641.039928:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508641.040089:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509567104 00000100:00100000:1.0:1787508641.040100:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509567104 00000100:00100000:1.0:1787508641.040181:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94017 00000100:00100000:1.0:1787508641.040193:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+18:337324:x1874324509567104:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508641.040216:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508641.040238:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34e8a lrc: 2/0,0 mode: --/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae671 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508641.040313:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34e91 lrc: 3/1,0 mode: --/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508641.040327:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34e91 lrc: 3/1,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508641.040338:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34e91 lrc: 3/1,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508641.040356:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f34e98 lrc: 3/1,0 mode: --/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508641.040362:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f34e98 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508641.040368:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f34e98 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508641.040451:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34e91 lrc: 4/1,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508641.040458:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34e91 lrc: 4/1,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508641.040464:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34e91 lrc: 3/0,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508641.040469:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34e91 lrc: 4/0,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508641.040474:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508641.040478:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34e91 lrc: 4/0,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508641.040485:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34e91 lrc: 5/0,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508641.040497:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x553:0x0].0x0 (ffff9090ccb87600) 00010000:00010000:1.0:1787508641.040499:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508641.040504:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34e91 lrc: 3/0,0 mode: --/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508641.040510:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34e91 lrc: 0/0,0 mode: --/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508641.040521:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f34e98 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508641.040526:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f34e98 lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508641.040531:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f34e98 lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508641.040535:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508641.040538:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f34e98 lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508641.040543:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f34e98 lrc: 4/0,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508641.040549:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x553:0x0].0xfbe05a87 (ffff9090cda8af00) 00010000:00010000:1.0:1787508641.040552:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508641.040554:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f34e98 lrc: 2/0,0 mode: --/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508641.040559:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f34e98 lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508641.040588:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34e8a lrc: 1/0,0 mode: --/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae671 expref: 19 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508641.040603:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x553:0x0].0x0 (ffff9090ccb87600) 00010000:00010000:1.0:1787508641.040605:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508641.040609:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34e8a lrc: 0/0,0 mode: --/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae671 expref: 19 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508641.040619:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b600, rc 0) 00000100:00080000:0.0:1787508641.040764:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787508641.042099:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+18:337324:x1874324509567104:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1901us (2190us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508641.042111:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94017 00000100:00100000:1.0:1787508641.050836:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508641.050891:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509567360 00000100:00100000:3.0:1787508641.050912:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509567360 00000100:00100000:3.0:1787508641.051027:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94018 00000100:00100000:3.0:1787508641.051038:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+18:337324:x1874324509567360:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508641.051060:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508641.051081:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34e9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae678 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.051184:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34ea6 lrc: 3/1,0 mode: --/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.051198:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34ea6 lrc: 3/1,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.051210:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34ea6 lrc: 3/1,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508641.051222:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a3:0x553:0x0]: returning size 4096 00010000:00010000:3.0:1787508641.051307:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f34e9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae678 expref: 21 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.051321:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34ea6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae678 expref: 20 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.051328:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x553:0x0].0x0 (ffff9090ccb87600) 00010000:00010000:3.0:1787508641.051330:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787508641.051333:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e800, rc 0) 00000100:00100000:3.0:1787508641.051387:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+20:337324:x1874324509567360:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 351us (562us total) trans 12884944120 rc 0/0 00000100:00100000:3.0:1787508641.051394:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94018 00000100:00100000:2.0:1787508641.054082:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508641.054275:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509567488 00000100:00100000:3.0:1787508641.054285:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509567488 00000100:00100000:3.0:1787508641.054350:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94019 00000100:00100000:3.0:1787508641.054361:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+20:337324:x1874324509567488:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:3.0:1787508641.054442:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34eb4 lrc: 3/1,0 mode: --/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054458:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34eb4 lrc: 3/1,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054469:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34eb4 lrc: 3/1,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054485:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34ebb lrc: 3/1,0 mode: --/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054493:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34ebb lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054499:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34ebb lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054581:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34ec2 lrc: 3/1,0 mode: --/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054601:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34ec2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054608:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34ec2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508641.054659:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a3:0x554:0x0]: returning size 0 00000004:00200000:3.0:1787508641.054664:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508641.054679:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34ec2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054696:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34eb4 lrc: 4/1,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054703:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34eb4 lrc: 4/1,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054710:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34eb4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054716:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34eb4 lrc: 4/0,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054722:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508641.054726:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34eb4 lrc: 4/0,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054733:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34eb4 lrc: 5/0,0 mode: CR/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054746:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x553:0x0].0x0 (ffff9090ccb87600) 00010000:00010000:3.0:1787508641.054749:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508641.054754:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34eb4 lrc: 3/0,0 mode: --/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054759:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f34eb4 lrc: 0/0,0 mode: --/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054771:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34ebb lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054776:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34ebb lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054793:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34ebb lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054798:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508641.054800:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34ebb lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054806:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34ebb lrc: 4/0,0 mode: PR/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054813:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x553:0x0].0xfbe05a87 (ffff9090ccb87700) 00010000:00010000:3.0:1787508641.054815:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508641.054818:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34ebb lrc: 2/0,0 mode: --/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054824:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f34ebb lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x553:0x0].0xfbe05a87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054836:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34ec2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054843:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34ec2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054849:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34ec2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054854:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508641.054857:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34ec2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054867:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34ec2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054875:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x554:0x0].0x0 (ffff9090ccb87c00) 00010000:00010000:3.0:1787508641.054877:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508641.054880:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34ec2 lrc: 2/0,0 mode: --/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508641.054885:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f34ec2 lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x554:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508641.055210:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+20:337324:x1874324509567488:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 849us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508641.055219:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94019 00010000:00010000:0.0:1787508641.338204:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508641.468556:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787508641.468579:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480153088:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787508641.468651:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508641.468751:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480153088 00000100:00100000:2.0:1787508641.468760:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480153088 00000100:00100000:2.0:1787508641.468832:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1645 00000100:00100000:2.0:1787508641.468842:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480153088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787508641.468874:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75854400 pending 0 free 3884056576 avail 3652534272 00000100:00100000:2.0:1787508641.468922:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480153088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508641.468929:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1645 00000100:00100000:1.0:1787508641.469056:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480153088:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787508641.469078:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508641.469367:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787508641.469378:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480153216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787508641.469413:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508641.469520:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480153216 00000100:00100000:0.0:1787508641.469525:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480153216 00000100:00100000:0.0:1787508641.469573:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1646 00000100:00100000:0.0:1787508641.469581:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480153216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787508641.469593:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75854400 pending 0 free 3884056576 avail 3652534272 00000100:00080000:1.0:1787508641.469681:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508641.469757:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480153216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 176us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508641.469764:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1646 00000100:00100000:3.0:1787508641.469820:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480153216:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787508642.374318:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508643.003132:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787508643.003168:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480153344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787508643.003471:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787508643.003483:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480153472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787508643.003567:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508643.003719:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480153472 00000100:00100000:2.0:1787508643.003727:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480153472 00000100:00100000:2.0:1787508643.003794:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1647 00000100:00100000:2.0:1787508643.003804:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480153472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787508643.003832:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16990784 pending 0 free 3910828032 avail 3679305728 00000100:00080000:1.0:1787508643.004190:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787508643.004446:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480153472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 641us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508643.004454:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1647 00000100:00100000:0.0:1787508643.005235:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508643.005411:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480153344 00000100:00100000:1.0:1787508643.005418:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480153344 00000100:00100000:1.0:1787508643.005481:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1648 00000100:00100000:1.0:1787508643.005491:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480153344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787508643.005514:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16990784 pending 0 free 3910828032 avail 3679305728 00000100:00100000:1.0:1787508643.005574:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480153344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508643.005584:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1648 00000100:00100000:1.0:1787508643.005633:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480153344:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787508643.005752:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787508643.006294:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480153472:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787508643.387472:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508644.027730:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787508644.027752:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480153600:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787508644.027828:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508644.028031:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480153600 00000100:00100000:3.0:1787508644.028040:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480153600 00000100:00100000:3.0:1787508644.028085:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29814 00000100:00100000:3.0:1787508644.028095:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:3617:x1874324480153600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787508644.028134:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1441771520 avail 1295532032 00000100:00100000:3.0:1787508644.028184:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:3617:x1874324480153600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508644.028191:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29814 00000001:00080000:3.0:1787508644.029147:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944120 is committed 00000001:00080000:3.0:1787508644.029166:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944117 is committed 00000001:00080000:3.0:1787508644.029173:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944114 is committed 00000100:00100000:2.0:1787508644.029290:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480153600:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787508644.030341:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787508644.030358:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480153728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787508644.032868:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508644.033126:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480153728 00000100:00100000:3.0:1787508644.033135:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480153728 00000100:00100000:3.0:1787508644.033194:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29815 00000100:00100000:3.0:1787508644.033206:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480153728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787508644.033244:0:202232:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1442783232 avail 1296543744 00000100:00100000:3.0:1787508644.033299:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480153728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508644.033306:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29815 00000100:00100000:2.0:1787508644.033607:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480153728:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787508644.410528:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508644.538506:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480153984:0@lo:400:kworker.0 00000100:00100000:0.0:1787508644.538582:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508644.538616:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480153984 00000100:00100000:1.0:1787508644.538624:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480153984 00000100:00100000:0.0:1787508644.538647:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d30f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480154496:0@lo:400:kworker.0 00000100:00100000:1.0:1787508644.538672:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2306 00000100:00100000:1.0:1787508644.538681:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480153984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508644.538687:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508644.538711:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d38da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874324480155008:0@lo:400:kworker.0 00000100:00100000:1.0:1787508644.538729:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480153984:12345-0@lo:400:kworker.0 Request processed in 48us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508644.538734:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508644.538735:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2306 00000100:00100000:1.0:1787508644.538749:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480154496 00000100:00100000:1.0:1787508644.538752:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480154496 00000100:00100000:0.0:1787508644.538765:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480153984:0@lo:400:kworker.0 00000100:00100000:1.0:1787508644.538781:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2307 00000100:00100000:0.0:1787508644.538783:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787508644.538786:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480154496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508644.538788:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79de3f65-4bad-42d0-a46f-842a654b33a0:3619:1874324480153856:0@lo:400:kworker.0 00000100:00100000:1.0:1787508644.538816:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480154496:12345-0@lo:400:kworker.0 Request processed in 30us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508644.538816:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508644.538822:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2307 00000100:00100000:0.0:1787508644.538835:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d30f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480154368:0@lo:400:kworker.0 00000100:00080000:1.0:1787508644.538840:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508644.538864:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480155008 00000100:00100000:1.0:1787508644.538867:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480155008 00000100:00100000:1.0:1787508644.538898:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2909 00000100:00100000:1.0:1787508644.538905:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874324480155008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508644.538971:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874324480155008:12345-0@lo:400:kworker.0 Request processed in 66us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508644.538977:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2909 00000100:00080000:1.0:1787508644.538995:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508644.539353:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874324480154240:0@lo:400:kworker.0 00000100:00100000:2.0:1787508644.539386:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508644.539404:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d38db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874324480154752:0@lo:400:kworker.0 00000100:00100000:2.0:1787508644.539422:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508644.539422:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508644.539439:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d38d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480154880:0@lo:400:kworker.0 00000100:00100000:2.0:1787508644.539440:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787508644.539445:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480154112:0@lo:400:kworker.0 00000100:00100000:0.0:1787508644.539459:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508644.539461:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508644.539475:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d30f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480154624:0@lo:400:kworker.0 00000100:00100000:0.0:1787508644.539481:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d30f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480154496:0@lo:400:kworker.0 00000100:00100000:0.0:1787508644.539491:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d38da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874324480155008:0@lo:400:kworker.0 00000100:00100000:2.0:1787508644.539493:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508644.539505:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480155136:0@lo:400:kworker.0 00000100:00100000:2.0:1787508644.539523:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508644.539546:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480154240 00000100:00100000:2.0:1787508644.539550:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480154240 00000100:00100000:0.0:1787508644.539552:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480154368 00000100:00100000:0.0:1787508644.539571:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480154368 00000100:00100000:2.0:1787508644.539573:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480154752 00000100:00100000:2.0:1787508644.539575:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480154752 00000100:00100000:2.0:1787508644.539590:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480154880 00000100:00100000:0.0:1787508644.539591:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480154112 00000100:00100000:2.0:1787508644.539593:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480154880 00000100:00100000:0.0:1787508644.539593:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480154112 00000100:00100000:2.0:1787508644.539604:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480154624 00000100:00100000:2.0:1787508644.539606:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480154624 00000100:00100000:0.0:1787508644.539608:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2308 00000100:00100000:0.0:1787508644.539614:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480154368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508644.539615:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480155136 00000100:00100000:2.0:1787508644.539617:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480155136 00000100:00100000:2.0:1787508644.539630:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2910 00000100:00100000:2.0:1787508644.539635:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874324480154240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508644.539652:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480154368:12345-0@lo:400:kworker.0 Request processed in 38us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508644.539659:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2308 00000100:00100000:2.0:1787508644.539665:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874324480154240:12345-0@lo:400:kworker.0 Request processed in 30us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508644.539671:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2910 00000100:00100000:2.0:1787508644.539685:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2911 00000100:00100000:2.0:1787508644.539690:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874324480154752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508644.539715:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874324480154752:12345-0@lo:400:kworker.0 Request processed in 25us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508644.539721:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2911 00000100:00100000:2.0:1787508644.539731:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2912 00000100:00100000:2.0:1787508644.539737:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480154880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508644.539764:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480154880:12345-0@lo:400:kworker.0 Request processed in 28us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508644.539769:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2912 00000100:00100000:2.0:1787508644.539781:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2913 00000100:00100000:2.0:1787508644.539786:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480154624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508644.539811:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480154624:12345-0@lo:400:kworker.0 Request processed in 25us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508644.539817:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2913 00000100:00100000:2.0:1787508644.539829:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2914 00000100:00100000:2.0:1787508644.539837:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480155136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508644.539862:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480155136:12345-0@lo:400:kworker.0 Request processed in 27us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508644.539867:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2914 00000100:00100000:2.0:1787508644.539885:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2309 00000100:00100000:2.0:1787508644.539891:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480154112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508644.539918:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480154112:12345-0@lo:400:kworker.0 Request processed in 28us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508644.539923:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2309 00000100:00080000:1.0:1787508644.540016:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787508644.540021:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787508644.540023:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787508644.540163:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d30f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480154368:0@lo:400:kworker.0 00000100:00100000:1.0:1787508644.540174:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d38d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480154880:0@lo:400:kworker.0 00000100:00100000:0.0:1787508644.540244:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480154112:0@lo:400:kworker.0 00000100:00100000:0.0:1787508644.540254:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d30f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480154624:0@lo:400:kworker.0 00000100:00100000:0.0:1787508644.540262:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480155136:0@lo:400:kworker.0 00000100:00100000:0.0:1787508644.540271:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874324480154240:0@lo:400:kworker.0 00000100:00100000:0.0:1787508644.540279:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d38db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874324480154752:0@lo:400:kworker.0 00000100:00100000:3.0:1787508644.540457:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480153856 00000100:00100000:3.0:1787508644.540463:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480153856 00000100:00100000:3.0:1787508644.540494:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:3.0:1787508644.540502:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed92ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3619:x1874324480153856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508644.540543:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed92ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3619:x1874324480153856:12345-0@lo:400:kworker.0 Request processed in 42us (1726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508644.540549:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:0.0:1787508644.540558:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79de3f65-4bad-42d0-a46f-842a654b33a0:3619:1874324480153856:0@lo:400:kworker.0 00010000:00010000:0.0:1787508645.436530:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508645.994289:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508645.994528:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508645.994570:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508645.994607:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508645.994818:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508645.994840:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508645.994858:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508645.994883:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508645.994927:0:208928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509568000 00000100:00100000:1.0:1787508645.994936:0:208928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509568000 00000100:00100000:1.0:1787508645.995031:0:208928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509568512 00000100:00100000:1.0:1787508645.995035:0:208928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509568512 00000100:00100000:1.0:1787508645.995054:0:208928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509568128 00000100:00100000:1.0:1787508645.995057:0:208928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509568128 00000100:00100000:1.0:1787508645.995078:0:208928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2310 00000100:00100000:1.0:1787508645.995088:0:208928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2400:x1874324509568000:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508645.995163:0:208928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2400:x1874324509568000:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 76us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508645.995171:0:208928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2310 00000100:00100000:1.0:1787508645.995204:0:208928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2311 00000100:00100000:1.0:1787508645.995211:0:208928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509568512:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508645.995346:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509567744 00000100:00100000:0.0:1787508645.995350:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509567744 00000100:00100000:0.0:1787508645.995381:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509568256 00000100:00100000:0.0:1787508645.995384:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509568256 00000100:00100000:0.0:1787508645.995398:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509567872 00000100:00100000:0.0:1787508645.995401:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509567872 00000100:00100000:0.0:1787508645.995415:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509568384 00000100:00100000:0.0:1787508645.995417:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509568384 00000100:00100000:0.0:1787508645.995430:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2915 00000100:00100000:0.0:1787508645.995436:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:2400:x1874324509567744:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508645.995464:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:2400:x1874324509567744:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 28us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508645.995470:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2915 00000100:00100000:0.0:1787508645.995482:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2916 00000100:00100000:0.0:1787508645.995487:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2400:x1874324509568256:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508645.995507:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2400:x1874324509568256:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 20us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508645.995513:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2916 00000100:00100000:0.0:1787508645.995522:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2917 00000100:00100000:0.0:1787508645.995526:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2400:x1874324509567872:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508645.995544:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2400:x1874324509567872:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 17us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508645.995549:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2917 00000100:00100000:0.0:1787508645.995569:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2918 00000100:00100000:0.0:1787508645.995576:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509568384:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508645.995596:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509568384:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508645.995601:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2918 00000100:00080000:0.0:1787508645.995665:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508645.995669:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787508645.995671:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787508645.995673:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787508645.995688:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2312 00000100:00100000:0.0:1787508645.995695:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2400:x1874324509568128:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508645.995719:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2400:x1874324509568128:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508645.995724:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2312 00000100:00100000:0.0:1787508645.995745:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509567616 00000100:00100000:0.0:1787508645.995749:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509567616 00000100:00100000:0.0:1787508645.995771:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 990 00000100:00100000:0.0:1787508645.995777:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed92cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2400:x1874324509567616:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508645.995797:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed92cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2400:x1874324509567616:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508645.995803:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 990 00000100:00100000:1.0:1787508645.997911:0:208928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509568512:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 2677us (3280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508645.997930:0:208928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2311 00010000:00010000:0.0:1787508646.462789:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508646.586568:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480155264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787508646.586675:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508646.587176:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480155392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787508646.587478:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480155264 00000100:00100000:2.0:1787508646.587491:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480155264 00000100:00100000:2.0:1787508646.587582:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1649 00000100:00100000:2.0:1787508646.587596:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480155264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787508646.587638:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75854400 pending 0 free 3884056576 avail 3652534272 00000100:00100000:2.0:1787508646.587711:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480155264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508646.587721:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1649 00000100:00100000:0.0:1787508646.587995:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480155264:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787508646.588168:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508646.588675:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508646.588739:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480155392 00000100:00100000:2.0:1787508646.588747:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480155392 00000100:00100000:2.0:1787508646.588812:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1650 00000100:00100000:2.0:1787508646.588834:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480155392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787508646.588854:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 75854400 pending 0 free 3884056576 avail 3652534272 00000100:00100000:2.0:1787508646.588926:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480155392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508646.588933:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1650 00000100:00100000:3.0:1787508646.588989:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480155392:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787508646.589238:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:0.0:1787508647.262800:0:232387:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 94: signal vs CP callback race =========== 14:10:46 (1787508646) 00000100:00100000:1.0:1787508647.342643:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508647.342731:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509568640 00000100:00100000:3.0:1787508647.342745:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509568640 00000100:00100000:3.0:1787508647.342799:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15054 00000100:00100000:3.0:1787508647.342810:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:2399:x1874324509568640:12345-192.168.201.30@tcp:8:lctl.0 00010000:00080000:3.0:1787508647.342852:0:225837:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from eb35f31c-097f-45a3-8275-bc75f97f89ee@192.168.201.30@tcp t0 exp 0000000000000000 cur 13618 last 0 00000020:00000080:3.0:1787508647.342902:0:225837:0:(genops.c:1385:class_connect()) connect: client eb35f31c-097f-45a3-8275-bc75f97f89ee, cookie 0xb126349c40f34ec9 00002000:00100000:3.0:1787508647.342917:0:225837:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli eb35f31c-097f-45a3-8275-bc75f97f89ee/ffff9091f9b4e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787508647.342975:0:225837:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:3.0:1787508647.343079:0:225837:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787508647.343120:0:225837:0:(import.c:65:import_set_state_nolock()) ffff9091f9b4a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787508647.343216:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2399:x1874324509568640:12345-192.168.201.30@tcp:8:lctl.0 Request processed in 405us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508647.343225:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15054 00000100:00100000:3.0:1787508647.353525:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508647.356411:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509568896 00000100:00100000:0.0:1787508647.356430:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509568896 00000100:00100000:0.0:1787508647.356538:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94020 00000100:00100000:0.0:1787508647.356552:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:337904:x1874324509568896:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1787508647.356579:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508647.356584:0:202228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787508647.356620:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f34d6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae61d expref: 14 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508647.356642:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508647.356648:0:202228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508647.356666:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34ed0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae67f expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508647.356822:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34ed7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508647.356838:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f34d10 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae601 expref: 584 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508647.356847:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34ed7 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508647.356900:0:202228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f34d10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae601 expref: 584 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508647.356920:0:202228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f34d10 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae601 expref: 584 pid: 203348 timeout: 13718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508647.356934:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9682680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480155520:192.168.201.30@tcp:104: 00000100:00080000:2.0:1787508647.357049:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787508647.357285:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787508647.361613:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508647.361737:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9682680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480155520:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508647.361775:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34ed7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508647.361854:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509569024 00000100:00100000:3.0:1787508647.361863:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509569024 00000100:00080000:2.0:1787508647.362097:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787508647.362197:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f34d10 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae601 expref: 585 pid: 203348 timeout: 13718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508647.362249:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27912 00000100:00100000:3.0:1787508647.362263:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:2401:x1874324509569024:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508647.362284:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508647.362293:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f34d10 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae601 expref: 585 pid: 203348 timeout: 13718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508647.362314:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f34d10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae601 expref: 585 pid: 203348 timeout: 13718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508647.362339:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f34d10 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae601 expref: 585 pid: 203348 timeout: 13718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508647.362356:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508647.362444:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34ed7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508647.362457:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34ed7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508647.362465:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34ed7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508647.362489:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508647.362560:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:2401:x1874324509569024:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 299us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508647.362569:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27912 00010000:00010000:2.0:1787508647.362734:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34ed7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.362742:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34ed7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.362771:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34ede lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.362782:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34ede lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.362790:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34ede lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787508647.363310:0:202228:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1589:0x0], index 1: 0 00010000:00010000:2.0:1787508647.363538:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34ee5 lrc: 3/1,0 mode: --/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.363548:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34ee5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.363556:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34ee5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.363596:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34ed7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.363604:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34ed7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.363611:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34ed7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.363617:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34ed7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.363623:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508647.363628:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34ed7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.363637:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34ed7 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.363648:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508647.363652:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508647.363656:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34ed7 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.363662:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f34ed7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508647.363676:0:202228:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f25afc07 reply state 00000000a98c1f48 transno 12884944121 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34ede lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.363689:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34ede lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.363696:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6bc7b3a7 (ffff9090d36fd800) 00010000:00010000:2.0:1787508647.363698:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787508647.363701:0:202228:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787508647.363741:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34ed0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae67f expref: 16 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.363757:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34ee5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae67f expref: 15 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.363764:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x555:0x0].0x0 (ffff9090d36fd500) 00010000:00010000:2.0:1787508647.363766:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787508647.363768:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa000, rc 0) 00000100:00100000:2.0:1787508647.363833:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:337904:x1874324509568896:12345-192.168.201.30@tcp:101:dd.0 Request processed in 7285us (10324us total) trans 12884944121 rc 0/0 00000100:00100000:2.0:1787508647.363841:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94020 00000100:00100000:0.0:1787508647.387473:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508647.387649:0:230130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509569152 00000100:00100000:3.0:1787508647.387663:0:230130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509569152 00000100:00100000:3.0:1787508647.387754:0:230130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15055 00000100:00100000:3.0:1787508647.387770:0:230130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:337904:x1874324509569152:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:3.0:1787508647.387792:0:230130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508647.387823:0:230130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004689354c/0xb126349c40f34ef3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae686 expref: -99 pid: 230130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787508647.387862:0:230130:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1589:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787508647.387902:0:230130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1589:0x0].0x0 since=13618s v=(0 0) 00010000:00010000:3.0:1787508647.387909:0:230130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1589:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787508647.387920:0:230130:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004689354c/0xb126349c40f34ef3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae686 expref: 7 pid: 230130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787508647.388082:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787508647.388181:0:230130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004689354c/0xb126349c40f34ef3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae686 expref: 7 pid: 230130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508647.388201:0:230130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f000, rc 0) 00000100:00100000:3.0:1787508647.388325:0:230130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:337904:x1874324509569152:12345-192.168.201.30@tcp:101:dd.0 Request processed in 560us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508647.388334:0:230130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15055 00000100:00100000:3.0:1787508647.397394:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508647.397444:0:203731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509569280 00000100:00100000:3.0:1787508647.397453:0:203731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509569280 00002000:00100000:3.0:1787508647.397505:0:203731:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x1589:0x0] (0->8191) req@ffff9090d55a6300 x1874324509569280/t0(0) o4->eb35f31c-097f-45a3-8275-bc75f97f89ee@192.168.201.30@tcp:103/0 lens 8680/0 e 0 to 0 dl 1787508658 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787508647.397515:0:203731:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090d55a6300 with x1874324509569280 ext(0->8191) 00002000:00010000:3.0:1787508647.397521:0:203731:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9090d55a6300 00000100:00100000:3.0:1787508647.397713:0:203731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:3.0:1787508647.397725:0:203731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2400:x1874324509569280:12345-192.168.201.30@tcp:4:dd.0 00000100:00100000:3.0:1787508647.399556:0:203731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2400:x1874324509569280:12345-192.168.201.30@tcp:4:dd.0 Request processed in 1823us (2163us total) trans 8589940552 rc 0/0 00000100:00100000:3.0:1787508647.399575:0:203731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 34 00002000:00100000:3.0:1787508647.399913:0:203731:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x1589:0x0] (0->8191) req@ffff9090d55a6300 x1874324509569280/t8589940552(0) o4->eb35f31c-097f-45a3-8275-bc75f97f89ee@192.168.201.30@tcp:103/0 lens 8680/448 e 0 to 0 dl 1787508658 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787508647.399927:0:203731:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090d55a6300 with x1874324509569280 ext(0->8191) 00002000:00010000:3.0:1787508647.399933:0:203731:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9090d55a6300 00000100:00100000:3.0:1787508647.407145:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508647.407310:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509569408 00000100:00100000:0.0:1787508647.407321:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509569408 00000100:00100000:0.0:1787508647.407492:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94021 00000100:00100000:0.0:1787508647.407506:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:337904:x1874324509569408:12345-192.168.201.30@tcp:44:dd.0 00000001:00080000:3.0:1787508647.410039:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944121 is committed 00010000:00010000:0.0:1787508647.410140:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34ede lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508647.410155:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34ede lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508647.410163:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34ede lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508647.410169:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508647.410174:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34ede lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508647.410182:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34ede lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508647.410198:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6bc7b3a7 (ffff9090d36fd800) 00010000:00010000:0.0:1787508647.410201:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508647.410205:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34ede lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508647.410212:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f34ede lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508647.410384:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:337904:x1874324509569408:12345-192.168.201.30@tcp:44:dd.0 Request processed in 2875us (3242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508647.410397:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94021 00000100:00100000:0.0:1787508647.421431:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508647.421739:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509569536 00000100:00100000:2.0:1787508647.421754:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509569536 00000100:00100000:2.0:1787508647.421871:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15056 00000100:00100000:2.0:1787508647.421901:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d38db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2401:x1874324509569536:12345-192.168.201.30@tcp:16:dd.0 00000001:00080000:2.0:1787508647.426304:0:204539:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589940552 is committed 00000100:00100000:0.0:1787508647.426542:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d38db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2401:x1874324509569536:12345-192.168.201.30@tcp:16:dd.0 Request processed in 4632us (5115us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508647.426562:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15056 00000100:00100000:3.0:1787508647.430473:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508647.430556:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509569792 00000100:00100000:0.0:1787508647.430575:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509569792 00000100:00100000:0.0:1787508647.430664:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15426 00000100:00100000:0.0:1787508647.430678:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:337904:x1874324509569792:12345-192.168.201.30@tcp:35:dd.0 00000001:00080000:0.0:1787508647.431105:0:202229:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884944122 00000100:00100000:0.0:1787508647.431249:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:337904:x1874324509569792:12345-192.168.201.30@tcp:35:dd.0 Request processed in 574us (787us total) trans 12884944123 rc 0/0 00000100:00100000:0.0:1787508647.431256:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15426 00000020:00080000:0.0:1787508647.431261:0:202229:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787508647.490071:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508647.540270:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508647.540453:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509569920 00000100:00100000:0.0:1787508647.540468:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509569920 00000100:00100000:0.0:1787508647.540557:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94022 00000100:00100000:0.0:1787508647.540570:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+584:337908:x1874324509569920:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1787508647.540598:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508647.540627:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34efa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae68d expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508647.540718:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34f01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508647.540738:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34f01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508647.540752:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34f01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508647.540815:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787508647.540819:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508647.540844:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34f01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508647.540888:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f34efa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae68d expref: 586 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508647.540913:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34f01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae68d expref: 585 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508647.540923:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508647.540927:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508647.540931:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7c00, rc 0) 00000100:00100000:0.0:1787508647.541146:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:337908:x1874324509569920:12345-192.168.201.30@tcp:101:dd.0 Request processed in 577us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508647.541158:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94022 00000100:00100000:1.0:1787508647.544671:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508647.544795:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509570176 00000100:00100000:2.0:1787508647.544809:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509570176 00000100:00100000:2.0:1787508647.544906:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94023 00000100:00100000:2.0:1787508647.544919:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:337908:x1874324509570176:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:2.0:1787508647.545104:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508647.545109:0:205405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787508647.545146:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34f01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae68d expref: 585 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.545172:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508647.545188:0:205405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508647.545280:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f34f08 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae694 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.545511:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f34f0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.545526:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f34f0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.545538:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f34f0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.545556:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34f16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.545563:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34f16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.545571:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34f16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.545643:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34f1d lrc: 3/1,0 mode: --/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.545652:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34f1d lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.545659:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34f1d lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508647.545671:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a3:0x555:0x0]: returning size 8192 00010000:00010000:2.0:1787508647.545781:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f34f0f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.545789:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f34f0f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.545796:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f34f0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.545802:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f34f0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.545808:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508647.545814:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f34f0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.545822:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f34f0f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.545833:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508647.545836:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508647.545839:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f34f0f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.545846:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f34f0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.545859:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34f16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.545870:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34f16 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.545886:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34f16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.545891:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508647.545894:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34f16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.545899:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34f16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.545906:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6bc7b3a7 (ffff9090d36fd400) 00010000:00010000:2.0:1787508647.545909:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508647.545912:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34f16 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.545917:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34f16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6bc7b3a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.546510:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f34f08 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae694 expref: 587 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.546533:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34f1d lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae694 expref: 586 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508647.546542:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x555:0x0].0x0 (ffff9090d36fd500) 00010000:00010000:2.0:1787508647.546544:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787508647.546548:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab600, rc 0) 00000100:00100000:2.0:1787508647.546689:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:337908:x1874324509570176:12345-192.168.201.30@tcp:101:dd.0 Request processed in 1770us (2032us total) trans 12884944124 rc 0/0 00000100:00100000:2.0:1787508647.546700:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94023 00000100:00100000:2.0:1787508647.565249:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508647.565361:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509570304 00000100:00100000:1.0:1787508647.565371:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509570304 00000100:00100000:1.0:1787508647.565436:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15057 00000100:00100000:1.0:1787508647.565445:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:337908:x1874324509570304:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:1.0:1787508647.565463:0:225831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508647.565481:0:225831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc63c4ae/0xb126349c40f34f2b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae69b expref: -99 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508647.565512:0:225831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004689354c/0xb126349c40f34ef3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae686 expref: 6 pid: 230130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508647.565521:0:225831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1589:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787508647.565526:0:225831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1589:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787508647.565531:0:225831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc63c4ae/0xb126349c40f34f2b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae69b expref: 7 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508647.565564:0:225831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004689354c/0xb126349c40f34ef3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae686 expref: 6 pid: 230130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508647.565578:0:225831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004689354c/0xb126349c40f34ef3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae686 expref: 6 pid: 230130 timeout: 13718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508647.565593:0:225831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:225831:1874324480155648:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508647.565668:0:225831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c9af3900 going to sleep for 11 seconds 00000100:00080000:2.0:1787508647.565774:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508647.574136:0:225831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:225831:1874324480155648:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508647.574181:0:225831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fc63c4ae/0xb126349c40f34f2b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae69b expref: 7 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508647.574203:0:225831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a200, rc 0) 00000100:00100000:1.0:1787508647.574267:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:337908:x1874324509570304:12345-192.168.201.30@tcp:101:dd.0 Request processed in 8822us (9027us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508647.574276:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15057 00000100:00100000:3.0:1787508648.125002:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787508648.125035:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480155776:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787508648.125119:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508648.125384:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787508648.125397:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480155904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787508648.125430:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508648.125628:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480155776 00000100:00100000:1.0:1787508648.125636:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480155776 00000100:00100000:1.0:1787508648.125697:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480155904 00000100:00100000:1.0:1787508648.125701:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480155904 00000100:00100000:1.0:1787508648.125721:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1651 00000100:00100000:1.0:1787508648.125729:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480155776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787508648.125749:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25428544 pending 0 free 3910828032 avail 3679305728 00000100:00100000:1.0:1787508648.125793:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480155776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508648.125800:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1651 00000100:00100000:1.0:1787508648.125815:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1652 00000100:00100000:1.0:1787508648.125821:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d38d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480155904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787508648.125830:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25428544 pending 0 free 3910828032 avail 3679305728 00000100:00100000:1.0:1787508648.125857:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d38d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480155904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508648.125874:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1652 00000100:00080000:0.0:1787508648.126013:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787508648.126062:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480155904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787508648.126634:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480155776:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787508648.507273:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508649.146406:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787508649.146431:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480156032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787508649.146512:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508649.146605:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787508649.146615:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d38da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480156160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787508649.146643:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508649.146695:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480156032 00000100:00100000:0.0:1787508649.146703:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480156032 00000100:00100000:0.0:1787508649.146755:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480156160 00000100:00100000:0.0:1787508649.146767:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480156160 00000100:00100000:0.0:1787508649.146789:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29816 00000100:00100000:0.0:1787508649.146798:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480156032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787508649.146831:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1442783232 avail 1296543744 00000100:00100000:0.0:1787508649.146895:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480156032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508649.146902:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29816 00000100:00100000:0.0:1787508649.146919:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29817 00000100:00100000:0.0:1787508649.146925:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480156160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787508649.146968:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1441771520 avail 1295532032 00000100:00100000:0.0:1787508649.147006:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480156160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508649.147013:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29817 00000100:00100000:3.0:1787508649.147504:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944114 gen 2 00000004:00080000:3.0:1787508649.147511:0:3619:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944114 committed transno 12884944114 00000100:00100000:3.0:1787508649.147542:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d38da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480156160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787508649.147586:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480156032:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787508649.531675:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508649.616548:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508649.619530:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509570432 00000100:00100000:2.0:1787508649.619547:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509570432 00000100:00100000:2.0:1787508649.619637:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94024 00000100:00100000:2.0:1787508649.619652:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:337913:x1874324509570432:12345-192.168.201.30@tcp:101:dd.0 00000100:00080000:0.0:1787508649.619671:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787508649.619678:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508649.619702:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34f32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae6a2 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508649.619773:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f34f39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508649.619787:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f34f39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508649.619799:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f34f39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508649.619857:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508649.619861:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508649.619882:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f34f39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508649.619925:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34f32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6a2 expref: 18 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508649.619982:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f34f39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6a2 expref: 17 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508649.619991:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508649.619994:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508649.619998:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aac00, rc 0) 00000100:00100000:2.0:1787508649.620064:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:337913:x1874324509570432:12345-192.168.201.30@tcp:101:dd.0 Request processed in 418us (3526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508649.620072:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94024 00000100:00100000:2.0:1787508649.632747:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508649.633001:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509570688 00000100:00100000:0.0:1787508649.633012:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509570688 00000100:00100000:0.0:1787508649.633146:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94025 00000100:00100000:0.0:1787508649.633157:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:337913:x1874324509570688:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1787508649.633178:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508649.633180:0:209004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787508649.633204:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f34f39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6a2 expref: 17 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508649.633239:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508649.633244:0:209004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508649.633258:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f34f40 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae6a9 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508649.633359:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34f47 lrc: 3/1,0 mode: --/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508649.633373:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34f47 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508649.633383:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34f47 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508649.633393:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a3:0x555:0x0]: returning size 8192 00010000:00010000:0.0:1787508649.633513:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f34f40 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6a9 expref: 19 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508649.633528:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34f47 lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6a9 expref: 18 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508649.633536:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x555:0x0].0x0 (ffff9090d36fd500) 00010000:00010000:0.0:1787508649.633538:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787508649.633541:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6200, rc 0) 00000100:00100000:0.0:1787508649.633622:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+18:337913:x1874324509570688:12345-192.168.201.30@tcp:101:dd.0 Request processed in 467us (883us total) trans 12884944125 rc 0/0 00000100:00100000:0.0:1787508649.633630:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94025 00000100:00100000:3.0:1787508649.637465:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508649.637594:0:225834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509570816 00000100:00100000:1.0:1787508649.637605:0:225834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509570816 00000100:00100000:1.0:1787508649.637676:0:225834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15058 00000100:00100000:1.0:1787508649.637687:0:225834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:337913:x1874324509570816:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:1.0:1787508649.637705:0:225834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508649.637721:0:225834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003209cef6/0xb126349c40f34f55 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae6b0 expref: -99 pid: 225834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508649.637761:0:225834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1589:0x0].0x0 since=2s v=(1 0) 00010000:00010000:1.0:1787508649.637769:0:225834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc63c4ae/0xb126349c40f34f2b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae69b expref: 6 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508649.637776:0:225834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1589:0x0].0x0 since=0s v=(1 1) 00010000:00010000:1.0:1787508649.637788:0:225834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003209cef6/0xb126349c40f34f55 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6b0 expref: 8 pid: 225834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508649.637825:0:225834:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fc63c4ae/0xb126349c40f34f2b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae69b expref: 6 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508649.637851:0:225834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003209cef6/0xb126349c40f34f55 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6b0 expref: 8 pid: 225834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508649.637864:0:225834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b000, rc 0) 00000100:00100000:1.0:1787508649.637923:0:225834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:337913:x1874324509570816:12345-192.168.201.30@tcp:101:dd.0 Request processed in 238us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508649.637931:0:225834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15058 00000100:00080000:0.0:1787508649.639678:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508649.642726:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508649.642909:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509570944 00000100:00100000:2.0:1787508649.642921:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509570944 00000100:00100000:2.0:1787508649.643032:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9798 00000100:00100000:2.0:1787508649.643043:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde3f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+18:2400:x1874324509570944:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508649.643057:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508649.643083:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f34f47 lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6a9 expref: 18 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508649.643101:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x555:0x0].0x0 (ffff9090d36fd500) 00010000:00010000:2.0:1787508649.643118:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508649.643186:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde3f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:2400:x1874324509570944:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 144us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508649.643193:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9798 00000100:00100000:1.0:1787508649.658407:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787508649.658528:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787508649.658549:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480156800:0@lo:400:kworker.0 00000100:00100000:3.0:1787508649.658620:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508649.658672:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480156800 00000100:00100000:3.0:1787508649.658679:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480156800 00000100:00100000:3.0:1787508649.658728:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2919 00000100:00100000:3.0:1787508649.658737:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480156800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508649.658809:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480156800:12345-0@lo:400:kworker.0 Request processed in 71us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508649.658817:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2919 00000100:00100000:3.0:1787508649.658893:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480156800:0@lo:400:kworker.0 00000100:00100000:0.0:1787508649.658975:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480156544:0@lo:400:kworker.0 00000100:00100000:0.0:1787508649.659009:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508649.659041:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787508649.659047:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c818f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480156672:0@lo:400:kworker.0 00000100:00100000:0.0:1787508649.659069:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508649.659096:0:203728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480156544 00000100:00100000:0.0:1787508649.659100:0:203728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480156544 00000100:00100000:0.0:1787508649.659127:0:203728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480156672 00000100:00100000:0.0:1787508649.659130:0:203728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480156672 00000100:00100000:0.0:1787508649.659163:0:203728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2313 00000100:00100000:0.0:1787508649.659169:0:203728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d38da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480156544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508649.659206:0:203728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d38da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480156544:12345-0@lo:400:kworker.0 Request processed in 38us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508649.659212:0:203728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2313 00000100:00100000:0.0:1787508649.659224:0:203728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2314 00000100:00100000:0.0:1787508649.659230:0:203728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d30f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480156672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508649.659256:0:203728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d30f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480156672:12345-0@lo:400:kworker.0 Request processed in 26us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508649.659262:0:203728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2314 00000100:00080000:0.0:1787508649.659281:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508649.659300:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c818f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480156672:0@lo:400:kworker.0 00000100:00100000:0.0:1787508649.659309:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480156544:0@lo:400:kworker.0 00000100:00100000:1.0:1787508649.661162:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c92cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480156416:0@lo:400:kworker.0 00000100:00100000:1.0:1787508649.661219:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508649.661335:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480156416 00000100:00100000:3.0:1787508649.661342:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480156416 00000100:00100000:3.0:1787508649.661397:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:3.0:1787508649.661407:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed92d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480156416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508649.661467:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed92d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480156416:12345-0@lo:400:kworker.0 Request processed in 61us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508649.661473:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00100000:1.0:1787508649.661652:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c92cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480156416:0@lo:400:kworker.0 00000100:00100000:3.0:1787508649.662036:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480156928:0@lo:400:kworker.0 00000100:00100000:3.0:1787508649.662070:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508649.662097:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d8783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480157440:0@lo:400:kworker.0 00000100:00100000:2.0:1787508649.662104:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480156928 00000100:00100000:2.0:1787508649.662108:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480156928 00000100:00100000:2.0:1787508649.662139:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2315 00000100:00100000:2.0:1787508649.662146:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480156928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508649.662183:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480156928:12345-0@lo:400:kworker.0 Request processed in 37us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508649.662190:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2315 00000100:00100000:3.0:1787508649.662198:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508649.662225:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480157440 00000100:00100000:3.0:1787508649.662228:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480156928:0@lo:400:kworker.0 00000100:00100000:2.0:1787508649.662228:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480157440 00000100:00100000:3.0:1787508649.662240:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787508649.662246:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d8780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480157312:0@lo:400:kworker.0 00000100:00100000:2.0:1787508649.662260:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2920 00000100:00100000:3.0:1787508649.662267:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508649.662267:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480157440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508649.662292:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480157312 00000100:00100000:3.0:1787508649.662295:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480157312 00000100:00100000:3.0:1787508649.662324:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2921 00000100:00100000:3.0:1787508649.662331:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480157312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508649.662392:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480157184:0@lo:400:kworker.0 00000100:00100000:3.0:1787508649.662972:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480157312:12345-0@lo:400:kworker.0 Request processed in 639us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508649.662980:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2921 00000100:00080000:3.0:1787508649.663022:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787508649.663026:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787508649.663052:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480157056:0@lo:400:kworker.0 00000100:00100000:3.0:1787508649.663083:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508649.663103:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d8781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480157568:0@lo:400:kworker.0 00000100:00100000:0.0:1787508649.663243:0:225833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480157056 00000100:00100000:0.0:1787508649.663249:0:225833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480157056 00000100:00100000:2.0:1787508649.663384:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480157440:12345-0@lo:400:kworker.0 Request processed in 1005us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508649.663392:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2920 00000100:00100000:1.0:1787508649.663552:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d8780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480157312:0@lo:400:kworker.0 00000100:00100000:1.0:1787508649.663564:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d8783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480157440:0@lo:400:kworker.0 00000100:00100000:3.0:1787508649.663612:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787508649.663683:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508649.663724:0:225833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2316 00000100:00100000:0.0:1787508649.663735:0:225833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480157056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508649.663793:0:225833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480157056:12345-0@lo:400:kworker.0 Request processed in 61us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508649.663817:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480157568 00000100:00100000:1.0:1787508649.663821:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480157568 00000100:00100000:1.0:1787508649.664005:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2922 00000100:00100000:1.0:1787508649.664013:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480157568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508649.664050:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480157568:12345-0@lo:400:kworker.0 Request processed in 39us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508649.664057:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2922 00000100:00080000:2.0:1787508649.664128:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508649.664151:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480157056:0@lo:400:kworker.0 00000100:00100000:2.0:1787508649.664161:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d8781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480157568:0@lo:400:kworker.0 00000100:00100000:0.0:1787508649.664246:0:225833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2316 00000100:00100000:0.0:1787508649.664272:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508649.664305:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480157696:0@lo:400:kworker.0 00000100:00100000:0.0:1787508649.664333:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508649.664507:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480157184 00000100:00100000:1.0:1787508649.664513:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480157184 00000100:00100000:1.0:1787508649.664549:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480157696 00000100:00100000:1.0:1787508649.664552:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480157696 00000100:00100000:1.0:1787508649.664587:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2923 00000100:00100000:1.0:1787508649.664594:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d30f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480157184:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787508649.664619:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787508649.664634:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d30f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480157184:12345-0@lo:400:kworker.0 Request processed in 40us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508649.664639:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2924 00000100:00100000:2.0:1787508649.664648:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d30f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480157696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508649.664682:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d30f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480157696:12345-0@lo:400:kworker.0 Request processed in 36us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508649.664689:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480157184:0@lo:400:kworker.0 00000100:00100000:0.0:1787508649.664744:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480157696:0@lo:400:kworker.0 00000100:00100000:1.0:1787508649.664807:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2923 00000100:00100000:2.0:1787508649.665118:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2924 00010000:00010000:0.0:1787508650.554488:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508651.112259:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508651.112307:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508651.112348:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508651.112380:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508651.112402:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509571584 00000100:00100000:1.0:1787508651.112408:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508651.112422:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509571584 00000100:00100000:1.0:1787508651.112431:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508651.112457:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508651.112481:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508651.112484:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509572096 00000100:00100000:0.0:1787508651.112488:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509572096 00000100:00100000:0.0:1787508651.112513:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509571456 00000100:00100000:0.0:1787508651.112517:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509571456 00000100:00100000:1.0:1787508651.112518:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508651.112541:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509571968 00000100:00100000:0.0:1787508651.112545:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509571968 00000100:00100000:1.0:1787508651.112554:0:208928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2317 00000100:00100000:2.0:1787508651.112617:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509571072 00000100:00100000:2.0:1787508651.112623:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509571072 00000100:00100000:2.0:1787508651.112657:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 992 00000100:00100000:2.0:1787508651.112665:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed92e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509571072:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508651.112732:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed92e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509571072:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 68us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508651.112739:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 992 00000100:00080000:2.0:1787508651.112771:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787508651.112774:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508651.113088:0:208928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d8781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2403:x1874324509571584:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508651.113131:0:208928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d8781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2403:x1874324509571584:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 567us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508651.113360:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509571328 00000100:00100000:3.0:1787508651.113375:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509571328 00000100:00100000:3.0:1787508651.113484:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509571840 00000100:00100000:3.0:1787508651.113489:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509571840 00000100:00100000:3.0:1787508651.113515:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509571200 00000100:00100000:3.0:1787508651.113518:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509571200 00000100:00100000:3.0:1787508651.113534:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509571712 00000100:00100000:3.0:1787508651.113537:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509571712 00000100:00100000:3.0:1787508651.113550:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2925 00000100:00100000:3.0:1787508651.113557:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2403:x1874324509571328:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508651.113691:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2403:x1874324509571328:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 134us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508651.113698:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2925 00000100:00100000:3.0:1787508651.113717:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2926 00000100:00100000:3.0:1787508651.113733:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d8783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509571840:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508651.113759:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d8783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509571840:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 36us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508651.113765:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2926 00000100:00100000:3.0:1787508651.113778:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2927 00000100:00100000:3.0:1787508651.113784:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c92cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:2403:x1874324509571200:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508651.113809:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c92cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:2403:x1874324509571200:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508651.113831:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2927 00000100:00100000:3.0:1787508651.113843:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2928 00000100:00100000:3.0:1787508651.113850:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4857b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:2403:x1874324509571712:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508651.113874:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4857b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:2403:x1874324509571712:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508651.113880:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2928 00000100:00100000:0.0:1787508651.117627:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2318 00000100:00100000:0.0:1787508651.117651:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d8780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2403:x1874324509572096:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508651.117857:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d8780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2403:x1874324509572096:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 216us (5448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508651.117866:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2318 00000100:00100000:0.0:1787508651.117888:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2319 00000100:00100000:0.0:1787508651.117896:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4856a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509571456:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508651.117925:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4856a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509571456:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 31us (5467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508651.117932:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2319 00000100:00100000:0.0:1787508651.117962:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2320 00000100:00100000:0.0:1787508651.117969:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4854000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2403:x1874324509571968:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508651.117993:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4854000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2403:x1874324509571968:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (5477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508651.118000:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2320 00000100:00080000:0.0:1787508651.118521:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787508651.118527:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787508651.127367:0:208928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2317 00010000:00010000:1.0:1787508651.578183:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508651.706512:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787508651.706534:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d4857100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480157824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787508651.706619:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508651.706705:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480157824 00000100:00100000:1.0:1787508651.706713:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480157824 00000100:00100000:1.0:1787508651.706774:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1653 00000100:00100000:1.0:1787508651.706782:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480157824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787508651.706820:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84259392 pending 0 free 3884048384 avail 3652526080 00000100:00100000:1.0:1787508651.706876:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480157824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508651.706884:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1653 00000100:00100000:1.0:1787508651.706931:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480157952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787508651.706979:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508651.707158:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d4857100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480157824:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787508651.707306:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787508651.707748:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480157952 00000100:00100000:2.0:1787508651.707755:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480157952 00000100:00100000:2.0:1787508651.707854:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1654 00000100:00100000:2.0:1787508651.707862:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4854700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480157952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787508651.707876:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 84259392 pending 0 free 3884048384 avail 3652526080 00000100:00100000:2.0:1787508651.707936:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4854700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480157952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508651.707970:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1654 00000100:00100000:3.0:1787508651.708135:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480157952:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787508651.708193:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508652.591935:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508652.592167:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509572224 00000100:00100000:3.0:1787508652.592177:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509572224 00010000:00010000:3.0:1787508652.592224:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004689354c/0xb126349c40f34ef3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae686 expref: 8 pid: 230130 timeout: 13718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508652.592276:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27913 00000100:00100000:3.0:1787508652.592287:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4857100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2402:x1874324509572224:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508652.592301:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787508652.592319:0:229383:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1589:0x0] updating lvb size from disk: 0 -> 8192 00002000:00010000:3.0:1787508652.592322:0:229383:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1589:0x0] updating lvb mtime from disk: 0 -> 1787508648 00002000:00010000:3.0:1787508652.592325:0:229383:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1589:0x0] updating lvb ctime from disk: 0 -> 1787508648 00002000:00010000:3.0:1787508652.592327:0:229383:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1589:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:3.0:1787508652.592334:0:229383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 5s ns: filter-lustre-OST0001_UUID lock: 000000004689354c/0xb126349c40f34ef3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae686 expref: 8 pid: 230130 timeout: 13718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508652.592351:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004689354c/0xb126349c40f34ef3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae686 expref: 8 pid: 230130 timeout: 13718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508652.592377:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004689354c/0xb126349c40f34ef3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae686 expref: 8 pid: 230130 timeout: 13718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508652.592404:0:229383:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1589:0x0].0x0 since=3s v=(2 1) 00010000:00010000:3.0:1787508652.592409:0:229383:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1589:0x0].0x0 since=0s v=(2 1) 00010000:00010000:3.0:1787508652.592417:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc63c4ae/0xb126349c40f34f2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60080000020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae69b expref: 6 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508652.592427:0:229383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc63c4ae/0xb126349c40f34f2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60080000020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae69b expref: 6 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508652.592469:0:229383:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fc63c4ae/0xb126349c40f34f2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae69b expref: 6 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508652.592482:0:229383:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fc63c4ae/0xb126349c40f34f2b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000000020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae69b expref: 6 pid: 225831 timeout: 13723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508652.592501:0:229383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a98a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:229383:1874324480158080:192.168.201.30@tcp:105: 00000100:00100000:3.0:1787508652.592591:0:229383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9e8df00 going to sleep for 11 seconds 00010000:00010000:3.0:1787508652.598160:0:229383:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.30@tcp) returned -22 from completion AST (req@000000001e3cf085 x1874324480158080) - normal race ns: filter-lustre-OST0001_UUID lock: 00000000fc63c4ae/0xb126349c40f34f2b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae69b expref: 6 pid: 225831 timeout: 13723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508652.598205:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fc63c4ae/0xb126349c40f34f2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae69b expref: 6 pid: 225831 timeout: 13723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508652.598228:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc63c4ae/0xb126349c40f34f2b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae69b expref: 6 pid: 225831 timeout: 13723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508652.598242:0:229383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a98a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:229383:1874324480158080:192.168.201.30@tcp:105: 00010000:00010000:3.0:1787508652.598265:0:229383:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1589:0x0].0x0 since=0s v=(2 1) 00010000:00010000:3.0:1787508652.598269:0:229383:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1589:0x0].0x0 since=0s v=(2 1) 00010000:00010000:3.0:1787508652.598276:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003209cef6/0xb126349c40f34f55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6b0 expref: 7 pid: 225834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508652.598286:0:229383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003209cef6/0xb126349c40f34f55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6b0 expref: 7 pid: 225834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508652.598328:0:229383:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003209cef6/0xb126349c40f34f55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6b0 expref: 7 pid: 225834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508652.598350:0:229383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a98a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:229383:1874324480158208:192.168.201.30@tcp:105: 00000100:00100000:3.0:1787508652.598440:0:229383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9e8df00 going to sleep for 11 seconds 00010000:00010000:3.0:1787508652.623178:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508652.630609:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508652.631145:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509572352 00000100:00100000:2.0:1787508652.631157:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509572352 00000100:00100000:2.0:1787508652.631227:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94026 00000100:00100000:2.0:1787508652.631237:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:337913:x1874324509572352:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:2.0:1787508652.631256:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508652.631278:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f34f5c lrc: 2/0,0 mode: --/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae6b7 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508652.631312:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34f63 lrc: 3/1,0 mode: --/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508652.631326:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34f63 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508652.631337:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34f63 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508652.631471:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f34f5c lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6b7 expref: 19 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508652.631489:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34f63 lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6b7 expref: 18 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508652.631497:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x555:0x0].0x0 (ffff9090d36fd500) 00010000:00010000:2.0:1787508652.631500:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787508652.631504:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abc00, rc 0) 00000100:00100000:2.0:1787508652.631570:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+18:337913:x1874324509572352:12345-192.168.201.30@tcp:101:dd.0 Request processed in 334us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508652.631577:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94026 00000100:00100000:3.0:1787508652.642317:0:229383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a98a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:229383:1874324480158208:192.168.201.30@tcp:105: 00010000:00010000:3.0:1787508652.642346:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508652.643533:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508652.644768:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509572608 00000100:00100000:3.0:1787508652.644779:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509572608 00000100:00100000:3.0:1787508652.644859:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15427 00000100:00100000:3.0:1787508652.644878:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+18:337913:x1874324509572608:12345-192.168.201.30@tcp:35:dd.0 00000001:00080000:3.0:1787508652.645357:0:202230:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884944126 00000100:00100000:3.0:1787508652.645497:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+20:337913:x1874324509572608:12345-192.168.201.30@tcp:35:dd.0 Request processed in 620us (1968us total) trans 12884944127 rc 0/0 00000100:00100000:3.0:1787508652.645506:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15427 00000020:00080000:3.0:1787508652.645510:0:202230:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787508652.656938:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4857100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2402:x1874324509572224:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 64638us (64997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508652.656968:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27913 00000100:00100000:2.0:1787508652.668897:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508652.668985:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508652.672133:0:225843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509572864 00000100:00100000:3.0:1787508652.672148:0:225843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509572864 00000100:00100000:3.0:1787508652.672292:0:225843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15059 00000100:00100000:3.0:1787508652.672303:0:225843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2402:x1874324509572864:12345-192.168.201.30@tcp:16:kworker.0 00000100:00100000:3.0:1787508652.672416:0:225843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2402:x1874324509572864:12345-192.168.201.30@tcp:16:kworker.0 Request processed in 114us (3529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508652.672424:0:225843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15059 00000100:00100000:1.0:1787508652.679910:0:205407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509572736 00000100:00100000:1.0:1787508652.679925:0:205407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509572736 00002000:00100000:1.0:1787508652.679999:0:205407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1589:0x0] (8192->12287) req@ffff9090d1cbc000 x1874324509572736/t0(0) o4->eb35f31c-097f-45a3-8275-bc75f97f89ee@192.168.201.30@tcp:108/0 lens 4584/0 e 0 to 0 dl 1787508663 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787508652.680010:0:205407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090d1cbc000 with x1874324509572736 ext(8192->12287) 00002000:00010000:1.0:1787508652.680016:0:205407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9090d1cbc000 00000100:00100000:1.0:1787508652.680047:0:205407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:1.0:1787508652.680058:0:205407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2402:x1874324509572736:12345-192.168.201.30@tcp:4:dd.0 00000100:00100000:1.0:1787508652.681061:0:205407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2402:x1874324509572736:12345-192.168.201.30@tcp:4:dd.0 Request processed in 999us (12070us total) trans 8589940553 rc 0/0 00000100:00100000:1.0:1787508652.681071:0:205407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 35 00002000:00100000:1.0:1787508652.681080:0:205407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1589:0x0] (8192->12287) req@ffff9090d1cbc000 x1874324509572736/t8589940553(0) o4->eb35f31c-097f-45a3-8275-bc75f97f89ee@192.168.201.30@tcp:108/0 lens 4584/448 e 0 to 0 dl 1787508663 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787508652.681088:0:205407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090d1cbc000 with x1874324509572736 ext(8192->12287) 00002000:00010000:1.0:1787508652.681093:0:205407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9090d1cbc000 00000001:00080000:2.0:1787508652.694032:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944127 is committed 00000001:00080000:2.0:1787508652.694053:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944124 is committed 00000001:00100000:2.0:1787508652.741760:0:203722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of eb35f31c-097f-45a3-8275-bc75f97f89ee 00000100:00100000:3.0:1787508653.244426:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480158336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787508653.244512:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508653.244810:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480158336 00000100:00100000:0.0:1787508653.244819:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480158336 00000100:00100000:0.0:1787508653.244886:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1655 00000100:00100000:0.0:1787508653.244907:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f2ad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480158336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787508653.244968:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25428544 pending 0 free 3910828032 avail 3679305728 00000100:00100000:0.0:1787508653.245033:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f2ad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480158336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508653.245041:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1655 00000100:00100000:0.0:1787508653.245316:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480158336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787508653.246968:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480158464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787508653.247038:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508653.247411:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480158464 00000100:00100000:2.0:1787508653.247418:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480158464 00000100:00100000:2.0:1787508653.247477:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1656 00000100:00100000:2.0:1787508653.247487:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480158464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787508653.247510:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25428544 pending 0 free 3910828032 avail 3679305728 00000100:00100000:2.0:1787508653.247558:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480158464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508653.247565:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1656 00000100:00100000:1.0:1787508653.247734:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480158464:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787508653.248109:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787508653.627564:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508654.266981:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480158592:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787508654.267057:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508654.267212:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480158592 00000100:00100000:0.0:1787508654.267226:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480158592 00000100:00100000:0.0:1787508654.267283:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29818 00000100:00100000:0.0:1787508654.267294:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480158592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787508654.267327:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1441771520 avail 1295532032 00000100:00100000:0.0:1787508654.267815:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480158592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 522us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508654.267823:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29818 00000100:00100000:0.0:1787508654.267862:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480158720:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787508654.267892:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508654.267979:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480158720 00000100:00100000:3.0:1787508654.267985:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480158720 00000100:00100000:3.0:1787508654.268021:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29819 00000100:00100000:3.0:1787508654.268029:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480158720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787508654.268049:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1442783232 avail 1296543744 00000100:00100000:3.0:1787508654.268090:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480158720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508654.268096:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29819 00000100:00100000:3.0:1787508654.268139:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480158720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787508654.268403:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480158592:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787508654.651859:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508654.778284:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787508654.778308:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480159104:0@lo:400:kworker.0 00000100:00100000:2.0:1787508654.778384:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508654.778452:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480159232:0@lo:400:kworker.0 00000100:00100000:2.0:1787508654.778480:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508654.778529:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787508654.778535:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874324480159616:0@lo:400:kworker.0 00000100:00100000:2.0:1787508654.778559:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508654.778595:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480159744:0@lo:400:kworker.0 00000100:00100000:2.0:1787508654.778618:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508654.778672:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787508654.778679:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874324480160128:0@lo:400:kworker.0 00000100:00100000:2.0:1787508654.778720:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508654.778881:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480159232 00000100:00100000:3.0:1787508654.778889:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480159232 00000100:00100000:0.0:1787508654.778903:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480159616 00000100:00100000:0.0:1787508654.778909:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480159616 00000100:00100000:3.0:1787508654.778937:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480159744 00000100:00100000:3.0:1787508654.778965:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480159744 00000100:00100000:0.0:1787508654.778965:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480160128 00000100:00100000:0.0:1787508654.778972:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480160128 00000100:00100000:1.0:1787508654.779074:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480158976:0@lo:400:kworker.0 00000100:00100000:1.0:1787508654.779105:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508654.779127:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480159488:0@lo:400:kworker.0 00000100:00100000:1.0:1787508654.779148:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508654.779164:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480160000:0@lo:400:kworker.0 00000100:00100000:1.0:1787508654.779182:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508654.783129:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787508654.783149:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79de3f65-4bad-42d0-a46f-842a654b33a0:3617:1874324480158848:0@lo:400:kworker.0 00000100:00100000:1.0:1787508654.783221:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508654.783268:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480159360:0@lo:400:kworker.0 00000100:00100000:1.0:1787508654.783306:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508654.783328:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874324480159872:0@lo:400:kworker.0 00000100:00100000:1.0:1787508654.783357:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508654.791977:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2929 00000100:00100000:0.0:1787508654.792004:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480159232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508654.792081:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2930 00000100:00100000:2.0:1787508654.792095:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874324480159616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508654.792128:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480159232:12345-0@lo:400:kworker.0 Request processed in 137us (13645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508654.792137:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2929 00000100:00100000:2.0:1787508654.792148:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874324480159616:12345-0@lo:400:kworker.0 Request processed in 56us (13587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508654.792156:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2930 00000100:00100000:0.0:1787508654.792166:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2931 00000100:00100000:0.0:1787508654.792177:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480159744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508654.792182:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2932 00000100:00100000:2.0:1787508654.792193:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874324480160128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508654.792220:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480159744:12345-0@lo:400:kworker.0 Request processed in 45us (13599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508654.792228:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2931 00000100:00100000:2.0:1787508654.792250:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874324480160128:12345-0@lo:400:kworker.0 Request processed in 60us (13529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508654.792257:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2932 00000100:00100000:2.0:1787508654.792318:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874324480160128:0@lo:400:kworker.0 00000100:00100000:2.0:1787508654.792338:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480159744:0@lo:400:kworker.0 00000100:00100000:2.0:1787508654.792355:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874324480159616:0@lo:400:kworker.0 00000100:00100000:2.0:1787508654.792368:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480159232:0@lo:400:kworker.0 00000100:00100000:0.0:1787508654.792422:0:203728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480159104 00000100:00100000:0.0:1787508654.792429:0:203728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480159104 00000100:00080000:2.0:1787508654.792431:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787508654.792438:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787508654.792481:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508654.792583:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480158848 00000100:00100000:1.0:1787508654.792588:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480158848 00000100:00100000:1.0:1787508654.792620:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:1.0:1787508654.792628:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed92c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3617:x1874324480158848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508654.792663:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed92c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3617:x1874324480158848:12345-0@lo:400:kworker.0 Request processed in 36us (9442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508654.792670:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00100000:0.0:1787508654.792841:0:203728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480158976 00000100:00100000:0.0:1787508654.792846:0:203728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480158976 00000100:00100000:3.0:1787508654.793773:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480160000 00000100:00100000:3.0:1787508654.793782:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480160000 00000100:00100000:2.0:1787508654.795147:0:225834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480159488 00000100:00100000:2.0:1787508654.795159:0:225834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480159488 00000100:00100000:2.0:1787508654.795212:0:225834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480159360 00000100:00100000:2.0:1787508654.795215:0:225834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480159360 00000100:00100000:3.0:1787508654.796390:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480159872 00000100:00100000:3.0:1787508654.796399:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480159872 00000100:00100000:3.0:1787508654.796438:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2933 00000100:00100000:3.0:1787508654.796449:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480160000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508654.796559:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480160000:12345-0@lo:400:kworker.0 Request processed in 112us (17375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508654.796566:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2933 00000100:00100000:3.0:1787508654.796590:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2934 00000100:00100000:3.0:1787508654.796597:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874324480159872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508654.796626:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874324480159872:12345-0@lo:400:kworker.0 Request processed in 31us (13268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508654.796632:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2934 00000100:00100000:2.0:1787508654.797227:0:225834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2321 00000100:00100000:2.0:1787508654.797250:0:225834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480159104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508654.797309:0:225834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480159104:12345-0@lo:400:kworker.0 Request processed in 74us (18925us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508654.797314:0:225834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2321 00000100:00100000:2.0:1787508654.797329:0:225834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2322 00000100:00100000:2.0:1787508654.797336:0:225834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4856300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480158976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508654.797365:0:225834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4856300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480158976:12345-0@lo:400:kworker.0 Request processed in 31us (18259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508654.797370:0:225834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2322 00000100:00100000:2.0:1787508654.797381:0:225834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2323 00000100:00100000:2.0:1787508654.797388:0:225834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480159488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508654.797416:0:225834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480159488:12345-0@lo:400:kworker.0 Request processed in 29us (18267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508654.797425:0:225834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2323 00000100:00100000:2.0:1787508654.797437:0:225834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2324 00000100:00100000:2.0:1787508654.797444:0:225834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480159360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508654.797471:0:225834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480159360:12345-0@lo:400:kworker.0 Request processed in 28us (14164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508654.797476:0:225834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2324 00000100:00080000:3.0:1787508654.810784:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787508654.810797:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787508654.810801:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787508654.810978:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480159104:0@lo:400:kworker.0 00000100:00100000:1.0:1787508654.819105:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874324480159872:0@lo:400:kworker.0 00000100:00100000:1.0:1787508654.819129:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480158976:0@lo:400:kworker.0 00000100:00100000:1.0:1787508654.819144:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480159488:0@lo:400:kworker.0 00000100:00100000:1.0:1787508654.819155:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480160000:0@lo:400:kworker.0 00000100:00100000:1.0:1787508654.819195:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79de3f65-4bad-42d0-a46f-842a654b33a0:3617:1874324480158848:0@lo:400:kworker.0 00000100:00100000:1.0:1787508654.819207:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480159360:0@lo:400:kworker.0 00000100:00100000:0.0:1787508655.667032:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508655.667235:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509573120 00000100:00100000:3.0:1787508655.667244:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509573120 00000100:00100000:3.0:1787508655.667349:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15428 00000100:00100000:3.0:1787508655.667362:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+585:337908:x1874324509573120:12345-192.168.201.30@tcp:35:dd.0 00000100:00100000:3.0:1787508655.667604:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:337908:x1874324509573120:12345-192.168.201.30@tcp:35:dd.0 Request processed in 245us (597us total) trans 12884944128 rc 0/0 00000100:00100000:3.0:1787508655.667613:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15428 00000100:00080000:2.0:1787508655.668628:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787508655.674476:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508655.693078:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508655.693310:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509573248 00000100:00100000:2.0:1787508655.693321:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509573248 00000100:00100000:2.0:1787508655.693387:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94027 00000100:00100000:2.0:1787508655.693396:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+586:337915:x1874324509573248:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:2.0:1787508655.693419:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508655.693439:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f34f6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae6be expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508655.693801:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34f71 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508655.693817:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34f71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508655.693829:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34f71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508655.693874:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508655.693878:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508655.693898:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34f71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508655.693925:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f34f6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6be expref: 588 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508655.694250:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34f71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6be expref: 587 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508655.694271:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508655.694274:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508655.694278:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab200, rc 0) 00000100:00100000:2.0:1787508655.694593:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+587:337915:x1874324509573248:12345-192.168.201.30@tcp:101:dd.0 Request processed in 941us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508655.694602:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94027 00000100:00100000:1.0:1787508655.711193:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508655.711569:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509573504 00000100:00100000:0.0:1787508655.711581:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509573504 00000100:00100000:0.0:1787508655.711660:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94028 00000100:00100000:0.0:1787508655.711671:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+587:337915:x1874324509573504:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1787508655.711696:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508655.711699:0:202226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787508655.711728:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34f71 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6be expref: 587 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508655.711760:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508655.711766:0:202226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508655.711785:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34f78 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae6c5 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508655.711908:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34f7f lrc: 3/0,1 mode: --/CW res: [0x2000013a3:0x555:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508655.711923:0:202226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34ee5 lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae67f expref: 14 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508655.711932:0:202226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34f1d lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae694 expref: 587 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508655.712002:0:202226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34f7f lrc: 5/0,1 mode: --/CW res: [0x2000013a3:0x555:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508655.712161:0:202226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34f1d lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae694 expref: 587 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508655.712177:0:202226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34f1d lrc: 4/0,0 mode: PR/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae694 expref: 587 pid: 205405 timeout: 13726 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508655.712193:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480160256:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508655.712699:0:202226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34ee5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae67f expref: 14 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508655.712711:0:202226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34ee5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae67f expref: 14 pid: 202228 timeout: 13726 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508655.712722:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d8780700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480160384:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508655.712760:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1c88240 going to sleep for 11 seconds 00000100:00100000:2.0:1787508655.721678:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480160256:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508655.721695:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d8780700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480160384:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508655.721724:0:202226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34f7f lrc: 3/0,1 mode: --/CW res: [0x2000013a3:0x555:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508655.725331:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508655.727932:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509573632 00000100:00100000:3.0:1787508655.727984:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509573632 00010000:00010000:3.0:1787508655.728046:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34f1d lrc: 4/0,0 mode: PR/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae694 expref: 588 pid: 205405 timeout: 13726 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508655.728092:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27914 00000100:00100000:3.0:1787508655.728101:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4855500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+588:2401:x1874324509573632:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508655.728116:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508655.728122:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34f1d lrc: 4/0,0 mode: PR/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae694 expref: 588 pid: 205405 timeout: 13726 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508655.728137:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34f1d lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae694 expref: 588 pid: 205405 timeout: 13726 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508655.728165:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34f1d lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae694 expref: 588 pid: 205405 timeout: 13726 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508655.728183:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x555:0x0].0x0 (ffff9090d36fd500) 00010000:00010000:3.0:1787508655.728188:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34f7f lrc: 3/0,1 mode: --/CW res: [0x2000013a3:0x555:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508655.728197:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34f7f lrc: 3/0,1 mode: --/CW res: [0x2000013a3:0x555:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508655.728204:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508655.728278:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4855500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+587:2401:x1874324509573632:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 170us (2949us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508655.728292:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27914 00000100:00100000:0.0:1787508655.736861:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508655.736975:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509573760 00000100:00100000:2.0:1787508655.736986:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509573760 00010000:00010000:2.0:1787508655.737063:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34ee5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae67f expref: 15 pid: 202228 timeout: 13726 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508655.737109:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27915 00000100:00100000:2.0:1787508655.737120:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d8783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2401:x1874324509573760:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508655.737138:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508655.737146:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34ee5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae67f expref: 15 pid: 202228 timeout: 13726 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508655.737160:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34ee5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae67f expref: 15 pid: 202228 timeout: 13726 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508655.737185:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f34ee5 lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae67f expref: 15 pid: 202228 timeout: 13726 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508655.737205:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x555:0x0].0x0 (ffff9090d36fd500) 00010000:00010000:2.0:1787508655.737210:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34f7f lrc: 3/0,1 mode: --/CW res: [0x2000013a3:0x555:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508655.737220:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34f7f lrc: 3/0,1 mode: CW/CW res: [0x2000013a3:0x555:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508655.737228:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34f7f lrc: 4/0,1 mode: CW/CW res: [0x2000013a3:0x555:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508655.737274:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508655.737330:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d8783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2401:x1874324509573760:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 211us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508655.737349:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27915 00010000:00010000:1.0:1787508655.737579:0:202226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34f7f lrc: 3/0,1 mode: CW/CW res: [0x2000013a3:0x555:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508655.737588:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34f7f lrc: 3/0,1 mode: CW/CW res: [0x2000013a3:0x555:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508655.737608:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a3:0x555:0x0]: returning size 12288 00010000:00010000:1.0:1787508655.737756:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f34f78 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6c5 expref: 588 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508655.737774:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34f7f lrc: 3/0,0 mode: CW/CW res: [0x2000013a3:0x555:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6c5 expref: 587 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508655.737782:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x555:0x0].0x0 (ffff9090d36fd500) 00010000:00010000:1.0:1787508655.737785:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787508655.737788:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6800, rc 0) 00000100:00100000:1.0:1787508655.737815:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+587:337915:x1874324509573504:12345-192.168.201.30@tcp:101:dd.0 Request processed in 26146us (26632us total) trans 12884944129 rc 0/0 00000100:00100000:1.0:1787508655.737823:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94028 00000100:00080000:3.0:1787508655.738277:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787508655.739999:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508655.748031:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509573888 00000100:00100000:3.0:1787508655.748047:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509573888 00000100:00100000:2.0:1787508655.748728:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94029 00000100:00100000:2.0:1787508655.748751:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+587:337915:x1874324509573888:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:2.0:1787508655.748776:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508655.748799:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f34f8d lrc: 2/0,0 mode: --/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae6cc expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508655.748843:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34f94 lrc: 3/1,0 mode: --/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508655.748859:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34f94 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508655.748869:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34f94 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508655.749027:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f34f8d lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6cc expref: 589 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508655.749048:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34f94 lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6cc expref: 588 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508655.749058:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x555:0x0].0x0 (ffff9090d36fd500) 00010000:00010000:2.0:1787508655.749061:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787508655.749065:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab600, rc 0) 00000100:00100000:2.0:1787508655.749185:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+588:337915:x1874324509573888:12345-192.168.201.30@tcp:101:dd.0 Request processed in 436us (9194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508655.749193:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94029 00000100:00100000:1.0:1787508655.754265:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508655.754563:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509574144 00000100:00100000:0.0:1787508655.754574:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509574144 00000100:00100000:0.0:1787508655.754642:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94030 00000100:00100000:0.0:1787508655.754653:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+588:337915:x1874324509574144:12345-192.168.201.30@tcp:36:dd.0 00010000:00010000:0.0:1787508655.754910:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34f9b lrc: 3/0,1 mode: --/PW res: [0x2000013a3:0x555:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508655.754928:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34f9b lrc: 3/0,1 mode: PW/PW res: [0x2000013a3:0x555:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508655.754980:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34f9b lrc: 3/0,1 mode: PW/PW res: [0x2000013a3:0x555:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787508655.755232:0:202227:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884944130 00000004:00010000:0.0:1787508655.755262:0:202227:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005ea752f reply state 00000000c2f4374f transno 12884944131 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34f9b lrc: 3/0,1 mode: PW/PW res: [0x2000013a3:0x555:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508655.755668:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34f9b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a3:0x555:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508655.755677:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x555:0x0].0x0 (ffff9090d36fd500) 00010000:00010000:0.0:1787508655.755680:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787508655.755684:0:202227:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787508655.755800:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+591:337915:x1874324509574144:12345-192.168.201.30@tcp:36:dd.0 Request processed in 1146us (1543us total) trans 12884944131 rc 0/0 00000100:00100000:0.0:1787508655.755808:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94030 00000020:00080000:0.0:1787508655.755813:0:202227:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787508655.763668:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508655.763975:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509574272 00000100:00100000:2.0:1787508655.763985:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509574272 00000100:00100000:2.0:1787508655.764061:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94031 00000100:00100000:2.0:1787508655.764072:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d8780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+591:337915:x1874324509574272:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:2.0:1787508655.764097:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508655.764118:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f34fa2 lrc: 2/0,0 mode: --/CR res: [0x2000013a3:0x555:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae6d3 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508655.764181:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f34fa2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a3:0x555:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6d3 expref: 592 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508655.764198:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f34fa2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a3:0x555:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6d3 expref: 592 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508655.764218:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x555:0x0].0x0 (ffff9090d36fd500) 00010000:00010000:2.0:1787508655.764221:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787508655.764225:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab400, rc 0) 00000100:00100000:2.0:1787508655.764303:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d8780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+592:337915:x1874324509574272:12345-192.168.201.30@tcp:101:dd.0 Request processed in 232us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508655.764311:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94031 00000100:00100000:1.0:1787508655.767724:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508655.767985:0:203996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509574400 00000100:00100000:3.0:1787508655.767996:0:203996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509574400 00000100:00100000:3.0:1787508655.768078:0:203996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15060 00000100:00100000:3.0:1787508655.768089:0:203996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:337915:x1874324509574400:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:3.0:1787508655.768107:0:203996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508655.768126:0:203996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004689354c/0xb126349c40f34fa9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae6da expref: -99 pid: 203996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508655.768157:0:203996:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003209cef6/0xb126349c40f34f55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6b0 expref: 8 pid: 225834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508655.768170:0:203996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1589:0x0].0x0 since=3s v=(2 1) 00010000:00010000:3.0:1787508655.768175:0:203996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1589:0x0].0x0 since=0s v=(1 2) 00010000:00010000:3.0:1787508655.768181:0:203996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004689354c/0xb126349c40f34fa9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6da expref: 7 pid: 203996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508655.768213:0:203996:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003209cef6/0xb126349c40f34f55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6b0 expref: 8 pid: 225834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508655.768228:0:203996:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003209cef6/0xb126349c40f34f55 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6b0 expref: 8 pid: 225834 timeout: 13726 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508655.768242:0:203996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:203996:1874324480160512:192.168.201.30@tcp:104: 00000100:00080000:2.0:1787508655.768542:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508655.768768:0:203996:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d9e8d480 going to sleep for 11 seconds 00000100:00100000:3.0:1787508655.781248:0:203996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a99180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:203996:1874324480160512:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508655.781312:0:203996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004689354c/0xb126349c40f34fa9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6da expref: 7 pid: 203996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508655.781343:0:203996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f000, rc 0) 00000100:00100000:3.0:1787508655.781413:0:203996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:337915:x1874324509574400:12345-192.168.201.30@tcp:101:dd.0 Request processed in 13325us (13698us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508655.781423:0:203996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15060 00000100:00100000:1.0:1787508655.789929:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508655.790170:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509574528 00000100:00100000:2.0:1787508655.790180:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509574528 00010000:00010000:2.0:1787508655.790240:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003209cef6/0xb126349c40f34f55 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6b0 expref: 9 pid: 225834 timeout: 13726 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508655.790288:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27916 00000100:00100000:2.0:1787508655.790298:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2400:x1874324509574528:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508655.790313:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508655.790319:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003209cef6/0xb126349c40f34f55 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6b0 expref: 9 pid: 225834 timeout: 13726 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787508655.790422:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787508655.790490:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003209cef6/0xb126349c40f34f55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6b0 expref: 9 pid: 225834 timeout: 13726 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508655.790516:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003209cef6/0xb126349c40f34f55 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6b0 expref: 9 pid: 225834 timeout: 13726 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508655.790533:0:202212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1589:0x0].0x0 since=0s v=(1 2) 00010000:00010000:2.0:1787508655.790537:0:202212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1589:0x0].0x0 since=0s v=(1 2) 00010000:00010000:2.0:1787508655.790544:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004689354c/0xb126349c40f34fa9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6da expref: 6 pid: 203996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508655.790554:0:202212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004689354c/0xb126349c40f34fa9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6da expref: 6 pid: 203996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508655.790592:0:202212:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004689354c/0xb126349c40f34fa9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6da expref: 6 pid: 203996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508655.790608:0:202212:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9680a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:202212:1874324480160640:192.168.201.30@tcp:105: 00000100:00100000:2.0:1787508655.790759:0:202212:0:(client.c:2715:ptlrpc_set_wait()) set ffff9091fd9753c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787508655.795100:0:202212:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9680a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:202212:1874324480160640:192.168.201.30@tcp:105: 00010000:00010000:2.0:1787508655.795127:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508655.795186:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2400:x1874324509574528:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 4888us (5265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508655.795198:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27916 00000100:00100000:1.0:1787508655.802623:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508655.802767:0:203733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509574656 00000100:00100000:3.0:1787508655.802777:0:203733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509574656 00002000:00010000:3.0:1787508655.802817:0:203733:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5513 (0->18446744073709551615) 00002000:00100000:3.0:1787508655.802821:0:203733:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091ffc0f800 with x1874324509574656 ext(0->18446744073709551615) 00002000:00010000:3.0:1787508655.802834:0:203733:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9091ffc0f800. 00000100:00100000:3.0:1787508655.802866:0:203733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00100000:3.0:1787508655.802877:0:203733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2400:x1874324509574656:12345-192.168.201.30@tcp:10:dd.0 00002000:00010000:3.0:1787508655.803203:0:203733:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1589:0x0] updating lvb size from disk: 8192 -> 0 00002000:00010000:3.0:1787508655.803208:0:203733:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1589:0x0] updating lvb mtime from disk: 1787508648 -> 1787508656 00002000:00010000:3.0:1787508655.803211:0:203733:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1589:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787508655.803214:0:203733:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1589:0x0] updating lvb ctime from disk: 1787508648 -> 1787508656 00002000:00010000:3.0:1787508655.803216:0:203733:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1589:0x0] updating lvb blocks from disk: 16 -> 0 00000100:00100000:3.0:1787508655.803268:0:203733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2400:x1874324509574656:12345-192.168.201.30@tcp:10:dd.0 Request processed in 392us (656us total) trans 8589940554 rc 0/0 00000100:00100000:3.0:1787508655.803276:0:203733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 36 00002000:00010000:3.0:1787508655.803280:0:203733:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5513 (0->18446744073709551615) 00002000:00100000:3.0:1787508655.803627:0:203733:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091ffc0f800 with x1874324509574656 ext(0->18446744073709551615) 00002000:00010000:3.0:1787508655.803634:0:203733:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9091ffc0f800. 00000100:00100000:1.0:1787508655.808840:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508655.808931:0:208929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509574784 00000100:00100000:0.0:1787508655.808974:0:208929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509574784 00002000:00100000:0.0:1787508655.809033:0:208929:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x1589:0x0] (0->4095) req@ffff9091ffc0d180 x1874324509574784/t0(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:111/0 lens 4584/0 e 0 to 0 dl 1787508666 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787508655.809044:0:208929:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091ffc0d180 with x1874324509574784 ext(0->4095) 00002000:00010000:0.0:1787508655.809050:0:208929:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9091ffc0d180 00000100:00100000:0.0:1787508655.809079:0:208929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:0.0:1787508655.809089:0:208929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2400:x1874324509574784:12345-192.168.201.30@tcp:4:dd.0 00000100:00100000:0.0:1787508655.812994:0:208929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2400:x1874324509574784:12345-192.168.201.30@tcp:4:dd.0 Request processed in 3895us (4152us total) trans 8589940555 rc 0/0 00000100:00100000:0.0:1787508655.813009:0:208929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 37 00002000:00100000:0.0:1787508655.813033:0:208929:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x1589:0x0] (0->4095) req@ffff9091ffc0d180 x1874324509574784/t8589940555(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:111/0 lens 4584/448 e 0 to 0 dl 1787508666 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787508655.813044:0:208929:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091ffc0d180 with x1874324509574784 ext(0->4095) 00002000:00010000:0.0:1787508655.813050:0:208929:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9091ffc0d180 00000100:00100000:0.0:1787508655.824643:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508655.826409:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509574912 00000100:00100000:1.0:1787508655.826425:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509574912 00000100:00100000:1.0:1787508655.826502:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94032 00000100:00100000:1.0:1787508655.826513:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d30f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+592:337915:x1874324509574912:12345-192.168.201.30@tcp:44:dd.0 00000100:00100000:1.0:1787508655.826663:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d30f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+592:337915:x1874324509574912:12345-192.168.201.30@tcp:44:dd.0 Request processed in 151us (2029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508655.826670:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94032 00000100:00100000:1.0:1787508655.834864:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508655.834990:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509575040 00000100:00100000:0.0:1787508655.835000:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509575040 00000100:00100000:0.0:1787508655.835071:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15061 00000100:00100000:0.0:1787508655.835082:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2401:x1874324509575040:12345-192.168.201.30@tcp:16:dd.0 00000001:00080000:1.0:1787508655.836838:0:204539:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589940555 is committed 00000001:00080000:1.0:1787508655.836857:0:204539:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589940553 is committed 00000100:00100000:0.0:1787508655.838602:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2401:x1874324509575040:12345-192.168.201.30@tcp:16:dd.0 Request processed in 3512us (3740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508655.838616:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15061 00000100:00100000:0.0:1787508656.245404:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508656.245457:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508656.245786:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508656.245839:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508656.245880:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509575168 00000100:00100000:0.0:1787508656.245891:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509575168 00000100:00100000:0.0:1787508656.245992:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 994 00000100:00100000:0.0:1787508656.246004:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed92f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509575168:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508656.246116:0:225838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509575808 00000100:00100000:1.0:1787508656.246130:0:225838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509575808 00000100:00100000:1.0:1787508656.246207:0:225838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2325 00000100:00100000:1.0:1787508656.246220:0:225838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509575808:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508656.246278:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed92f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509575168:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 266us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508656.246290:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 994 00000100:00100000:1.0:1787508656.246306:0:225838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509575808:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 86us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508656.246316:0:225838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2325 00000100:00100000:2.0:1787508656.246668:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509575296 00000100:00100000:2.0:1787508656.246675:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509575296 00000100:00100000:2.0:1787508656.246718:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509575552 00000100:00100000:2.0:1787508656.246734:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509575552 00000100:00100000:2.0:1787508656.246833:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2935 00000100:00100000:2.0:1787508656.246842:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2402:x1874324509575296:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508656.246884:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2402:x1874324509575296:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 44us (1496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508656.246892:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2935 00000100:00100000:2.0:1787508656.246908:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2936 00000100:00100000:2.0:1787508656.246914:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2402:x1874324509575552:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508656.246982:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2402:x1874324509575552:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 68us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508656.246990:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2936 00000100:00080000:3.0:1787508656.267660:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787508656.267676:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787508656.276356:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508656.276407:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508656.276988:0:230130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509575424 00000100:00100000:1.0:1787508656.276998:0:230130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509575424 00000100:00100000:1.0:1787508656.277062:0:230130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2326 00000100:00100000:1.0:1787508656.277072:0:230130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da0bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509575424:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508656.277146:0:230130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da0bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509575424:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 76us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508656.277154:0:230130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2326 00000100:00100000:2.0:1787508656.277345:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509575680 00000100:00100000:2.0:1787508656.277357:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509575680 00000100:00100000:2.0:1787508656.277435:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2937 00000100:00100000:2.0:1787508656.277445:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509575680:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508656.277533:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509575680:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 89us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508656.277541:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2937 00000100:00080000:3.0:1787508656.278265:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787508656.278273:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787508656.698578:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508656.826570:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787508656.826601:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480160768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787508656.826769:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508656.826889:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480160768 00000100:00100000:2.0:1787508656.826901:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480160768 00000100:00100000:2.0:1787508656.827008:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1657 00000100:00100000:2.0:1787508656.827021:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480160768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787508656.827048:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 101077568 pending 0 free 3884056576 avail 3652476928 00000100:00100000:2.0:1787508656.827120:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480160768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508656.827133:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1657 00000100:00080000:0.0:1787508656.827353:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508656.827402:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480160768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787508656.828255:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787508656.828271:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480160896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508656.828325:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508656.828522:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480160896 00000100:00100000:0.0:1787508656.828530:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480160896 00000100:00080000:3.0:1787508656.828642:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508656.829141:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1658 00000100:00100000:0.0:1787508656.829153:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480160896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787508656.829179:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 101077568 pending 0 free 3884056576 avail 3652476928 00000100:00100000:0.0:1787508656.829243:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480160896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508656.829250:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1658 00000100:00100000:1.0:1787508656.829338:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480160896:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787508657.733384:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508658.362716:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787508658.362740:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480161024:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787508658.362821:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508658.363002:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480161024 00000100:00100000:2.0:1787508658.363011:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480161024 00000100:00100000:2.0:1787508658.363092:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1659 00000100:00100000:2.0:1787508658.363104:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480161024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787508658.363135:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25428544 pending 0 free 3910828032 avail 3679305728 00000100:00100000:2.0:1787508658.363196:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480161024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508658.363202:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1659 00000100:00080000:3.0:1787508658.363434:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787508658.363477:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480161024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787508658.367436:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787508658.367456:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480161152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787508658.367525:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508658.367579:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480161152 00000100:00100000:2.0:1787508658.367586:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480161152 00000100:00100000:2.0:1787508658.367639:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1660 00000100:00100000:2.0:1787508658.367646:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480161152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787508658.367667:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25428544 pending 0 free 3910828032 avail 3679305728 00000100:00100000:2.0:1787508658.367718:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480161152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508658.367725:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1660 00000100:00080000:2.0:1787508658.367745:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787508658.367775:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480161152:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787508658.754643:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508659.386392:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480161280:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787508659.386482:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508659.386717:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480161280 00000100:00100000:2.0:1787508659.386725:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480161280 00000100:00100000:2.0:1787508659.386779:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29820 00000100:00100000:2.0:1787508659.386789:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480161280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787508659.386827:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1442783232 avail 1296543744 00000100:00100000:2.0:1787508659.386886:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480161280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508659.386893:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29820 00000100:00100000:3.0:1787508659.387023:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480161280:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787508659.387251:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480161408:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787508659.387283:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508659.388123:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480161408 00000100:00100000:2.0:1787508659.388133:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480161408 00000100:00100000:2.0:1787508659.388182:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29821 00000100:00100000:2.0:1787508659.388190:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480161408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787508659.388217:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1441771520 avail 1295532032 00000100:00100000:2.0:1787508659.388329:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480161408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508659.388336:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29821 00000100:00100000:3.0:1787508659.390929:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480161408:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787508659.770243:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508659.902265:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480161664:0@lo:400:kworker.0 00000100:00100000:1.0:1787508659.902333:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508659.902389:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480162176:0@lo:400:kworker.0 00000100:00100000:1.0:1787508659.902411:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508659.902433:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480162688:0@lo:400:kworker.0 00000100:00100000:1.0:1787508659.902455:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508659.902479:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787508659.902485:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480161792:0@lo:400:kworker.0 00000100:00100000:1.0:1787508659.902504:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508659.902522:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480162304:0@lo:400:kworker.0 00000100:00100000:1.0:1787508659.902541:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508659.902558:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480162816:0@lo:400:kworker.0 00000100:00100000:1.0:1787508659.902577:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508659.902615:0:208928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480161664 00000100:00100000:1.0:1787508659.902624:0:208928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480161664 00000100:00100000:1.0:1787508659.902676:0:208928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480162176 00000100:00100000:1.0:1787508659.902680:0:208928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480162176 00000100:00100000:1.0:1787508659.902707:0:208928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480161792 00000100:00100000:1.0:1787508659.902710:0:208928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480161792 00000100:00100000:1.0:1787508659.902733:0:208928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2327 00000100:00100000:1.0:1787508659.902741:0:208928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480161664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508659.902795:0:208928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480161664:12345-0@lo:400:kworker.0 Request processed in 54us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508659.902818:0:208928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2327 00000100:00100000:1.0:1787508659.902833:0:208928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2328 00000100:00100000:1.0:1787508659.902838:0:208928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480162176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508659.902877:0:208928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480162176:12345-0@lo:400:kworker.0 Request processed in 39us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508659.902883:0:208928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2328 00000100:00100000:1.0:1787508659.902898:0:208928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2329 00000100:00100000:1.0:1787508659.902904:0:208928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480161792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508659.902931:0:208928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480161792:12345-0@lo:400:kworker.0 Request processed in 27us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508659.902937:0:208928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2329 00000100:00100000:1.0:1787508659.902991:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480162688 00000100:00100000:1.0:1787508659.902994:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480162688 00000100:00100000:1.0:1787508659.903020:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480162304 00000100:00100000:1.0:1787508659.903024:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480162304 00000100:00100000:1.0:1787508659.903040:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480162816 00000100:00100000:1.0:1787508659.903043:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480162816 00000100:00100000:1.0:1787508659.903062:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2938 00000100:00100000:1.0:1787508659.903068:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480162688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508659.903098:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480162688:12345-0@lo:400:kworker.0 Request processed in 30us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508659.903103:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2938 00000100:00100000:1.0:1787508659.903114:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2939 00000100:00100000:1.0:1787508659.903119:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480162304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508659.903140:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480162304:12345-0@lo:400:kworker.0 Request processed in 22us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508659.903149:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2939 00000100:00100000:1.0:1787508659.903158:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2940 00000100:00100000:1.0:1787508659.903164:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480162816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508659.903191:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480162816:12345-0@lo:400:kworker.0 Request processed in 28us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508659.903196:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2940 00000100:00080000:1.0:1787508659.903222:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787508659.903226:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787508659.903229:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508659.903271:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480161792:0@lo:400:kworker.0 00000100:00100000:1.0:1787508659.903282:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480162304:0@lo:400:kworker.0 00000100:00100000:1.0:1787508659.903291:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480162816:0@lo:400:kworker.0 00000100:00100000:1.0:1787508659.903299:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480161664:0@lo:400:kworker.0 00000100:00100000:1.0:1787508659.903307:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480162176:0@lo:400:kworker.0 00000100:00100000:1.0:1787508659.903314:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480162688:0@lo:400:kworker.0 00000100:00100000:0.0:1787508659.903759:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874324480161920:0@lo:400:kworker.0 00000100:00100000:0.0:1787508659.903814:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508659.903844:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874324480162432:0@lo:400:kworker.0 00000100:00100000:0.0:1787508659.903876:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508659.903900:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787508659.903906:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480161536:0@lo:400:kworker.0 00000100:00100000:0.0:1787508659.903933:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508659.903982:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480162048:0@lo:400:kworker.0 00000100:00100000:0.0:1787508659.904007:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508659.904023:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480162560:0@lo:400:kworker.0 00000100:00100000:0.0:1787508659.904043:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508659.904072:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480162048 00000100:00100000:0.0:1787508659.904077:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480162048 00000100:00100000:0.0:1787508659.904112:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2330 00000100:00100000:0.0:1787508659.904119:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480162048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508659.904160:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480162048:12345-0@lo:400:kworker.0 Request processed in 41us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508659.904166:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2330 00000100:00100000:0.0:1787508659.904187:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480161920 00000100:00100000:0.0:1787508659.904191:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480161920 00000100:00100000:0.0:1787508659.904213:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480162432 00000100:00100000:0.0:1787508659.904217:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480162432 00000100:00100000:0.0:1787508659.904241:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480162560 00000100:00100000:0.0:1787508659.904244:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480162560 00000100:00100000:0.0:1787508659.904265:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2941 00000100:00100000:0.0:1787508659.904271:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874324480161920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508659.904302:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874324480161920:12345-0@lo:400:kworker.0 Request processed in 31us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508659.904308:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2941 00000100:00100000:0.0:1787508659.904320:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2942 00000100:00100000:0.0:1787508659.904326:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874324480162432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508659.904352:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874324480162432:12345-0@lo:400:kworker.0 Request processed in 27us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508659.904358:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2942 00000100:00100000:0.0:1787508659.904370:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2943 00000100:00100000:0.0:1787508659.904376:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480162560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508659.904401:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480162560:12345-0@lo:400:kworker.0 Request processed in 26us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508659.904407:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2943 00000100:00080000:0.0:1787508659.904429:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508659.904433:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787508659.904458:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480162048:0@lo:400:kworker.0 00000100:00100000:0.0:1787508659.904469:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480162560:0@lo:400:kworker.0 00000100:00100000:0.0:1787508659.904479:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874324480161920:0@lo:400:kworker.0 00000100:00100000:0.0:1787508659.904487:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874324480162432:0@lo:400:kworker.0 00000100:00100000:3.0:1787508659.904790:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480161536 00000100:00100000:3.0:1787508659.904795:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480161536 00000100:00100000:3.0:1787508659.904856:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:3.0:1787508659.904865:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d980b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480161536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508659.904915:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d980b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480161536:12345-0@lo:400:kworker.0 Request processed in 51us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508659.904921:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00100000:1.0:1787508659.905162:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480161536:0@lo:400:kworker.0 00010000:00010000:3.0:1787508660.795170:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508661.354154:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508661.354202:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508661.354238:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508661.354275:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508661.354297:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508661.354321:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508661.354342:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508661.354360:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508661.354388:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508661.354416:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509576448 00000100:00100000:3.0:1787508661.354425:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509576448 00000100:00100000:3.0:1787508661.354476:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509576960 00000100:00100000:3.0:1787508661.354479:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509576960 00000100:00100000:3.0:1787508661.354499:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509576320 00000100:00100000:3.0:1787508661.354502:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509576320 00000100:00100000:3.0:1787508661.354517:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509576832 00000100:00100000:3.0:1787508661.354520:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509576832 00000100:00100000:3.0:1787508661.354540:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2331 00000100:00100000:3.0:1787508661.354564:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2403:x1874324509576448:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508661.354633:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2403:x1874324509576448:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 85us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508661.354652:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2331 00000100:00100000:3.0:1787508661.354673:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2332 00000100:00100000:3.0:1787508661.354679:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2403:x1874324509576960:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508661.354702:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2403:x1874324509576960:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508661.354708:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2332 00000100:00100000:3.0:1787508661.354718:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2333 00000100:00100000:3.0:1787508661.354723:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509576320:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508661.354744:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509576320:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508661.354749:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2333 00000100:00100000:3.0:1787508661.354759:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2334 00000100:00100000:3.0:1787508661.354764:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509576832:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508661.354782:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509576832:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 19us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508661.354788:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2334 00000100:00100000:1.0:1787508661.355054:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509576192 00000100:00100000:1.0:1787508661.355060:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509576192 00000100:00100000:1.0:1787508661.355103:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509576704 00000100:00100000:1.0:1787508661.355107:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509576704 00000100:00100000:1.0:1787508661.355124:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509576064 00000100:00100000:1.0:1787508661.355127:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509576064 00000100:00100000:1.0:1787508661.355144:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509576576 00000100:00100000:1.0:1787508661.355147:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509576576 00000100:00100000:1.0:1787508661.355164:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2944 00000100:00100000:1.0:1787508661.355171:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2403:x1874324509576192:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508661.355210:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2403:x1874324509576192:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 39us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508661.355216:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2944 00000100:00100000:1.0:1787508661.355228:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2945 00000100:00100000:1.0:1787508661.355233:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509576704:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508661.355257:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509576704:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508661.355263:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2945 00000100:00100000:1.0:1787508661.355278:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2946 00000100:00100000:1.0:1787508661.355283:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+592:2403:x1874324509576064:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508661.355305:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+592:2403:x1874324509576064:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508661.355311:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2946 00000100:00100000:1.0:1787508661.355322:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2947 00000100:00100000:1.0:1787508661.355329:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2403:x1874324509576576:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508661.355351:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2403:x1874324509576576:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508661.355356:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2947 00000100:00100000:0.0:1787508661.355883:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509575936 00000100:00100000:0.0:1787508661.355889:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509575936 00000100:00100000:0.0:1787508661.355937:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 996 00000100:00100000:0.0:1787508661.355989:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d980a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509575936:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508661.356025:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d980a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509575936:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 40us (1883us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508661.356032:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 996 00000100:00080000:0.0:1787508661.356078:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787508661.356082:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508661.356085:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787508661.356088:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787508661.818869:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508661.946224:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787508661.946249:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480162944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787508661.946303:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787508661.946317:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c968ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480163072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787508661.946326:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508661.946376:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508661.946426:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480162944 00000100:00100000:1.0:1787508661.946434:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480162944 00000100:00100000:0.0:1787508661.946438:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480163072 00000100:00100000:0.0:1787508661.946444:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480163072 00000100:00100000:1.0:1787508661.946517:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1661 00000100:00100000:1.0:1787508661.946526:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480162944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787508661.946558:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 101077568 pending 0 free 3884052480 avail 3652530176 00000100:00100000:1.0:1787508661.946605:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480162944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508661.946612:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1661 00000100:00100000:1.0:1787508661.946675:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480162944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787508661.955473:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1662 00000100:00100000:0.0:1787508661.955488:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480163072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787508661.955517:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 101077568 pending 0 free 3884052480 avail 3652530176 00000100:00100000:0.0:1787508661.955610:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480163072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (9247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508661.955617:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1662 00000100:00100000:0.0:1787508661.955684:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c968ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480163072:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787508661.956573:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787508661.958044:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944131 is committed 00010000:00010000:2.0:1787508661.958388:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34f9b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a3:0x555:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508661.958401:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34f9b lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a3:0x555:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508661.958410:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34f9b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a3:0x555:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508661.958416:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508661.958420:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34f9b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a3:0x555:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508661.958427:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34f9b lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a3:0x555:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508661.958446:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x555:0x0].0x0 (ffff9090d36fd500) 00010000:00010000:2.0:1787508661.958449:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508661.958454:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34f9b lrc: 2/0,0 mode: --/TXN res: [0x2000013a3:0x555:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508661.958460:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f34f9b lrc: 0/0,0 mode: --/TXN res: [0x2000013a3:0x555:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508662.842142:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508663.485040:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787508663.485065:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480163200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787508663.485129:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508663.485355:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480163200 00000100:00100000:2.0:1787508663.485362:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480163200 00000100:00100000:2.0:1787508663.485428:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1663 00000100:00100000:2.0:1787508663.485439:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480163200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787508663.485467:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25428544 pending 0 free 3910828032 avail 3679305728 00000100:00100000:2.0:1787508663.485514:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480163200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508663.485522:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1663 00000100:00100000:2.0:1787508663.485564:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480163200:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787508663.485666:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508663.485791:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787508663.485802:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c968ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480163328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787508663.485832:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508663.485903:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480163328 00000100:00100000:0.0:1787508663.485908:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480163328 00000100:00100000:0.0:1787508663.485974:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1664 00000100:00100000:0.0:1787508663.485982:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480163328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787508663.485993:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25428544 pending 0 free 3910828032 avail 3679305728 00000100:00100000:0.0:1787508663.486025:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480163328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508663.486032:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1664 00000100:00100000:1.0:1787508663.486103:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c968ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480163328:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787508663.486158:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787508663.867455:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508664.507214:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787508664.507244:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480163456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787508664.507349:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508664.507660:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480163456 00000100:00100000:2.0:1787508664.507673:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480163456 00000100:00100000:2.0:1787508664.507736:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29822 00000100:00100000:2.0:1787508664.507746:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480163456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787508664.507784:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1442783232 avail 1296543744 00000100:00100000:2.0:1787508664.507852:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480163456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508664.507859:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29822 00000100:00100000:3.0:1787508664.508183:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480163456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787508664.509923:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c968ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480163584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787508664.510160:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508664.511167:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480163584 00000100:00100000:2.0:1787508664.511182:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480163584 00000100:00100000:2.0:1787508664.511260:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29823 00000100:00100000:2.0:1787508664.511269:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480163584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787508664.511304:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1441771520 avail 1295532032 00000100:00100000:2.0:1787508664.511390:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480163584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (1350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508664.511398:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29823 00000100:00100000:3.0:1787508664.511473:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c968ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480163584:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787508664.890755:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787508665.014588:0:232599:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 95a: Check readpage() on a page that was removed from page cache ========================================================== 14:11:03 (1787508663) 00000100:00100000:2.0:1787508665.018299:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480163712:0@lo:400:kworker.0 00000100:00100000:1.0:1787508665.018360:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480163968:0@lo:400:kworker.0 00000100:00100000:3.0:1787508665.018483:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480163840:0@lo:400:kworker.0 00000100:00100000:1.0:1787508665.018678:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508665.018703:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508665.018732:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480164480:0@lo:400:kworker.0 00000100:00100000:2.0:1787508665.018740:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480164224:0@lo:400:kworker.0 00000100:00100000:1.0:1787508665.018754:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508665.018763:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508665.018770:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480164992:0@lo:400:kworker.0 00000100:00100000:2.0:1787508665.018777:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480164736:0@lo:400:kworker.0 00000100:00100000:1.0:1787508665.018790:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508665.018804:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480163712 00000100:00100000:1.0:1787508665.018810:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787508665.018811:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480163712 00000100:00100000:1.0:1787508665.018815:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480164096:0@lo:400:kworker.0 00000100:00100000:1.0:1787508665.018835:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508665.018850:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480164608:0@lo:400:kworker.0 00000100:00100000:2.0:1787508665.018854:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:2.0:1787508665.018862:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d980b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480163712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508665.018870:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508665.018886:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480165120:0@lo:400:kworker.0 00000100:00100000:1.0:1787508665.018903:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508665.018909:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d980b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480163712:12345-0@lo:400:kworker.0 Request processed in 48us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508665.018917:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00100000:1.0:1787508665.018931:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480163968 00000100:00100000:1.0:1787508665.018934:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480163968 00000100:00080000:2.0:1787508665.019003:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508665.019006:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480164480 00000100:00100000:1.0:1787508665.019009:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480164480 00000100:00080000:2.0:1787508665.019024:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508665.019029:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480164096 00000100:00100000:1.0:1787508665.019031:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480164096 00000100:00100000:1.0:1787508665.019051:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480164608 00000100:00080000:2.0:1787508665.019052:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508665.019054:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480164608 00000100:00080000:2.0:1787508665.019076:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508665.019081:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2335 00000100:00100000:1.0:1787508665.019088:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480163968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508665.019139:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480163968:12345-0@lo:400:kworker.0 Request processed in 52us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508665.019146:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2335 00000100:00100000:1.0:1787508665.019161:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2336 00000100:00100000:1.0:1787508665.019167:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480164480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508665.019178:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480163968:0@lo:400:kworker.0 00000100:00100000:1.0:1787508665.019191:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480164480:12345-0@lo:400:kworker.0 Request processed in 25us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508665.019196:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2336 00000100:00100000:2.0:1787508665.019201:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480164480:0@lo:400:kworker.0 00000100:00100000:1.0:1787508665.019206:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2337 00000100:00100000:1.0:1787508665.019212:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480164096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508665.019242:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480164096:12345-0@lo:400:kworker.0 Request processed in 30us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508665.019248:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2337 00000100:00100000:2.0:1787508665.019257:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480164096:0@lo:400:kworker.0 00000100:00100000:1.0:1787508665.019257:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2338 00000100:00100000:1.0:1787508665.019263:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480164608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508665.019295:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480164608:12345-0@lo:400:kworker.0 Request processed in 32us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508665.019301:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2338 00000100:00100000:2.0:1787508665.019310:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480164608:0@lo:400:kworker.0 00000100:00100000:1.0:1787508665.019320:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480164224 00000100:00100000:1.0:1787508665.019323:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480164224 00000100:00100000:1.0:1787508665.019348:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480164992 00000100:00100000:1.0:1787508665.019351:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480164992 00000100:00100000:2.0:1787508665.019368:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480165120 00000100:00100000:2.0:1787508665.019371:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480165120 00000100:00100000:1.0:1787508665.019374:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2948 00000100:00100000:1.0:1787508665.019379:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480164224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508665.019396:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2949 00000100:00100000:2.0:1787508665.019401:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480164992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508665.019410:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480164224:12345-0@lo:400:kworker.0 Request processed in 31us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508665.019415:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2948 00000100:00100000:1.0:1787508665.019426:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2950 00000100:00100000:2.0:1787508665.019431:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480164992:12345-0@lo:400:kworker.0 Request processed in 31us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508665.019432:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480165120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508665.019437:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2949 00000100:00100000:1.0:1787508665.019456:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480165120:12345-0@lo:400:kworker.0 Request processed in 24us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508665.019461:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2950 00000100:00100000:2.0:1787508665.019463:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480165120:0@lo:400:kworker.0 00000100:00100000:2.0:1787508665.019473:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480164992:0@lo:400:kworker.0 00000100:00080000:1.0:1787508665.019499:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787508665.019502:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787508665.019511:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508665.019539:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480165248:0@lo:400:kworker.0 00000100:00100000:1.0:1787508665.019561:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508665.019594:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480163712:0@lo:400:kworker.0 00000100:00100000:1.0:1787508665.019611:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480164224:0@lo:400:kworker.0 00000100:00100000:1.0:1787508665.019627:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480164736 00000100:00100000:1.0:1787508665.019630:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480164736 00000100:00100000:1.0:1787508665.019649:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480165248 00000100:00100000:1.0:1787508665.019652:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480165248 00000100:00100000:1.0:1787508665.019670:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2951 00000100:00100000:1.0:1787508665.019675:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8fb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480164736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508665.019707:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8fb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480164736:12345-0@lo:400:kworker.0 Request processed in 31us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508665.019711:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2952 00000100:00100000:1.0:1787508665.019714:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2951 00000100:00100000:2.0:1787508665.019717:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8fb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480165248:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787508665.019727:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787508665.019744:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480164736:0@lo:400:kworker.0 00000100:00100000:2.0:1787508665.019748:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8fb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480165248:12345-0@lo:400:kworker.0 Request processed in 32us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508665.019752:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480165248:0@lo:400:kworker.0 00000100:00100000:2.0:1787508665.019753:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2952 00000100:00100000:3.0:1787508665.026384:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508665.026443:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480164352:0@lo:400:kworker.0 00000100:00100000:3.0:1787508665.026468:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508665.026479:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480164864:0@lo:400:kworker.0 00000100:00100000:3.0:1787508665.026495:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508665.028605:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480163840 00000100:00100000:2.0:1787508665.028617:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480163840 00000100:00100000:2.0:1787508665.028673:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480164352 00000100:00100000:2.0:1787508665.028676:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480164352 00000100:00100000:2.0:1787508665.028704:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29824 00000100:00100000:2.0:1787508665.028714:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480163840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508665.028810:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480163840:12345-0@lo:400:kworker.0 Request processed in 97us (2432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508665.028817:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29824 00000100:00100000:2.0:1787508665.028835:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29825 00000100:00100000:2.0:1787508665.028841:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480164352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508665.028868:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480164352:12345-0@lo:400:kworker.0 Request processed in 28us (2399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508665.028874:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29825 00000100:00100000:2.0:1787508665.028918:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480163840:0@lo:400:kworker.0 00000100:00100000:2.0:1787508665.028930:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480164352:0@lo:400:kworker.0 00000100:00100000:1.0:1787508665.031762:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480164864 00000100:00100000:1.0:1787508665.031773:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480164864 00000100:00100000:1.0:1787508665.031843:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2953 00000100:00080000:2.0:1787508665.031844:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787508665.031852:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480164864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508665.031932:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480164864:12345-0@lo:400:kworker.0 Request processed in 81us (5434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508665.031962:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2953 00000100:00100000:2.0:1787508665.031980:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480164864:0@lo:400:kworker.0 00000100:00100000:3.0:1787508665.411044:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508665.411726:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509577088 00000100:00100000:1.0:1787508665.411737:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509577088 00000100:00100000:1.0:1787508665.411826:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94033 00000100:00100000:1.0:1787508665.411836:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+587:338500:x1874324509577088:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508665.412172:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508665.412198:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34fb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae6e1 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508665.412266:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34fb7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508665.412281:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508665.412294:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508665.412343:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508665.412347:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508665.412367:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508665.412407:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f34fb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6e1 expref: 589 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508665.412426:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34fb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6e1 expref: 588 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508665.412436:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508665.412438:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508665.412441:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b000, rc 0) 00000100:00080000:3.0:1787508665.412727:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787508665.412766:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+588:338500:x1874324509577088:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 930us (1730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508665.412776:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94033 00000100:00100000:1.0:1787508665.426061:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508665.426148:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509577344 00000100:00100000:2.0:1787508665.426159:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509577344 00000100:00100000:2.0:1787508665.426234:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94034 00000100:00100000:2.0:1787508665.426246:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+588:338500:x1874324509577344:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508665.426269:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508665.426272:0:209004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787508665.426302:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f34fb7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6e1 expref: 588 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.426332:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508665.426338:0:209004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508665.426353:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f34fbe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae6e8 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.426508:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34fc5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.426522:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34fc5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.426532:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34fc5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.426546:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34fcc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.426553:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34fcc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.426559:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34fcc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.427034:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34fd3 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.427045:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34fd3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.427052:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34fd3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508665.427061:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1260:0x0]: returning size 0 00010000:00010000:2.0:1787508665.427087:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34fc5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.427099:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34fc5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.427105:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34fc5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.427112:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34fc5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.427118:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508665.427123:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34fc5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.427130:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34fc5 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.427140:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508665.427143:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508665.427147:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34fc5 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.427153:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34fc5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508665.427166:0:209004:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b6ca581 reply state 0000000080a8c430 transno 12884944132 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34fcc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.427176:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34fcc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.427182:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28fbc66 (ffff9090d36fdb00) 00010000:00010000:2.0:1787508665.427185:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787508665.427188:0:209004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787508665.427212:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f34fbe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6e8 expref: 590 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.427226:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34fd3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6e8 expref: 589 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.427233:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1260:0x0].0x0 (ffff9090d36fd300) 00010000:00010000:2.0:1787508665.427235:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787508665.427238:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab200, rc 0) 00000100:00100000:2.0:1787508665.427309:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+590:338500:x1874324509577344:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1065us (1258us total) trans 12884944132 rc 0/0 00000100:00100000:2.0:1787508665.427317:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94034 00000100:00100000:0.0:1787508665.439469:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508665.439676:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509577600 00000100:00100000:2.0:1787508665.439687:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509577600 00000100:00100000:2.0:1787508665.439757:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94035 00000100:00100000:2.0:1787508665.439769:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c968ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+590:338500:x1874324509577600:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508665.439795:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508665.439829:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f34fe1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae6ef expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.439976:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34fe8 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x1260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.439991:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34fd3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6e8 expref: 591 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.440006:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34fe8 lrc: 4/0,1 mode: --/EX res: [0x2000013a4:0x1260:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.440038:0:202228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34fd3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6e8 expref: 591 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.440053:0:202228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34fd3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6e8 expref: 591 pid: 209004 timeout: 13736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508665.440066:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480165376:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508665.440276:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d0a39480 going to sleep for 11 seconds 00000100:00100000:3.0:1787508665.458548:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508665.459202:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509577728 00000100:00100000:1.0:1787508665.459217:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509577728 00010000:00010000:1.0:1787508665.459273:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34fd3 lrc: 5/0,0 mode: PR/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6e8 expref: 592 pid: 209004 timeout: 13736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508665.459347:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27917 00000100:00100000:1.0:1787508665.459358:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+592:2400:x1874324509577728:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508665.459375:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508665.459382:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34fd3 lrc: 5/0,0 mode: PR/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6e8 expref: 592 pid: 209004 timeout: 13736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508665.459409:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34fd3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6e8 expref: 592 pid: 209004 timeout: 13736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508665.459431:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1260:0x0].0x0 (ffff9090d36fd300) 00010000:00010000:1.0:1787508665.459436:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34fe8 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x1260:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508665.459445:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34fe8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1260:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508665.459452:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34fe8 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x1260:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508665.459476:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508665.459601:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+592:2400:x1874324509577728:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 244us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508665.459610:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27917 00010000:00010000:2.0:1787508665.460701:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f34fd3 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6e8 expref: 591 pid: 209004 timeout: 13736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508665.460736:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480165376:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508665.460769:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34fe8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1260:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.460792:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34fe8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1260:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.460800:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34fe8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1260:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508665.460828:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1260:0x0]: returning size 0 00000004:00080000:2.0:1787508665.461353:0:202228:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x158a:0x0], index 1: 0 00000004:00080000:2.0:1787508665.461363:0:202228:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x152c:0x0], index 0: 0 00010000:00010000:2.0:1787508665.461837:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34fe8 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1260:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.461849:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34fe8 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x1260:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.461857:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34fe8 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1260:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.461863:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508665.461868:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34fe8 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1260:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.461877:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34fe8 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x1260:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.461896:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1260:0x0].0x0 (ffff9090d36fd300) 00010000:00010000:2.0:1787508665.461900:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787508665.461906:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34fe8 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x1260:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.461912:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f34fe8 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x1260:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.463347:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f34fe1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6ef expref: 591 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.463364:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508665.463367:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508665.463373:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f34fe1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6ef expref: 591 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.463389:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aac00, rc 0) 00000100:00100000:2.0:1787508665.463483:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c968ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+590:338500:x1874324509577600:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 23705us (24015us total) trans 12884944133 rc 301/301 00000100:00100000:2.0:1787508665.463494:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94035 00000100:00100000:1.0:1787508665.475106:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508665.475409:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509577984 00000100:00100000:2.0:1787508665.475423:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509577984 00000100:00100000:2.0:1787508665.475508:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15429 00000100:00100000:2.0:1787508665.475521:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+590:338500:x1874324509577984:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1787508665.478435:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+591:338500:x1874324509577984:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 2898us (3325us total) trans 12884944134 rc 0/0 00000100:00100000:2.0:1787508665.478457:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15429 00000100:00100000:0.0:1787508665.484716:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508665.484879:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509578112 00000100:00100000:1.0:1787508665.484893:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509578112 00000100:00100000:1.0:1787508665.485006:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94036 00000100:00100000:1.0:1787508665.485021:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+591:338500:x1874324509578112:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508665.485056:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508665.485099:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34ff6 lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae6f6 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508665.485448:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34ff6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6f6 expref: 592 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508665.485467:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34ff6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6f6 expref: 592 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508665.485504:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1260:0x0].0x0 (ffff9090d171f300) 00010000:00010000:1.0:1787508665.485508:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787508665.485513:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b600, rc 0) 00000100:00100000:1.0:1787508665.485609:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+592:338500:x1874324509578112:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 590us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508665.485617:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94036 00000100:00100000:1.0:1787508665.493761:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508665.494190:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509578368 00000100:00100000:0.0:1787508665.494208:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509578368 00000100:00100000:0.0:1787508665.494303:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15430 00000100:00100000:0.0:1787508665.494318:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+592:338500:x1874324509578368:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1787508665.494658:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+593:338500:x1874324509578368:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 343us (905us total) trans 12884944135 rc 0/0 00000100:00100000:0.0:1787508665.494668:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15430 00000100:00100000:2.0:1787508665.536003:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508665.536878:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509578496 00000100:00100000:1.0:1787508665.536893:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509578496 00000100:00100000:1.0:1787508665.537010:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94037 00000100:00100000:1.0:1787508665.537023:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+593:338505:x1874324509578496:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:1.0:1787508665.537055:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508665.537092:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f34ffd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae6fd expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508665.537177:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f35004 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508665.537194:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f35004 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508665.537208:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f35004 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508665.537266:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508665.537270:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508665.537296:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f35004 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508665.537325:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f34ffd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6fd expref: 595 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508665.537346:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f35004 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6fd expref: 594 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508665.537356:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508665.537360:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508665.537364:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a400, rc 0) 00000100:00100000:1.0:1787508665.537622:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+594:338505:x1874324509578496:12345-192.168.201.30@tcp:101:dd.0 Request processed in 600us (1635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508665.537631:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94037 00000100:00100000:1.0:1787508665.549424:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508665.549574:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509578752 00000100:00100000:2.0:1787508665.549588:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509578752 00000100:00100000:2.0:1787508665.549668:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94038 00000100:00100000:2.0:1787508665.549681:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+594:338505:x1874324509578752:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:2.0:1787508665.549709:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508665.549713:0:203348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787508665.549749:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f35004 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6fd expref: 594 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.549773:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508665.549779:0:203348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508665.549796:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3500b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae704 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.550024:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35012 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.550041:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35012 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.550053:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35012 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.550066:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35019 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.550073:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35019 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.550080:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35019 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.550153:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f35020 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.550162:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f35020 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.550168:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f35020 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508665.550178:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1260:0x0]: returning size 0 00010000:00010000:2.0:1787508665.550280:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35012 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.550293:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35012 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.550299:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35012 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.550306:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35012 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.550312:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508665.550317:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35012 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.550326:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35012 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.550335:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508665.550338:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508665.550342:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35012 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.550348:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35012 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.550362:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35019 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.550368:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35019 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.550375:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35019 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.550381:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508665.550384:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35019 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.550391:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35019 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.550398:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28fbc66 (ffff9090d36fdb00) 00010000:00010000:2.0:1787508665.550400:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508665.550403:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35019 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.550410:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35019 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.550447:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3500b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae704 expref: 596 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.550461:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f35020 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae704 expref: 595 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.550469:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1260:0x0].0x0 (ffff9090d171f300) 00010000:00010000:2.0:1787508665.550471:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787508665.550768:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aac00, rc 0) 00000100:00100000:2.0:1787508665.551458:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+595:338505:x1874324509578752:12345-192.168.201.30@tcp:101:dd.0 Request processed in 1773us (2044us total) trans 12884944136 rc 0/0 00000100:00100000:2.0:1787508665.551469:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94038 00000100:00100000:3.0:1787508665.567098:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508665.567212:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509578880 00000100:00100000:2.0:1787508665.567226:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509578880 00000100:00100000:2.0:1787508665.567308:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94039 00000100:00100000:2.0:1787508665.567331:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+595:338505:x1874324509578880:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:2.0:1787508665.567367:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508665.567398:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3502e lrc: 2/0,0 mode: --/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae70b expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.567443:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35035 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.567461:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35035 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.567476:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35035 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.567656:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3502e lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae70b expref: 597 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.567681:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35035 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae70b expref: 596 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.567691:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1260:0x0].0x0 (ffff9090d171f300) 00010000:00010000:2.0:1787508665.567694:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787508665.567699:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa000, rc 0) 00000100:00100000:2.0:1787508665.567775:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+596:338505:x1874324509578880:12345-192.168.201.30@tcp:101:dd.0 Request processed in 447us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508665.567782:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94039 00000100:00100000:1.0:1787508665.570604:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508665.570717:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509579136 00000100:00100000:0.0:1787508665.570729:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509579136 00000100:00100000:0.0:1787508665.570803:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94040 00000100:00100000:0.0:1787508665.570815:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+596:338505:x1874324509579136:12345-192.168.201.30@tcp:36:dd.0 00010000:00010000:0.0:1787508665.570888:0:205405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508665.570922:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f35020 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae704 expref: 596 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508665.570979:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1260:0x0].0x0 (ffff9090d171f300) 00010000:00010000:0.0:1787508665.570986:0:205405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508665.571222:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3503c lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1260:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508665.571240:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3503c lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508665.571251:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3503c lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787508665.571307:0:205405:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884944137 00000004:00010000:0.0:1787508665.571334:0:205405:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e692ecfd reply state 000000003d2bf526 transno 12884944138 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3503c lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508665.571347:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3503c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1260:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508665.571354:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1260:0x0].0x0 (ffff9090d171f300) 00010000:00010000:0.0:1787508665.571357:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787508665.571360:0:205405:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787508665.571472:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+598:338505:x1874324509579136:12345-192.168.201.30@tcp:36:dd.0 Request processed in 659us (881us total) trans 12884944138 rc 0/0 00000100:00100000:0.0:1787508665.571481:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94040 00000020:00080000:0.0:1787508665.571487:0:205405:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787508665.580080:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508665.580250:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509579264 00000100:00100000:2.0:1787508665.580264:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509579264 00000100:00100000:2.0:1787508665.580362:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15062 00000100:00100000:2.0:1787508665.580376:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:338505:x1874324509579264:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:2.0:1787508665.580398:0:225831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508665.580428:0:225831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa96315d/0xb126349c40f35043 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae712 expref: -99 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787508665.580462:0:225831:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x158a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787508665.580506:0:225831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x158a:0x0].0x0 since=13636s v=(0 0) 00010000:00010000:2.0:1787508665.580512:0:225831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x158a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787508665.580522:0:225831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa96315d/0xb126349c40f35043 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae712 expref: 8 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.580545:0:225831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fa96315d/0xb126349c40f35043 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae712 expref: 8 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508665.580560:0:225831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa800, rc 0) 00000100:00100000:2.0:1787508665.580642:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:338505:x1874324509579264:12345-192.168.201.30@tcp:101:dd.0 Request processed in 269us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508665.580650:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15062 00000100:00080000:3.0:1787508665.580784:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508665.587906:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508665.588060:0:225832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509579392 00000100:00100000:0.0:1787508665.588081:0:225832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509579392 00000100:00100000:0.0:1787508665.588177:0:225832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15063 00000100:00100000:0.0:1787508665.588190:0:225832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:338505:x1874324509579392:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1787508665.588215:0:225832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508665.588246:0:225832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1f295a/0xb126349c40f3504a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x152c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae719 expref: -99 pid: 225832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787508665.588283:0:225832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x152c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787508665.588311:0:225832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x152c:0x0].0x0 since=13636s v=(0 0) 00010000:00010000:0.0:1787508665.588316:0:225832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x152c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787508665.588326:0:225832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1f295a/0xb126349c40f3504a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x152c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae719 expref: 7 pid: 225832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508665.588345:0:225832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008a1f295a/0xb126349c40f3504a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x152c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae719 expref: 7 pid: 225832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508665.588360:0:225832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7c00, rc 0) 00000100:00100000:0.0:1787508665.588440:0:225832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:338505:x1874324509579392:12345-192.168.201.30@tcp:101:dd.0 Request processed in 252us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508665.588448:0:225832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15063 00000100:00080000:3.0:1787508665.589803:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508665.595585:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508665.595642:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508665.596981:0:205404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509579520 00000100:00100000:0.0:1787508665.596999:0:205404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509579520 00002000:00010000:0.0:1787508665.597063:0:205404:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5514 (0->18446744073709551615) 00002000:00100000:0.0:1787508665.602644:0:205404:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091f9ac9c00 with x1874324509579520 ext(0->18446744073709551615) 00002000:00010000:0.0:1787508665.602679:0:205404:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9091f9ac9c00. 00000100:00100000:0.0:1787508665.602757:0:205404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509579648 00000100:00100000:0.0:1787508665.602770:0:205404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509579648 00002000:00010000:0.0:1787508665.602833:0:205404:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5420 (0->18446744073709551615) 00002000:00100000:0.0:1787508665.602848:0:205404:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091f9ac8000 with x1874324509579648 ext(0->18446744073709551615) 00002000:00010000:0.0:1787508665.602855:0:205404:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9091f9ac8000. 00000100:00100000:0.0:1787508665.602888:0:205404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:0.0:1787508665.602900:0:205404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2400:x1874324509579520:12345-192.168.201.30@tcp:10:dd.0 00000100:00100000:3.0:1787508665.603666:0:203733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:3.0:1787508665.603685:0:203733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2401:x1874324509579648:12345-192.168.201.30@tcp:10:dd.0 00002000:00010000:3.0:1787508665.603876:0:203733:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x152c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787508665.603880:0:203733:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x152c:0x0] updating lvb mtime from disk: 0 -> 1787508666 00002000:00010000:3.0:1787508665.603883:0:203733:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x152c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787508665.603885:0:203733:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x152c:0x0] updating lvb ctime from disk: 0 -> 1787508666 00002000:00010000:3.0:1787508665.603887:0:203733:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x152c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787508665.603996:0:203733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2401:x1874324509579648:12345-192.168.201.30@tcp:10:dd.0 Request processed in 319us (8352us total) trans 8589941250 rc 0/0 00000100:00100000:3.0:1787508665.604004:0:203733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 39 00002000:00010000:3.0:1787508665.604009:0:203733:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5420 (0->18446744073709551615) 00002000:00100000:3.0:1787508665.604012:0:203733:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091f9ac8000 with x1874324509579648 ext(0->18446744073709551615) 00002000:00010000:3.0:1787508665.604018:0:203733:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9091f9ac8000. 00002000:00010000:0.0:1787508665.604715:0:205404:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x158a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787508665.604721:0:205404:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x158a:0x0] updating lvb mtime from disk: 0 -> 1787508666 00002000:00010000:0.0:1787508665.604724:0:205404:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x158a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787508665.604726:0:205404:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x158a:0x0] updating lvb ctime from disk: 0 -> 1787508666 00002000:00010000:0.0:1787508665.604728:0:205404:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x158a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787508665.605643:0:205404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:2400:x1874324509579520:12345-192.168.201.30@tcp:10:dd.0 Request processed in 2737us (10073us total) trans 8589940556 rc 0/0 00000100:00100000:0.0:1787508665.605654:0:205404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 38 00002000:00010000:0.0:1787508665.605661:0:205404:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5514 (0->18446744073709551615) 00002000:00100000:0.0:1787508665.605664:0:205404:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091f9ac9c00 with x1874324509579520 ext(0->18446744073709551615) 00002000:00010000:0.0:1787508665.605672:0:205404:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9091f9ac9c00. 00000100:00100000:1.0:1787508665.772842:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508665.773021:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509579904 00000100:00100000:2.0:1787508665.773035:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509579904 00000100:00100000:2.0:1787508665.773116:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15431 00000100:00100000:2.0:1787508665.773132:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde32050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+598:338505:x1874324509579904:12345-192.168.201.30@tcp:35:dd.0 00000100:00100000:2.0:1787508665.773752:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde32050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+599:338505:x1874324509579904:12345-192.168.201.30@tcp:35:dd.0 Request processed in 621us (923us total) trans 12884944139 rc 0/0 00000100:00100000:2.0:1787508665.773766:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15431 00000100:00100000:3.0:1787508665.858289:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508665.858374:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508665.858620:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509580032 00000100:00100000:0.0:1787508665.858635:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509580032 00000100:00100000:0.0:1787508665.858732:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509580160 00000100:00100000:0.0:1787508665.858736:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509580160 00000100:00100000:0.0:1787508665.858792:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9799 00000100:00100000:0.0:1787508665.858806:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:288110:x1874324509580032:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508665.858829:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00002000:00010000:0.0:1787508665.858857:0:225839:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x140a:0x0] updating lvb size from disk: 0 -> 2421 00002000:00010000:0.0:1787508665.858861:0:225839:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x140a:0x0] updating lvb mtime from disk: 0 -> 1787508069 00002000:00010000:0.0:1787508665.858864:0:225839:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x140a:0x0] updating lvb atime from disk: 0 -> 1787508069 00002000:00010000:0.0:1787508665.858866:0:225839:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x140a:0x0] updating lvb ctime from disk: 0 -> 1787508069 00002000:00010000:0.0:1787508665.858868:0:225839:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x140a:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787508665.858903:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba68782e/0xb126349c40e16b6b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x140a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa58f4f expref: 8 pid: 225842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508665.859026:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1f295a/0xb126349c40f3504a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x152c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae719 expref: 7 pid: 225832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508665.859044:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508665.859297:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9800 00000100:00100000:1.0:1787508665.859310:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde3f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:287589:x1874324509580160:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508665.859322:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508665.859348:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eeb2e33d/0xb126349c40cca9fb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xd1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa27ae1 expref: 6 pid: 225832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508665.859367:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508665.859432:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde3f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:287589:x1874324509580160:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 125us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508665.859441:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9800 00000100:00100000:0.0:1787508665.859567:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:288110:x1874324509580032:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 754us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508665.859576:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9799 00000100:00080000:3.0:1787508665.861427:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508665.862652:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508665.863279:0:208929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509580288 00000100:00100000:3.0:1787508665.863294:0:208929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509580288 00002000:00100000:3.0:1787508665.863372:0:208929:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x158a:0x0] (0->2097151) req@ffff9090d8783800 x1874324509580288/t0(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:121/0 lens 488/0 e 0 to 0 dl 1787508676 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787508665.863385:0:208929:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090d8783800 with x1874324509580288 ext(0->2097151) 00002000:00010000:3.0:1787508665.863392:0:208929:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9090d8783800 00000100:00100000:3.0:1787508665.863431:0:208929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:3.0:1787508665.863443:0:208929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d8783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:2402:x1874324509580288:12345-192.168.201.30@tcp:4:dd.0 00010000:00010000:0.0:1787508665.920324:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508665.926430:0:208929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d8783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:2402:x1874324509580288:12345-192.168.201.30@tcp:4:dd.0 Request processed in 62969us (63771us total) trans 8589940557 rc 0/0 00000100:00100000:1.0:1787508665.926451:0:208929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 40 00002000:00100000:1.0:1787508665.926468:0:208929:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x158a:0x0] (0->2097151) req@ffff9090d8783800 x1874324509580288/t8589940557(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:121/0 lens 488/448 e 0 to 0 dl 1787508676 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787508665.926480:0:208929:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090d8783800 with x1874324509580288 ext(0->2097151) 00002000:00010000:1.0:1787508665.926489:0:208929:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9090d8783800 00000100:00100000:2.0:1787508665.953794:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508665.953923:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509580416 00000100:00100000:1.0:1787508665.953937:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509580416 00000100:00100000:1.0:1787508665.954093:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9801 00000100:00100000:1.0:1787508665.954106:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:288263:x1874324509580416:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508665.954130:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00002000:00010000:1.0:1787508665.954158:0:205406:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1589:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:1.0:1787508665.954163:0:205406:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1589:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787508665.954210:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004689354c/0xb126349c40f34fa9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1589:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6da expref: 11 pid: 203996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787508665.954258:0:205406:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xd1f:0x0] updating lvb size from disk: 0 -> 6 00002000:00010000:1.0:1787508665.954261:0:205406:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xd1f:0x0] updating lvb mtime from disk: 0 -> 1787507378 00002000:00010000:1.0:1787508665.954263:0:205406:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xd1f:0x0] updating lvb ctime from disk: 0 -> 1787507378 00002000:00010000:1.0:1787508665.954266:0:205406:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xd1f:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787508665.954275:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2092daa/0xb126349c40cca754 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa27a0f expref: 10 pid: 203727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787508665.954297:0:205406:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x158a:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1787508665.954300:0:205406:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x158a:0x0] updating lvb blocks from disk: 0 -> 4096 00010000:00010000:1.0:1787508665.954308:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa96315d/0xb126349c40f35043 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae712 expref: 9 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508665.954322:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508665.954394:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:288263:x1874324509580416:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 289us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508665.954402:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9801 00000100:00100000:3.0:1787508666.053147:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508666.053322:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509580544 00000100:00100000:2.0:1787508666.053340:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509580544 00000100:00100000:2.0:1787508666.053508:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94041 00000100:00100000:2.0:1787508666.053522:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+599:338517:x1874324509580544:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:2.0:1787508666.053568:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508666.053595:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f35051 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae720 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.053686:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35058 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.053704:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35058 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.053721:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35058 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508666.053779:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508666.053784:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508666.053810:0:209004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35058 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.053842:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f35051 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae720 expref: 601 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.053870:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35058 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae720 expref: 600 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.053886:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508666.053889:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508666.053893:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa200, rc 0) 00000100:00100000:2.0:1787508666.055294:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+600:338517:x1874324509580544:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 1765us (2146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508666.055306:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94041 00000100:00100000:0.0:1787508666.078647:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508666.080411:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509580800 00000100:00100000:2.0:1787508666.080433:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509580800 00000100:00100000:2.0:1787508666.080544:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94042 00000100:00100000:2.0:1787508666.080568:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+600:338517:x1874324509580800:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:2.0:1787508666.080600:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508666.080605:0:203348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787508666.080644:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35058 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae720 expref: 600 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.080675:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508666.080681:0:203348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508666.080699:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f3505f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae727 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.080890:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35066 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.080907:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35066 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.080931:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35066 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.081314:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3506d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.081325:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3506d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.081334:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3506d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.081435:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35074 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.081448:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35074 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.081456:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35074 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508666.081470:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1260:0x0]: returning size 2097152 00010000:00010000:2.0:1787508666.081598:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35066 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.081606:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35066 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.081614:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35066 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.081621:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35066 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.081628:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508666.081634:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35066 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.081643:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35066 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.081656:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508666.081659:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508666.081664:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35066 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.081672:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35066 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.081687:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3506d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.081694:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3506d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.081700:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3506d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.081706:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508666.081709:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3506d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.081716:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3506d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.081723:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28fbc66 (ffff9090d36fdb00) 00010000:00010000:2.0:1787508666.081727:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508666.081730:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3506d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.081736:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3506d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.081782:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f3505f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae727 expref: 602 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.081798:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35074 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae727 expref: 601 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.081805:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1260:0x0].0x0 (ffff9090d171f300) 00010000:00010000:2.0:1787508666.081807:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787508666.081809:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aae00, rc 0) 00000100:00100000:2.0:1787508666.081908:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+601:338517:x1874324509580800:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 1351us (3276us total) trans 12884944140 rc 0/0 00000100:00100000:2.0:1787508666.081918:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94042 00000100:00100000:2.0:1787508666.088577:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508666.093019:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509580928 00000100:00100000:3.0:1787508666.093035:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509580928 00000100:00100000:3.0:1787508666.093109:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15064 00000100:00100000:3.0:1787508666.093119:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:338517:x1874324509580928:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:3.0:1787508666.093138:0:203726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508666.093160:0:203726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031ca7b1a/0xb126349c40f35082 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae72e expref: -99 pid: 203726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787508666.093188:0:203726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x158a:0x0] initial LVB size: 2097152, mtime: 0x6a8b37ba, atime: 0x0, ctime: 0x6a8b37ba, blocks: 0x1000 00010000:00010000:3.0:1787508666.093211:0:203726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x158a:0x0].0x0 since=13637s v=(0 0) 00010000:00010000:3.0:1787508666.093216:0:203726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x158a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787508666.093225:0:203726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031ca7b1a/0xb126349c40f35082 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae72e expref: 9 pid: 203726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.093243:0:203726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000031ca7b1a/0xb126349c40f35082 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae72e expref: 9 pid: 203726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.093257:0:203726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e600, rc 0) 00000100:00100000:3.0:1787508666.093331:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:338517:x1874324509580928:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 213us (4778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508666.093338:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15064 00000100:00100000:3.0:1787508666.095920:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508666.096193:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509581184 00000100:00100000:1.0:1787508666.096202:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509581184 00000100:00100000:1.0:1787508666.096267:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15432 00000100:00100000:1.0:1787508666.096277:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+601:338517:x1874324509581184:12345-192.168.201.30@tcp:35:multiop.0 00000100:00100000:1.0:1787508666.096608:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+602:338517:x1874324509581184:12345-192.168.201.30@tcp:35:multiop.0 Request processed in 331us (694us total) trans 12884944141 rc 0/0 00000100:00100000:1.0:1787508666.096616:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15432 00000100:00100000:1.0:1787508666.115304:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508666.116239:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509581312 00000100:00100000:2.0:1787508666.116259:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509581312 00000100:00100000:2.0:1787508666.116492:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94043 00000100:00100000:2.0:1787508666.116507:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+602:338518:x1874324509581312:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:2.0:1787508666.116544:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508666.116583:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35089 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae735 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.116678:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35090 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.116696:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.116709:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508666.116770:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508666.116774:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508666.116801:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.116831:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35089 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae735 expref: 604 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.116856:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35090 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae735 expref: 603 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.116866:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508666.116870:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508666.116874:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab800, rc 0) 00000100:00100000:3.0:1787508666.126748:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+603:338518:x1874324509581312:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 10223us (11434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508666.126843:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94043 00000100:00100000:2.0:1787508666.145336:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508666.145620:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509581568 00000100:00100000:1.0:1787508666.145635:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509581568 00000100:00100000:1.0:1787508666.145722:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94044 00000100:00100000:1.0:1787508666.145735:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+603:338518:x1874324509581568:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:1.0:1787508666.145764:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508666.145793:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f35097 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae73c expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508666.146004:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3509e lrc: 3/1,0 mode: --/CR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508666.146025:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3509e lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x1260:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508666.146039:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3509e lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x1260:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508666.146052:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1260:0x0]: returning size 2097152 00010000:00010000:0.0:1787508666.148518:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f35097 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae73c expref: 606 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508666.148563:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3509e lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x1260:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae73c expref: 605 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508666.148575:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1260:0x0].0x0 (ffff9090d171f300) 00010000:00010000:0.0:1787508666.148578:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787508666.148583:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a200, rc 0) 00000100:00100000:0.0:1787508666.148686:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+605:338518:x1874324509581568:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 2952us (3519us total) trans 12884944142 rc 0/0 00000100:00100000:0.0:1787508666.148695:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94044 00000100:00100000:0.0:1787508666.155708:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508666.155812:0:203733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509581696 00000100:00100000:3.0:1787508666.155827:0:203733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509581696 00002000:00100000:3.0:1787508666.155898:0:203733:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x158a:0x0] (1044480->1048575) req@ffff9091f9b59180 x1874324509581696/t0(0) o3->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:122/0 lens 488/0 e 0 to 0 dl 1787508677 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787508666.155910:0:203733:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091f9b59180 with x1874324509581696 ext(1044480->1048575) 00002000:00010000:3.0:1787508666.155929:0:203733:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9091f9b59180 00000100:00100000:3.0:1787508666.155987:0:203733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:3.0:1787508666.156001:0:203733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:2401:x1874324509581696:12345-192.168.201.30@tcp:3:multiop.0 00000100:00100000:3.0:1787508666.157051:0:203733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:2401:x1874324509581696:12345-192.168.201.30@tcp:3:multiop.0 Request processed in 1046us (1361us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787508666.157061:0:203733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 41 00002000:00100000:3.0:1787508666.157071:0:203733:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x158a:0x0] (1044480->1048575) req@ffff9091f9b59180 x1874324509581696/t0(0) o3->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:122/0 lens 488/4536 e 0 to 0 dl 1787508677 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787508666.157083:0:203733:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091f9b59180 with x1874324509581696 ext(1044480->1048575) 00002000:00010000:3.0:1787508666.157087:0:203733:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9091f9b59180 00000100:00100000:1.0:1787508666.269871:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508666.271567:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509581824 00000100:00100000:2.0:1787508666.271588:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509581824 00000100:00100000:2.0:1787508666.271705:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94045 00000100:00100000:2.0:1787508666.271717:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:338520:x1874324509581824:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:2.0:1787508666.271744:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508666.271773:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f350ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae743 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.271867:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f350b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.271885:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f350b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.271898:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f350b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787508666.273310:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1787508666.274648:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508666.274658:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508666.274704:0:209004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f350b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.274759:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f350ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae743 expref: 16 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.274790:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f350b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae743 expref: 15 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.274801:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508666.274804:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508666.274808:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa600, rc 0) 00000100:00100000:2.0:1787508666.274929:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:338520:x1874324509581824:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 3203us (5063us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508666.274983:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94045 00000100:00100000:2.0:1787508666.289509:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508666.290914:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509582080 00000100:00100000:3.0:1787508666.290936:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509582080 00000100:00100000:3.0:1787508666.291088:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94046 00000100:00100000:3.0:1787508666.291101:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:338520:x1874324509582080:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:3.0:1787508666.291547:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508666.291560:0:202228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787508666.291604:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f350b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae743 expref: 15 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.291644:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508666.291651:0:202228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508666.291670:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f350ba lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae74a expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.292916:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f350c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.293456:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f350c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.294290:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f350c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.294323:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f350c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.294335:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f350c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.294342:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f350c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.296607:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f350cf lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.296935:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f350cf lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.297257:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f350cf lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508666.297282:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1260:0x0]: returning size 2097152 00010000:00010000:3.0:1787508666.298861:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f350c1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.298888:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f350c1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.298895:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f350c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.298904:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f350c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.298911:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508666.298917:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f350c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.298927:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f350c1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.300076:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508666.300086:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508666.300093:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f350c1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.300103:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f350c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.300699:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f350c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.300714:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f350c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.300732:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f350c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.301295:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508666.301300:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f350c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.301308:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f350c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.301323:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28fbc66 (ffff9090d36fdb00) 00010000:00010000:3.0:1787508666.301326:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508666.301330:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f350c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.301335:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f350c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.301432:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f350ba lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae74a expref: 17 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.301460:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f350cf lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae74a expref: 16 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.301478:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1260:0x0].0x0 (ffff9090d171f300) 00010000:00010000:3.0:1787508666.301481:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787508666.301485:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e200, rc 0) 00000100:00100000:3.0:1787508666.301605:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:338520:x1874324509582080:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 10504us (12112us total) trans 12884944143 rc 0/0 00000100:00100000:3.0:1787508666.301626:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94046 00000100:00100000:0.0:1787508666.306284:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508666.307598:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509582208 00000100:00100000:2.0:1787508666.307617:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509582208 00000100:00100000:2.0:1787508666.307714:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15065 00000100:00100000:2.0:1787508666.307728:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:338520:x1874324509582208:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:2.0:1787508666.307755:0:225836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508666.307781:0:225836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000650db6b/0xb126349c40f350dd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae751 expref: -99 pid: 225836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.307825:0:225836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000031ca7b1a/0xb126349c40f35082 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae72e expref: 8 pid: 203726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.307836:0:225836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x158a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787508666.307842:0:225836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x158a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787508666.307848:0:225836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000650db6b/0xb126349c40f350dd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 3 type: EXT [1048576->1052671] (req 1048576->1052671) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae751 expref: 6 pid: 225836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.307893:0:225836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000031ca7b1a/0xb126349c40f35082 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae72e expref: 8 pid: 203726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.307911:0:225836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000031ca7b1a/0xb126349c40f35082 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae72e expref: 8 pid: 203726 timeout: 13737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508666.308490:0:225836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:225836:1874324480165504:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508666.308626:0:225836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d0a39b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787508666.316473:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508666.320234:0:203731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509582336 00000100:00100000:3.0:1787508666.320259:0:203731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509582336 00002000:00100000:3.0:1787508666.320348:0:203731:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x158a:0x0] (1048576->1052671) req@ffff9091f9ac9180 x1874324509582336/t0(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:122/0 lens 4584/0 e 0 to 0 dl 1787508677 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787508666.320362:0:203731:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091f9ac9180 with x1874324509582336 ext(1048576->1052671) 00010000:00010000:3.0:1787508666.320373:0:203731:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000031ca7b1a/0xb126349c40f35082 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae72e expref: 9 pid: 203726 timeout: 13737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.320397:0:203731:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000031ca7b1a/0xb126349c40f35082 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae72e expref: 9 pid: 203726 timeout: 13737 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787508666.320406:0:203731:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9091f9ac9180 00000100:00100000:3.0:1787508666.320462:0:203731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:3.0:1787508666.320474:0:203731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:2401:x1874324509582336:12345-192.168.201.30@tcp:4:multiop.0 00000100:00100000:3.0:1787508666.321341:0:203731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:2401:x1874324509582336:12345-192.168.201.30@tcp:4:multiop.0 Request processed in 858us (4873us total) trans 8589940558 rc 0/0 00000100:00100000:3.0:1787508666.321356:0:203731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00002000:00100000:3.0:1787508666.321370:0:203731:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x158a:0x0] (1048576->1052671) req@ffff9091f9ac9180 x1874324509582336/t8589940558(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:122/0 lens 4584/448 e 0 to 0 dl 1787508677 ref 1 fl Complete:H/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787508666.321380:0:203731:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091f9ac9180 with x1874324509582336 ext(1048576->1052671) 00010000:00010000:3.0:1787508666.321390:0:203731:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000031ca7b1a/0xb126349c40f35082 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae72e expref: 11 pid: 203726 timeout: 13737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.321412:0:203731:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000031ca7b1a/0xb126349c40f35082 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae72e expref: 11 pid: 203726 timeout: 13737 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787508666.321420:0:203731:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9091f9ac9180 00000100:00100000:1.0:1787508666.323836:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508666.323988:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509582464 00000100:00100000:3.0:1787508666.323997:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509582464 00010000:00010000:3.0:1787508666.324037:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000031ca7b1a/0xb126349c40f35082 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae72e expref: 11 pid: 203726 timeout: 13737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508666.324084:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27918 00000100:00100000:3.0:1787508666.324095:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:2400:x1874324509582464:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508666.324111:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787508666.324129:0:202212:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x158a:0x0] updating lvb atime from disk: 0 -> 1787508666 00010000:00010000:3.0:1787508666.324136:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000031ca7b1a/0xb126349c40f35082 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae72e expref: 11 pid: 203726 timeout: 13737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.324151:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000031ca7b1a/0xb126349c40f35082 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae72e expref: 11 pid: 203726 timeout: 13737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.324192:0:202212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x158a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787508666.324197:0:202212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x158a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787508666.324206:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000650db6b/0xb126349c40f350dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x50080000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae751 expref: 6 pid: 225836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.324232:0:202212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000650db6b/0xb126349c40f350dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x50080000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae751 expref: 6 pid: 225836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508666.324271:0:202212:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000650db6b/0xb126349c40f350dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae751 expref: 6 pid: 225836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508666.324285:0:202212:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b53480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:202212:1874324480165632:192.168.201.30@tcp:105: 00010000:00010000:2.0:1787508666.324522:0:225836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031ca7b1a/0xb126349c40f35082 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae72e expref: 11 pid: 203726 timeout: 13737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508666.324564:0:225836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:225836:1874324480165504:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508666.324602:0:225836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000650db6b/0xb126349c40f350dd lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae751 expref: 6 pid: 225836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508666.324619:0:225836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa200, rc 0) 00000100:00100000:3.0:1787508666.324623:0:202212:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c883c300 going to sleep for 11 seconds 00000100:00100000:2.0:1787508666.324678:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:338520:x1874324509582208:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 16952us (18409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508666.324690:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15065 00000100:00100000:3.0:1787508666.330010:0:202212:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b53480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:202212:1874324480165632:192.168.201.30@tcp:105: 00010000:00010000:3.0:1787508666.330038:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508666.330104:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2400:x1874324509582464:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 6009us (6275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508666.330119:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27918 00000100:00100000:1.0:1787508666.472108:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508666.472153:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508666.472207:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508666.472248:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508666.472276:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509582720 00000100:00100000:1.0:1787508666.472285:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509582720 00000100:00100000:1.0:1787508666.472346:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509582848 00000100:00100000:1.0:1787508666.472350:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509582848 00000100:00100000:1.0:1787508666.472375:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2954 00000100:00100000:1.0:1787508666.472384:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2400:x1874324509582720:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508666.472471:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2400:x1874324509582720:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 76us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508666.472479:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2954 00000100:00100000:1.0:1787508666.472496:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2955 00000100:00100000:1.0:1787508666.472502:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509582848:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508666.472526:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509582848:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508666.472532:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2955 00000100:00080000:1.0:1787508666.472588:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787508666.472834:0:208927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509582976 00000100:00100000:2.0:1787508666.472840:0:208927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509582976 00000100:00100000:2.0:1787508666.472889:0:208927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2339 00000100:00100000:2.0:1787508666.472897:0:208927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509582976:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508666.472971:0:208927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509582976:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 75us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508666.472978:0:208927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2339 00000100:00100000:0.0:1787508666.473282:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509582592 00000100:00100000:0.0:1787508666.473287:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509582592 00000100:00100000:0.0:1787508666.473335:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 998 00000100:00100000:0.0:1787508666.473344:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d980b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2400:x1874324509582592:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508666.473380:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d980b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2400:x1874324509582592:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 38us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508666.473386:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 998 00000100:00080000:1.0:1787508666.473589:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787508666.939133:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508667.066189:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480165888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787508667.066268:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508667.066292:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480165760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787508667.066324:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508667.066351:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480165888 00000100:00100000:2.0:1787508667.066359:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480165888 00000100:00100000:2.0:1787508667.066429:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480165760 00000100:00100000:2.0:1787508667.066433:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480165760 00000100:00100000:2.0:1787508667.066450:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1665 00000100:00100000:2.0:1787508667.066458:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480165888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787508667.066485:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 117953088 pending 2150400 free 3881955328 avail 3650433024 00000100:00100000:2.0:1787508667.066530:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480165888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508667.066549:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1665 00000100:00100000:2.0:1787508667.066568:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1666 00000100:00100000:2.0:1787508667.066574:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480165760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787508667.066586:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 117953088 pending 2150400 free 3881955328 avail 3650433024 00000100:00100000:2.0:1787508667.066613:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480165760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508667.066619:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1666 00000100:00100000:2.0:1787508667.066661:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480165888:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787508667.066803:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508667.066828:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480165760:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787508667.966300:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508668.011325:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508668.015134:0:225833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509583232 00000100:00100000:0.0:1787508668.015150:0:225833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509583232 00000100:00080000:3.0:1787508668.015246:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508668.015272:0:225833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15066 00000100:00100000:0.0:1787508668.015288:0:225833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509583232:12345-192.168.201.30@tcp:16:kworker.0 00000001:00080000:2.0:1787508668.018905:0:204539:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589940558 is committed 00000100:00100000:1.0:1787508668.019137:0:225833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509583232:12345-192.168.201.30@tcp:16:kworker.0 Request processed in 3849us (7822us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508668.019150:0:225833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15066 00000100:00100000:0.0:1787508668.030548:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508668.037713:0:203732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509583104 00000100:00100000:3.0:1787508668.037728:0:203732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509583104 00002000:00100000:3.0:1787508668.037790:0:203732:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x158a:0x0] (1048576->1052671) req@ffff9091f2980850 x1874324509583104/t0(0) o4->eb35f31c-097f-45a3-8275-bc75f97f89ee@192.168.201.30@tcp:124/0 lens 4584/0 e 0 to 0 dl 1787508679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787508668.037807:0:203732:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091f2980850 with x1874324509583104 ext(1048576->1052671) 00002000:00010000:3.0:1787508668.037813:0:203732:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9091f2980850 00000100:00100000:3.0:1787508668.037841:0:203732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:3.0:1787508668.037851:0:203732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f2980850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509583104:12345-192.168.201.30@tcp:4:multiop.0 00000100:00100000:3.0:1787508668.038655:0:203732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f2980850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2402:x1874324509583104:12345-192.168.201.30@tcp:4:multiop.0 Request processed in 801us (8114us total) trans 8589940559 rc 0/0 00000100:00100000:3.0:1787508668.038676:0:203732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 42 00002000:00100000:3.0:1787508668.038684:0:203732:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x158a:0x0] (1048576->1052671) req@ffff9091f2980850 x1874324509583104/t8589940559(0) o4->eb35f31c-097f-45a3-8275-bc75f97f89ee@192.168.201.30@tcp:124/0 lens 4584/448 e 0 to 0 dl 1787508679 ref 1 fl Complete:/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787508668.038693:0:203732:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091f2980850 with x1874324509583104 ext(1048576->1052671) 00002000:00010000:3.0:1787508668.038696:0:203732:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9091f2980850 00000100:00100000:2.0:1787508668.336682:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508668.337014:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509583360 00000100:00100000:1.0:1787508668.337026:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509583360 00000100:00100000:1.0:1787508668.337122:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15067 00000100:00100000:1.0:1787508668.337134:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:338523:x1874324509583360:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:1.0:1787508668.337154:0:225841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508668.337177:0:225841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d5c36ef/0xb126349c40f350e4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x158a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae758 expref: -99 pid: 225841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508668.337214:0:225841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000650db6b/0xb126349c40f350dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae751 expref: 7 pid: 225836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508668.337229:0:225841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x158a:0x0].0x0 since=2s v=(1 0) 00010000:00010000:1.0:1787508668.337233:0:225841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x158a:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1787508668.337239:0:225841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d5c36ef/0xb126349c40f350e4 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x158a:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae758 expref: 6 pid: 225841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508668.337275:0:225841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000650db6b/0xb126349c40f350dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae751 expref: 7 pid: 225836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508668.337291:0:225841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000650db6b/0xb126349c40f350dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae751 expref: 7 pid: 225836 timeout: 13739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508668.337305:0:225841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:225841:1874324480166016:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508668.337392:0:225841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d01c9a80 going to sleep for 11 seconds 00000100:00080000:3.0:1787508668.341917:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508668.356569:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508668.356702:0:225841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:225841:1874324480166016:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508668.356753:0:225841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002d5c36ef/0xb126349c40f350e4 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x158a:0x0].0x0 rrc: 3 type: EXT [1044480->1048575] (req 1044480->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae758 expref: 6 pid: 225841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508668.356792:0:225841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ae00, rc 0) 00000100:00100000:2.0:1787508668.356857:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:338523:x1874324509583360:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 19725us (20197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508668.356867:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15067 00000100:00100000:3.0:1787508668.358109:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509583488 00000100:00100000:3.0:1787508668.358130:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509583488 00010000:00010000:3.0:1787508668.358171:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000650db6b/0xb126349c40f350dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae751 expref: 8 pid: 225836 timeout: 13739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508668.358212:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27919 00000100:00100000:3.0:1787508668.358222:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2401:x1874324509583488:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508668.358236:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508668.358257:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000650db6b/0xb126349c40f350dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae751 expref: 8 pid: 225836 timeout: 13739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508668.358289:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000650db6b/0xb126349c40f350dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae751 expref: 8 pid: 225836 timeout: 13739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508668.358312:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000650db6b/0xb126349c40f350dd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x158a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1052671) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae751 expref: 8 pid: 225836 timeout: 13739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508668.358328:0:202211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x158a:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1787508668.358333:0:202211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x158a:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1787508668.358342:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002d5c36ef/0xb126349c40f350e4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x158a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1044480->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae758 expref: 5 pid: 225841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508668.358352:0:202211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d5c36ef/0xb126349c40f350e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x158a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1044480->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae758 expref: 5 pid: 225841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508668.358386:0:202211:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002d5c36ef/0xb126349c40f350e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x158a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1044480->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae758 expref: 5 pid: 225841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508668.358400:0:202211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b50380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:202211:1874324480166144:192.168.201.30@tcp:105: 00000100:00100000:3.0:1787508668.358484:0:202211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c883c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787508668.367615:0:202211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b50380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:202211:1874324480166144:192.168.201.30@tcp:105: 00010000:00010000:3.0:1787508668.367646:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508668.367743:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2401:x1874324509583488:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 9521us (11182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508668.367759:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27919 00000100:00100000:1.0:1787508668.602583:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480166272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787508668.602665:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508668.602867:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480166272 00000100:00100000:0.0:1787508668.602876:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480166272 00000100:00100000:0.0:1787508668.602973:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1667 00000100:00100000:0.0:1787508668.602985:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9aca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480166272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787508668.603016:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25428544 pending 0 free 3910828032 avail 3679305728 00000100:00100000:0.0:1787508668.603067:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9aca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480166272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508668.603074:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1667 00000100:00080000:3.0:1787508668.603257:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508668.603353:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480166272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787508668.608258:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480166400:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787508668.608350:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508668.608607:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480166400 00000100:00100000:0.0:1787508668.608618:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480166400 00000100:00100000:0.0:1787508668.608691:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1668 00000100:00100000:0.0:1787508668.608701:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480166400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787508668.608725:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25428544 pending 0 free 3910828032 avail 3679305728 00000100:00100000:0.0:1787508668.608783:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480166400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508668.608789:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1668 00000100:00080000:3.0:1787508668.608901:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508668.609091:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480166400:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787508668.986640:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508669.626452:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787508669.626478:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480166528:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787508669.626563:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508669.626718:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480166528 00000100:00100000:0.0:1787508669.626726:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480166528 00000100:00100000:0.0:1787508669.626789:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29826 00000100:00100000:0.0:1787508669.626799:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480166528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787508669.626835:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1441771520 avail 1295532032 00000100:00100000:0.0:1787508669.626893:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480166528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508669.626900:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29826 00000100:00100000:0.0:1787508669.626977:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480166528:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787508669.627392:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480166656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787508669.627426:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508669.627509:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480166656 00000100:00100000:1.0:1787508669.627513:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480166656 00000100:00100000:1.0:1787508669.627553:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29827 00000100:00100000:1.0:1787508669.627561:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480166656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787508669.627581:0:202232:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1442783232 avail 1296543744 00000100:00100000:1.0:1787508669.627623:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480166656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508669.627629:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29827 00000100:00100000:1.0:1787508669.627663:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480166656:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787508670.013698:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508670.138757:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480167040:0@lo:400:kworker.0 00000100:00100000:3.0:1787508670.138829:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508670.138866:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480167552:0@lo:400:kworker.0 00000100:00100000:3.0:1787508670.138894:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508670.138910:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480168064:0@lo:400:kworker.0 00000100:00100000:3.0:1787508670.138933:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508670.138989:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787508670.138995:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480166912:0@lo:400:kworker.0 00000100:00100000:3.0:1787508670.139020:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508670.139034:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480167424:0@lo:400:kworker.0 00000100:00100000:3.0:1787508670.139053:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508670.139065:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480167936:0@lo:400:kworker.0 00000100:00100000:3.0:1787508670.139083:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508670.139176:0:230130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480167040 00000100:00100000:1.0:1787508670.139185:0:230130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480167040 00000100:00100000:1.0:1787508670.139253:0:230130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480167552 00000100:00100000:1.0:1787508670.139257:0:230130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480167552 00000100:00100000:1.0:1787508670.139279:0:230130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2340 00000100:00100000:1.0:1787508670.139288:0:230130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480167040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508670.139356:0:230130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480167040:12345-0@lo:400:kworker.0 Request processed in 68us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508670.139364:0:230130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2340 00000100:00100000:1.0:1787508670.139379:0:230130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2341 00000100:00100000:1.0:1787508670.139385:0:230130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480167552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508670.139420:0:230130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480167552:12345-0@lo:400:kworker.0 Request processed in 35us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508670.139426:0:230130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2341 00000100:00100000:1.0:1787508670.139658:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480167168:0@lo:400:kworker.0 00000100:00100000:1.0:1787508670.139685:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508670.139704:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480167680:0@lo:400:kworker.0 00000100:00100000:1.0:1787508670.139723:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508670.139738:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480168192:0@lo:400:kworker.0 00000100:00100000:1.0:1787508670.139758:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508670.139775:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1787508670.139781:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480166784:0@lo:400:kworker.0 00000100:00100000:1.0:1787508670.139805:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508670.139832:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874324480167296:0@lo:400:kworker.0 00000100:00100000:1.0:1787508670.139852:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508670.139869:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874324480167808:0@lo:400:kworker.0 00000100:00100000:1.0:1787508670.139890:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508670.139906:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874324480168320:0@lo:400:kworker.0 00000100:00100000:1.0:1787508670.139924:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508670.139976:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480167168 00000100:00100000:1.0:1787508670.139980:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480167168 00000100:00100000:1.0:1787508670.140005:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480167680 00000100:00100000:1.0:1787508670.140008:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480167680 00000100:00100000:1.0:1787508670.140027:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2342 00000100:00100000:1.0:1787508670.140033:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480167168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508670.140071:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480167168:12345-0@lo:400:kworker.0 Request processed in 37us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508670.140077:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2342 00000100:00100000:1.0:1787508670.140088:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2343 00000100:00100000:1.0:1787508670.140093:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480167680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508670.140119:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480167680:12345-0@lo:400:kworker.0 Request processed in 26us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508670.140125:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2343 00000100:00100000:1.0:1787508670.140146:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480166784 00000100:00100000:1.0:1787508670.140150:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480166784 00000100:00100000:1.0:1787508670.140172:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:1.0:1787508670.140178:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d980bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480166784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508670.140206:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d980bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480166784:12345-0@lo:400:kworker.0 Request processed in 28us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508670.140213:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:1.0:1787508670.140237:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480168064 00000100:00100000:1.0:1787508670.140240:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480168064 00000100:00100000:1.0:1787508670.140262:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480167936 00000100:00100000:1.0:1787508670.140265:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480167936 00000100:00100000:1.0:1787508670.140276:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480168192 00000100:00100000:1.0:1787508670.140279:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480168192 00000100:00100000:1.0:1787508670.140289:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480167296 00000100:00100000:1.0:1787508670.140291:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480167296 00000100:00100000:1.0:1787508670.140301:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480167808 00000100:00100000:1.0:1787508670.140303:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480167808 00000100:00100000:1.0:1787508670.140313:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480168320 00000100:00100000:1.0:1787508670.140315:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480168320 00000100:00100000:1.0:1787508670.140328:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2956 00000100:00100000:1.0:1787508670.140334:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480168064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508670.140363:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480168064:12345-0@lo:400:kworker.0 Request processed in 29us (1429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508670.140369:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2956 00000100:00100000:1.0:1787508670.140380:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2957 00000100:00100000:1.0:1787508670.140385:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480167936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508670.140411:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480167936:12345-0@lo:400:kworker.0 Request processed in 26us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508670.140417:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2957 00000100:00100000:1.0:1787508670.140428:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2958 00000100:00100000:1.0:1787508670.140433:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480168192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508670.140458:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480168192:12345-0@lo:400:kworker.0 Request processed in 25us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508670.140464:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2958 00000100:00100000:1.0:1787508670.140475:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2959 00000100:00100000:1.0:1787508670.140480:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874324480167296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508670.140520:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874324480167296:12345-0@lo:400:kworker.0 Request processed in 40us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508670.140526:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2959 00000100:00100000:1.0:1787508670.140537:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2960 00000100:00100000:1.0:1787508670.140543:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874324480167808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508670.140569:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874324480167808:12345-0@lo:400:kworker.0 Request processed in 26us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508670.140574:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2960 00000100:00100000:1.0:1787508670.140587:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2961 00000100:00100000:1.0:1787508670.140592:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874324480168320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508670.140613:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874324480168320:12345-0@lo:400:kworker.0 Request processed in 22us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508670.140619:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2961 00000100:00100000:1.0:1787508670.140651:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480166784:0@lo:400:kworker.0 00000100:00100000:1.0:1787508670.140664:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874324480167296:0@lo:400:kworker.0 00000100:00100000:1.0:1787508670.140673:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874324480167808:0@lo:400:kworker.0 00000100:00100000:1.0:1787508670.140681:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874324480168320:0@lo:400:kworker.0 00000100:00100000:1.0:1787508670.140690:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480167168:0@lo:400:kworker.0 00000100:00100000:1.0:1787508670.140698:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480167680:0@lo:400:kworker.0 00000100:00100000:1.0:1787508670.140706:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480168192:0@lo:400:kworker.0 00000100:00100000:1.0:1787508670.140755:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480167936:0@lo:400:kworker.0 00000100:00100000:1.0:1787508670.140767:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480167040:0@lo:400:kworker.0 00000100:00100000:1.0:1787508670.140776:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480167552:0@lo:400:kworker.0 00000100:00100000:1.0:1787508670.140785:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480168064:0@lo:400:kworker.0 00000100:00100000:0.0:1787508670.141354:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480166912 00000100:00100000:0.0:1787508670.141361:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480166912 00000100:00100000:0.0:1787508670.141402:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480167424 00000100:00100000:0.0:1787508670.141406:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480167424 00000100:00100000:0.0:1787508670.141426:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29828 00000100:00100000:0.0:1787508670.141446:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480166912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508670.141536:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480166912:12345-0@lo:400:kworker.0 Request processed in 91us (2515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508670.141543:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29828 00000100:00100000:0.0:1787508670.141558:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29829 00000100:00100000:0.0:1787508670.141564:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480167424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508670.141593:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480167424:12345-0@lo:400:kworker.0 Request processed in 30us (2539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508670.141599:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29829 00000100:00100000:0.0:1787508670.141647:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480166912:0@lo:400:kworker.0 00000100:00100000:0.0:1787508670.141658:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480167424:0@lo:400:kworker.0 00000100:00080000:3.0:1787508670.142287:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787508670.142293:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787508670.142296:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787508670.142299:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1787508670.652638:0:203722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589941250 is committed 00010000:00010000:3.0:1787508671.034864:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787508671.164560:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944143 is committed 00000001:00080000:3.0:1787508671.164584:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944142 is committed 00010000:00010000:1.0:1787508671.164783:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34fcc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508671.164853:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34fcc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508671.164861:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34fcc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508671.164867:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508671.164872:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34fcc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508671.164880:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34fcc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508671.164897:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x28fbc66 (ffff9090d36fdb00) 00010000:00010000:1.0:1787508671.164900:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508671.164903:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34fcc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508671.164910:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f34fcc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x28fbc66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508671.165004:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3503c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1260:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508671.165012:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3503c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x1260:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508671.165018:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3503c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1260:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508671.165022:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508671.165025:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3503c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1260:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508671.165031:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3503c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x1260:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508671.165039:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1260:0x0].0x0 (ffff9090d171f300) 00010000:00010000:1.0:1787508671.165041:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508671.165044:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3503c lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x1260:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508671.165050:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3503c lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x1260:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508671.601234:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508671.601283:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508671.601398:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508671.601428:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508671.601584:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509583616 00000100:00100000:2.0:1787508671.601603:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509583616 00000100:00100000:2.0:1787508671.601688:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1000 00000100:00100000:2.0:1787508671.601700:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509583616:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508671.603102:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509583616:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 1396us (1870us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508671.603117:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1000 00000100:00100000:0.0:1787508671.604029:0:225832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509584128 00000100:00100000:0.0:1787508671.604044:0:225832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509584128 00000100:00100000:0.0:1787508671.604133:0:225832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2344 00000100:00100000:0.0:1787508671.604148:0:225832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509584128:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508671.604226:0:225832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509584128:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 83us (2828us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508671.604234:0:225832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2344 00000100:00080000:0.0:1787508671.604410:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508671.607794:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508671.607820:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508671.607892:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509584640 00000100:00100000:2.0:1787508671.607902:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509584640 00000100:00100000:2.0:1787508671.607998:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2345 00000100:00100000:2.0:1787508671.608008:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2403:x1874324509584640:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508671.608076:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2403:x1874324509584640:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 70us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508671.608084:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2345 00000100:00080000:2.0:1787508671.608109:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508671.611032:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509583872 00000100:00100000:3.0:1787508671.611047:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509583872 00000100:00100000:3.0:1787508671.611119:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509584384 00000100:00100000:3.0:1787508671.611123:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509584384 00000100:00100000:3.0:1787508671.611157:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2962 00000100:00100000:3.0:1787508671.611167:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2403:x1874324509583872:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508671.611518:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2403:x1874324509583872:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 351us (10233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508671.611527:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2962 00000100:00100000:3.0:1787508671.611552:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2963 00000100:00100000:3.0:1787508671.611559:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509584384:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508671.611584:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509584384:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (10156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508671.611590:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2963 00000100:00100000:1.0:1787508671.614957:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508671.615068:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508671.615098:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508671.615134:0:226134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509584000 00000100:00100000:1.0:1787508671.615145:0:226134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509584000 00000100:00100000:1.0:1787508671.615199:0:226134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509584512 00000100:00100000:1.0:1787508671.615202:0:226134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509584512 00000100:00100000:1.0:1787508671.615225:0:226134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2346 00000100:00100000:1.0:1787508671.615235:0:226134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2403:x1874324509584000:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508671.615302:0:226134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2403:x1874324509584000:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 67us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508671.615309:0:226134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2346 00000100:00100000:1.0:1787508671.615327:0:226134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2347 00000100:00100000:1.0:1787508671.615333:0:226134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509584512:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508671.615357:0:226134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509584512:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508671.615364:0:226134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2347 00000100:00100000:1.0:1787508671.615396:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509583744 00000100:00100000:1.0:1787508671.615401:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509583744 00000100:00100000:1.0:1787508671.615428:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509584256 00000100:00100000:1.0:1787508671.615432:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509584256 00000100:00100000:1.0:1787508671.615451:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2964 00000100:00100000:1.0:1787508671.615466:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+592:2403:x1874324509583744:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508671.615506:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+592:2403:x1874324509583744:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 49us (7685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508671.615513:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2964 00000100:00100000:1.0:1787508671.615527:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2965 00000100:00100000:1.0:1787508671.615533:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2403:x1874324509584256:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508671.615557:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2403:x1874324509584256:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508671.615563:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2965 00000100:00080000:2.0:1787508671.616887:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787508671.616898:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787508671.616900:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1787508672.059725:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508672.186488:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787508672.186511:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480168448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787508672.186583:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508672.186648:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480168448 00000100:00100000:0.0:1787508672.186657:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480168448 00000100:00100000:2.0:1787508672.186992:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787508672.187003:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480168576:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787508672.187032:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508672.187072:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480168576 00000100:00100000:2.0:1787508672.187076:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480168576 00000100:00100000:0.0:1787508672.187166:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1669 00000100:00100000:0.0:1787508672.187176:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480168448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787508672.187204:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 124240448 pending 28672 free 3881955328 avail 3650433024 00000100:00100000:0.0:1787508672.187244:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480168448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508672.187251:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1669 00000100:00100000:0.0:1787508672.187326:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480168448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787508672.194085:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1670 00000100:00100000:2.0:1787508672.194103:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480168576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787508672.194131:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 124240448 pending 28672 free 3881955328 avail 3650433024 00000100:00100000:2.0:1787508672.194532:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480168576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 434us (7497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508672.194541:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1670 00000100:00100000:3.0:1787508672.194760:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480168576:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787508672.195674:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787508673.082394:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508673.722481:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787508673.722513:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480168704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787508673.722612:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508673.723133:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480168704 00000100:00100000:3.0:1787508673.723145:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480168704 00000100:00100000:3.0:1787508673.723233:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1671 00000100:00100000:3.0:1787508673.723248:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480168704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787508673.723289:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25428544 pending 0 free 3910828032 avail 3679305728 00000100:00100000:3.0:1787508673.723364:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480168704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508673.723373:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1671 00000100:00100000:0.0:1787508673.723444:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480168704:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787508673.723471:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787508673.723551:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787508673.723566:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480168832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787508673.723607:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:2.0:1787508673.733172:0:204539:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589940559 is committed 00000100:00100000:2.0:1787508673.738457:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480168832 00000100:00100000:2.0:1787508673.738482:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480168832 00000100:00100000:2.0:1787508673.738669:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1672 00000100:00100000:2.0:1787508673.738682:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480168832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787508673.738720:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25428544 pending 0 free 3910828032 avail 3679305728 00000100:00100000:2.0:1787508673.738830:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480168832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (15222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508673.738838:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1672 00000100:00100000:2.0:1787508673.738916:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480168832:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787508673.744080:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787508674.112352:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508674.746310:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480168960:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787508674.746417:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508674.747084:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787508674.747098:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480169088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787508674.747154:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508674.747214:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480168960 00000100:00100000:2.0:1787508674.747223:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480168960 00000100:00100000:2.0:1787508674.747281:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480169088 00000100:00100000:2.0:1787508674.747284:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480169088 00000100:00100000:2.0:1787508674.747310:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29830 00000100:00100000:2.0:1787508674.747321:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480168960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787508674.747390:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1442783232 avail 1296543744 00000100:00100000:2.0:1787508674.747464:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480168960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 144us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508674.747472:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29830 00000100:00100000:2.0:1787508674.747493:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29831 00000100:00100000:2.0:1787508674.747499:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480169088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787508674.747518:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1441771520 avail 1295532032 00000100:00100000:2.0:1787508674.747548:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480169088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 49us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508674.747554:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29831 00000100:00100000:2.0:1787508674.747621:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480169088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787508674.747635:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480168960:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787508675.130643:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508675.258438:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480169600:0@lo:400:kworker.0 00000100:00100000:3.0:1787508675.258542:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508675.258621:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480170112:0@lo:400:kworker.0 00000100:00100000:3.0:1787508675.258646:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508675.258670:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874324480170624:0@lo:400:kworker.0 00000100:00100000:3.0:1787508675.258697:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508675.258727:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787508675.258733:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480169472:0@lo:400:kworker.0 00000100:00100000:3.0:1787508675.258758:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508675.258775:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480169984:0@lo:400:kworker.0 00000100:00100000:3.0:1787508675.258796:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508675.258810:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480170496:0@lo:400:kworker.0 00000100:00100000:3.0:1787508675.258830:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508675.258867:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480170624 00000100:00100000:3.0:1787508675.258877:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480170624 00000100:00100000:3.0:1787508675.258986:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480170496 00000100:00100000:3.0:1787508675.258990:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480170496 00000100:00100000:3.0:1787508675.259020:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2966 00000100:00100000:3.0:1787508675.259034:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874324480170624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508675.259095:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874324480170624:12345-0@lo:400:kworker.0 Request processed in 66us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508675.259102:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2966 00000100:00100000:3.0:1787508675.259129:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2967 00000100:00100000:3.0:1787508675.259136:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480170496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508675.259163:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480170496:12345-0@lo:400:kworker.0 Request processed in 28us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508675.259169:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2967 00000100:00100000:3.0:1787508675.259214:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480170496:0@lo:400:kworker.0 00000100:00100000:3.0:1787508675.259225:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874324480170624:0@lo:400:kworker.0 00000100:00100000:1.0:1787508675.259351:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480169600 00000100:00100000:1.0:1787508675.259355:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480169600 00000100:00100000:1.0:1787508675.259410:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480170112 00000100:00100000:1.0:1787508675.259414:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480170112 00000100:00100000:1.0:1787508675.259438:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480169472 00000100:00100000:1.0:1787508675.259442:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480169472 00000100:00100000:1.0:1787508675.259461:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480169984 00000100:00100000:1.0:1787508675.259464:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480169984 00000100:00100000:1.0:1787508675.259485:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2348 00000100:00100000:1.0:1787508675.259492:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480169600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508675.259537:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480169600:12345-0@lo:400:kworker.0 Request processed in 46us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508675.259543:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2348 00000100:00100000:1.0:1787508675.259556:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2349 00000100:00100000:1.0:1787508675.259561:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480170112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508675.259587:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480170112:12345-0@lo:400:kworker.0 Request processed in 26us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508675.259596:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2349 00000100:00100000:1.0:1787508675.259606:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2350 00000100:00100000:1.0:1787508675.259612:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480169472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508675.259640:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480169472:12345-0@lo:400:kworker.0 Request processed in 29us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508675.259645:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2350 00000100:00100000:1.0:1787508675.259655:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2351 00000100:00100000:1.0:1787508675.259662:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480169984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508675.259688:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480169984:12345-0@lo:400:kworker.0 Request processed in 27us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508675.259694:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2351 00000100:00080000:1.0:1787508675.259715:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787508675.259720:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787508675.259723:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787508675.259725:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508675.260633:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480169216:0@lo:400:kworker.0 00000100:00100000:2.0:1787508675.260712:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508675.260773:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874324480169728:0@lo:400:kworker.0 00000100:00100000:2.0:1787508675.260800:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508675.260818:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874324480170240:0@lo:400:kworker.0 00000100:00100000:2.0:1787508675.260836:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508675.260858:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874324480170752:0@lo:400:kworker.0 00000100:00100000:2.0:1787508675.260878:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508675.261278:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480169344:0@lo:400:kworker.0 00000100:00100000:0.0:1787508675.261323:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508675.261364:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480169856:0@lo:400:kworker.0 00000100:00100000:0.0:1787508675.261389:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508675.261422:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874324480170368:0@lo:400:kworker.0 00000100:00100000:0.0:1787508675.261686:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480169728 00000100:00100000:0.0:1787508675.261695:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480169728 00000100:00100000:0.0:1787508675.261750:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480170240 00000100:00100000:0.0:1787508675.261754:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480170240 00000100:00100000:0.0:1787508675.261772:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480170752 00000100:00100000:0.0:1787508675.261775:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480170752 00000100:00100000:0.0:1787508675.261807:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2968 00000100:00100000:0.0:1787508675.261816:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874324480169728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508675.262257:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2969 00000100:00100000:2.0:1787508675.262268:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874324480170240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508675.262308:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874324480170240:12345-0@lo:400:kworker.0 Request processed in 43us (1470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508675.262315:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2969 00000100:00100000:2.0:1787508675.262339:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2970 00000100:00100000:2.0:1787508675.262345:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874324480170752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508675.262489:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480169216 00000100:00100000:1.0:1787508675.262496:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480169216 00000100:00100000:1.0:1787508675.262536:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:1.0:1787508675.262543:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480169216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508675.262585:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480169216:12345-0@lo:400:kworker.0 Request processed in 43us (1873us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508675.262591:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00080000:1.0:1787508675.262635:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787508675.262682:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480169344 00000100:00100000:1.0:1787508675.262686:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480169344 00000100:00100000:1.0:1787508675.262714:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480169856 00000100:00100000:1.0:1787508675.262717:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480169856 00000100:00100000:1.0:1787508675.262737:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29832 00000100:00100000:1.0:1787508675.262743:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480169344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508675.262779:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480169344:12345-0@lo:400:kworker.0 Request processed in 37us (1456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508675.262786:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29832 00000100:00100000:1.0:1787508675.262798:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29833 00000100:00100000:1.0:1787508675.262803:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480169856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508675.262838:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480169856:12345-0@lo:400:kworker.0 Request processed in 35us (1449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508675.262843:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29833 00000100:00100000:1.0:1787508675.262912:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508675.263003:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480169344:0@lo:400:kworker.0 00000100:00100000:1.0:1787508675.263016:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480169856:0@lo:400:kworker.0 00000100:00100000:1.0:1787508675.263051:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480170368 00000100:00100000:1.0:1787508675.263066:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480170368 00000100:00100000:1.0:1787508675.263101:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2971 00000100:00100000:1.0:1787508675.263119:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874324480170368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508675.263157:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874324480170368:12345-0@lo:400:kworker.0 Request processed in 51us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508675.264235:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874324480169728:12345-0@lo:400:kworker.0 Request processed in 63us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508675.264721:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874324480170752:12345-0@lo:400:kworker.0 Request processed in 2370us (3835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508675.264865:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2971 00000100:00080000:1.0:1787508675.264935:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787508675.265001:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874324480170368:0@lo:400:kworker.0 00000100:00100000:3.0:1787508675.265429:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480169472:0@lo:400:kworker.0 00000100:00100000:3.0:1787508675.265446:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480169984:0@lo:400:kworker.0 00000100:00100000:3.0:1787508675.265463:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480169600:0@lo:400:kworker.0 00000100:00100000:3.0:1787508675.265477:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480170112:0@lo:400:kworker.0 00000100:00100000:3.0:1787508675.265542:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480169216:0@lo:400:kworker.0 00000100:00100000:3.0:1787508675.265559:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874324480169728:0@lo:400:kworker.0 00000100:00100000:3.0:1787508675.265573:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874324480170240:0@lo:400:kworker.0 00000100:00100000:3.0:1787508675.265586:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874324480170752:0@lo:400:kworker.0 00000100:00100000:0.0:1787508675.274326:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2968 00000100:00100000:2.0:1787508675.287403:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2970 00010000:00010000:0.0:1787508676.154219:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508676.715207:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508676.715269:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508676.715306:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508676.715335:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508676.715354:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508676.715384:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508676.715405:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508676.715424:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508676.716288:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508676.716339:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509585152 00000100:00100000:1.0:1787508676.716353:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509585152 00000100:00100000:1.0:1787508676.716439:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509585280 00000100:00100000:3.0:1787508676.716601:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509584896 00000100:00100000:3.0:1787508676.716607:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509584896 00000100:00100000:3.0:1787508676.716645:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509585024 00000100:00100000:3.0:1787508676.716649:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509585024 00000100:00100000:3.0:1787508676.716666:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509585536 00000100:00100000:3.0:1787508676.716669:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509585536 00000100:00100000:3.0:1787508676.716686:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509585408 00000100:00100000:3.0:1787508676.716690:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509585408 00000100:00100000:3.0:1787508676.716718:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2972 00000100:00100000:3.0:1787508676.716729:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+592:2400:x1874324509584896:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508676.716836:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+592:2400:x1874324509584896:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 107us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508676.716845:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2972 00000100:00100000:3.0:1787508676.716872:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2973 00000100:00100000:3.0:1787508676.716878:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2400:x1874324509585024:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508676.716904:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2400:x1874324509585024:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (1568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508676.716911:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2973 00000100:00100000:3.0:1787508676.716923:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2974 00000100:00100000:3.0:1787508676.716928:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509585536:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508676.716997:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509585536:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 68us (1612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508676.717003:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2974 00000100:00100000:3.0:1787508676.717015:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2975 00000100:00100000:3.0:1787508676.717022:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2401:x1874324509585408:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508676.717046:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2401:x1874324509585408:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (1641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508676.717053:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2975 00000100:00100000:3.0:1787508676.717125:0:225834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509585792 00000100:00100000:3.0:1787508676.717130:0:225834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509585792 00000100:00100000:3.0:1787508676.717152:0:225834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509585664 00000100:00100000:3.0:1787508676.717155:0:225834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509585664 00000100:00100000:3.0:1787508676.717172:0:225834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2352 00000100:00100000:3.0:1787508676.717179:0:225834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2401:x1874324509585152:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508676.717205:0:225834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2401:x1874324509585152:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 27us (1898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508676.717211:0:225834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2352 00000100:00100000:3.0:1787508676.717223:0:225834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2353 00000100:00100000:3.0:1787508676.717229:0:225834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509585792:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508676.717248:0:225834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509585792:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 19us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508676.717254:0:225834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2353 00000100:00100000:3.0:1787508676.717262:0:225834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2354 00000100:00100000:3.0:1787508676.717267:0:225834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2401:x1874324509585664:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508676.717286:0:225834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2401:x1874324509585664:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 19us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508676.717292:0:225834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2354 00000100:00080000:3.0:1787508676.717326:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787508676.717331:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787508676.717334:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787508676.717336:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787508676.717457:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509584768 00000100:00100000:2.0:1787508676.717462:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509584768 00000100:00100000:2.0:1787508676.717497:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1002 00000100:00100000:2.0:1787508676.717504:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d980ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2400:x1874324509584768:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508676.717533:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d980ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2400:x1874324509584768:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 30us (2343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508676.717540:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1002 00000100:00100000:1.0:1787508676.718050:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509585280 00000100:00100000:1.0:1787508676.718107:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2355 00000100:00100000:1.0:1787508676.718115:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2400:x1874324509585280:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508676.718151:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2400:x1874324509585280:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 38us (2796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508676.718157:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2355 00000100:00080000:2.0:1787508676.723357:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787508677.178269:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508677.307692:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480170880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508677.308046:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508677.308262:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480170880 00000100:00100000:2.0:1787508677.308276:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480170880 00000100:00100000:2.0:1787508677.308388:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1673 00000100:00100000:2.0:1787508677.308403:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480170880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787508677.308882:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 124211776 pending 0 free 3881955328 avail 3650433024 00000100:00100000:2.0:1787508677.308999:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480170880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 600us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508677.309008:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1673 00000100:00100000:2.0:1787508677.309081:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480170880:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787508677.309151:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508677.310766:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787508677.310799:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d4856a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480171008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787508677.310897:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508677.311074:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480171008 00000100:00100000:0.0:1787508677.311083:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480171008 00000100:00100000:0.0:1787508677.311173:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1674 00000100:00100000:0.0:1787508677.311185:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480171008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787508677.311775:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 124211776 pending 0 free 3881955328 avail 3650433024 00000100:00100000:0.0:1787508677.311872:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480171008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 687us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508677.311882:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1674 00000100:00080000:3.0:1787508677.311973:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508677.312084:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d4856a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480171008:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787508678.202327:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508678.397663:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508678.397750:0:205404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509585920 00000100:00100000:0.0:1787508678.397760:0:205404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509585920 00002000:00100000:0.0:1787508678.397834:0:205404:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x158a:0x0] (1044480->1048575) req@ffff9091e6a5f800 x1874324509585920/t0(0) o3->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:134/0 lens 488/0 e 0 to 0 dl 1787508689 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787508678.397846:0:205404:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091e6a5f800 with x1874324509585920 ext(1044480->1048575) 00002000:00010000:0.0:1787508678.397852:0:205404:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9091e6a5f800 00000100:00100000:0.0:1787508678.398157:0:205404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:0.0:1787508678.398174:0:205404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2401:x1874324509585920:12345-192.168.201.30@tcp:3:multiop.0 00000100:00080000:3.0:1787508678.398378:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508678.398622:0:205404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2401:x1874324509585920:12345-192.168.201.30@tcp:3:multiop.0 Request processed in 453us (968us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787508678.398631:0:205404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 43 00002000:00100000:0.0:1787508678.398638:0:205404:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x158a:0x0] (1044480->1048575) req@ffff9091e6a5f800 x1874324509585920/t0(0) o3->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:134/0 lens 488/4536 e 0 to 0 dl 1787508689 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787508678.398647:0:205404:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091e6a5f800 with x1874324509585920 ext(1044480->1048575) 00002000:00010000:0.0:1787508678.398650:0:205404:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9091e6a5f800 00000100:00100000:2.0:1787508678.421499:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508678.421657:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509586176 00000100:00100000:3.0:1787508678.421667:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509586176 00000100:00100000:3.0:1787508678.421809:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15433 00000100:00100000:3.0:1787508678.421831:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:338520:x1874324509586176:12345-192.168.201.30@tcp:35:multiop.0 00000100:00100000:3.0:1787508678.422129:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:338520:x1874324509586176:12345-192.168.201.30@tcp:35:multiop.0 Request processed in 300us (638us total) trans 12884944144 rc 0/0 00000100:00100000:3.0:1787508678.422137:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15433 00000100:00080000:0.0:1787508678.422751:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508678.842405:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787508678.842429:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480171136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787508678.842496:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508678.842837:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480171136 00000100:00100000:3.0:1787508678.842845:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480171136 00000100:00100000:3.0:1787508678.842912:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1675 00000100:00100000:3.0:1787508678.842922:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4856300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480171136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787508678.842966:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25428544 pending 0 free 3910828032 avail 3679305728 00000100:00100000:3.0:1787508678.843015:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4856300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480171136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508678.843023:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1675 00000100:00100000:3.0:1787508678.843069:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480171136:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787508678.843161:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787508678.843641:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480171264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787508678.843686:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508678.843823:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480171264 00000100:00100000:1.0:1787508678.843828:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480171264 00000100:00100000:1.0:1787508678.843870:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1676 00000100:00100000:1.0:1787508678.843877:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480171264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787508678.843890:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25428544 pending 0 free 3910828032 avail 3679305728 00000100:00100000:1.0:1787508678.843928:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480171264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508678.843938:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1676 00000100:00100000:1.0:1787508678.843987:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480171264:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787508678.844045:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787508679.226294:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508679.866157:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787508679.866185:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480171392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787508679.866225:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787508679.866237:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d4857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480171520:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787508679.866272:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508679.866314:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508679.866365:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480171392 00000100:00100000:2.0:1787508679.866368:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480171520 00000100:00100000:1.0:1787508679.866373:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480171392 00000100:00100000:2.0:1787508679.866374:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480171520 00000100:00100000:2.0:1787508679.866509:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29834 00000100:00100000:2.0:1787508679.866519:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480171520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787508679.866550:0:202232:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1441771520 avail 1295532032 00000100:00100000:2.0:1787508679.866598:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480171520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508679.866605:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29834 00000100:00100000:2.0:1787508679.866623:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29835 00000100:00100000:2.0:1787508679.866629:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480171392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787508679.866647:0:202232:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1442783232 avail 1296543744 00000100:00100000:2.0:1787508679.866680:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480171392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 51us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508679.866686:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29835 00000100:00100000:2.0:1787508679.873143:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480171392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787508679.873223:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d4857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480171520:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787508680.256246:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508680.378536:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480171904:0@lo:400:kworker.0 00000100:00100000:0.0:1787508680.378606:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508680.378659:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480172416:0@lo:400:kworker.0 00000100:00100000:0.0:1787508680.378679:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508680.378698:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874324480172928:0@lo:400:kworker.0 00000100:00100000:0.0:1787508680.378720:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508680.378743:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787508680.378748:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480171776:0@lo:400:kworker.0 00000100:00100000:0.0:1787508680.378771:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508680.378789:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480172288:0@lo:400:kworker.0 00000100:00100000:0.0:1787508680.378809:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508680.378825:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874324480172800:0@lo:400:kworker.0 00000100:00100000:0.0:1787508680.378851:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508680.378884:0:226134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480171904 00000100:00100000:0.0:1787508680.378892:0:226134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480171904 00000100:00100000:0.0:1787508680.378965:0:226134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480172416 00000100:00100000:0.0:1787508680.378968:0:226134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480172416 00000100:00100000:0.0:1787508680.378996:0:226134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2356 00000100:00100000:0.0:1787508680.379004:0:226134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480171904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508680.379062:0:226134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480171904:12345-0@lo:400:kworker.0 Request processed in 59us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508680.379069:0:226134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2356 00000100:00100000:0.0:1787508680.379086:0:226134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2357 00000100:00100000:0.0:1787508680.379093:0:226134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480172416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508680.379120:0:226134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480172416:12345-0@lo:400:kworker.0 Request processed in 28us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508680.379126:0:226134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2357 00000100:00100000:0.0:1787508680.379144:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480172928 00000100:00100000:0.0:1787508680.379148:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480172928 00000100:00100000:0.0:1787508680.379173:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480172800 00000100:00100000:0.0:1787508680.379177:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480172800 00000100:00100000:0.0:1787508680.379196:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2976 00000100:00100000:0.0:1787508680.379203:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874324480172928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508680.379233:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874324480172928:12345-0@lo:400:kworker.0 Request processed in 31us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508680.379239:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2976 00000100:00100000:0.0:1787508680.379252:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2977 00000100:00100000:0.0:1787508680.379258:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874324480172800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508680.379284:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874324480172800:12345-0@lo:400:kworker.0 Request processed in 28us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508680.379290:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2977 00000100:00100000:0.0:1787508680.379321:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480171776 00000100:00100000:0.0:1787508680.379325:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480171776 00000100:00100000:0.0:1787508680.379346:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480172288 00000100:00100000:0.0:1787508680.379349:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480172288 00000100:00100000:0.0:1787508680.379368:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29836 00000100:00100000:0.0:1787508680.379374:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480171776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508680.379412:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480171776:12345-0@lo:400:kworker.0 Request processed in 36us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508680.379418:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29836 00000100:00100000:0.0:1787508680.379431:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29837 00000100:00100000:0.0:1787508680.379436:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480172288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508680.379464:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480172288:12345-0@lo:400:kworker.0 Request processed in 28us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508680.379471:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29837 00000100:00100000:0.0:1787508680.379532:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480171776:0@lo:400:kworker.0 00000100:00100000:0.0:1787508680.379543:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480172288:0@lo:400:kworker.0 00000100:00100000:0.0:1787508680.379555:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874324480172800:0@lo:400:kworker.0 00000100:00100000:0.0:1787508680.379565:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480171904:0@lo:400:kworker.0 00000100:00100000:0.0:1787508680.379576:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480172416:0@lo:400:kworker.0 00000100:00100000:0.0:1787508680.379585:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874324480172928:0@lo:400:kworker.0 00000100:00100000:2.0:1787508680.379704:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79de3f65-4bad-42d0-a46f-842a654b33a0:3619:1874324480171648:0@lo:400:kworker.0 00000100:00100000:2.0:1787508680.379748:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508680.379788:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480172160:0@lo:400:kworker.0 00000100:00100000:2.0:1787508680.379812:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508680.379832:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874324480172672:0@lo:400:kworker.0 00000100:00100000:2.0:1787508680.379852:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508680.379871:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874324480173184:0@lo:400:kworker.0 00000100:00100000:2.0:1787508680.379891:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508680.379912:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787508680.379919:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480172032:0@lo:400:kworker.0 00000100:00100000:2.0:1787508680.379966:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508680.379987:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480172544:0@lo:400:kworker.0 00000100:00100000:2.0:1787508680.380009:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508680.380026:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874324480173056:0@lo:400:kworker.0 00000100:00100000:2.0:1787508680.380046:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508680.380076:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480172032 00000100:00100000:2.0:1787508680.380080:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480172032 00000100:00100000:2.0:1787508680.380111:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480172544 00000100:00100000:2.0:1787508680.380115:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480172544 00000100:00100000:2.0:1787508680.380137:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2358 00000100:00100000:2.0:1787508680.380144:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480172032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508680.380182:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480172032:12345-0@lo:400:kworker.0 Request processed in 38us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508680.380188:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2358 00000100:00100000:2.0:1787508680.380202:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2359 00000100:00100000:2.0:1787508680.380208:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480172544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508680.380237:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480172544:12345-0@lo:400:kworker.0 Request processed in 29us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508680.380242:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2359 00000100:00080000:2.0:1787508680.380258:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787508680.380262:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787508680.380265:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787508680.380267:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787508680.380285:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480172160 00000100:00100000:2.0:1787508680.380288:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480172160 00000100:00100000:2.0:1787508680.380322:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480172672 00000100:00100000:2.0:1787508680.380325:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480172672 00000100:00100000:2.0:1787508680.380341:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480173184 00000100:00100000:2.0:1787508680.380343:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480173184 00000100:00100000:2.0:1787508680.380361:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480173056 00000100:00100000:2.0:1787508680.380363:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480173056 00000100:00100000:2.0:1787508680.380378:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2978 00000100:00100000:2.0:1787508680.380383:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480172160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508680.380416:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480172160:12345-0@lo:400:kworker.0 Request processed in 33us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508680.380422:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2978 00000100:00100000:2.0:1787508680.380433:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2979 00000100:00100000:2.0:1787508680.380437:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874324480172672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508680.380459:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874324480172672:12345-0@lo:400:kworker.0 Request processed in 22us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508680.380464:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2979 00000100:00100000:2.0:1787508680.380472:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2980 00000100:00100000:2.0:1787508680.380477:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4855c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874324480173184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508680.380497:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4855c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874324480173184:12345-0@lo:400:kworker.0 Request processed in 20us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508680.380502:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2980 00000100:00100000:2.0:1787508680.380511:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2981 00000100:00100000:2.0:1787508680.380515:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874324480173056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508680.380534:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874324480173056:12345-0@lo:400:kworker.0 Request processed in 19us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508680.380539:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2981 00000100:00100000:2.0:1787508680.380581:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480172032:0@lo:400:kworker.0 00000100:00100000:2.0:1787508680.380590:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480172544:0@lo:400:kworker.0 00000100:00100000:2.0:1787508680.380597:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874324480173056:0@lo:400:kworker.0 00000100:00100000:2.0:1787508680.380604:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480172160:0@lo:400:kworker.0 00000100:00100000:2.0:1787508680.380613:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874324480172672:0@lo:400:kworker.0 00000100:00100000:2.0:1787508680.380620:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874324480173184:0@lo:400:kworker.0 00000100:00080000:2.0:1787508680.380645:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787508680.380648:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787508680.383681:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480171648 00000100:00100000:0.0:1787508680.383699:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480171648 00000100:00100000:0.0:1787508680.383852:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:00100000:0.0:1787508680.383864:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3619:x1874324480171648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508680.383993:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3619:x1874324480171648:12345-0@lo:400:kworker.0 Request processed in 130us (4243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508680.384001:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00100000:1.0:1787508680.385835:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79de3f65-4bad-42d0-a46f-842a654b33a0:3619:1874324480171648:0@lo:400:kworker.0 00010000:00010000:3.0:1787508681.275871:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508681.835537:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508681.835603:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508681.835638:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508681.835670:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508681.835700:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508681.835707:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509586560 00000100:00100000:0.0:1787508681.835723:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508681.835727:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509586560 00000100:00100000:0.0:1787508681.835751:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508681.835771:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508681.835794:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508681.835830:0:225843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509586816 00000100:00100000:0.0:1787508681.835839:0:225843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509586816 00000100:00100000:3.0:1787508681.835904:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509587072 00000100:00100000:0.0:1787508681.835910:0:225843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509587328 00000100:00100000:3.0:1787508681.835911:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509587072 00000100:00100000:0.0:1787508681.835918:0:225843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509587328 00000100:00100000:3.0:1787508681.835982:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509586432 00000100:00100000:3.0:1787508681.835987:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509586432 00000100:00100000:0.0:1787508681.836000:0:225843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509586688 00000100:00100000:0.0:1787508681.836008:0:225843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509586688 00000100:00100000:0.0:1787508681.836029:0:225843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509587200 00000100:00100000:0.0:1787508681.836032:0:225843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509587200 00000100:00100000:0.0:1787508681.836056:0:225843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2360 00000100:00100000:0.0:1787508681.836066:0:225843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2400:x1874324509586816:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508681.836137:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509586944 00000100:00100000:3.0:1787508681.836143:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509586944 00000100:00100000:0.0:1787508681.836151:0:225843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2400:x1874324509586816:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 84us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508681.836162:0:225843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2360 00000100:00100000:3.0:1787508681.836183:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2982 00000100:00100000:0.0:1787508681.836190:0:225843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2361 00000100:00100000:3.0:1787508681.836211:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2400:x1874324509586560:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508681.836212:0:225843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509587328:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508681.836248:0:225843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509587328:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 48us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508681.836254:0:225843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2361 00000100:00100000:0.0:1787508681.836267:0:225843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2362 00000100:00100000:0.0:1787508681.836272:0:225843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2400:x1874324509586688:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508681.836308:0:225843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2400:x1874324509586688:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 36us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508681.836314:0:225843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2362 00000100:00100000:0.0:1787508681.836325:0:225843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2363 00000100:00100000:0.0:1787508681.836331:0:225843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509587200:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508681.836352:0:225843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509587200:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508681.836358:0:225843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2363 00000100:00100000:0.0:1787508681.836381:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2983 00000100:00100000:0.0:1787508681.836389:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509587072:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508681.836426:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509587072:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 37us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508681.836436:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2983 00000100:00100000:0.0:1787508681.836462:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2984 00000100:00100000:0.0:1787508681.836470:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+592:2400:x1874324509586432:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508681.836543:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2400:x1874324509586560:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 347us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508681.836553:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2982 00000100:00100000:1.0:1787508681.836560:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509586304 00000100:00100000:1.0:1787508681.836569:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509586304 00000100:00100000:3.0:1787508681.836585:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2985 00000100:00100000:3.0:1787508681.836598:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:2400:x1874324509586944:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508681.836623:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1004 00000100:00100000:1.0:1787508681.836634:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2400:x1874324509586304:12345-192.168.201.30@tcp:400:kworker.0 00000100:00080000:2.0:1787508681.836772:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787508681.836778:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787508681.836780:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787508681.836783:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787508681.837464:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+592:2400:x1874324509586432:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 991us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508681.837472:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2984 00000100:00100000:3.0:1787508681.842109:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:2400:x1874324509586944:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 5494us (6315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508681.842130:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2985 00000100:00100000:1.0:1787508681.848350:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2400:x1874324509586304:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 11700us (12806us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508681.848368:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1004 00010000:00010000:0.0:1787508682.316045:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508682.426104:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480173312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787508682.426201:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508682.426295:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480173312 00000100:00100000:1.0:1787508682.426304:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480173312 00000100:00100000:1.0:1787508682.426375:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1677 00000100:00100000:1.0:1787508682.426386:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480173312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787508682.426416:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 124211776 pending 0 free 3881955328 avail 3650433024 00000100:00100000:1.0:1787508682.426460:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480173312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508682.426466:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1677 00000100:00080000:3.0:1787508682.426506:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508682.426541:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480173312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787508682.426775:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480173440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508682.426807:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508682.427100:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480173440 00000100:00100000:3.0:1787508682.427104:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480173440 00000100:00100000:3.0:1787508682.427146:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1678 00000100:00100000:3.0:1787508682.427153:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480173440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787508682.427166:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 124211776 pending 0 free 3881955328 avail 3650433024 00000100:00100000:3.0:1787508682.427215:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480173440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508682.427221:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1678 00000100:00100000:3.0:1787508682.427283:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480173440:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787508682.427336:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787508683.322373:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508683.962591:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480173568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787508683.962665:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508683.963105:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787508683.963114:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480173696:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787508683.963144:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508683.963181:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480173568 00000100:00100000:2.0:1787508683.963188:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480173568 00000100:00100000:2.0:1787508683.963236:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480173696 00000100:00100000:2.0:1787508683.963239:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480173696 00000100:00100000:2.0:1787508683.963276:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1679 00000100:00100000:2.0:1787508683.963285:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4856a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480173568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787508683.963314:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25428544 pending 0 free 3910828032 avail 3679305728 00000100:00100000:2.0:1787508683.963361:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4856a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480173568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508683.963368:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1679 00000100:00100000:2.0:1787508683.963385:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1680 00000100:00100000:2.0:1787508683.963391:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480173696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787508683.963400:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25428544 pending 0 free 3910828032 avail 3679305728 00000100:00100000:2.0:1787508683.963423:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480173696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 33us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508683.963428:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1680 00000100:00080000:2.0:1787508683.963444:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787508683.963481:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480173696:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787508683.963495:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480173568:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1787508683.969694:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944144 is committed 00010000:00010000:0.0:1787508684.347999:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508684.986219:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787508684.986257:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480173824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787508684.986326:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508684.986704:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480173824 00000100:00100000:2.0:1787508684.986712:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480173824 00000100:00100000:2.0:1787508684.986765:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29838 00000100:00100000:2.0:1787508684.986774:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480173824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787508684.986924:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1441771520 avail 1295532032 00000100:00100000:2.0:1787508684.987011:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480173824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 238us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508684.987021:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29838 00000100:00100000:0.0:1787508684.987110:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480173824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787508684.988783:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480173952:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787508684.988862:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508684.989422:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480173952 00000100:00100000:1.0:1787508684.989431:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480173952 00000100:00100000:1.0:1787508684.989499:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29839 00000100:00100000:1.0:1787508684.989509:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480173952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787508684.989551:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1442783232 avail 1296543744 00000100:00100000:1.0:1787508684.989611:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480173952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508684.989617:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29839 00000100:00100000:0.0:1787508684.989828:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480173952:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787508685.371823:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508685.500641:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480174080:0@lo:400:kworker.0 00000100:00100000:2.0:1787508685.500721:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508685.500775:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480174592:0@lo:400:kworker.0 00000100:00100000:2.0:1787508685.500802:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508685.500830:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874324480175104:0@lo:400:kworker.0 00000100:00100000:2.0:1787508685.500855:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508685.500882:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787508685.500888:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480174208:0@lo:400:kworker.0 00000100:00100000:2.0:1787508685.500911:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508685.500925:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480174720:0@lo:400:kworker.0 00000100:00100000:2.0:1787508685.500970:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508685.500986:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480175232:0@lo:400:kworker.0 00000100:00100000:2.0:1787508685.501004:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508685.501033:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480175104 00000100:00100000:2.0:1787508685.501039:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480175104 00000100:00100000:2.0:1787508685.501102:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480175232 00000100:00100000:2.0:1787508685.501105:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480175232 00000100:00100000:2.0:1787508685.501126:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2986 00000100:00100000:2.0:1787508685.501135:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874324480175104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508685.501182:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874324480175104:12345-0@lo:400:kworker.0 Request processed in 49us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508685.501189:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2986 00000100:00100000:2.0:1787508685.501204:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2987 00000100:00100000:2.0:1787508685.501210:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480175232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508685.501249:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480175232:12345-0@lo:400:kworker.0 Request processed in 39us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508685.501255:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2987 00000100:00080000:2.0:1787508685.501273:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787508685.501276:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787508685.501305:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480175232:0@lo:400:kworker.0 00000100:00100000:2.0:1787508685.501316:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874324480175104:0@lo:400:kworker.0 00000100:00100000:3.0:1787508685.501357:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480174336:0@lo:400:kworker.0 00000100:00100000:3.0:1787508685.501390:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508685.501415:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874324480174848:0@lo:400:kworker.0 00000100:00100000:3.0:1787508685.501433:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508685.501448:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874324480175360:0@lo:400:kworker.0 00000100:00100000:3.0:1787508685.501465:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508685.501480:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787508685.501485:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874324480174464:0@lo:400:kworker.0 00000100:00100000:3.0:1787508685.501502:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508685.501515:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874324480174976:0@lo:400:kworker.0 00000100:00100000:3.0:1787508685.501534:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508685.501559:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480174848 00000100:00100000:3.0:1787508685.501563:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480174848 00000100:00100000:1.0:1787508685.501576:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480174080 00000100:00100000:1.0:1787508685.501583:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480174080 00000100:00100000:3.0:1787508685.501594:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480175360 00000100:00100000:3.0:1787508685.501600:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480175360 00000100:00100000:1.0:1787508685.501631:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:3.0:1787508685.501633:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480174464 00000100:00100000:3.0:1787508685.501637:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480174464 00000100:00100000:1.0:1787508685.501643:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d980a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480174080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508685.501654:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480174976 00000100:00100000:3.0:1787508685.501658:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480174976 00000100:00100000:3.0:1787508685.501678:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2988 00000100:00100000:1.0:1787508685.501691:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d980a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480174080:12345-0@lo:400:kworker.0 Request processed in 49us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508685.501692:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874324480174848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508685.501705:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00100000:3.0:1787508685.501749:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874324480174848:12345-0@lo:400:kworker.0 Request processed in 62us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508685.501755:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2989 00000100:00100000:3.0:1787508685.501762:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2988 00000100:00100000:1.0:1787508685.501768:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874324480175360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508685.501786:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2990 00000100:00100000:3.0:1787508685.501795:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874324480174464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508685.501806:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874324480175360:12345-0@lo:400:kworker.0 Request processed in 42us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508685.501825:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2989 00000100:00100000:3.0:1787508685.501830:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874324480174464:12345-0@lo:400:kworker.0 Request processed in 35us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508685.501837:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2990 00000100:00100000:1.0:1787508685.501850:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2991 00000100:00100000:1.0:1787508685.501860:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874324480174976:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787508685.501864:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787508685.501869:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787508685.501886:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874324480174464:0@lo:400:kworker.0 00000100:00100000:0.0:1787508685.501992:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480174592 00000100:00100000:0.0:1787508685.501997:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480174592 00000100:00100000:0.0:1787508685.502032:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480174208 00000100:00100000:0.0:1787508685.502034:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480174208 00000100:00100000:0.0:1787508685.502066:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480174720 00000100:00100000:0.0:1787508685.502070:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480174720 00000100:00100000:0.0:1787508685.502086:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480174336 00000100:00100000:0.0:1787508685.502088:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480174336 00000100:00100000:0.0:1787508685.502107:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2364 00000100:00100000:0.0:1787508685.502112:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480174592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508685.502165:0:203996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2365 00000100:00100000:2.0:1787508685.502174:0:203996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480174208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508685.512445:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874324480174976:12345-0@lo:400:kworker.0 Request processed in 10577us (10899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508685.512461:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2991 00000100:00100000:1.0:1787508685.512666:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2366 00000100:00100000:1.0:1787508685.512680:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480174720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508685.512742:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480174720:12345-0@lo:400:kworker.0 Request processed in 68us (11771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508685.512748:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2366 00000100:00100000:1.0:1787508685.512764:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2367 00000100:00100000:1.0:1787508685.512770:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480174336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508685.512802:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480174336:12345-0@lo:400:kworker.0 Request processed in 31us (11411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508685.512808:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2367 00000100:00080000:1.0:1787508685.514584:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787508685.514595:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508685.514760:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480174720:0@lo:400:kworker.0 00000100:00100000:1.0:1787508685.514775:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480174080:0@lo:400:kworker.0 00000100:00100000:3.0:1787508685.520329:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874324480174848:0@lo:400:kworker.0 00000100:00100000:3.0:1787508685.520356:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874324480175360:0@lo:400:kworker.0 00000100:00100000:0.0:1787508685.520531:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480174592:12345-0@lo:400:kworker.0 Request processed in 18415us (19725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508685.520543:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2364 00000100:00100000:1.0:1787508685.520661:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480174592:0@lo:400:kworker.0 00000100:00100000:2.0:1787508685.526343:0:203996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480174208:12345-0@lo:400:kworker.0 Request processed in 24160us (25420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508685.526363:0:203996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2365 00000100:00100000:1.0:1787508685.526515:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480174208:0@lo:400:kworker.0 00000100:00100000:3.0:1787508685.533451:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874324480174976:0@lo:400:kworker.0 00000100:00100000:3.0:1787508685.533476:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480174336:0@lo:400:kworker.0 00010000:00010000:2.0:1787508686.395803:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787508686.757069:0:232815:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 95b: Check readpage() on a page that is no longer uptodate ========================================================== 14:11:25 (1787508685) 00000100:00100000:0.0:1787508686.942345:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508686.942384:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509587584 00000100:00100000:0.0:1787508686.942393:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509587584 00000100:00100000:0.0:1787508686.942456:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94047 00000100:00100000:0.0:1787508686.942467:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+592:339101:x1874324509587584:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508686.942488:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508686.942491:0:202227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787508686.942520:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35090 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae735 expref: 592 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508686.944402:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508686.944408:0:202227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508686.944429:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f350eb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae75f expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508686.945262:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f350f2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508686.945278:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f350f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508686.945289:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f350f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508686.945307:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f350f9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508686.945314:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f350f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508686.945320:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f350f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508686.949928:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f35100 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508686.949967:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f35100 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508686.949980:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f35100 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508686.949992:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1263:0x0]: returning size 0 00010000:00010000:0.0:1787508686.950024:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f350f2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508686.950031:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f350f2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508686.950037:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f350f2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508686.950043:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f350f2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508686.950049:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508686.950054:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f350f2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508686.950062:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f350f2 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508686.950075:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508686.950078:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508686.950083:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f350f2 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508686.950089:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f350f2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508686.950102:0:202227:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000692be254 reply state 00000000610e6266 transno 12884944145 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f350f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787508686.953104:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787508686.954669:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f350f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508686.954691:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24b6b805 (ffff9091d43a5100) 00010000:00010000:0.0:1787508686.954695:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787508686.954699:0:202227:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787508686.954869:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6200/0xb126349c40f350eb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae75f expref: 594 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508686.954888:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f35100 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae75f expref: 593 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508686.954896:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1263:0x0].0x0 (ffff9091d43a5300) 00010000:00010000:0.0:1787508686.954898:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787508686.954901:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7800, rc 0) 00000100:00100000:0.0:1787508686.954988:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+594:339101:x1874324509587584:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 12522us (12652us total) trans 12884944145 rc 0/0 00000100:00100000:0.0:1787508686.954998:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94047 00000100:00100000:0.0:1787508686.955118:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508686.955214:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508686.955239:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508686.955260:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508686.955285:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508686.955304:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508686.955324:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508686.955360:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508686.955386:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509587840 00000100:00100000:0.0:1787508686.955393:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509587840 00000100:00100000:0.0:1787508686.955436:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509588352 00000100:00100000:0.0:1787508686.955439:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509588352 00000100:00100000:0.0:1787508686.955458:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509588224 00000100:00100000:0.0:1787508686.955461:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509588224 00000100:00100000:0.0:1787508686.955481:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2992 00000100:00100000:0.0:1787508686.955490:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2400:x1874324509587840:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508686.955534:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2400:x1874324509587840:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 46us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508686.955542:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2992 00000100:00100000:0.0:1787508686.955555:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2993 00000100:00100000:0.0:1787508686.955562:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509588352:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508686.955587:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509588352:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508686.955596:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2993 00000100:00100000:0.0:1787508686.955608:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2994 00000100:00100000:0.0:1787508686.955614:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2400:x1874324509588224:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508686.955637:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2400:x1874324509588224:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508686.955642:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2994 00000100:00100000:0.0:1787508686.955658:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509588096 00000100:00100000:0.0:1787508686.955662:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509588096 00000100:00100000:0.0:1787508686.955682:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509588608 00000100:00100000:0.0:1787508686.955685:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509588608 00000100:00100000:0.0:1787508686.955698:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509587968 00000100:00100000:0.0:1787508686.955701:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509587968 00000100:00100000:0.0:1787508686.955714:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509588480 00000100:00100000:0.0:1787508686.955716:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509588480 00000100:00100000:0.0:1787508686.955731:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2368 00000100:00100000:0.0:1787508686.955737:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2400:x1874324509588096:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508686.955761:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2400:x1874324509588096:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508686.955767:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2368 00000100:00100000:0.0:1787508686.955776:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2369 00000100:00100000:0.0:1787508686.955781:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509588608:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508686.955799:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509588608:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 18us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508686.955804:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2369 00000100:00100000:0.0:1787508686.955812:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2370 00000100:00100000:0.0:1787508686.955818:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2400:x1874324509587968:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508686.955836:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2400:x1874324509587968:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 18us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508686.955841:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2370 00000100:00100000:0.0:1787508686.955850:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2371 00000100:00100000:0.0:1787508686.955855:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509588480:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508686.955870:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509588480:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 16us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508686.955876:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2371 00000100:00100000:0.0:1787508686.955895:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509587712 00000100:00100000:0.0:1787508686.955898:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509587712 00000100:00100000:0.0:1787508686.955920:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1006 00000100:00100000:0.0:1787508686.955926:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2400:x1874324509587712:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508686.955975:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2400:x1874324509587712:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 49us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508686.955981:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1006 00000100:00080000:0.0:1787508686.956011:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787508686.956015:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787508686.956018:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787508686.956020:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787508686.962370:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508686.962503:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509588864 00000100:00100000:0.0:1787508686.962513:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509588864 00000100:00100000:0.0:1787508686.962571:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94048 00000100:00100000:0.0:1787508686.962583:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+594:339101:x1874324509588864:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508686.962613:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508686.962638:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3510e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae766 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508686.962753:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f35115 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x1263:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508686.962770:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f35100 lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae75f expref: 595 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508686.962780:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f35115 lrc: 4/0,1 mode: --/EX res: [0x2000013a4:0x1263:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508686.962811:0:202228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f35100 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae75f expref: 595 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508686.962826:0:202228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f35100 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae75f expref: 595 pid: 202227 timeout: 13758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508686.962841:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b25500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480175488:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508686.962919:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c99199c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787508686.968148:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508686.968270:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509588992 00000100:00100000:2.0:1787508686.968279:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509588992 00010000:00010000:2.0:1787508686.968318:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f35100 lrc: 5/0,0 mode: PR/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae75f expref: 596 pid: 202227 timeout: 13758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508686.968360:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27920 00000100:00100000:2.0:1787508686.968371:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+596:2401:x1874324509588992:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508686.968384:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508686.968391:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f35100 lrc: 5/0,0 mode: PR/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae75f expref: 596 pid: 202227 timeout: 13758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508686.968395:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b25500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480175488:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508686.968404:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f35100 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae75f expref: 596 pid: 202227 timeout: 13758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508686.968427:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f35100 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae75f expref: 596 pid: 202227 timeout: 13758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508686.977624:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f35115 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x1263:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508686.979377:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1263:0x0].0x0 (ffff9091d43a5300) 00010000:00010000:2.0:1787508686.979391:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f35115 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x1263:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508686.979403:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f35115 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1263:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508686.979411:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f35115 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x1263:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508686.979451:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787508686.979666:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f35115 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1263:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508686.979679:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f35115 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1263:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508686.979703:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1263:0x0]: returning size 0 00000004:00080000:1.0:1787508686.979874:0:202228:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x152d:0x0], index 0: 0 00000004:00080000:1.0:1787508686.979882:0:202228:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x158b:0x0], index 1: 0 00000100:00100000:2.0:1787508686.980683:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+595:2401:x1874324509588992:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 12305us (12534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508686.980698:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27920 00010000:00010000:1.0:1787508686.980903:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f35115 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1263:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508686.980925:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f35115 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x1263:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508686.980932:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f35115 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1263:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508686.980938:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508686.980956:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f35115 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1263:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508686.980963:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f35115 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x1263:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508686.980979:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1263:0x0].0x0 (ffff9091d43a5300) 00010000:00010000:1.0:1787508686.980982:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787508686.980986:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f35115 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x1263:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508686.980993:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f35115 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x1263:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508686.981055:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3510e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae766 expref: 595 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508686.981066:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508686.981069:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508686.981073:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f3510e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae766 expref: 595 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508686.981083:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7600, rc 0) 00000100:00100000:1.0:1787508686.981131:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+594:339101:x1874324509588864:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 18551us (18772us total) trans 12884944146 rc 301/301 00000100:00100000:1.0:1787508686.981139:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94048 00000100:00100000:0.0:1787508686.988679:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508686.988729:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509589248 00000100:00100000:3.0:1787508686.988740:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509589248 00000100:00100000:3.0:1787508686.988804:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15434 00000100:00100000:3.0:1787508686.988818:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+594:339101:x1874324509589248:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1787508686.989133:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+595:339101:x1874324509589248:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 318us (462us total) trans 12884944147 rc 0/0 00000100:00100000:3.0:1787508686.989142:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15434 00000100:00100000:3.0:1787508686.992330:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508686.993016:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509589376 00000100:00100000:0.0:1787508686.993028:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509589376 00000100:00100000:0.0:1787508686.993100:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94049 00000100:00100000:0.0:1787508686.993111:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+595:339101:x1874324509589376:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508686.993136:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508686.993160:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f35123 lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae76d expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508686.993238:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f35123 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae76d expref: 596 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508686.993255:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f35123 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae76d expref: 596 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508686.993274:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1263:0x0].0x0 (ffff9091d43a5300) 00010000:00010000:0.0:1787508686.993277:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787508686.993281:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7c00, rc 0) 00000100:00100000:0.0:1787508686.993342:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+596:339101:x1874324509589376:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 233us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508686.993349:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94049 00000100:00100000:0.0:1787508687.005896:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508687.006077:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509589632 00000100:00100000:1.0:1787508687.006088:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509589632 00000100:00100000:1.0:1787508687.006147:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15435 00000100:00100000:1.0:1787508687.006157:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+596:339101:x1874324509589632:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:1.0:1787508687.006399:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+597:339101:x1874324509589632:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 242us (513us total) trans 12884944148 rc 0/0 00000100:00100000:1.0:1787508687.006406:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15435 00000100:00100000:0.0:1787508687.017161:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508687.017303:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509589760 00000100:00100000:2.0:1787508687.017314:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509589760 00000100:00100000:2.0:1787508687.017375:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94050 00000100:00100000:2.0:1787508687.017386:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+597:339108:x1874324509589760:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:2.0:1787508687.017409:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508687.017431:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3512a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae774 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508687.017493:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f35131 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508687.017509:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f35131 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508687.017520:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f35131 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508687.017641:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508687.017646:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508687.017666:0:205405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f35131 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508687.017687:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f3512a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae774 expref: 599 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508687.017705:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f35131 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae774 expref: 598 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508687.017714:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508687.017717:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508687.017721:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa800, rc 0) 00000100:00100000:2.0:1787508687.017783:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+598:339108:x1874324509589760:12345-192.168.201.30@tcp:101:dd.0 Request processed in 399us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508687.017790:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94050 00000100:00100000:3.0:1787508687.024673:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508687.024938:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509590016 00000100:00100000:0.0:1787508687.024966:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509590016 00000100:00100000:0.0:1787508687.025033:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94051 00000100:00100000:0.0:1787508687.025046:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+598:339108:x1874324509590016:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1787508687.025066:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508687.025069:0:202226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787508687.025095:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f35131 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae774 expref: 598 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.025114:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508687.025119:0:202226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508687.025134:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f35138 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae77b expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.025281:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3513f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.025293:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3513f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.025303:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3513f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.025314:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f35146 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.025322:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f35146 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.025328:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f35146 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.025384:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3514d lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.025394:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3514d lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.025400:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3514d lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508687.025411:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1263:0x0]: returning size 0 00010000:00010000:0.0:1787508687.025485:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3513f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.025494:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3513f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.025501:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3513f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.025508:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3513f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.025514:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508687.025518:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3513f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.025525:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3513f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.025534:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508687.025538:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508687.025541:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3513f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.025547:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f3513f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.025557:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f35146 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.025562:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f35146 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.025567:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f35146 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.025572:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508687.025575:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f35146 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.025579:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f35146 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.025585:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24b6b805 (ffff9091d43a5100) 00010000:00010000:0.0:1787508687.025587:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508687.025590:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f35146 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.025595:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f35146 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.025763:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f35138 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae77b expref: 600 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.025785:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3514d lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae77b expref: 599 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.025794:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1263:0x0].0x0 (ffff9091d43a5300) 00010000:00010000:0.0:1787508687.025796:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787508687.025799:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6400, rc 0) 00000100:00100000:0.0:1787508687.025866:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+599:339108:x1874324509590016:12345-192.168.201.30@tcp:101:dd.0 Request processed in 822us (1201us total) trans 12884944149 rc 0/0 00000100:00100000:0.0:1787508687.025873:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94051 00000100:00100000:1.0:1787508687.038755:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508687.038911:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509590144 00000100:00100000:0.0:1787508687.038922:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509590144 00000100:00100000:0.0:1787508687.039029:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94052 00000100:00100000:0.0:1787508687.039039:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+599:339108:x1874324509590144:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1787508687.039061:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508687.039082:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3515b lrc: 2/0,0 mode: --/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae782 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.039114:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f35162 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.039127:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f35162 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.039137:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f35162 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.039263:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7800/0xb126349c40f3515b lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae782 expref: 601 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.039278:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f35162 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae782 expref: 600 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.039287:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1263:0x0].0x0 (ffff9091d43a5300) 00010000:00010000:0.0:1787508687.039289:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787508687.039293:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7600, rc 0) 00000100:00100000:0.0:1787508687.039355:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+600:339108:x1874324509590144:12345-192.168.201.30@tcp:101:dd.0 Request processed in 318us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508687.039362:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94052 00000100:00100000:2.0:1787508687.045988:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508687.046131:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509590400 00000100:00100000:0.0:1787508687.046141:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509590400 00000100:00100000:0.0:1787508687.046220:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94053 00000100:00100000:0.0:1787508687.046230:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+600:339108:x1874324509590400:12345-192.168.201.30@tcp:36:dd.0 00010000:00010000:0.0:1787508687.046279:0:230618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508687.046304:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3514d lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae77b expref: 600 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.046322:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1263:0x0].0x0 (ffff9091d43a5300) 00010000:00010000:0.0:1787508687.046327:0:230618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508687.046482:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f35169 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1263:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.046495:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f35169 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1263:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.046505:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f35169 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1263:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787508687.046548:0:230618:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884944150 00000004:00010000:0.0:1787508687.046569:0:230618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ece4dc7 reply state 0000000016ffbff1 transno 12884944151 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f35169 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1263:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.046580:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f35169 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1263:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.046586:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1263:0x0].0x0 (ffff9091d43a5300) 00010000:00010000:0.0:1787508687.046589:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787508687.046592:0:230618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787508687.046691:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+602:339108:x1874324509590400:12345-192.168.201.30@tcp:36:dd.0 Request processed in 463us (714us total) trans 12884944151 rc 0/0 00000100:00100000:0.0:1787508687.046702:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94053 00000020:00080000:0.0:1787508687.046707:0:230618:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787508687.051338:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508687.051434:0:230130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509590528 00000100:00100000:0.0:1787508687.051446:0:230130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509590528 00000100:00100000:0.0:1787508687.051514:0:230130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15068 00000100:00100000:0.0:1787508687.051524:0:230130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:339108:x1874324509590528:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1787508687.051541:0:230130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508687.051564:0:230130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091bbb7bc/0xb126349c40f35170 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x152d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae789 expref: -99 pid: 230130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787508687.051589:0:230130:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x152d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787508687.051610:0:230130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x152d:0x0].0x0 since=13658s v=(0 0) 00010000:00010000:0.0:1787508687.051615:0:230130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x152d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787508687.051623:0:230130:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091bbb7bc/0xb126349c40f35170 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x152d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae789 expref: 6 pid: 230130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.051642:0:230130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000091bbb7bc/0xb126349c40f35170 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x152d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae789 expref: 6 pid: 230130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.051655:0:230130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6200, rc 0) 00000100:00100000:0.0:1787508687.051719:0:230130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:339108:x1874324509590528:12345-192.168.201.30@tcp:101:dd.0 Request processed in 196us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508687.051726:0:230130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15068 00000100:00100000:3.0:1787508687.054762:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508687.054850:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509590656 00000100:00100000:0.0:1787508687.054866:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509590656 00000100:00100000:0.0:1787508687.054990:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15069 00000100:00100000:0.0:1787508687.055003:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:339108:x1874324509590656:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1787508687.055019:0:203726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508687.055041:0:203726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd6e743c/0xb126349c40f35177 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x158b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae790 expref: -99 pid: 203726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787508687.055067:0:203726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x158b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787508687.055089:0:203726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x158b:0x0].0x0 since=13658s v=(0 0) 00010000:00010000:0.0:1787508687.055094:0:203726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x158b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787508687.055101:0:203726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd6e743c/0xb126349c40f35177 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x158b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae790 expref: 7 pid: 203726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.055130:0:203726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bd6e743c/0xb126349c40f35177 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x158b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae790 expref: 7 pid: 203726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.055142:0:203726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f7800, rc 0) 00000100:00100000:0.0:1787508687.055214:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:339108:x1874324509590656:12345-192.168.201.30@tcp:101:dd.0 Request processed in 213us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508687.055221:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15069 00000100:00100000:1.0:1787508687.062409:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508687.063242:0:208929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509590784 00000100:00100000:0.0:1787508687.063258:0:208929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509590784 00002000:00010000:0.0:1787508687.063312:0:208929:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5421 (0->18446744073709551615) 00002000:00100000:0.0:1787508687.063317:0:208929:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091dabbca80 with x1874324509590784 ext(0->18446744073709551615) 00002000:00010000:0.0:1787508687.063331:0:208929:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9091dabbca80. 00000100:00100000:0.0:1787508687.063377:0:208929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:0.0:1787508687.063389:0:208929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2400:x1874324509590784:12345-192.168.201.30@tcp:10:dd.0 00002000:00010000:0.0:1787508687.063570:0:208929:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x152d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787508687.063573:0:208929:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x152d:0x0] updating lvb mtime from disk: 0 -> 1787508687 00002000:00010000:0.0:1787508687.063576:0:208929:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x152d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787508687.063578:0:208929:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x152d:0x0] updating lvb ctime from disk: 0 -> 1787508687 00002000:00010000:0.0:1787508687.063581:0:208929:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x152d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787508687.063646:0:208929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2400:x1874324509590784:12345-192.168.201.30@tcp:10:dd.0 Request processed in 259us (1252us total) trans 8589941251 rc 0/0 00000100:00100000:0.0:1787508687.063653:0:208929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 44 00002000:00010000:0.0:1787508687.063657:0:208929:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5421 (0->18446744073709551615) 00002000:00100000:0.0:1787508687.063661:0:208929:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091dabbca80 with x1874324509590784 ext(0->18446744073709551615) 00002000:00010000:0.0:1787508687.063666:0:208929:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9091dabbca80. 00000100:00100000:2.0:1787508687.065040:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508687.065201:0:203733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509590912 00000100:00100000:3.0:1787508687.065215:0:203733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509590912 00002000:00010000:3.0:1787508687.065267:0:203733:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5515 (0->18446744073709551615) 00002000:00100000:3.0:1787508687.065273:0:203733:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091ffc0ce00 with x1874324509590912 ext(0->18446744073709551615) 00002000:00010000:3.0:1787508687.065289:0:203733:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9091ffc0ce00. 00000100:00100000:3.0:1787508687.065395:0:203733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:3.0:1787508687.065410:0:203733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2401:x1874324509590912:12345-192.168.201.30@tcp:10:dd.0 00002000:00010000:3.0:1787508687.065770:0:203733:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x158b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787508687.065775:0:203733:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x158b:0x0] updating lvb mtime from disk: 0 -> 1787508687 00002000:00010000:3.0:1787508687.065778:0:203733:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x158b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787508687.065780:0:203733:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x158b:0x0] updating lvb ctime from disk: 0 -> 1787508687 00002000:00010000:3.0:1787508687.065782:0:203733:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x158b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787508687.065865:0:203733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2401:x1874324509590912:12345-192.168.201.30@tcp:10:dd.0 Request processed in 457us (834us total) trans 8589940560 rc 0/0 00000100:00100000:3.0:1787508687.065874:0:203733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 45 00002000:00010000:3.0:1787508687.065879:0:203733:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5515 (0->18446744073709551615) 00002000:00100000:3.0:1787508687.065881:0:203733:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091ffc0ce00 with x1874324509590912 ext(0->18446744073709551615) 00002000:00010000:3.0:1787508687.065887:0:203733:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9091ffc0ce00. 00000100:00100000:3.0:1787508687.079774:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508687.079892:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509591168 00000100:00100000:2.0:1787508687.079904:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509591168 00000100:00100000:2.0:1787508687.080016:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15436 00000100:00100000:2.0:1787508687.080029:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+602:339108:x1874324509591168:12345-192.168.201.30@tcp:35:dd.0 00000100:00100000:2.0:1787508687.082339:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+603:339108:x1874324509591168:12345-192.168.201.30@tcp:35:dd.0 Request processed in 2305us (2701us total) trans 12884944152 rc 0/0 00000100:00100000:2.0:1787508687.083298:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15436 00000100:00100000:2.0:1787508687.126237:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508687.126400:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509591296 00000100:00100000:0.0:1787508687.126412:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509591296 00000100:00100000:0.0:1787508687.126481:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94054 00000100:00100000:0.0:1787508687.126491:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:339111:x1874324509591296:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:0.0:1787508687.126510:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508687.126529:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3517e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae797 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.126591:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f35185 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.126605:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f35185 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.126615:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f35185 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508687.126670:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787508687.126674:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508687.126696:0:203348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f35185 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.126720:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3517e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae797 expref: 17 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.126739:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f35185 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae797 expref: 16 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.126747:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508687.126750:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508687.126753:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d56f6000, rc 0) 00000100:00100000:0.0:1787508687.126816:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:339111:x1874324509591296:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 325us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508687.126823:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94054 00000100:00100000:3.0:1787508687.135350:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508687.135455:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509591552 00000100:00100000:0.0:1787508687.135466:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509591552 00000100:00100000:0.0:1787508687.135598:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94055 00000100:00100000:0.0:1787508687.135609:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:339111:x1874324509591552:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:0.0:1787508687.135629:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508687.135651:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3518c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae79e expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.135729:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce8ed600/0xb126349c40f35193 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.135747:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce8ed600/0xb126349c40f35193 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.135759:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce8ed600/0xb126349c40f35193 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.135771:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3519a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.135788:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3519a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.135794:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3519a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.135922:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f351a1 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.135932:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f351a1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.135977:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f351a1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508687.135986:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1263:0x0]: returning size 12288 00010000:00010000:0.0:1787508687.136057:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce8ed600/0xb126349c40f35193 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.136065:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce8ed600/0xb126349c40f35193 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.136071:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce8ed600/0xb126349c40f35193 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.136078:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce8ed600/0xb126349c40f35193 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.136084:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090ce8ed600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508687.136089:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce8ed600/0xb126349c40f35193 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.136097:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce8ed600/0xb126349c40f35193 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.136117:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508687.136120:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508687.136123:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce8ed600/0xb126349c40f35193 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.136127:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce8ed600/0xb126349c40f35193 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.136146:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3519a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.136150:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3519a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.136154:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3519a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.136156:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508687.136158:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3519a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.136164:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3519a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.136168:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24b6b805 (ffff9091d43a5100) 00010000:00010000:0.0:1787508687.136170:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508687.136171:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3519a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.136174:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3519a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.136211:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6400/0xb126349c40f3518c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae79e expref: 19 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.136221:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f351a1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae79e expref: 18 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.136226:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1263:0x0].0x0 (ffff9091d43a5300) 00010000:00010000:0.0:1787508687.136228:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787508687.136229:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5600, rc 0) 00000100:00100000:0.0:1787508687.136282:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+18:339111:x1874324509591552:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 676us (945us total) trans 12884944153 rc 0/0 00000100:00100000:0.0:1787508687.136287:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94055 00000100:00100000:3.0:1787508687.139811:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508687.140376:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509591680 00000100:00100000:1.0:1787508687.140389:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509591680 00000100:00100000:1.0:1787508687.140442:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15070 00000100:00100000:1.0:1787508687.140452:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:339111:x1874324509591680:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:1.0:1787508687.140736:0:225840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508687.140754:0:225840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c8021ba/0xb126349c40f351af lrc: 2/0,0 mode: --/PR res: [0x280000401:0x152d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae7a5 expref: -99 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508687.141091:0:225840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000091bbb7bc/0xb126349c40f35170 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x152d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae789 expref: 6 pid: 230130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508687.141100:0:225840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x152d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787508687.141105:0:225840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x152d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787508687.141110:0:225840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c8021ba/0xb126349c40f351af lrc: 4/0,0 mode: --/PR res: [0x280000401:0x152d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7a5 expref: 6 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508687.141152:0:225840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000091bbb7bc/0xb126349c40f35170 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x152d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae789 expref: 6 pid: 230130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508687.141170:0:225840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000091bbb7bc/0xb126349c40f35170 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x152d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae789 expref: 6 pid: 230130 timeout: 13758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508687.141186:0:225840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:225840:1874324480175616:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508687.141282:0:225840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d317b900 going to sleep for 11 seconds 00000100:00100000:3.0:1787508687.144040:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508687.144535:0:225840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:225840:1874324480175616:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508687.144567:0:225840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009c8021ba/0xb126349c40f351af lrc: 3/0,0 mode: --/PR res: [0x280000401:0x152d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7a5 expref: 6 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.144588:0:225840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b800, rc 0) 00000100:00100000:0.0:1787508687.144645:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:339111:x1874324509591680:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 4194us (4843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508687.144654:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15070 00000100:00100000:1.0:1787508687.144831:0:205404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509591808 00000100:00100000:1.0:1787508687.144839:0:205404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509591808 00002000:00100000:1.0:1787508687.144884:0:205404:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x152d:0x0] (0->12287) req@ffff9091f9a9ad80 x1874324509591808/t0(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:143/0 lens 12776/0 e 0 to 0 dl 1787508698 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787508687.144893:0:205404:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091f9a9ad80 with x1874324509591808 ext(0->12287) 00010000:00010000:1.0:1787508687.144901:0:205404:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000091bbb7bc/0xb126349c40f35170 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x152d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae789 expref: 7 pid: 230130 timeout: 13758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508687.144916:0:205404:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000091bbb7bc/0xb126349c40f35170 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x152d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae789 expref: 7 pid: 230130 timeout: 13758 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787508687.144923:0:205404:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9091f9a9ad80 00000100:00100000:1.0:1787508687.145458:0:205404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:1.0:1787508687.145472:0:205404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2400:x1874324509591808:12345-192.168.201.30@tcp:4:dd.0 00000100:00100000:1.0:1787508687.146592:0:205404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:2400:x1874324509591808:12345-192.168.201.30@tcp:4:dd.0 Request processed in 1115us (2554us total) trans 8589941252 rc 0/0 00000100:00100000:1.0:1787508687.146602:0:205404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00002000:00100000:1.0:1787508687.146612:0:205404:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x152d:0x0] (0->12287) req@ffff9091f9a9ad80 x1874324509591808/t8589941252(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:143/0 lens 12776/448 e 0 to 0 dl 1787508698 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787508687.146621:0:205404:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091f9a9ad80 with x1874324509591808 ext(0->12287) 00010000:00010000:1.0:1787508687.146629:0:205404:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000091bbb7bc/0xb126349c40f35170 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x152d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae789 expref: 9 pid: 230130 timeout: 13758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508687.146647:0:205404:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000091bbb7bc/0xb126349c40f35170 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x152d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae789 expref: 9 pid: 230130 timeout: 13758 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787508687.146655:0:205404:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9091f9a9ad80 00000100:00100000:3.0:1787508687.158988:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508687.159314:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509591936 00000100:00100000:0.0:1787508687.159325:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509591936 00010000:00010000:0.0:1787508687.159369:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000091bbb7bc/0xb126349c40f35170 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x152d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae789 expref: 9 pid: 230130 timeout: 13758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508687.159413:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27921 00000100:00100000:0.0:1787508687.159424:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:2403:x1874324509591936:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508687.159439:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787508687.159456:0:202212:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x152d:0x0] updating lvb size from disk: 0 -> 12288 00002000:00010000:0.0:1787508687.159460:0:202212:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x152d:0x0] updating lvb blocks from disk: 0 -> 24 00010000:00010000:0.0:1787508687.159466:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000091bbb7bc/0xb126349c40f35170 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x152d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae789 expref: 9 pid: 230130 timeout: 13758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.159481:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000091bbb7bc/0xb126349c40f35170 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x152d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae789 expref: 9 pid: 230130 timeout: 13758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.159504:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091bbb7bc/0xb126349c40f35170 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x152d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae789 expref: 9 pid: 230130 timeout: 13758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.159519:0:202212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x152d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787508687.159524:0:202212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x152d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787508687.159533:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c8021ba/0xb126349c40f351af lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x152d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7a5 expref: 5 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.159543:0:202212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c8021ba/0xb126349c40f351af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x152d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7a5 expref: 5 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508687.159579:0:202212:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009c8021ba/0xb126349c40f351af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x152d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7a5 expref: 5 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508687.159604:0:202212:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:202212:1874324480175744:192.168.201.30@tcp:105: 00000100:00100000:0.0:1787508687.159691:0:202212:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c9919780 going to sleep for 11 seconds 00000100:00100000:0.0:1787508687.162670:0:202212:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:202212:1874324480175744:192.168.201.30@tcp:105: 00010000:00010000:0.0:1787508687.162698:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508687.162756:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2403:x1874324509591936:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 3333us (3776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508687.162767:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27921 00000100:00100000:2.0:1787508687.164095:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508687.164716:0:208929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509592064 00000100:00100000:0.0:1787508687.164727:0:208929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509592064 00002000:00100000:0.0:1787508687.164776:0:208929:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x152d:0x0] (0->4095) req@ffff9091ffc0f800 x1874324509592064/t0(0) o3->eb35f31c-097f-45a3-8275-bc75f97f89ee@192.168.201.30@tcp:143/0 lens 488/0 e 0 to 0 dl 1787508698 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787508687.164786:0:208929:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091ffc0f800 with x1874324509592064 ext(0->4095) 00002000:00010000:0.0:1787508687.164791:0:208929:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9091ffc0f800 00000100:00100000:0.0:1787508687.164814:0:208929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:0.0:1787508687.164824:0:208929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2401:x1874324509592064:12345-192.168.201.30@tcp:3:multiop.0 00000100:00100000:0.0:1787508687.165019:0:208929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2401:x1874324509592064:12345-192.168.201.30@tcp:3:multiop.0 Request processed in 196us (928us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787508687.165024:0:208929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 46 00002000:00100000:0.0:1787508687.165029:0:208929:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x152d:0x0] (0->4095) req@ffff9091ffc0f800 x1874324509592064/t0(0) o3->eb35f31c-097f-45a3-8275-bc75f97f89ee@192.168.201.30@tcp:143/0 lens 488/4536 e 0 to 0 dl 1787508698 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787508687.165035:0:208929:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091ffc0f800 with x1874324509592064 ext(0->4095) 00002000:00010000:0.0:1787508687.165037:0:208929:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9091ffc0f800 00010000:00010000:3.0:1787508687.418237:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508687.546978:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480176000:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787508687.547065:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508687.547114:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787508687.547121:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480175872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787508687.547161:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508687.547485:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480176000 00000100:00100000:0.0:1787508687.547494:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480176000 00000100:00080000:1.0:1787508687.547540:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508687.547561:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480175872 00000100:00100000:0.0:1787508687.547565:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480175872 00000100:00080000:1.0:1787508687.547598:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508687.547609:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1681 00000100:00100000:0.0:1787508687.547619:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480176000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787508687.547655:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 124211776 pending 0 free 3881955328 avail 3650433024 00000100:00100000:0.0:1787508687.547713:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480176000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508687.547721:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1681 00000100:00100000:0.0:1787508687.547742:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1682 00000100:00100000:0.0:1787508687.547750:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480175872:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508687.547753:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480176000:0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787508687.547762:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 124211776 pending 0 free 3881955328 avail 3650433024 00000100:00100000:0.0:1787508687.547809:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480175872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508687.547815:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1682 00000100:00100000:1.0:1787508687.547882:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480175872:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787508688.443354:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508689.082914:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787508689.082967:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480176128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787508689.083053:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508689.083357:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480176128 00000100:00100000:2.0:1787508689.083367:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480176128 00000100:00100000:2.0:1787508689.083439:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1683 00000100:00100000:2.0:1787508689.083450:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480176128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787508689.083480:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33866304 pending 36864 free 3910815744 avail 3679293440 00000100:00100000:2.0:1787508689.083526:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480176128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508689.083533:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1683 00000100:00080000:1.0:1787508689.083611:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508689.083650:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480176128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787508689.084309:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480176256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787508689.084348:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508689.084475:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480176256 00000100:00100000:3.0:1787508689.084483:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480176256 00000100:00100000:3.0:1787508689.084535:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1684 00000100:00100000:3.0:1787508689.084542:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480176256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787508689.084556:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33866304 pending 36864 free 3910815744 avail 3679293440 00000100:00100000:3.0:1787508689.084606:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480176256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508689.084615:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1684 00000100:00100000:0.0:1787508689.084697:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480176256:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787508689.085999:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787508689.175850:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508689.175969:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509592320 00000100:00100000:0.0:1787508689.175979:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509592320 00000100:00100000:0.0:1787508689.176065:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94056 00000100:00100000:0.0:1787508689.176088:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+18:339113:x1874324509592320:12345-192.168.201.30@tcp:101:fadvise_dontnee.0 00010000:00010000:0.0:1787508689.176117:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508689.176138:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f351b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae7ac expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508689.176264:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f351bd lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508689.176280:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f351bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508689.176293:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f351bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508689.176304:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1263:0x0]: returning size 12288 00010000:00010000:0.0:1787508689.176433:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f351b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7ac expref: 21 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508689.176452:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f351bd lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7ac expref: 20 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508689.176460:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1263:0x0].0x0 (ffff9091d43a5300) 00010000:00010000:0.0:1787508689.176463:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787508689.176467:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5200, rc 0) 00000100:00100000:0.0:1787508689.176533:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+20:339113:x1874324509592320:12345-192.168.201.30@tcp:101:fadvise_dontnee.0 Request processed in 450us (693us total) trans 12884944154 rc 0/0 00000100:00100000:0.0:1787508689.176544:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94056 00000100:00080000:1.0:1787508689.176625:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787508689.206096:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508689.206211:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509592448 00000100:00100000:0.0:1787508689.206221:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509592448 00000100:00100000:0.0:1787508689.206297:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9802 00000100:00100000:0.0:1787508689.206307:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+20:2403:x1874324509592448:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508689.206323:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508689.206347:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f351bd lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7ac expref: 20 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508689.206367:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1263:0x0].0x0 (ffff9091d43a5300) 00010000:00010000:0.0:1787508689.206372:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508689.206432:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+19:2403:x1874324509592448:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 126us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508689.206439:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9802 00000100:00100000:2.0:1787508689.209187:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508689.210800:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509592704 00000100:00100000:0.0:1787508689.210814:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509592704 00000100:00100000:0.0:1787508689.210972:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15437 00000100:00100000:0.0:1787508689.210984:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde31850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+19:339113:x1874324509592704:12345-192.168.201.30@tcp:35:fadvise_dontnee.0 00000100:00100000:0.0:1787508689.213610:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde31850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+20:339113:x1874324509592704:12345-192.168.201.30@tcp:35:fadvise_dontnee.0 Request processed in 2609us (4413us total) trans 12884944155 rc 0/0 00000100:00100000:0.0:1787508689.213625:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15437 00000100:00100000:2.0:1787508689.268172:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508689.268334:0:203733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509592832 00000100:00100000:3.0:1787508689.268346:0:203733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509592832 00002000:00100000:3.0:1787508689.268420:0:203733:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x152d:0x0] (0->4095) req@ffff9091ffc0fb80 x1874324509592832/t0(0) o3->eb35f31c-097f-45a3-8275-bc75f97f89ee@192.168.201.30@tcp:145/0 lens 488/0 e 0 to 0 dl 1787508700 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787508689.268432:0:203733:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091ffc0fb80 with x1874324509592832 ext(0->4095) 00002000:00010000:3.0:1787508689.268437:0:203733:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9091ffc0fb80 00000100:00100000:3.0:1787508689.268477:0:203733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:3.0:1787508689.268488:0:203733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509592832:12345-192.168.201.30@tcp:3:multiop.0 00000100:00100000:3.0:1787508689.268669:0:203733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509592832:12345-192.168.201.30@tcp:3:multiop.0 Request processed in 182us (520us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787508689.268677:0:203733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 47 00002000:00100000:3.0:1787508689.268684:0:203733:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x152d:0x0] (0->4095) req@ffff9091ffc0fb80 x1874324509592832/t0(0) o3->eb35f31c-097f-45a3-8275-bc75f97f89ee@192.168.201.30@tcp:145/0 lens 488/4536 e 0 to 0 dl 1787508700 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787508689.268691:0:203733:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091ffc0fb80 with x1874324509592832 ext(0->4095) 00002000:00010000:3.0:1787508689.268695:0:203733:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9091ffc0fb80 00000100:00080000:1.0:1787508689.269397:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787508689.273332:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508689.273500:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509593088 00000100:00100000:1.0:1787508689.273511:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509593088 00000100:00100000:1.0:1787508689.273572:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15438 00000100:00100000:1.0:1787508689.273582:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+20:339111:x1874324509593088:12345-192.168.201.30@tcp:35:multiop.0 00000100:00100000:1.0:1787508689.273818:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+21:339111:x1874324509593088:12345-192.168.201.30@tcp:35:multiop.0 Request processed in 236us (495us total) trans 12884944156 rc 0/0 00000100:00100000:1.0:1787508689.273827:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15438 00010000:00010000:3.0:1787508689.466359:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508690.107487:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787508690.107513:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480176512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787508690.107591:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508690.107649:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787508690.107658:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480176384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787508690.107682:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508690.107756:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480176512 00000100:00100000:1.0:1787508690.107763:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480176512 00000100:00100000:1.0:1787508690.107814:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480176384 00000100:00100000:1.0:1787508690.107818:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480176384 00000100:00100000:1.0:1787508690.107843:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29840 00000100:00100000:1.0:1787508690.107852:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480176512:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787508690.107861:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29841 00000100:00100000:3.0:1787508690.107871:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480176384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787508690.107884:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1442783232 avail 1296543744 00000004:00000024:3.0:1787508690.107887:0:202232:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1441771520 avail 1295532032 00000100:00100000:3.0:1787508690.107929:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480176384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508690.107929:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480176512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508690.107936:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29840 00000100:00100000:3.0:1787508690.107972:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29841 00000100:00100000:0.0:1787508690.108038:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480176512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787508690.108086:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480176384:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787508690.490262:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508690.619360:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480176896:0@lo:400:kworker.0 00000100:00100000:1.0:1787508690.619449:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508690.619505:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480177408:0@lo:400:kworker.0 00000100:00100000:1.0:1787508690.619551:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508690.619578:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480177920:0@lo:400:kworker.0 00000100:00100000:1.0:1787508690.619599:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508690.619634:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787508690.619641:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480176768:0@lo:400:kworker.0 00000100:00100000:1.0:1787508690.619679:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508690.619697:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480177280:0@lo:400:kworker.0 00000100:00100000:1.0:1787508690.619717:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508690.619734:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480177792:0@lo:400:kworker.0 00000100:00100000:1.0:1787508690.619753:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508690.619785:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480176896 00000100:00100000:1.0:1787508690.619791:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480176896 00000100:00100000:1.0:1787508690.619861:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480176768 00000100:00100000:1.0:1787508690.619864:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480176768 00000100:00100000:1.0:1787508690.619879:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480177280 00000100:00100000:1.0:1787508690.619881:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480177280 00000100:00100000:1.0:1787508690.619901:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2372 00000100:00100000:1.0:1787508690.619908:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480176896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508690.619975:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480176896:12345-0@lo:400:kworker.0 Request processed in 67us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508690.619981:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2372 00000100:00100000:1.0:1787508690.619998:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2373 00000100:00100000:1.0:1787508690.620004:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480176768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508690.620043:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480176768:12345-0@lo:400:kworker.0 Request processed in 39us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508690.620048:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2373 00000100:00100000:1.0:1787508690.620058:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2374 00000100:00100000:1.0:1787508690.620063:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce781f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480177280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508690.620085:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce781f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480177280:12345-0@lo:400:kworker.0 Request processed in 22us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508690.620090:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2374 00000100:00100000:1.0:1787508690.620140:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480177408 00000100:00100000:1.0:1787508690.620144:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480177408 00000100:00100000:1.0:1787508690.620168:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480177920 00000100:00100000:1.0:1787508690.620171:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480177920 00000100:00100000:1.0:1787508690.620186:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480177792 00000100:00100000:1.0:1787508690.620189:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480177792 00000100:00100000:1.0:1787508690.620204:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2995 00000100:00100000:1.0:1787508690.620210:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480177408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508690.620240:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480177408:12345-0@lo:400:kworker.0 Request processed in 30us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508690.620246:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2995 00000100:00100000:1.0:1787508690.620260:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2996 00000100:00100000:1.0:1787508690.620266:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480177920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508690.620290:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480177920:12345-0@lo:400:kworker.0 Request processed in 25us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508690.620294:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2996 00000100:00100000:1.0:1787508690.620304:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2997 00000100:00100000:1.0:1787508690.620310:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480177792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508690.620333:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480177792:12345-0@lo:400:kworker.0 Request processed in 23us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508690.620339:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2997 00000100:00080000:1.0:1787508690.620353:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787508690.620357:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787508690.620359:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508690.620388:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480176768:0@lo:400:kworker.0 00000100:00100000:1.0:1787508690.620397:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480177280:0@lo:400:kworker.0 00000100:00100000:1.0:1787508690.620405:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480177792:0@lo:400:kworker.0 00000100:00100000:1.0:1787508690.620413:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480176896:0@lo:400:kworker.0 00000100:00100000:1.0:1787508690.620421:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480177408:0@lo:400:kworker.0 00000100:00100000:1.0:1787508690.620429:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480177920:0@lo:400:kworker.0 00000100:00100000:0.0:1787508690.620727:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79de3f65-4bad-42d0-a46f-842a654b33a0:3619:1874324480176640:0@lo:400:kworker.0 00000100:00100000:0.0:1787508690.620796:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508690.620838:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480177152:0@lo:400:kworker.0 00000100:00100000:0.0:1787508690.620877:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508690.620909:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480177664:0@lo:400:kworker.0 00000100:00100000:0.0:1787508690.620932:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508690.620969:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787508690.620975:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480177024:0@lo:400:kworker.0 00000100:00100000:0.0:1787508690.620997:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508690.621014:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480177536:0@lo:400:kworker.0 00000100:00100000:0.0:1787508690.621035:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508690.621057:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480177152 00000100:00100000:0.0:1787508690.621061:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480177152 00000100:00100000:0.0:1787508690.621092:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2375 00000100:00100000:0.0:1787508690.621098:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480177152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508690.621149:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480177152:12345-0@lo:400:kworker.0 Request processed in 51us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508690.621155:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2375 00000100:00100000:0.0:1787508690.621190:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480177664 00000100:00100000:0.0:1787508690.621194:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480177664 00000100:00100000:0.0:1787508690.621217:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480177024 00000100:00100000:0.0:1787508690.621220:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480177024 00000100:00100000:0.0:1787508690.621230:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480177536 00000100:00100000:0.0:1787508690.621232:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480177536 00000100:00100000:0.0:1787508690.621262:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2998 00000100:00100000:0.0:1787508690.621267:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480177664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508690.621296:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480177664:12345-0@lo:400:kworker.0 Request processed in 29us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508690.621303:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2998 00000100:00100000:0.0:1787508690.621314:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2999 00000100:00100000:0.0:1787508690.621320:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480177024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508690.621346:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480177024:12345-0@lo:400:kworker.0 Request processed in 26us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508690.621352:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2999 00000100:00100000:0.0:1787508690.621363:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3000 00000100:00100000:0.0:1787508690.621368:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480177536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508690.621391:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480177536:12345-0@lo:400:kworker.0 Request processed in 24us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508690.621395:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3000 00000100:00080000:0.0:1787508690.621415:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787508690.621418:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787508690.621493:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480177024:0@lo:400:kworker.0 00000100:00100000:0.0:1787508690.621502:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480177536:0@lo:400:kworker.0 00000100:00100000:0.0:1787508690.621509:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480177152:0@lo:400:kworker.0 00000100:00100000:0.0:1787508690.621516:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480177664:0@lo:400:kworker.0 00000100:00100000:1.0:1787508690.621672:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480176640 00000100:00100000:1.0:1787508690.621676:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480176640 00000100:00100000:1.0:1787508690.621708:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1007 00000100:00100000:1.0:1787508690.621714:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3619:x1874324480176640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508690.621847:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3619:x1874324480176640:12345-0@lo:400:kworker.0 Request processed in 133us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508690.621854:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1007 00000100:00100000:2.0:1787508690.622352:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79de3f65-4bad-42d0-a46f-842a654b33a0:3619:1874324480176640:0@lo:400:kworker.0 00010000:00010000:3.0:1787508691.514473:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508692.076043:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508692.076088:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508692.076217:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509593344 00000100:00100000:0.0:1787508692.076227:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509593344 00000100:00100000:0.0:1787508692.076303:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3001 00000100:00100000:0.0:1787508692.076313:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+603:2403:x1874324509593344:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508692.076385:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+603:2403:x1874324509593344:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 73us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508692.076392:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3001 00000100:00080000:3.0:1787508692.076845:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508692.076917:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508692.076980:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508692.077373:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509593856 00000100:00100000:0.0:1787508692.077379:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509593856 00000100:00100000:0.0:1787508692.077440:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3002 00000100:00100000:0.0:1787508692.077448:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+21:2403:x1874324509593856:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508692.077496:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+21:2403:x1874324509593856:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 48us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508692.077502:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3002 00000100:00080000:3.0:1787508692.077806:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508692.078202:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508692.078382:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508692.078418:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508692.078501:0:225835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509593600 00000100:00100000:1.0:1787508692.078507:0:225835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509593600 00000100:00100000:1.0:1787508692.078551:0:225835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509594112 00000100:00100000:1.0:1787508692.078554:0:225835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509594112 00000100:00100000:1.0:1787508692.078577:0:225835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2376 00000100:00100000:1.0:1787508692.078584:0:225835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2403:x1874324509593600:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508692.081326:0:225835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2403:x1874324509593600:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 2719us (5214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508692.081342:0:225835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2376 00000100:00100000:1.0:1787508692.081385:0:225835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2377 00000100:00100000:1.0:1787508692.081397:0:225835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2403:x1874324509594112:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508692.081437:0:225835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2403:x1874324509594112:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 45us (4457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508692.081444:0:225835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2377 00000100:00080000:1.0:1787508692.081477:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508692.081626:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509593472 00000100:00100000:1.0:1787508692.081635:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509593472 00000100:00100000:1.0:1787508692.081700:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3003 00000100:00100000:1.0:1787508692.081708:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2403:x1874324509593472:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508692.081751:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2403:x1874324509593472:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 44us (3368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508692.081757:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3003 00000100:00080000:1.0:1787508692.081772:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787508692.083556:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508692.083609:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508692.083722:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509593984 00000100:00100000:1.0:1787508692.083731:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509593984 00000100:00100000:1.0:1787508692.083795:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3004 00000100:00100000:1.0:1787508692.083804:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509593984:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508692.083878:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509593984:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 74us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508692.083885:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3004 00000100:00100000:3.0:1787508692.084603:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509593216 00000100:00100000:3.0:1787508692.084610:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509593216 00000100:00100000:3.0:1787508692.084647:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1008 00000100:00100000:3.0:1787508692.084656:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d980a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509593216:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508692.084701:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d980a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509593216:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 46us (6501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508692.084707:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1008 00000100:00080000:2.0:1787508692.086141:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787508692.086465:0:225838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509593728 00000100:00100000:0.0:1787508692.086476:0:225838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509593728 00000100:00100000:0.0:1787508692.086550:0:225838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509594240 00000100:00100000:0.0:1787508692.086554:0:225838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509594240 00000100:00100000:0.0:1787508692.086596:0:225838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2378 00000100:00100000:0.0:1787508692.086606:0:225838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2403:x1874324509593728:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508692.086671:0:225838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2403:x1874324509593728:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 66us (8251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508692.086679:0:225838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2378 00000100:00100000:0.0:1787508692.086696:0:225838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2379 00000100:00100000:0.0:1787508692.086703:0:225838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509594240:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508692.086725:0:225838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509594240:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (3116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508692.086732:0:225838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2379 00000100:00080000:2.0:1787508692.087234:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787508692.538363:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787508692.668046:0:203722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589941252 is committed 00000001:00080000:0.0:1787508692.669499:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944156 is committed 00000001:00080000:0.0:1787508692.669531:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944152 is committed 00010000:00010000:0.0:1787508692.669576:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f350f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508692.669589:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f350f9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508692.669597:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f350f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508692.669604:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f7a00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508692.669610:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f350f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508692.669618:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f350f9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508692.669635:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24b6b805 (ffff9091d43a5100) 00010000:00010000:0.0:1787508692.669638:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508692.669643:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f350f9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508692.669650:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7a00/0xb126349c40f350f9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24b6b805 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508692.669678:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f35169 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508692.669686:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f35169 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x1263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508692.669692:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f35169 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508692.669697:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d56f6e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508692.669700:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f35169 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508692.669707:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f35169 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x1263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508692.669715:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1263:0x0].0x0 (ffff9091d43a5300) 00010000:00010000:0.0:1787508692.669717:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508692.669720:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f35169 lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x1263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508692.669726:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6e00/0xb126349c40f35169 lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x1263:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508692.671778:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480178048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787508692.671868:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508692.672037:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480178048 00000100:00100000:2.0:1787508692.672045:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480178048 00000100:00100000:2.0:1787508692.672121:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1685 00000100:00100000:2.0:1787508692.672131:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480178048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787508692.672162:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 124211776 pending 0 free 3881955328 avail 3650433024 00000100:00100000:2.0:1787508692.672209:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480178048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508692.672216:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1685 00000100:00100000:2.0:1787508692.672271:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480178048:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787508692.672336:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787508692.673179:0:204539:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589940560 is committed 00000100:00100000:3.0:1787508692.675317:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480178176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787508692.675455:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508692.675600:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480178176 00000100:00100000:2.0:1787508692.675608:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480178176 00000100:00100000:2.0:1787508692.675675:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1686 00000100:00100000:2.0:1787508692.675685:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480178176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787508692.675706:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 124211776 pending 0 free 3881955328 avail 3650433024 00000100:00080000:1.0:1787508692.675771:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787508692.676556:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480178176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 870us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508692.676566:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1686 00000100:00100000:3.0:1787508692.676644:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480178176:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787508693.563332:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508694.204020:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480178304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787508694.204111:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508694.204190:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480178304 00000100:00100000:0.0:1787508694.204197:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480178304 00000100:00100000:0.0:1787508694.204254:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1687 00000100:00100000:0.0:1787508694.204265:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480178304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787508694.204297:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33829440 pending 0 free 3910815744 avail 3679293440 00000100:00100000:0.0:1787508694.204356:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480178304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508694.204363:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1687 00000100:00080000:0.0:1787508694.204385:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787508694.204419:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480178304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787508694.207389:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787508694.207411:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480178432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787508694.207479:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508694.207545:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480178432 00000100:00100000:0.0:1787508694.207552:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480178432 00000100:00100000:0.0:1787508694.207612:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1688 00000100:00100000:0.0:1787508694.207621:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480178432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787508694.207643:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33829440 pending 0 free 3910815744 avail 3679293440 00000100:00100000:0.0:1787508694.207687:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480178432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508694.207695:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1688 00000100:00080000:0.0:1787508694.207716:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787508694.207752:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480178432:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787508694.588136:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508695.226471:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787508695.226496:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480178560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787508695.226567:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508695.226781:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480178560 00000100:00100000:2.0:1787508695.226790:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480178560 00000100:00100000:2.0:1787508695.226854:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29842 00000100:00100000:2.0:1787508695.226864:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480178560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787508695.226899:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1441771520 avail 1295532032 00000100:00100000:2.0:1787508695.226972:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480178560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508695.226979:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29842 00000100:00100000:0.0:1787508695.227332:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480178560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787508695.227486:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480178688:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787508695.227516:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508695.227973:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480178688 00000100:00100000:1.0:1787508695.227980:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480178688 00000100:00100000:1.0:1787508695.228024:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29843 00000100:00100000:1.0:1787508695.228032:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480178688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787508695.228070:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1442783232 avail 1296543744 00000100:00100000:1.0:1787508695.228134:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480178688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508695.228140:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29843 00000100:00100000:0.0:1787508695.228364:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480178688:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787508695.610482:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508695.739123:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480179072:0@lo:400:kworker.0 00000100:00100000:3.0:1787508695.739195:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508695.739266:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480179584:0@lo:400:kworker.0 00000100:00100000:3.0:1787508695.739296:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508695.739313:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480180096:0@lo:400:kworker.0 00000100:00100000:3.0:1787508695.739335:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508695.739357:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787508695.739363:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480179200:0@lo:400:kworker.0 00000100:00100000:3.0:1787508695.739428:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508695.739443:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874324480179712:0@lo:400:kworker.0 00000100:00100000:3.0:1787508695.739461:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508695.739686:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480179072 00000100:00100000:0.0:1787508695.739695:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480179072 00000100:00100000:0.0:1787508695.739757:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2380 00000100:00100000:0.0:1787508695.739768:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480179072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508695.739842:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480179072:12345-0@lo:400:kworker.0 Request processed in 76us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508695.739851:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2380 00000100:00100000:0.0:1787508695.739875:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480179584 00000100:00100000:0.0:1787508695.739879:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480179584 00000100:00100000:0.0:1787508695.739902:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480180096 00000100:00100000:0.0:1787508695.739905:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480180096 00000100:00100000:0.0:1787508695.739921:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480179200 00000100:00100000:0.0:1787508695.739924:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480179200 00000100:00100000:0.0:1787508695.739939:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480179712 00000100:00100000:0.0:1787508695.739977:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480179712 00000100:00100000:0.0:1787508695.739995:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3005 00000100:00100000:0.0:1787508695.740002:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480179584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508695.740056:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480179584:12345-0@lo:400:kworker.0 Request processed in 55us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508695.740063:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3005 00000100:00100000:0.0:1787508695.740076:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3006 00000100:00100000:0.0:1787508695.740082:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480180096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508695.740110:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480180096:12345-0@lo:400:kworker.0 Request processed in 28us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508695.740115:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3006 00000100:00100000:0.0:1787508695.740127:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3007 00000100:00100000:0.0:1787508695.740133:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480179200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508695.740163:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480179200:12345-0@lo:400:kworker.0 Request processed in 31us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508695.740169:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3007 00000100:00100000:0.0:1787508695.740181:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3008 00000100:00100000:0.0:1787508695.740187:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874324480179712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508695.740225:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874324480179712:12345-0@lo:400:kworker.0 Request processed in 38us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508695.740231:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3008 00000100:00100000:0.0:1787508695.740276:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480179200:0@lo:400:kworker.0 00000100:00100000:0.0:1787508695.740286:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874324480179712:0@lo:400:kworker.0 00000100:00100000:0.0:1787508695.740297:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480179072:0@lo:400:kworker.0 00000100:00100000:0.0:1787508695.740305:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480179584:0@lo:400:kworker.0 00000100:00100000:0.0:1787508695.740314:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480180096:0@lo:400:kworker.0 00000100:00100000:1.0:1787508695.740716:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480178816:0@lo:400:kworker.0 00000100:00100000:1.0:1787508695.740759:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508695.740803:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480179328:0@lo:400:kworker.0 00000100:00100000:1.0:1787508695.740840:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508695.740860:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480179840:0@lo:400:kworker.0 00000100:00100000:1.0:1787508695.740882:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508695.740901:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787508695.740908:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480178944:0@lo:400:kworker.0 00000100:00100000:1.0:1787508695.740929:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508695.741087:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480179456:0@lo:400:kworker.0 00000100:00100000:1.0:1787508695.741110:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508695.741128:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480179968:0@lo:400:kworker.0 00000100:00100000:1.0:1787508695.741147:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508695.741179:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480179840 00000100:00100000:1.0:1787508695.741184:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480179840 00000100:00100000:1.0:1787508695.741226:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480179968 00000100:00100000:1.0:1787508695.741230:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480179968 00000100:00100000:1.0:1787508695.741251:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3009 00000100:00100000:1.0:1787508695.741259:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480179840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508695.741299:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480179840:12345-0@lo:400:kworker.0 Request processed in 41us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508695.741306:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3009 00000100:00100000:1.0:1787508695.741321:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3010 00000100:00100000:1.0:1787508695.741327:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480179968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508695.741353:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480179968:12345-0@lo:400:kworker.0 Request processed in 27us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508695.741359:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3010 00000100:00100000:1.0:1787508695.741374:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480179328 00000100:00100000:1.0:1787508695.741377:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480179328 00000100:00100000:1.0:1787508695.741397:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480178944 00000100:00100000:1.0:1787508695.741399:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480178944 00000100:00100000:1.0:1787508695.741414:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480179456 00000100:00100000:1.0:1787508695.741416:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480179456 00000100:00100000:1.0:1787508695.741435:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2381 00000100:00100000:1.0:1787508695.741440:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480179328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508695.741470:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480179328:12345-0@lo:400:kworker.0 Request processed in 29us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508695.741475:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2381 00000100:00100000:1.0:1787508695.741486:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2382 00000100:00100000:1.0:1787508695.741492:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480178944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508695.741516:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480178944:12345-0@lo:400:kworker.0 Request processed in 25us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508695.741522:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2382 00000100:00100000:1.0:1787508695.741531:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2383 00000100:00100000:1.0:1787508695.741537:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480179456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508695.741560:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480179456:12345-0@lo:400:kworker.0 Request processed in 24us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508695.741566:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2383 00000100:00100000:1.0:1787508695.741606:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480178944:0@lo:400:kworker.0 00000100:00100000:1.0:1787508695.741614:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480179456:0@lo:400:kworker.0 00000100:00100000:1.0:1787508695.741622:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480179968:0@lo:400:kworker.0 00000100:00100000:1.0:1787508695.741630:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480179328:0@lo:400:kworker.0 00000100:00100000:1.0:1787508695.741637:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480179840:0@lo:400:kworker.0 00000100:00080000:3.0:1787508695.742793:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787508695.742800:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787508695.742804:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508695.742995:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480178816 00000100:00100000:0.0:1787508695.743004:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480178816 00000100:00100000:0.0:1787508695.743073:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:0.0:1787508695.743082:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480178816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508695.743150:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480178816:12345-0@lo:400:kworker.0 Request processed in 70us (2391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508695.743157:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00100000:1.0:1787508695.743541:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480178816:0@lo:400:kworker.0 00010000:00010000:0.0:1787508696.636153:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508697.196211:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508697.196262:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508697.196340:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508697.196409:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509594752 00000100:00100000:0.0:1787508697.196419:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509594752 00000100:00100000:0.0:1787508697.196485:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2384 00000100:00100000:0.0:1787508697.196498:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2400:x1874324509594752:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508697.196571:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2400:x1874324509594752:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 77us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508697.196579:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2384 00000100:00100000:2.0:1787508697.196832:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508697.196865:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508697.196911:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508697.196969:0:225833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509595264 00000100:00100000:0.0:1787508697.196974:0:225833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509595264 00000100:00100000:0.0:1787508697.197006:0:225833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2385 00000100:00100000:0.0:1787508697.197014:0:225833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509595264:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508697.197080:0:225833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509595264:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 66us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508697.197087:0:225833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2385 00000100:00080000:0.0:1787508697.197138:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787508697.197162:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509594368 00000100:00100000:0.0:1787508697.197165:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509594368 00000100:00100000:0.0:1787508697.197190:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1010 00000100:00100000:0.0:1787508697.197197:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fccc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2400:x1874324509594368:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508697.197221:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fccc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2400:x1874324509594368:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508697.197227:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1010 00000100:00100000:1.0:1787508697.205347:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509594496 00000100:00100000:1.0:1787508697.205366:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509594496 00000100:00100000:1.0:1787508697.205457:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509595008 00000100:00100000:1.0:1787508697.205460:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509595008 00000100:00100000:1.0:1787508697.205496:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3011 00000100:00100000:1.0:1787508697.205507:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+593:2400:x1874324509594496:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508697.205593:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+593:2400:x1874324509594496:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 87us (9391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508697.205600:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3011 00000100:00100000:1.0:1787508697.205618:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3012 00000100:00100000:1.0:1787508697.205625:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:2400:x1874324509595008:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508697.205650:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:2400:x1874324509595008:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (9310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508697.205656:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3012 00000100:00080000:0.0:1787508697.205711:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787508697.212729:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508697.212772:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508697.212834:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508697.212920:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509594624 00000100:00100000:3.0:1787508697.212930:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509594624 00000100:00100000:3.0:1787508697.213030:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509595136 00000100:00100000:3.0:1787508697.213034:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509595136 00000100:00100000:3.0:1787508697.213061:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3013 00000100:00100000:3.0:1787508697.213071:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2400:x1874324509594624:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508697.213146:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2400:x1874324509594624:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 76us (16236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508697.213153:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3013 00000100:00100000:3.0:1787508697.213173:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3014 00000100:00100000:3.0:1787508697.213180:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509595136:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508697.213203:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509595136:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508697.213208:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3014 00000100:00080000:0.0:1787508697.213586:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787508697.213644:0:225835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509594880 00000100:00100000:2.0:1787508697.213649:0:225835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509594880 00000100:00100000:2.0:1787508697.213698:0:225835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509595392 00000100:00100000:2.0:1787508697.213701:0:225835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509595392 00000100:00100000:2.0:1787508697.213723:0:225835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2386 00000100:00100000:2.0:1787508697.213729:0:225835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2400:x1874324509594880:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508697.213768:0:225835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2400:x1874324509594880:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 39us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508697.213775:0:225835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2386 00000100:00100000:2.0:1787508697.213792:0:225835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2387 00000100:00100000:2.0:1787508697.213798:0:225835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509595392:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508697.213820:0:225835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509595392:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508697.213826:0:225835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2387 00000100:00080000:0.0:1787508697.214060:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787508697.659176:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508697.786600:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787508697.786624:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480180224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787508697.786693:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508697.786750:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480180224 00000100:00100000:1.0:1787508697.786758:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480180224 00000100:00100000:1.0:1787508697.786826:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1689 00000100:00100000:1.0:1787508697.786836:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480180224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787508697.786866:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 124211776 pending 0 free 3881955328 avail 3650433024 00000100:00100000:1.0:1787508697.786913:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480180224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508697.786920:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1689 00000100:00080000:1.0:1787508697.786996:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508697.787046:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480180224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787508697.787480:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787508697.787491:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480180352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508697.787522:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508697.787552:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480180352 00000100:00100000:1.0:1787508697.787556:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480180352 00000100:00100000:1.0:1787508697.787589:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1690 00000100:00100000:1.0:1787508697.787596:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480180352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787508697.787608:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 124211776 pending 0 free 3881955328 avail 3650433024 00000100:00100000:1.0:1787508697.787639:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480180352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508697.787649:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1690 00000100:00080000:1.0:1787508697.787664:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508697.787684:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480180352:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787508698.684503:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508699.323031:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787508699.323058:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480180608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787508699.323132:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508699.324212:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480180480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787508699.324270:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508699.324336:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480180608 00000100:00100000:1.0:1787508699.324345:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480180608 00000100:00100000:0.0:1787508699.324353:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480180480 00000100:00100000:0.0:1787508699.324357:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480180480 00000100:00100000:1.0:1787508699.324554:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1691 00000100:00100000:1.0:1787508699.324608:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480180608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787508699.324642:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33829440 pending 0 free 3910815744 avail 3679293440 00000100:00100000:1.0:1787508699.324692:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480180608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (1559us total) trans 0 rc 0/0 00000100:00080000:2.0:1787508699.326124:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787508699.327142:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480180608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787508699.327935:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1692 00000100:00100000:0.0:1787508699.327970:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480180480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787508699.328036:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33829440 pending 0 free 3910815744 avail 3679293440 00000100:00100000:0.0:1787508699.328131:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480180480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 173us (3860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508699.328140:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1692 00000100:00100000:2.0:1787508699.328272:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480180480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787508699.329510:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1691 00010000:00010000:3.0:1787508699.706189:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787508700.024677:0:233011:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 100a: DoM: glimpse RPCs for stat without IO lock (DoM only file) ========================================================== 14:11:39 (1787508699) 00000100:00100000:0.0:1787508700.346234:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787508700.346261:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480180736:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787508700.346338:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508700.346415:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480180864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787508700.346439:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508700.346474:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480180736 00000100:00100000:0.0:1787508700.346481:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480180736 00000100:00100000:0.0:1787508700.346532:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480180864 00000100:00100000:0.0:1787508700.346535:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480180864 00000100:00100000:2.0:1787508700.346536:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29844 00000100:00100000:2.0:1787508700.346546:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480180736:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787508700.346554:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29845 00000100:00100000:0.0:1787508700.346559:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480180864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787508700.346581:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1442783232 avail 1296543744 00000004:00000024:0.0:1787508700.346581:0:202232:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1441771520 avail 1295532032 00000100:00100000:2.0:1787508700.346689:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480180736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508700.346697:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29844 00000100:00100000:0.0:1787508700.347637:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480180864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1072us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508700.347646:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29845 00000100:00100000:1.0:1787508700.347934:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480180736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787508700.347979:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480180864:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787508700.730857:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508700.858453:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480180992:0@lo:400:kworker.0 00000100:00100000:3.0:1787508700.858533:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508700.858665:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480180992 00000100:00100000:0.0:1787508700.858674:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480180992 00000100:00100000:0.0:1787508700.858732:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:0.0:1787508700.858742:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fccc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480180992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508700.858793:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fccc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480180992:12345-0@lo:400:kworker.0 Request processed in 53us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508700.858801:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:1.0:1787508700.858833:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480181376:0@lo:400:kworker.0 00000100:00100000:0.0:1787508700.858843:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480181504:0@lo:400:kworker.0 00000100:00100000:1.0:1787508700.858866:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508700.858866:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508700.858914:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480181120:0@lo:400:kworker.0 00000100:00100000:3.0:1787508700.858938:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480181376 00000100:00100000:3.0:1787508700.858966:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480181376 00000100:00100000:3.0:1787508700.859002:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3015 00000100:00100000:3.0:1787508700.859009:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480181376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508700.860609:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480182016:0@lo:400:kworker.0 00000100:00100000:0.0:1787508700.860653:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508700.860692:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480180992:0@lo:400:kworker.0 00000100:00100000:0.0:1787508700.860731:0:225838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480181504 00000100:00100000:0.0:1787508700.860735:0:225838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480181504 00000100:00100000:0.0:1787508700.860772:0:225838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2388 00000100:00100000:0.0:1787508700.860780:0:225838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480181504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508700.860821:0:225838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480181504:12345-0@lo:400:kworker.0 Request processed in 42us (1954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508700.860828:0:225838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2388 00000100:00100000:0.0:1787508700.860848:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480182016 00000100:00100000:0.0:1787508700.860851:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480182016 00000100:00100000:0.0:1787508700.860880:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3016 00000100:00100000:0.0:1787508700.860886:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480182016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508700.860913:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480182016:12345-0@lo:400:kworker.0 Request processed in 28us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508700.861003:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3016 00000100:00080000:0.0:1787508700.861024:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787508700.861046:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480181504:0@lo:400:kworker.0 00000100:00100000:0.0:1787508700.861054:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480182016:0@lo:400:kworker.0 00000100:00100000:1.0:1787508700.863554:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480181248:0@lo:400:kworker.0 00000100:00100000:1.0:1787508700.863614:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508700.863642:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480181760:0@lo:400:kworker.0 00000100:00100000:0.0:1787508700.863649:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480181888:0@lo:400:kworker.0 00000100:00100000:1.0:1787508700.863666:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508700.863693:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480182272:0@lo:400:kworker.0 00000100:00100000:0.0:1787508700.863698:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480181248 00000100:00100000:0.0:1787508700.863705:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480181248 00000100:00100000:1.0:1787508700.863713:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508700.863745:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480181760 00000100:00100000:1.0:1787508700.863748:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480181760 00000100:00100000:0.0:1787508700.863754:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2389 00000100:00100000:0.0:1787508700.863762:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480181248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508700.863770:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480182272 00000100:00100000:1.0:1787508700.863772:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480182272 00000100:00100000:1.0:1787508700.863793:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3017 00000100:00100000:1.0:1787508700.863798:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480181760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508700.863811:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480181248:12345-0@lo:400:kworker.0 Request processed in 50us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508700.863818:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2389 00000100:00100000:1.0:1787508700.863826:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480181760:12345-0@lo:400:kworker.0 Request processed in 29us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508700.863832:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3017 00000100:00080000:0.0:1787508700.863837:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508700.863841:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508700.863843:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3018 00000100:00100000:1.0:1787508700.863849:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480182272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508700.863849:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508700.863869:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480181888 00000100:00100000:0.0:1787508700.863872:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480181888 00000100:00100000:1.0:1787508700.863873:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480182272:12345-0@lo:400:kworker.0 Request processed in 25us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508700.863879:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3018 00000100:00100000:1.0:1787508700.863890:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3019 00000100:00100000:1.0:1787508700.863896:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480181888:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787508700.863900:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787508700.863927:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480181888:12345-0@lo:400:kworker.0 Request processed in 31us (77us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508700.863933:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3019 00000100:00100000:0.0:1787508700.863988:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480181888:0@lo:400:kworker.0 00000100:00100000:1.0:1787508700.865598:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480181248:0@lo:400:kworker.0 00000100:00100000:1.0:1787508700.865612:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480181760:0@lo:400:kworker.0 00000100:00100000:1.0:1787508700.865621:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480182272:0@lo:400:kworker.0 00000100:00100000:3.0:1787508700.872633:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480181376:12345-0@lo:400:kworker.0 Request processed in 13614us (13755us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508700.872650:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3015 00000100:00100000:0.0:1787508700.873240:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480181376:0@lo:400:kworker.0 00000100:00100000:2.0:1787508700.874530:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508700.874570:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480181632:0@lo:400:kworker.0 00000100:00100000:2.0:1787508700.874607:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508700.874634:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480182144:0@lo:400:kworker.0 00000100:00100000:2.0:1787508700.874657:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508700.874836:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480181120 00000100:00100000:1.0:1787508700.874845:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480181120 00000100:00100000:1.0:1787508700.874897:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2390 00000100:00100000:1.0:1787508700.874907:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480181120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508700.875060:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480181632 00000100:00100000:0.0:1787508700.875064:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480181632 00000100:00100000:0.0:1787508700.875103:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2391 00000100:00100000:0.0:1787508700.875110:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480181632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508700.875190:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480181632:12345-0@lo:400:kworker.0 Request processed in 80us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508700.875198:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2391 00000100:00080000:0.0:1787508700.875218:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508700.875220:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480181120:12345-0@lo:400:kworker.0 Request processed in 315us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508700.875226:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2390 00000100:00100000:3.0:1787508700.875442:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480182144 00000100:00100000:3.0:1787508700.875446:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480182144 00000100:00100000:3.0:1787508700.875493:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3020 00000100:00100000:3.0:1787508700.875500:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480182144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508700.875535:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480182144:12345-0@lo:400:kworker.0 Request processed in 36us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508700.875540:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3020 00000100:00080000:0.0:1787508700.875596:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508700.875673:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480181120:0@lo:400:kworker.0 00000100:00100000:1.0:1787508700.875753:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480181632:0@lo:400:kworker.0 00000100:00100000:1.0:1787508700.875762:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480182144:0@lo:400:kworker.0 00000001:02000400:1.0:1787508701.664627:0:233060:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanityn test_100a Reserved for glimpse-ahead 00010000:00010000:1.0:1787508701.757220:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508702.312262:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508702.312369:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508702.312490:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509595520 00000100:00100000:2.0:1787508702.312499:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509595520 00000100:00100000:2.0:1787508702.312564:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1012 00000100:00100000:2.0:1787508702.312575:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fccc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2400:x1874324509595520:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508702.312650:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fccc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2400:x1874324509595520:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 77us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508702.312662:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1012 00000100:00100000:0.0:1787508702.313547:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508702.313576:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508702.313631:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509596032 00000100:00100000:2.0:1787508702.313638:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509596032 00000100:00100000:2.0:1787508702.313695:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2392 00000100:00100000:2.0:1787508702.313703:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2400:x1874324509596032:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508702.313747:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2400:x1874324509596032:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 45us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508702.313754:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2392 00000100:00080000:3.0:1787508702.313953:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508702.315614:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508702.316236:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508702.316407:0:203728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509596544 00000100:00100000:3.0:1787508702.316417:0:203728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509596544 00000100:00100000:3.0:1787508702.316477:0:203728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2393 00000100:00100000:3.0:1787508702.316487:0:203728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509596544:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508702.316570:0:203728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509596544:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 84us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508702.316578:0:203728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2393 00000100:00080000:3.0:1787508702.316607:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508702.316839:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509595776 00000100:00100000:1.0:1787508702.316844:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509595776 00000100:00100000:1.0:1787508702.316883:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509596288 00000100:00100000:1.0:1787508702.316886:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509596288 00000100:00100000:1.0:1787508702.316910:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3021 00000100:00100000:1.0:1787508702.316917:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2400:x1874324509595776:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508702.321213:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:2400:x1874324509595776:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 4284us (8832us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508702.321228:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3021 00000100:00100000:1.0:1787508702.321274:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3022 00000100:00100000:1.0:1787508702.321286:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509596288:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508702.321326:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509596288:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 45us (7749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508702.321333:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3022 00000100:00080000:3.0:1787508702.322495:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787508702.325282:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508702.325321:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508702.325376:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509595904 00000100:00100000:1.0:1787508702.325386:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509595904 00000100:00100000:1.0:1787508702.325464:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2394 00000100:00100000:1.0:1787508702.325476:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2400:x1874324509595904:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508702.325553:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2400:x1874324509595904:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 80us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508702.325561:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2394 00000100:00080000:2.0:1787508702.326462:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787508702.328300:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508702.328467:0:225833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509596416 00000100:00100000:1.0:1787508702.328478:0:225833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509596416 00000100:00100000:1.0:1787508702.328557:0:225833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2395 00000100:00100000:1.0:1787508702.328569:0:225833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509596416:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508702.328659:0:225833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509596416:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 80us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508702.328667:0:225833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2395 00000100:00080000:0.0:1787508702.329666:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787508702.331236:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509595648 00000100:00100000:3.0:1787508702.331250:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509595648 00000100:00100000:3.0:1787508702.331514:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509596160 00000100:00100000:3.0:1787508702.331518:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509596160 00000100:00100000:1.0:1787508702.331583:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3023 00000100:00100000:1.0:1787508702.331594:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+593:2400:x1874324509595648:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508702.331699:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+593:2400:x1874324509595648:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 106us (16053us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508702.331706:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3023 00000100:00080000:0.0:1787508702.332580:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787508702.332890:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3024 00000100:00100000:3.0:1787508702.332900:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:2400:x1874324509596160:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508702.332984:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:2400:x1874324509596160:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 86us (7662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508702.333711:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3024 00010000:00010000:1.0:1787508702.788267:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508702.910731:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480182400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508702.910800:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508702.910851:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480182528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787508702.910871:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508702.910902:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480182400 00000100:00100000:1.0:1787508702.910910:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480182400 00000100:00100000:1.0:1787508702.910986:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480182528 00000100:00100000:1.0:1787508702.910989:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480182528 00000100:00100000:1.0:1787508702.911006:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1693 00000100:00100000:1.0:1787508702.911014:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480182400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787508702.911045:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 124211776 pending 0 free 3881955328 avail 3650433024 00000100:00100000:1.0:1787508702.911112:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480182400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508702.911119:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1693 00000100:00100000:1.0:1787508702.911136:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1694 00000100:00100000:1.0:1787508702.911142:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480182528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787508702.911151:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 124211776 pending 0 free 3881955328 avail 3650433024 00000100:00100000:1.0:1787508702.911179:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480182528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508702.911184:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1694 00000100:00080000:1.0:1787508702.911201:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508702.911235:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480182400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508702.911263:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480182528:0@lo:13:osp-pre-1-1.0 00000001:02000400:0.0:1787508703.310444:0:233108:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 100b: DoM: no glimpse RPC for stat with IO lock (DoM only file) ========================================================== 14:11:42 (1787508702) 00000100:00100000:0.0:1787508703.436354:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508703.436888:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509596672 00000100:00100000:3.0:1787508703.436899:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509596672 00000100:00100000:3.0:1787508703.436995:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94057 00000100:00100000:3.0:1787508703.437006:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+593:339988:x1874324509596672:12345-192.168.201.30@tcp:101:mkdir.0 00010000:00010000:3.0:1787508703.437026:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508703.437071:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f351cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae7b3 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.437137:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f351d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.437150:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f351d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.437163:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f351d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508703.437210:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508703.437215:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508703.437250:0:205405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f351d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.437276:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f351cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7b3 expref: 595 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.440172:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f351d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7b3 expref: 594 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.440192:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508703.440195:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508703.440199:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f200, rc 0) 00000100:00100000:3.0:1787508703.440329:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+594:339988:x1874324509596672:12345-192.168.201.30@tcp:101:mkdir.0 Request processed in 3323us (3985us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508703.440340:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94057 00000100:00100000:2.0:1787508703.450387:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508703.450428:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508703.450491:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509596800 00000100:00100000:0.0:1787508703.450502:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509596800 00000100:00100000:0.0:1787508703.450560:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509597056 00000100:00100000:0.0:1787508703.450563:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509597056 00000100:00100000:0.0:1787508703.450588:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94058 00000100:00100000:0.0:1787508703.450599:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+641:2400:x1874324509596800:12345-192.168.201.30@tcp:41:mkdir.0 00000004:00000024:0.0:1787508703.450642:0:209004:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1442783232 avail 1296543744 00000100:00100000:0.0:1787508703.450747:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+641:2400:x1874324509596800:12345-192.168.201.30@tcp:41:mkdir.0 Request processed in 149us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508703.450754:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94058 00000100:00100000:0.0:1787508703.450772:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94059 00000100:00100000:0.0:1787508703.450779:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+640:339988:x1874324509597056:12345-192.168.201.30@tcp:36:mkdir.0 00000100:00100000:0.0:1787508703.450870:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba2680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480182656:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787508703.451023:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508703.451291:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cdd73d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787508703.451321:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480182656 00000100:00100000:0.0:1787508703.451325:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480182656 00000100:00100000:0.0:1787508703.451359:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29846 00000100:00100000:0.0:1787508703.451367:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:209004:x1874324480182656:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787508703.451428:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:209004:x1874324480182656:12345-0@lo:1000:mdt00_005.0 Request processed in 61us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508703.451435:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29846 00000100:00100000:0.0:1787508703.451566:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba2680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480182656:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787508703.451615:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba2680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480182784:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787508703.451640:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508703.451654:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cdd73d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787508703.451734:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480182784 00000100:00100000:2.0:1787508703.451739:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480182784 00000100:00100000:2.0:1787508703.451775:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29847 00000100:00100000:2.0:1787508703.451782:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:209004:x1874324480182784:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787508703.451876:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:209004:x1874324480182784:12345-0@lo:1000:mdt00_005.0 Request processed in 94us (234us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787508703.451883:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29847 00000100:00100000:2.0:1787508703.451921:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba2680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480182784:0@lo:1000:mdt00_005.0 00010000:00010000:2.0:1787508703.451988:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f351d9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.451999:0:209004:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f351d9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.452010:0:209004:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f351d9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508703.452023:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0877100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480182912:0@lo:101:mdt00_005.0 00000100:00100000:2.0:1787508703.452059:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508703.452076:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d21c4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787508703.452089:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480182912 00000100:00100000:2.0:1787508703.452092:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480182912 00000100:00100000:2.0:1787508703.452114:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29848 00000100:00100000:2.0:1787508703.452119:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:209004:x1874324480182912:12345-0@lo:101:mdt00_005.0 00010000:00010000:2.0:1787508703.452128:0:202231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508703.452142:0:202231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f351e0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f351d9 expref: -99 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.452166:0:202231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f35185 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae797 expref: 16 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.452175:0:202231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f351d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7b3 expref: 593 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.452183:0:202231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f351e0 lrc: 5/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f351d9 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.452207:0:202231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f351d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7b3 expref: 593 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.452219:0:202231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f351d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7b3 expref: 593 pid: 205405 timeout: 13774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508703.452230:0:202231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0877b80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480183040:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508703.452291:0:202231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f35185 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae797 expref: 16 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.452300:0:202231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f35185 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae797 expref: 16 pid: 203348 timeout: 13774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508703.452307:0:202231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0876a00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480183168:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508703.452329:0:202231:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d21c4300 going to sleep for 11 seconds 00000100:00100000:2.0:1787508703.456443:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508703.456524:0:202231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0877b80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480183040:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508703.456537:0:202231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0876a00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480183168:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508703.456571:0:202231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f351e0 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f351d9 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.456585:0:202231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508703.456588:0:202231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508703.456592:0:202231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f351e0 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f351d9 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.456602:0:202231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa800, rc 0) 00000100:00100000:0.0:1787508703.456739:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:209004:x1874324480182912:12345-0@lo:101:mdt00_005.0 Request processed in 4546us (4606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508703.456749:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29848 00000100:00100000:2.0:1787508703.456827:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0877100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480182912:0@lo:101:mdt00_005.0 00010000:00010000:2.0:1787508703.456845:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f351d9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f351e0 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.456855:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f351d9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f351e0 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508703.457213:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509597184 00000100:00100000:3.0:1787508703.457221:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509597184 00010000:00010000:3.0:1787508703.457254:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f351d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7b3 expref: 594 pid: 205405 timeout: 13774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508703.457278:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27922 00000100:00100000:3.0:1787508703.457287:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90920207e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+594:2400:x1874324509597184:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508703.457301:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508703.457307:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f351d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7b3 expref: 594 pid: 205405 timeout: 13774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.457321:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f351d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7b3 expref: 594 pid: 205405 timeout: 13774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.457342:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f351d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7b3 expref: 594 pid: 205405 timeout: 13774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.457354:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508703.457360:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f351e0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f351d9 expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.457368:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508703.457404:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90920207e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+593:2400:x1874324509597184:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 119us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508703.457410:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27922 00000100:00100000:2.0:1787508703.457650:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508703.458253:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509597312 00000100:00100000:3.0:1787508703.458259:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509597312 00010000:00010000:3.0:1787508703.458280:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f35185 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae797 expref: 17 pid: 203348 timeout: 13774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508703.458593:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27923 00000100:00100000:3.0:1787508703.458604:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0876a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:2400:x1874324509597312:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508703.458615:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508703.458621:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f35185 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae797 expref: 17 pid: 203348 timeout: 13774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.458632:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f35185 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae797 expref: 17 pid: 203348 timeout: 13774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.458649:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6000/0xb126349c40f35185 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae797 expref: 17 pid: 203348 timeout: 13774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.458662:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508703.458684:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f351e0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f351d9 expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.458694:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f351e0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f351d9 expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.458703:0:202212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f351e0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f351d9 expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.458736:0:202212:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f351e0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f351d9 expref: 6 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508703.458749:0:202212:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:202212:1874324480183296:0@lo:105: 00000100:00100000:3.0:1787508703.458799:0:202212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508703.458842:0:202212:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cc0840c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508703.460538:0:229386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480183296 00000100:00100000:1.0:1787508703.460550:0:229386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480183296 00000100:00100000:1.0:1787508703.460616:0:229386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18197 00000100:00100000:1.0:1787508703.460626:0:229386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:202212:x1874324480183296:12345-0@lo:105: 00010000:00010000:1.0:1787508703.460640:0:229386:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f351d9 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f351e0 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.460651:0:229386:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f351d9 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f351e0 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.460661:0:229386:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f351d9 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f351e0 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.460675:0:229386:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f351d9 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f351e0 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.460682:0:229386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f351d9 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f351e0 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.460691:0:229386:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f351d9 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f351e0 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.460718:0:229386:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090cd2aa200) 00000100:00100000:1.0:1787508703.460790:0:229386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:202212:x1874324480183296:12345-0@lo:105: Request processed in 165us (1989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508703.460798:0:229386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18197 00000100:00100000:1.0:1787508703.460845:0:202212:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:202212:1874324480183296:0@lo:105: 00010000:00010000:1.0:1787508703.460862:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508703.460918:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0876a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:2400:x1874324509597312:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 2303us (3255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508703.460928:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27923 00010000:00010000:1.0:1787508703.468893:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f351d9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f351e0 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.468925:0:209004:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f351d9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f351e0 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787508703.468980:0:209004:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787508703.469025:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b000/0xb126349c40f351e7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.469034:0:209004:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b000/0xb126349c40f351e7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.469192:0:209004:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b000/0xb126349c40f351e7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508703.469280:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480183424:0@lo:101:mdt00_005.0 00000100:00100000:2.0:1787508703.469338:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508703.469369:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d21c4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787508703.469476:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480183424 00000100:00100000:0.0:1787508703.469485:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480183424 00000100:00100000:0.0:1787508703.470145:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29849 00000100:00100000:0.0:1787508703.470157:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:209004:x1874324480183424:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1787508703.470172:0:225829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508703.470244:0:225829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f351ee lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f351e7 expref: -99 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.470272:0:225829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f351ee lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f351e7 expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.470285:0:225829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f351ee lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f351e7 expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.470294:0:225829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2a8ecdf (ffff9090d6c66200) 00010000:00010000:0.0:1787508703.470297:0:225829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508703.470300:0:225829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4a00, rc 0) 00000100:00100000:0.0:1787508703.470356:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:209004:x1874324480183424:12345-0@lo:101:mdt00_005.0 Request processed in 202us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508703.470364:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29849 00000100:00100000:1.0:1787508703.470541:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480183424:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1787508703.470559:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b000/0xb126349c40f351e7 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f351ee expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.470571:0:209004:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b000/0xb126349c40f351e7 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f351ee expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787508703.470592:0:209004:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1787508703.470631:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480183552:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787508703.470662:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508703.473526:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480183552 00000100:00100000:2.0:1787508703.473538:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480183552 00000100:00100000:2.0:1787508703.473591:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29850 00000100:00100000:2.0:1787508703.473601:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:209004:x1874324480183552:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787508703.473719:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:209004:x1874324480183552:12345-0@lo:1000:mdt00_005.0 Request processed in 120us (3056us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508703.473730:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29850 00000100:00100000:0.0:1787508703.475001:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c9a6c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787508703.475166:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480183552:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787508703.475247:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba1500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480183680:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787508703.475297:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508703.476190:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cdd730c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508703.476883:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480183680 00000100:00100000:3.0:1787508703.476892:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480183680 00000100:00100000:2.0:1787508703.480006:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29851 00000100:00100000:2.0:1787508703.480308:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:209004:x1874324480183680:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787508703.480471:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:209004:x1874324480183680:12345-0@lo:1000:mdt00_005.0 Request processed in 452us (5173us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787508703.480479:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29851 00000100:00100000:0.0:1787508703.480529:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba1500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480183680:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787508703.480643:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba1500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480183808:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787508703.480684:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508703.480720:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cdd730c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787508703.481113:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480183808 00000100:00100000:2.0:1787508703.481121:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480183808 00000100:00100000:2.0:1787508703.481170:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29852 00000100:00100000:2.0:1787508703.481178:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:209004:x1874324480183808:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787508703.481254:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:209004:x1874324480183808:12345-0@lo:1000:mdt00_005.0 Request processed in 77us (570us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787508703.481261:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29852 00000100:00100000:0.0:1787508703.482491:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba1500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480183808:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787508703.482576:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba1500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480183936:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787508703.482628:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508703.482649:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cdd730c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508703.482892:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480183936 00000100:00100000:3.0:1787508703.482899:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480183936 00000100:00100000:3.0:1787508703.482966:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29853 00000100:00100000:3.0:1787508703.482976:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed03cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:209004:x1874324480183936:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787508703.483138:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed03cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:209004:x1874324480183936:12345-0@lo:1000:mdt00_005.0 Request processed in 163us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508703.483146:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29853 00000100:00100000:0.0:1787508703.483548:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba1500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480183936:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787508703.483600:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba1500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480184064:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787508703.483628:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508703.483656:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cdd730c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508703.486185:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480184064 00000100:00100000:3.0:1787508703.486196:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480184064 00000100:00100000:3.0:1787508703.486245:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29854 00000100:00100000:3.0:1787508703.486254:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:209004:x1874324480184064:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787508703.486377:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:209004:x1874324480184064:12345-0@lo:1000:mdt00_005.0 Request processed in 124us (2748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508703.486385:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29854 00000100:00100000:3.0:1787508703.486431:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba1500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480184064:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787508703.486504:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea3800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480184192:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787508703.486539:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508703.486565:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480184192 00000100:00100000:3.0:1787508703.486568:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480184192 00000100:00100000:3.0:1787508703.486592:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29855 00000100:00100000:3.0:1787508703.486598:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:209004:x1874324480184192:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787508703.486639:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:209004:x1874324480184192:12345-0@lo:1000:mdt00_005.0 Request processed in 41us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508703.486645:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29855 00000100:00100000:3.0:1787508703.486663:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cc084300 going to sleep for 11 seconds 00000100:00100000:3.0:1787508703.486674:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea3800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480184192:0@lo:1000:mdt00_005.0 00000040:00080000:3.0:1787508703.489300:0:209004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xf:0x0].54, 984 off89112 00000040:00080000:3.0:1787508703.489378:0:209004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x5:0x0].598, 1136 off758696 00000004:00080000:3.0:1787508703.489385:0:209004:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090cc084600 with version 13623 00000004:00080000:3.0:1787508703.489407:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13623 rpc_version 13623 00000020:00100000:3.0:1787508703.489442:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787508703.489453:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090cdea3800 x1874324480184448/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787508703.489476:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea3800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480184448:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508703.489538:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508703.489569:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cc084a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787508703.489593:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480184448 00000100:00100000:3.0:1787508703.489600:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480184448 00000100:00100000:3.0:1787508703.489645:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29856 00000100:00100000:3.0:1787508703.489654:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:202961:x1874324480184448:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508703.491623:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:202961:x1874324480184448:12345-0@lo:1000:osp_up0-1.0 Request processed in 1963us (2078us total) trans 12884944157 rc 0/0 00000100:00100000:3.0:1787508703.491637:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29856 00000100:00100000:1.0:1787508703.497274:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea3800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480184448:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1787508703.499418:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f351f5 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.499616:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f351f5 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.499632:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f351f5 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508703.499654:0:209004:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000031ea69f reply state 00000000363e27de transno 8589962037 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f351f5 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.499666:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f351f5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.499677:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d6:0x0].0x0 (ffff9090d36fd100) 00010000:00010000:2.0:1787508703.499680:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787508703.499684:0:209004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787508703.499689:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d6:0x0]: returning size 4096 00000004:00080000:2.0:1787508703.499699:0:209004:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787508703.499711:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f351d9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f351e0 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.499719:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f351d9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f351e0 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.499726:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f351d9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f351e0 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.499783:0:209004:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787508703.499789:0:209004:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787508703.499795:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b000/0xb126349c40f351e7 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f351ee expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.499803:0:209004:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b000/0xb126349c40f351e7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f351ee expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508703.499905:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+642:339988:x1874324509597056:12345-192.168.201.30@tcp:36:mkdir.0 Request processed in 49122us (49471us total) trans 8589962037 rc 0/0 00000100:00100000:2.0:1787508703.499925:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94059 00010000:00010000:3.0:1787508703.500118:0:202215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787508703.500250:0:202215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f351d9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xb126349c40f351e0 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.500259:0:202215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa200 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:3.0:1787508703.500265:0:202215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f351d9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xb126349c40f351e0 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508703.500273:0:202215:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f351d9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xb126349c40f351e0 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.500309:0:202215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f351d9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f351e0 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.500316:0:202215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787508703.500365:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480184576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787508703.500415:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787508703.500581:0:202215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f351d9 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f351e0 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.500589:0:202215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aa200/0xb126349c40f351d9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f351e0 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.500603:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508703.500605:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508703.500608:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508703.500619:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480184576 00000100:00100000:1.0:1787508703.500627:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480184576 00000100:00100000:1.0:1787508703.500823:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9803 00000100:00100000:1.0:1787508703.500832:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0877480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3617:x1874324480184576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508703.500846:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508703.500863:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f351e0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f351d9 expref: 9 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.500873:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508703.500877:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508703.500923:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0877480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3617:x1874324480184576:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508703.500930:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9803 00000100:00100000:2.0:1787508703.501678:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480184576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508703.519083:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508703.519176:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509597440 00000100:00100000:3.0:1787508703.519187:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509597440 00000100:00100000:3.0:1787508703.519279:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94060 00000100:00100000:3.0:1787508703.519291:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+593:339989:x1874324509597440:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508703.519314:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508703.519335:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f351fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae7ba expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.519397:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35203 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.519410:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35203 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.519421:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35203 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508703.519478:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508703.519481:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508703.519502:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35203 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.519526:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f351fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7ba expref: 595 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.519542:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35203 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7ba expref: 594 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.519550:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508703.519552:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508703.519555:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e600, rc 0) 00000100:00100000:3.0:1787508703.519618:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+594:339989:x1874324509597440:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 329us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508703.519624:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94060 00000100:00100000:2.0:1787508703.528299:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508703.528848:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509597568 00000100:00100000:3.0:1787508703.528858:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509597568 00000100:00100000:3.0:1787508703.528976:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94061 00000100:00100000:3.0:1787508703.528987:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+594:339989:x1874324509597568:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508703.529010:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508703.529031:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3520a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae7c1 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.529098:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35211 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.529114:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35211 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.529125:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35211 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.529136:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35218 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.529146:0:205405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f351ee lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f351e7 expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.529154:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35218 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.529188:0:205405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f351ee lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f351e7 expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508703.529203:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480184704:0@lo:104: 00000100:00100000:3.0:1787508703.529253:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508703.529293:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480184704 00000100:00100000:3.0:1787508703.529298:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cc0849c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508703.529298:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480184704 00000100:00100000:1.0:1787508703.529329:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18198 00000100:00100000:1.0:1787508703.529337:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:205405:x1874324480184704:12345-0@lo:104: 00010000:00010000:1.0:1787508703.529349:0:202210:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b000/0xb126349c40f351e7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f351ee expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.529415:0:202210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787508703.529421:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:205405:x1874324480184704:12345-0@lo:104: Request processed in 85us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508703.529428:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18198 00000100:00100000:3.0:1787508703.529497:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480184704:0@lo:104: 00010000:00010000:3.0:1787508703.529516:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35218 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.529610:0:226765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508703.529617:0:226765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b000/0xb126349c40f351e7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f351ee expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.529626:0:226765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:0.0:1787508703.529632:0:226765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b000/0xb126349c40f351e7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f351ee expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508703.529640:0:226765:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b000/0xb126349c40f351e7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f351ee expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.529675:0:226765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b000/0xb126349c40f351e7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f351ee expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.529682:0:226765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787508703.529726:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480184832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508703.529759:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508703.529797:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480184832 00000100:00100000:3.0:1787508703.529801:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480184832 00010000:00010000:3.0:1787508703.529829:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f351ee lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f351e7 expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508703.529857:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27924 00000100:00100000:3.0:1787508703.529863:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3618:x1874324480184832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787508703.529871:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508703.530219:0:226765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b000/0xb126349c40f351e7 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f351ee expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.530229:0:226765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b000/0xb126349c40f351e7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f351ee expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.530245:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508703.530247:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508703.530249:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787508703.532077:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944157 is committed 00010000:00010000:3.0:1787508703.533306:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f351ee lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f351e7 expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.533327:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2a8ecdf (ffff9090d6c66200) 00010000:00010000:3.0:1787508703.533333:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35218 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.533343:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35218 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.533351:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35218 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.533389:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508703.533475:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480184832:12345-0@lo:103:ldlm_bl.0 Request processed in 3611us (3714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508703.533485:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27924 00000100:00100000:2.0:1787508703.533730:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480184832:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508703.533792:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35218 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.533798:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35218 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508703.534057:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:205405:1874324480184960:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508703.534103:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508703.534136:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cdd73b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787508703.534188:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480184960 00000100:00100000:3.0:1787508703.534195:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480184960 00000100:00100000:3.0:1787508703.534281:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29857 00000100:00100000:3.0:1787508703.534290:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:205405:x1874324480184960:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508703.534369:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:205405:x1874324480184960:12345-0@lo:1000:mdt00_004.0 Request processed in 80us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508703.534377:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29857 00000100:00100000:0.0:1787508703.534420:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:205405:1874324480184960:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1787508703.534463:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f3521f lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.534474:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f3521f lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.534483:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f3521f lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508703.534504:0:205405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f3521f lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.534517:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35211 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.534524:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35211 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.534530:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35211 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.534536:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35211 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.534541:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508703.534545:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35211 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.534551:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35211 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.534561:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508703.534564:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508703.534568:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35211 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.534574:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35211 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.534584:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35218 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.534589:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35218 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.534592:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35218 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.534596:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508703.534598:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35218 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.534601:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35218 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.534605:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2a8ecdf (ffff9090d6c66200) 00010000:00010000:0.0:1787508703.534607:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508703.534608:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35218 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.534611:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35218 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.534637:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3520a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7c1 expref: 596 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.534647:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f3521f lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7c1 expref: 595 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.534651:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d6:0x0].0x0 (ffff9090ca4e2300) 00010000:00010000:0.0:1787508703.534653:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508703.534655:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4c00, rc 0) 00000100:00100000:0.0:1787508703.534706:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+595:339989:x1874324509597568:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 5722us (6417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508703.534713:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94061 00000100:00100000:1.0:1787508703.537610:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508703.537806:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509597696 00000100:00100000:2.0:1787508703.537817:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509597696 00000100:00100000:2.0:1787508703.537887:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94062 00000100:00100000:2.0:1787508703.537897:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+642:339989:x1874324509597696:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508703.537934:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508703.538348:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f35226 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae7c8 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.538411:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f3522d lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.538423:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f3522d lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.538647:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f3522d lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508703.538812:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d6:0x0]: returning size 4096 00000004:00200000:2.0:1787508703.538816:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1787508703.538935:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f35226 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7c8 expref: 644 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.538981:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f3522d lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7c8 expref: 643 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.538997:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d6:0x0].0x0 (ffff9090d36fd100) 00010000:00010000:2.0:1787508703.538999:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1787508703.539004:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab200, rc 0) 00000100:00100000:2.0:1787508703.539314:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+643:339989:x1874324509597696:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1417us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508703.539322:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94062 00000100:00100000:1.0:1787508703.542618:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508703.542796:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509597824 00000100:00100000:2.0:1787508703.542806:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509597824 00000100:00100000:2.0:1787508703.542872:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94063 00000100:00100000:2.0:1787508703.542883:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+643:339989:x1874324509597824:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508703.542903:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508703.542934:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa800/0xb126349c40f35234 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae7cf expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.543046:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f3523b lrc: 3/1,0 mode: --/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.543060:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f3523b lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.543072:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f3523b lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.543149:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f35242 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.543158:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f35242 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.543165:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f35242 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.543205:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f3523b lrc: 4/1,0 mode: CR/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.543212:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f3523b lrc: 4/1,0 mode: CR/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.543218:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f3523b lrc: 3/0,0 mode: CR/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.543225:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f3523b lrc: 4/0,0 mode: CR/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.543231:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508703.543235:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f3523b lrc: 4/0,0 mode: CR/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.543241:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f3523b lrc: 5/0,0 mode: CR/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.543253:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d6:0x0].0x0 (ffff9090d36fd100) 00010000:00010000:2.0:1787508703.543256:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508703.543260:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f3523b lrc: 3/0,0 mode: --/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.543266:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa200/0xb126349c40f3523b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.543279:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f35242 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.543286:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f35242 lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.543292:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f35242 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.543297:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508703.543299:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f35242 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.543305:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f35242 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.543312:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d6:0x0].0xfe058dd8 (ffff9090d36fd700) 00010000:00010000:2.0:1787508703.543315:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508703.543318:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f35242 lrc: 2/0,0 mode: --/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.543323:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f35242 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.543357:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa800/0xb126349c40f35234 lrc: 1/0,0 mode: --/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7cf expref: 644 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.543366:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d6:0x0].0x0 (ffff9090d36fd100) 00010000:00010000:2.0:1787508703.543368:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508703.543372:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa800/0xb126349c40f35234 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7cf expref: 644 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.543384:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa800, rc 0) 00000100:00100000:2.0:1787508703.543434:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+643:339989:x1874324509597824:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 553us (824us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508703.543441:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94063 00000100:00100000:0.0:1787508703.549459:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508703.549568:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509598080 00000100:00100000:3.0:1787508703.549579:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509598080 00000100:00100000:3.0:1787508703.549685:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94064 00000100:00100000:3.0:1787508703.549697:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+643:339989:x1874324509598080:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508703.549717:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508703.549736:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f35249 lrc: 2/0,0 mode: --/CW res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae7d6 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.550401:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f35250 lrc: 3/0,1 mode: --/CW res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.550419:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f35250 lrc: 3/0,1 mode: CW/CW res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.550429:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f35250 lrc: 3/0,1 mode: CW/CW res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.550446:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f35257 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.550453:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f35257 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.550460:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f35257 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508703.550599:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480185088:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787508703.551333:0:202227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508703.551596:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480185088 00000100:00100000:1.0:1787508703.551604:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480185088 00000100:00100000:1.0:1787508703.551783:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29858 00000100:00100000:1.0:1787508703.551794:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:202227:x1874324480185088:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787508703.551886:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:202227:x1874324480185088:12345-0@lo:1000:mdt00_001.0 Request processed in 94us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508703.551894:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29858 00000100:00100000:0.0:1787508703.552328:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cc0846c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787508703.552355:0:202227:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944157 gen 2 00000004:00080000:0.0:1787508703.552360:0:202227:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944157 committed transno 12884944157 00000100:00100000:0.0:1787508703.552389:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:202227:1874324480185088:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787508703.552903:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f3525e lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.552930:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f3525e lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.552975:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f3525e lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508703.552987:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d7:0x0]: returning size 0 00010000:00010000:0.0:1787508703.553023:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f35250 lrc: 4/0,1 mode: CW/CW res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.553031:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f35250 lrc: 4/0,1 mode: CW/CW res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.553044:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f35250 lrc: 3/0,0 mode: CW/CW res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.553052:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f35250 lrc: 4/0,0 mode: CW/CW res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.553059:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508703.553063:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f35250 lrc: 4/0,0 mode: CW/CW res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.553071:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f35250 lrc: 5/0,0 mode: CW/CW res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.553088:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d6:0x0].0x0 (ffff9090d36fd100) 00010000:00010000:0.0:1787508703.553092:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508703.553096:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f35250 lrc: 3/0,0 mode: --/CW res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.553103:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f35250 lrc: 0/0,0 mode: --/CW res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508703.553118:0:202227:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000004f89e7 reply state 0000000013bf1121 transno 8589962038 ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f35257 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.553209:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f35257 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.553216:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d6:0x0].0xfe058dd8 (ffff9090cc088200) 00010000:00010000:0.0:1787508703.553218:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787508703.553222:0:202227:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787508703.553259:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f35249 lrc: 0/0,0 mode: --/CW res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7d6 expref: 646 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.553275:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f3525e lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7d6 expref: 645 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.553283:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d7:0x0].0x0 (ffff9090ca4e2900) 00010000:00010000:0.0:1787508703.553285:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787508703.553287:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5c00, rc 0) 00000100:00100000:0.0:1787508703.553358:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+646:339989:x1874324509598080:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 3663us (3910us total) trans 8589962038 rc 0/0 00000100:00100000:0.0:1787508703.553367:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94064 00000100:00100000:1.0:1787508703.557709:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508703.557791:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509598336 00000100:00100000:0.0:1787508703.557801:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509598336 00000100:00100000:0.0:1787508703.557874:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94065 00000100:00100000:0.0:1787508703.557886:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+646:339989:x1874324509598336:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508703.557919:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508703.557977:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4e00/0xb126349c40f3526c lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae7dd expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.558108:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f35273 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.558120:0:205405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f3525e lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7d6 expref: 647 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.558252:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f35273 lrc: 4/0,1 mode: --/EX res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.558283:0:205405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f3525e lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7d6 expref: 647 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.558294:0:205405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f3525e lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7d6 expref: 647 pid: 202227 timeout: 13774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508703.558305:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:205405:1874324480185216:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508703.558372:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cdd739c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508703.561149:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508703.561341:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509598464 00000100:00100000:1.0:1787508703.561350:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509598464 00010000:00010000:1.0:1787508703.561387:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f3525e lrc: 5/0,0 mode: PR/PR res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7d6 expref: 648 pid: 202227 timeout: 13774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508703.561424:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27925 00000100:00100000:1.0:1787508703.561434:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+648:2400:x1874324509598464:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508703.561448:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508703.561455:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f3525e lrc: 5/0,0 mode: PR/PR res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7d6 expref: 648 pid: 202227 timeout: 13774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.561468:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f3525e lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7d6 expref: 648 pid: 202227 timeout: 13774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.561490:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d7:0x0].0x0 (ffff9090ca4e2900) 00010000:00010000:1.0:1787508703.561495:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f35273 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.561504:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f35273 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.561510:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f35273 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.561526:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508703.561582:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+648:2400:x1874324509598464:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 149us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508703.561590:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27925 00010000:00010000:0.0:1787508703.562357:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f3525e lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7d6 expref: 647 pid: 202227 timeout: 13774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508703.562383:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:205405:1874324480185216:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508703.562405:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f35273 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.562414:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f35273 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.562421:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f35273 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508703.562439:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d7:0x0]: returning size 0 00010000:00010000:0.0:1787508703.562635:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f35273 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.562642:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f35273 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.562648:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f35273 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.562653:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508703.562749:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f35273 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.562756:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f35273 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.562766:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d7:0x0].0x0 (ffff9090ca4e2900) 00010000:00010000:0.0:1787508703.562769:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787508703.562773:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f35273 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.562842:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f35273 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.562894:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4e00/0xb126349c40f3526c lrc: 1/0,0 mode: --/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7dd expref: 647 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.562914:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d6:0x0].0x0 (ffff9090d36fd100) 00010000:00010000:0.0:1787508703.562917:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508703.562922:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4e00/0xb126349c40f3526c lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7dd expref: 647 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.562931:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4e00, rc 0) 00000100:00100000:0.0:1787508703.563131:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+646:339989:x1874324509598336:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 5247us (5430us total) trans 8589962039 rc 301/301 00000100:00100000:0.0:1787508703.563140:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94065 00000100:00100000:3.0:1787508703.565607:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508703.565985:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509598720 00000100:00100000:0.0:1787508703.565996:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509598720 00000100:00100000:0.0:1787508703.566044:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15439 00000100:00100000:0.0:1787508703.566054:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+646:339989:x1874324509598720:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1787508703.566334:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+647:339989:x1874324509598720:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 280us (735us total) trans 8589962040 rc 0/0 00000100:00100000:0.0:1787508703.566343:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15439 00000100:00100000:2.0:1787508703.568462:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508703.568556:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509598976 00000100:00100000:3.0:1787508703.568567:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509598976 00000100:00100000:3.0:1787508703.568651:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15440 00000100:00100000:3.0:1787508703.568672:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+647:339989:x1874324509598976:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1787508703.569313:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+648:339989:x1874324509598976:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 642us (862us total) trans 8589962041 rc 0/0 00000100:00100000:3.0:1787508703.569321:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15440 00000100:00100000:2.0:1787508703.600427:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508703.601208:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509599104 00000100:00100000:3.0:1787508703.601219:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509599104 00000100:00100000:3.0:1787508703.601332:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94066 00000100:00100000:3.0:1787508703.601344:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:339991:x1874324509599104:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:3.0:1787508703.601365:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508703.601386:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35281 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae7e4 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.601450:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35288 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.601464:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35288 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.601475:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35288 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508703.601520:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508703.601523:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508703.601544:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35288 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.601568:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35281 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7e4 expref: 18 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.601585:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35288 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7e4 expref: 17 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.601599:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508703.601601:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508703.601606:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fc00, rc 0) 00000100:00100000:3.0:1787508703.601680:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:339991:x1874324509599104:12345-192.168.201.30@tcp:101:dd.0 Request processed in 338us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508703.601687:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94066 00000100:00100000:0.0:1787508703.604803:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508703.604917:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509599232 00000100:00100000:1.0:1787508703.604927:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509599232 00000100:00100000:1.0:1787508703.605058:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94067 00000100:00100000:1.0:1787508703.605069:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:339991:x1874324509599232:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:1.0:1787508703.605088:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508703.605110:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f3528f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae7eb expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.605385:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35296 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.605400:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35296 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.605411:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35296 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.605427:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3529d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.605434:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3529d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.605442:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3529d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.605509:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f352a4 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.605518:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f352a4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.605525:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f352a4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508703.605545:0:203348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f352a4 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.605560:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35296 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.605566:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35296 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.605573:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35296 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.605580:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35296 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.605585:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508703.605590:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35296 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.605598:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35296 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.605609:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508703.605612:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508703.605616:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35296 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.605622:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35296 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.605636:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3529d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.605642:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3529d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.605648:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3529d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.605653:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247bc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508703.605656:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3529d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.605663:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3529d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.605670:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2a8ecdf (ffff9090d171ff00) 00010000:00010000:1.0:1787508703.605673:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508703.605675:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3529d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.605682:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f3529d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.605711:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f3528f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7eb expref: 19 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.605723:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f352a4 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7eb expref: 18 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.605730:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d6:0x0].0x0 (ffff9090ca4e2300) 00010000:00010000:1.0:1787508703.605733:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508703.605736:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b200, rc 0) 00000100:00100000:1.0:1787508703.605805:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+18:339991:x1874324509599232:12345-192.168.201.30@tcp:101:dd.0 Request processed in 737us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508703.605812:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94067 00000100:00100000:0.0:1787508703.608821:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508703.608903:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509599360 00000100:00100000:1.0:1787508703.608925:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509599360 00000100:00100000:1.0:1787508703.609017:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94068 00000100:00100000:1.0:1787508703.609029:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:339991:x1874324509599360:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:1.0:1787508703.609057:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508703.609077:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f352ab lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae7f2 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.609134:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f352b2 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.609148:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f352b2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.609158:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f352b2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508703.609208:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d6:0x0]: returning size 4096 00000004:00200000:1.0:1787508703.609213:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1787508703.609270:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f352ab lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7f2 expref: 7 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.609289:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f352b2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7f2 expref: 6 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.609302:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d6:0x0].0x0 (ffff9090d36fd100) 00010000:00010000:1.0:1787508703.609305:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1787508703.609308:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a600, rc 0) 00000100:00100000:1.0:1787508703.609368:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:339991:x1874324509599360:12345-192.168.201.30@tcp:101:dd.0 Request processed in 341us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508703.609375:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94068 00000100:00100000:2.0:1787508703.613206:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508703.613242:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509599616 00000100:00100000:0.0:1787508703.613254:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509599616 00000100:00100000:0.0:1787508703.613309:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94069 00000100:00100000:0.0:1787508703.613320:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:339991:x1874324509599616:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1787508703.613341:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508703.613359:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f352b9 lrc: 2/0,0 mode: --/CW res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae7f9 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.613469:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f352c0 lrc: 3/1,0 mode: --/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.613481:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f352c0 lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.613489:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f352c0 lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.613496:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f352c7 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.613500:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f352c7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.613505:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f352c7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.613546:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f352ce lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.613551:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f352ce lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.613555:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f352ce lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508703.613623:0:205405:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d7:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1787508703.613625:0:205405:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d7:0x0] updating lvb mtime from disk: 0 -> 1787508704 00000004:00010000:0.0:1787508703.613627:0:205405:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d7:0x0] updating lvb atime from disk: 0 -> 1787508704 00000004:00010000:0.0:1787508703.613629:0:205405:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d7:0x0] updating lvb ctime from disk: 0 -> 1787508704 00000004:00010000:0.0:1787508703.613630:0:205405:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d7:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:0.0:1787508703.613632:0:205405:0:(mdt_io.c:1552:mdt_lvb2reply()) size 0 00010000:00010000:0.0:1787508703.613637:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f352c0 lrc: 4/1,0 mode: CR/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.613640:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f352c0 lrc: 4/1,0 mode: CR/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.613644:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f352c0 lrc: 3/0,0 mode: CR/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.613649:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f352c0 lrc: 4/0,0 mode: CR/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.613652:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508703.613656:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f352c0 lrc: 4/0,0 mode: CR/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.613727:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f352c0 lrc: 5/0,0 mode: CR/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.613739:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d6:0x0].0x0 (ffff9090d36fd100) 00010000:00010000:0.0:1787508703.613741:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508703.613744:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f352c0 lrc: 3/0,0 mode: --/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.613751:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f352c0 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.613762:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f352c7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.613765:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f352c7 lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.613769:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f352c7 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.613772:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508703.613774:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f352c7 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.613777:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f352c7 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.613780:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d6:0x0].0xfe058dd8 (ffff9090cc088200) 00010000:00010000:0.0:1787508703.613782:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508703.613783:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f352c7 lrc: 2/0,0 mode: --/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.613786:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f352c7 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.613816:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f352b9 lrc: 0/0,0 mode: --/CW res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7f9 expref: 9 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.613885:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f352ce lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7f9 expref: 8 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.613890:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d7:0x0].0x0 (ffff9090ca4e2900) 00010000:00010000:0.0:1787508703.613891:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:0.0:1787508703.613893:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4400, rc 0) 00000100:00100000:0.0:1787508703.613989:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:339991:x1874324509599616:12345-192.168.201.30@tcp:101:dd.0 Request processed in 670us (793us total) trans 8589962042 rc 0/0 00000100:00100000:0.0:1787508703.613995:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94069 00000100:00100000:0.0:1787508703.618283:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508703.618401:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509599872 00000100:00100000:3.0:1787508703.618410:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509599872 00000100:00100000:3.0:1787508703.618460:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94070 00000100:00100000:3.0:1787508703.618471:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:339991:x1874324509599872:12345-192.168.201.30@tcp:36:dd.0 00010000:00010000:3.0:1787508703.618590:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f352dc lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.618604:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f352ce lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7f9 expref: 8 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.618611:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f352dc lrc: 4/0,1 mode: --/PW res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.618638:0:202228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f352ce lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7f9 expref: 8 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.618648:0:202228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f352ce lrc: 4/0,0 mode: PW/PW res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7f9 expref: 8 pid: 205405 timeout: 13774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508703.618659:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:202228:1874324480185344:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508703.618744:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cc0843c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787508703.620597:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508703.620640:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509600000 00000100:00100000:0.0:1787508703.620649:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509600000 00000100:00100000:3.0:1787508703.620682:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:202228:1874324480185344:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508703.620706:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f352dc lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.620935:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f352ce lrc: 4/0,0 mode: PW/PW res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7f9 expref: 9 pid: 205405 timeout: 13774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508703.620999:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27926 00000100:00100000:0.0:1787508703.621009:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0218a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2400:x1874324509600000:12345-192.168.201.30@tcp:102:ldlm_bl.0 00010000:00010000:0.0:1787508703.621025:0:225839:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f352ce lrc: 4/0,0 mode: PW/PW res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7f9 expref: 9 pid: 205405 timeout: 13774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.621037:0:225839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f352ce lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7f9 expref: 9 pid: 205405 timeout: 13774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.621049:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f352ce lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7f9 expref: 9 pid: 205405 timeout: 13774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.621061:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d7:0x0].0x0 (ffff9090ca4e2900) 00010000:00010000:0.0:1787508703.621063:0:225839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:0.0:1787508703.621067:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f352dc lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.621075:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f352dc lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.621081:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f352dc lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.621112:0:225839:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f352ce lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7f9 expref: 9 pid: 205405 timeout: 13774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508703.621340:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0218a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2400:x1874324509600000:12345-192.168.201.30@tcp:102:ldlm_bl.0 Request processed in 331us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508703.621348:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27926 00010000:00010000:3.0:1787508703.621358:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f352dc lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.621365:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f352dc lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508703.621496:0:202228:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d7:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:3.0:1787508703.621501:0:202228:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d7:0x0] updating lvb mtime from disk: 1787508704 -> 1787508704 00000004:00010000:3.0:1787508703.621503:0:202228:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d7:0x0] updating lvb atime from disk: 1787508704 -> 1787508704 00000004:00010000:3.0:1787508703.621505:0:202228:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d7:0x0] updating lvb ctime from disk: 1787508704 -> 1787508704 00000004:00010000:3.0:1787508703.621507:0:202228:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d7:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:3.0:1787508703.621515:0:202228:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003e383af reply state 000000002d534535 transno 8589962043 ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f352dc lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.621527:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f352dc lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.621533:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d7:0x0].0x0 (ffff9090ca4e2900) 00010000:00010000:3.0:1787508703.621536:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508703.621538:0:202228:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787508703.621614:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:339991:x1874324509599872:12345-192.168.201.30@tcp:36:dd.0 Request processed in 3145us (3340us total) trans 8589962043 rc 0/0 00000100:00100000:3.0:1787508703.621621:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94070 00000100:00100000:2.0:1787508703.624023:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508703.624110:0:202239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509600128 00000100:00100000:3.0:1787508703.624120:0:202239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509600128 00002000:00010000:3.0:1787508703.624157:0:202239:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0001: refresh DOM lock for [0x240000bd0:0x13d7:0x0] 00002000:00100000:3.0:1787508703.624162:0:202239:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9090d021b800 with x1874324509600128 00000100:00100000:3.0:1787508703.624193:0:202239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7748 00000100:00100000:3.0:1787508703.624204:0:202239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2403:x1874324509600128:12345-192.168.201.30@tcp:10:dd.0 00000004:00010000:3.0:1787508703.624363:0:202239:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d7:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:3.0:1787508703.624366:0:202239:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d7:0x0] updating lvb mtime from disk: 1787508704 -> 1787508704 00000004:00010000:3.0:1787508703.624368:0:202239:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d7:0x0] updating lvb atime from disk: 1787508704 -> 1787508704 00000004:00010000:3.0:1787508703.624370:0:202239:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d7:0x0] updating lvb ctime from disk: 1787508704 -> 1787508704 00000004:00010000:3.0:1787508703.624371:0:202239:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d7:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787508703.624415:0:202239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2403:x1874324509600128:12345-192.168.201.30@tcp:10:dd.0 Request processed in 214us (411us total) trans 8589962044 rc 0/0 00000100:00100000:3.0:1787508703.624420:0:202239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7748 00002000:00010000:3.0:1787508703.624423:0:202239:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0001: refresh DOM lock for [0x240000bd0:0x13d7:0x0] 00002000:00100000:3.0:1787508703.624425:0:202239:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9090d021b800 with x1874324509600128 00000100:00100000:2.0:1787508703.628638:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508703.629380:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509600384 00000100:00100000:0.0:1787508703.629392:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509600384 00000100:00100000:0.0:1787508703.629466:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15441 00000100:00100000:0.0:1787508703.629477:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:339991:x1874324509600384:12345-192.168.201.30@tcp:35:dd.0 00000100:00100000:0.0:1787508703.629729:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:339991:x1874324509600384:12345-192.168.201.30@tcp:35:dd.0 Request processed in 253us (1102us total) trans 8589962045 rc 0/0 00000100:00100000:0.0:1787508703.629737:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15441 00000100:00100000:1.0:1787508703.647421:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508703.647516:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509600640 00000100:00100000:3.0:1787508703.647526:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509600640 00000100:00100000:3.0:1787508703.647587:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15442 00000100:00100000:3.0:1787508703.647598:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+18:287588:x1874324509600640:12345-192.168.201.30@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787508703.647877:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+19:287588:x1874324509600640:12345-192.168.201.30@tcp:35:ldlm_bl.0 Request processed in 279us (465us total) trans 12884944158 rc 0/0 00000100:00100000:3.0:1787508703.647885:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15442 00000100:00100000:2.0:1787508703.657578:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508703.657674:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509600896 00000100:00100000:1.0:1787508703.657684:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509600896 00000100:00100000:1.0:1787508703.657744:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15443 00000100:00100000:1.0:1787508703.657753:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde32c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+595:287589:x1874324509600896:12345-192.168.201.30@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787508703.658033:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde32c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+596:287589:x1874324509600896:12345-192.168.201.30@tcp:35:ldlm_bl.0 Request processed in 279us (463us total) trans 12884944159 rc 0/0 00000100:00100000:1.0:1787508703.658041:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15443 00000100:00100000:1.0:1787508703.662595:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508703.662702:0:230113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509601024 00000100:00100000:2.0:1787508703.662713:0:230113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509601024 00002000:00100000:2.0:1787508703.662765:0:230113:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_004: refresh rw locks for [0x240000bd0:0x13d7:0x0] req@ffff9091dabbd880 x1874324509601024/t0(0) o4->eb35f31c-097f-45a3-8275-bc75f97f89ee@192.168.201.30@tcp:159/0 lens 4584/0 e 0 to 0 dl 1787508714 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787508703.662776:0:230113:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9091dabbd880 with x1874324509601024 00000100:00100000:2.0:1787508703.662923:0:230113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7749 00000100:00100000:2.0:1787508703.662936:0:230113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2400:x1874324509601024:12345-192.168.201.30@tcp:4:dd.0 00000004:00010000:2.0:1787508703.664426:0:230113:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d7:0x0] updating lvb size from disk: 0 -> 4096 00000004:00010000:2.0:1787508703.664435:0:230113:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d7:0x0] updating lvb mtime from disk: 1787508704 -> 1787508704 00000004:00010000:2.0:1787508703.664438:0:230113:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d7:0x0] updating lvb atime from disk: 1787508704 -> 1787508704 00000004:00010000:2.0:1787508703.664440:0:230113:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d7:0x0] updating lvb ctime from disk: 1787508704 -> 1787508704 00000004:00010000:2.0:1787508703.664442:0:230113:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d7:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787508703.664527:0:230113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2400:x1874324509601024:12345-192.168.201.30@tcp:4:dd.0 Request processed in 1590us (1942us total) trans 8589962046 rc 0/0 00000100:00100000:3.0:1787508703.667511:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508703.667593:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509601536 00000100:00100000:0.0:1787508703.667602:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509601536 00000100:00100000:0.0:1787508703.667661:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15444 00000100:00100000:0.0:1787508703.667673:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+596:287589:x1874324509601536:12345-192.168.201.30@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787508703.667976:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+597:287589:x1874324509601536:12345-192.168.201.30@tcp:35:ldlm_bl.0 Request processed in 304us (474us total) trans 12884944160 rc 0/0 00000100:00100000:0.0:1787508703.667984:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15444 00000100:00100000:0.0:1787508703.668349:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508703.668378:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509601280 00000100:00100000:0.0:1787508703.668383:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509601280 00000100:00100000:0.0:1787508703.668419:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15445 00000100:00100000:0.0:1787508703.668428:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+19:287588:x1874324509601280:12345-192.168.201.30@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787508703.668485:0:230113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7749 00002000:00100000:2.0:1787508703.668502:0:230113:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_004: refresh rw locks for [0x240000bd0:0x13d7:0x0] req@ffff9091dabbd880 x1874324509601024/t8589962046(0) o4->eb35f31c-097f-45a3-8275-bc75f97f89ee@192.168.201.30@tcp:159/0 lens 4584/448 e 0 to 0 dl 1787508714 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787508703.668513:0:230113:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9091dabbd880 with x1874324509601024 00000100:00100000:0.0:1787508703.668566:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+20:287588:x1874324509601280:12345-192.168.201.30@tcp:35:ldlm_bl.0 Request processed in 137us (216us total) trans 12884944161 rc 0/0 00000100:00100000:0.0:1787508703.668573:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15445 00000100:00100000:1.0:1787508703.670827:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508703.670880:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508703.670980:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509601920 00000100:00100000:0.0:1787508703.670990:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509601920 00000100:00100000:0.0:1787508703.671042:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15446 00000100:00100000:0.0:1787508703.671052:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+597:287589:x1874324509601920:12345-192.168.201.30@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787508703.671351:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+598:287589:x1874324509601920:12345-192.168.201.30@tcp:35:ldlm_bl.0 Request processed in 299us (468us total) trans 12884944162 rc 0/0 00000100:00100000:0.0:1787508703.671361:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15446 00000100:00100000:2.0:1787508703.671677:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509601664 00000100:00100000:2.0:1787508703.671683:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509601664 00000100:00100000:2.0:1787508703.671730:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9804 00000100:00100000:2.0:1787508703.671737:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0877b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:288110:x1874324509601664:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508703.671749:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787508703.671785:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f352ce lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7f9 expref: 14 pid: 205405 timeout: 13774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.671804:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d7:0x0].0x0 (ffff9090ca4e2900) 00010000:00010000:2.0:1787508703.671814:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f352b2 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7f2 expref: 13 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.671822:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d6:0x0].0x0 (ffff9090d36fd100) 00010000:00010000:2.0:1787508703.671826:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508703.671861:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0877b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:288110:x1874324509601664:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 124us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508703.671867:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9804 00000100:00100000:1.0:1787508703.680128:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508703.682072:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508703.682171:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509602304 00000100:00100000:2.0:1787508703.682182:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509602304 00000100:00100000:2.0:1787508703.682252:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15447 00000100:00100000:2.0:1787508703.682262:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+598:287589:x1874324509602304:12345-192.168.201.30@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787508703.682569:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+599:287589:x1874324509602304:12345-192.168.201.30@tcp:35:ldlm_bl.0 Request processed in 307us (505us total) trans 12884944163 rc 0/0 00000100:00100000:2.0:1787508703.682577:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15447 00000100:00100000:1.0:1787508703.684257:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508703.687499:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509602048 00000100:00100000:0.0:1787508703.687522:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509602048 00000100:00100000:2.0:1787508703.687564:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509602432 00000100:00100000:2.0:1787508703.687571:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509602432 00000100:00100000:0.0:1787508703.687602:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9805 00000100:00100000:0.0:1787508703.687616:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90920207dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+20:287588:x1874324509602048:12345-192.168.201.30@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787508703.687619:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9806 00000100:00100000:2.0:1787508703.687633:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9f18450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+648:288263:x1874324509602432:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508703.687636:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 13 locks, starting at 0 00010000:00010000:2.0:1787508703.687643:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 409 locks, starting at 0 00010000:00010000:2.0:1787508703.687668:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c67d4000/0xb126349c40ec7cf8 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x12dd:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8d08e expref: 648 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.687688:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12dd:0x0].0x0 (ffff9090cda8a400) 00010000:00010000:2.0:1787508703.687751:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22cbc00/0xb126349c40ec5027 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x12c9:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8c3de expref: 647 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.687765:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12c9:0x0].0x0 (ffff9090cbeaf800) 00010000:00010000:2.0:1787508703.687794:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5473400/0xb126349c40ebddf0 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x12a7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8a35b expref: 646 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.687804:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12a7:0x0].0x0 (ffff9090e5bd2300) 00010000:00010000:2.0:1787508703.687829:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9ef9400/0xb126349c40ebb7c4 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1298:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8989c expref: 645 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.687842:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1298:0x0].0x0 (ffff9090d6c69200) 00010000:00010000:2.0:1787508703.687869:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d4492400/0xb126349c40eba453 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1292:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8931d expref: 644 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.687881:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1292:0x0].0x0 (ffff9090cc088500) 00010000:00010000:2.0:1787508703.687914:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9d20200/0xb126349c40eb77d6 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1284:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa88682 expref: 643 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.687926:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1284:0x0].0x0 (ffff9090cbeaed00) 00010000:00010000:2.0:1787508703.687970:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9ff0e00/0xb126349c40eb2e3a lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1265:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa87174 expref: 642 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.687982:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1265:0x0].0x0 (ffff9090ce78a200) 00010000:00010000:2.0:1787508703.688007:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a3ac00/0xb126349c40eac063 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1233:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa85241 expref: 641 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688018:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1233:0x0].0x0 (ffff9091da398100) 00010000:00010000:2.0:1787508703.688029:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cf775200/0xb126349c40eaab94 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1229:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa84c59 expref: 640 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688042:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1229:0x0].0x0 (ffff9090e5bd2600) 00010000:00010000:2.0:1787508703.688053:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e61c2800/0xb126349c40ea7bd6 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1218:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa83ead expref: 639 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688065:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1218:0x0].0x0 (ffff9090ca4f9600) 00010000:00010000:2.0:1787508703.688092:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d1556000/0xb126349c40ea51a5 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1208:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa832ba expref: 638 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.688099:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d613d400/0xb126349c40ccc43b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x55d:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa280c2 expref: 20 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688105:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1208:0x0].0x0 (ffff9090c991fc00) 00010000:00010000:0.0:1787508703.688126:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091ecbebe00/0xb126349c40cca914 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x55d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa27a94 expref: 19 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688137:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22cbe00/0xb126349c40ea1ba4 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x11fb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa82371 expref: 637 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.688138:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x55d:0x0].0x0 (ffff9090cf093e00) 00010000:00010000:2.0:1787508703.688156:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11fb:0x0].0x0 (ffff9090c6a3a000) 00010000:00010000:0.0:1787508703.688162:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e36dda00/0xb126349c40cca842 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x55c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa27a63 expref: 18 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.688177:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x55c:0x0].0x0 (ffff9090d218ec00) 00010000:00010000:2.0:1787508703.688186:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c8307400/0xb126349c40e9e525 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x11ea:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa813e9 expref: 636 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.688195:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd4a8600/0xb126349c40ccaae9 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x563:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa27b04 expref: 17 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688201:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11ea:0x0].0x0 (ffff9090d4d92c00) 00010000:00010000:2.0:1787508703.688215:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9815000/0xb126349c40e9d7fe lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x11e5:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa81038 expref: 635 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688225:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11e5:0x0].0x0 (ffff9090cd063d00) 00010000:00010000:2.0:1787508703.688235:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a76600/0xb126349c40e993e1 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x11cf:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7fcff expref: 634 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688244:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11cf:0x0].0x0 (ffff9090ceaf3c00) 00010000:00010000:2.0:1787508703.688255:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cdb24c00/0xb126349c40e97ace lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x11c5:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7f5f8 expref: 633 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688265:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11c5:0x0].0x0 (ffff9091d62de800) 00010000:00010000:2.0:1787508703.688276:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5dd9800/0xb126349c40e94c28 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x11b0:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7e899 expref: 632 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688302:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11b0:0x0].0x0 (ffff9091d62dec00) 00010000:00010000:0.0:1787508703.688302:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x563:0x0].0x0 (ffff9090c96b8600) 00010000:00010000:2.0:1787508703.688320:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c740da00/0xb126349c40e9124c lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1197:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7d838 expref: 631 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.688330:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21a00/0xb126349c40c9a9ad lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0xdd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa1d1b4 expref: 16 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688340:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1197:0x0].0x0 (ffff9091d213f200) 00010000:00010000:0.0:1787508703.688346:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xdd:0x0].0x0 (ffff9090d1b2b000) 00010000:00010000:2.0:1787508703.688360:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d301a800/0xb126349c40e8f6bc lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x118c:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7d04a expref: 630 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.688368:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f352a4 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7eb expref: 15 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688376:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x118c:0x0].0x0 (ffff9090e465eb00) 00010000:00010000:0.0:1787508703.688382:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d6:0x0].0x0 (ffff9090ca4e2300) 00010000:00010000:2.0:1787508703.688395:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e6fc1000/0xb126349c40e8a1ab lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x116d:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7b825 expref: 629 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.688398:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35288 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7e4 expref: 14 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688418:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x116d:0x0].0x0 (ffff9090d2302900) 00010000:00010000:0.0:1787508703.688421:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508703.688434:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f351a1 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae79e expref: 13 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688439:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9814e00/0xb126349c40e88c88 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1167:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7b213 expref: 628 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.688449:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1263:0x0].0x0 (ffff9091d43a5300) 00010000:00010000:2.0:1787508703.688456:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1167:0x0].0x0 (ffff9091c76ce600) 00010000:00010000:0.0:1787508703.688463:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f350cf lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae74a expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688475:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9815c00/0xb126349c40e84729 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x114c:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa79e4e expref: 627 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.688476:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1260:0x0].0x0 (ffff9090d171f300) 00010000:00010000:2.0:1787508703.688493:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x114c:0x0].0x0 (ffff9091d43a5900) 00010000:00010000:2.0:1787508703.688507:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cda82800/0xb126349c40e7c5cc lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1123:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7795d expref: 626 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688516:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1123:0x0].0x0 (ffff9090cc80b900) 00010000:00010000:2.0:1787508703.688528:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e36cf400/0xb126349c40e795eb lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x110f:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa76be9 expref: 625 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688543:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x110f:0x0].0x0 (ffff9090c6946500) 00010000:00010000:2.0:1787508703.688556:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd4a8000/0xb126349c40e77457 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1104:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7626c expref: 624 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688566:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1104:0x0].0x0 (ffff9091d552db00) 00010000:00010000:0.0:1787508703.688576:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f34f63 lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6b7 expref: 11 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688581:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e1a00/0xb126349c40e721c3 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x10e3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa74ae8 expref: 623 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.688599:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x555:0x0].0x0 (ffff9090d36fd500) 00010000:00010000:2.0:1787508703.688602:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10e3:0x0].0x0 (ffff9090c96b8300) 00010000:00010000:0.0:1787508703.688615:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f34ea6 lrc: 0/0,0 mode: --/CR res: [0x2000013a3:0x553:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae678 expref: 10 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688620:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9c6f000/0xb126349c40e6f729 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x10d7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa73ea1 expref: 622 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.688631:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x553:0x0].0x0 (ffff9090ccb87600) 00010000:00010000:2.0:1787508703.688637:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10d7:0x0].0x0 (ffff9091c8b72400) 00010000:00010000:2.0:1787508703.688653:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091c588ae00/0xb126349c40e686ff lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x10a0:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa71e80 expref: 621 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688664:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10a0:0x0].0x0 (ffff9090ca68e000) 00010000:00010000:2.0:1787508703.688675:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9d23c00/0xb126349c40e654cb lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x108f:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa71033 expref: 620 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688686:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x108f:0x0].0x0 (ffff9090cf0bf100) 00010000:00010000:2.0:1787508703.688697:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9d22400/0xb126349c40e627d7 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1083:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa70383 expref: 619 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688706:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1083:0x0].0x0 (ffff9090d00cdf00) 00010000:00010000:2.0:1787508703.688732:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091c588be00/0xb126349c40e60237 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1074:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6f8ee expref: 618 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.688747:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f34dd4 lrc: 0/0,0 mode: --/CR res: [0x2000013a3:0x554:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae640 expref: 9 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688749:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1074:0x0].0x0 (ffff9090d00cd400) 00010000:00010000:2.0:1787508703.688766:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091c57f8c00/0xb126349c40e5e12f lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1069:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6ef94 expref: 617 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.688768:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x554:0x0].0x0 (ffff9090ccb87c00) 00010000:00010000:2.0:1787508703.688788:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1069:0x0].0x0 (ffff9090d4d92100) 00010000:00010000:2.0:1787508703.688798:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0b2a200/0xb126349c40e5b22e lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1059:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6e23c expref: 616 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688806:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1059:0x0].0x0 (ffff9091fde57a00) 00010000:00010000:2.0:1787508703.688814:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091c588b400/0xb126349c40e5a63b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1050:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6dec3 expref: 615 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688821:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1050:0x0].0x0 (ffff9091cb980000) 00010000:00010000:2.0:1787508703.688831:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091f9b20a00/0xb126349c40cd64fc lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x78:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa2a256 expref: 614 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688839:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x78:0x0].0x0 (ffff9090ced0e800) 00010000:00010000:2.0:1787508703.688847:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9d23800/0xb126349c40d5b1fa lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x587:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa3b467 expref: 613 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688855:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x587:0x0].0x0 (ffff9090d4d92700) 00010000:00010000:2.0:1787508703.688865:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9c6ee00/0xb126349c40cd62a9 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa2a192 expref: 612 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688888:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x3:0x0].0x0 (ffff9090d3c50c00) 00010000:00010000:2.0:1787508703.688901:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5554800/0xb126349c40cd4544 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x60:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa29b79 expref: 611 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688922:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x60:0x0].0x0 (ffff9090cc78bb00) 00010000:00010000:2.0:1787508703.688962:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d1c1dc00/0xb126349c40cd44b1 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x62:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa29b56 expref: 610 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688976:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x62:0x0].0x0 (ffff9090d00cd900) 00010000:00010000:2.0:1787508703.688988:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5dd8600/0xb126349c40ccfbc4 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x49:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa28c53 expref: 609 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.688998:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x49:0x0].0x0 (ffff9090d38d0300) 00010000:00010000:2.0:1787508703.689009:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f3522d lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7c8 expref: 608 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.689018:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d6:0x0].0x0 (ffff9090d36fd100) 00010000:00010000:2.0:1787508703.689026:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d1556200/0xb126349c40ec78bb lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12dc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8cf4c expref: 607 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.689037:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12dc:0x0].0x0 (ffff9090ce7f6c00) 00010000:00010000:2.0:1787508703.689049:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c67d4a00/0xb126349c40ec7852 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12db:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8cf3e expref: 606 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.689059:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12db:0x0].0x0 (ffff9090ceaf3800) 00010000:00010000:2.0:1787508703.689068:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f400/0xb126349c40ec77cd lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12da:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8cf22 expref: 605 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.689085:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12da:0x0].0x0 (ffff9090d6c66a00) 00010000:00010000:2.0:1787508703.689096:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5472000/0xb126349c40ec7779 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8cf06 expref: 604 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.689106:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12d9:0x0].0x0 (ffff9090cc088600) 00010000:00010000:2.0:1787508703.689118:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c67d4c00/0xb126349c40ec72be lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12d8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8cdaf expref: 603 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.689129:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12d8:0x0].0x0 (ffff9090ce7f6300) 00010000:00010000:0.0:1787508703.689135:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f34d87 lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x553:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae624 expref: 8 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.689144:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ec00/0xb126349c40ec7263 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8cd8c expref: 602 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.689150:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x553:0x0].0x0 (ffff9090ccb87600) 00010000:00010000:2.0:1787508703.689157:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12d7:0x0].0x0 (ffff9090d54db600) 00010000:00010000:0.0:1787508703.689161:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508703.689173:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247aa00/0xb126349c40ec71f3 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8cd69 expref: 601 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.689183:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12d6:0x0].0x0 (ffff9090d54dbe00) 00010000:00010000:2.0:1787508703.689193:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ba00/0xb126349c40ec713d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8cd31 expref: 600 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.689202:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12d5:0x0].0x0 (ffff9090d3e9ad00) 00010000:00010000:2.0:1787508703.689212:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e000/0xb126349c40ec6e03 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12d3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8cc3c expref: 599 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.689221:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12d3:0x0].0x0 (ffff9090ce78a900) 00010000:00010000:2.0:1787508703.689232:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b400/0xb126349c40ec6d4d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12d2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8cc20 expref: 598 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.689241:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12d2:0x0].0x0 (ffff9090d6195500) 00010000:00010000:2.0:1787508703.689251:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ed000/0xb126349c40ec6cf2 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8cbfd expref: 597 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.689260:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12d1:0x0].0x0 (ffff9090ce78ab00) 00010000:00010000:2.0:1787508703.689268:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f600/0xb126349c40ec6c19 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12d0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8cbb7 expref: 596 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.689277:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12d0:0x0].0x0 (ffff9090cc088800) 00010000:00010000:2.0:1787508703.689287:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cf774e00/0xb126349c40ec64d3 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x12cf:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8c9bf expref: 595 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.689296:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12cf:0x0].0x0 (ffff9090ce7baa00) 00010000:00010000:2.0:1787508703.689305:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5000/0xb126349c40ec5d08 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x12ce:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8c77a expref: 594 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.689315:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12ce:0x0].0x0 (ffff9090cd6a4d00) 00000100:00100000:0.0:1787508703.689341:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90920207dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:287588:x1874324509602048:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1727us (9220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508703.689354:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9805 00010000:00010000:2.0:1787508703.689510:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5473600/0xb126349c40ec58b6 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8c64d expref: 593 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.689526:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12cd:0x0].0x0 (ffff9090c5b9ec00) 00010000:00010000:2.0:1787508703.689543:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c948d400/0xb126349c40ec5870 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12cc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8c638 expref: 592 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.689560:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12cc:0x0].0x0 (ffff9090d0b35200) 00010000:00010000:2.0:1787508703.689571:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f6600/0xb126349c40ec57e4 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12cb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8c607 expref: 591 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.689580:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12cb:0x0].0x0 (ffff9090cd6a4300) 00010000:00010000:2.0:1787508703.689590:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d20e2400/0xb126349c40ec5719 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8c5cf expref: 590 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.689599:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12ca:0x0].0x0 (ffff9090cd6a4000) 00010000:00010000:2.0:1787508703.689609:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7400/0xb126349c40ec4be3 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12c8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8c2b8 expref: 589 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.689618:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12c8:0x0].0x0 (ffff9090d9e7b500) 00010000:00010000:2.0:1787508703.689627:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c8306e00/0xb126349c40ec4b81 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12c7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8c295 expref: 588 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.689636:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12c7:0x0].0x0 (ffff9090d2273f00) 00010000:00010000:2.0:1787508703.689646:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d56f7200/0xb126349c40ec4aee lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12c6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8c264 expref: 587 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.689656:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12c6:0x0].0x0 (ffff9090d2273a00) 00010000:00010000:2.0:1787508703.689666:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e343a600/0xb126349c40ec4a4d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12c5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8c233 expref: 586 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.689675:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12c5:0x0].0x0 (ffff9090d171fd00) 00010000:00010000:2.0:1787508703.689686:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9ef9600/0xb126349c40ec4377 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x12c4:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8c050 expref: 585 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.689695:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12c4:0x0].0x0 (ffff9090e7423a00) 00010000:00010000:2.0:1787508703.689705:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cbcba800/0xb126349c40ec3f1e lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12c3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8bf1c expref: 584 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.689715:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12c3:0x0].0x0 (ffff9090d6194200) 00010000:00010000:2.0:1787508703.689727:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4800/0xb126349c40ec3ec3 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8bf00 expref: 583 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.689736:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12c2:0x0].0x0 (ffff9090e7423b00) 00010000:00010000:2.0:1787508703.689747:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40ec3e5a lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8bedd expref: 582 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.689754:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12c1:0x0].0x0 (ffff9090ce7f6200) 00010000:00010000:2.0:1787508703.689992:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40ec3d88 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12c0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8be9e expref: 581 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690007:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12c0:0x0].0x0 (ffff9090e7423700) 00010000:00010000:2.0:1787508703.690021:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9ccac00/0xb126349c40ec3688 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x12bf:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8bcad expref: 580 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690029:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12bf:0x0].0x0 (ffff9090cc088b00) 00010000:00010000:2.0:1787508703.690039:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d20e2e00/0xb126349c40ec2e38 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x12be:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8ba37 expref: 579 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690052:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12be:0x0].0x0 (ffff9090cc98b500) 00010000:00010000:2.0:1787508703.690061:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c67d5a00/0xb126349c40ec29df lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12bd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8b90a expref: 578 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690072:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12bd:0x0].0x0 (ffff9090ce111900) 00010000:00010000:2.0:1787508703.690083:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d37cc000/0xb126349c40ec298b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8b8e7 expref: 577 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690091:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12bc:0x0].0x0 (ffff9090cc98b300) 00010000:00010000:2.0:1787508703.690100:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d37cd600/0xb126349c40ec291b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8b8c4 expref: 576 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690109:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12bb:0x0].0x0 (ffff9090d6c69900) 00010000:00010000:2.0:1787508703.690119:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d37cca00/0xb126349c40ec285e lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12ba:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8b88c expref: 575 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690128:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12ba:0x0].0x0 (ffff9090c6a3aa00) 00010000:00010000:2.0:1787508703.690139:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d4105000/0xb126349c40ec2157 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x12b9:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8b694 expref: 574 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690148:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12b9:0x0].0x0 (ffff9090d0b35400) 00010000:00010000:2.0:1787508703.690157:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a30e00/0xb126349c40ec1ce9 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8b54b expref: 573 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690166:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12b8:0x0].0x0 (ffff9090d6c66700) 00010000:00010000:2.0:1787508703.690176:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9cb3400/0xb126349c40ec1c48 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12b7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8b521 expref: 572 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690185:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12b7:0x0].0x0 (ffff9090d2273b00) 00010000:00010000:2.0:1787508703.690194:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d4105600/0xb126349c40ec1ba0 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12b6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8b505 expref: 571 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690203:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12b6:0x0].0x0 (ffff9090d2273900) 00010000:00010000:2.0:1787508703.690214:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5473800/0xb126349c40ec1b4c lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12b5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8b4e9 expref: 570 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690223:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12b5:0x0].0x0 (ffff9090d0b35d00) 00010000:00010000:2.0:1787508703.690233:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e35b9a00/0xb126349c40ec1437 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x12b4:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8b2ea expref: 569 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690242:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12b4:0x0].0x0 (ffff9090d2273300) 00010000:00010000:2.0:1787508703.690252:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0148400/0xb126349c40ec0baf lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x12b3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8b05f expref: 568 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690261:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12b3:0x0].0x0 (ffff9090c5b9ea00) 00010000:00010000:2.0:1787508703.690271:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c67d5000/0xb126349c40ec07f7 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12b2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8af55 expref: 567 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690280:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12b2:0x0].0x0 (ffff9090c6913c00) 00010000:00010000:2.0:1787508703.690289:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d34a2200/0xb126349c40ec0764 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8af24 expref: 566 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690303:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12b1:0x0].0x0 (ffff9090d6194700) 00010000:00010000:2.0:1787508703.690314:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c67d4600/0xb126349c40ec06e6 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8af08 expref: 565 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690322:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12b0:0x0].0x0 (ffff9090d0b35500) 00010000:00010000:2.0:1787508703.690329:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c67d4200/0xb126349c40ec0653 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12af:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8aee5 expref: 564 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690336:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12af:0x0].0x0 (ffff9090d9d2b900) 00010000:00010000:2.0:1787508703.690344:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0149a00/0xb126349c40ebfeb9 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x12ae:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8acbc expref: 563 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690351:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12ae:0x0].0x0 (ffff9090cd6a4c00) 00010000:00010000:2.0:1787508703.690359:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c948c600/0xb126349c40ebfa98 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12ad:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8ab7a expref: 562 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690367:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12ad:0x0].0x0 (ffff9090ce7bab00) 00010000:00010000:2.0:1787508703.690376:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c67d4e00/0xb126349c40ebf9f0 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12ac:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8ab50 expref: 561 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690383:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12ac:0x0].0x0 (ffff9090c5b9ed00) 00010000:00010000:2.0:1787508703.690391:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5473200/0xb126349c40ebf94f lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8ab34 expref: 560 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690398:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12ab:0x0].0x0 (ffff9090cd6a4e00) 00010000:00010000:2.0:1787508703.690406:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c7ad9c00/0xb126349c40ebf8fb lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12aa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8ab18 expref: 559 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690415:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12aa:0x0].0x0 (ffff9090ce7ba900) 00010000:00010000:2.0:1787508703.690423:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c67d5200/0xb126349c40ebf1f4 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x12a9:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8a919 expref: 558 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690431:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12a9:0x0].0x0 (ffff9090d9d2b200) 00010000:00010000:2.0:1787508703.690440:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5472600/0xb126349c40ebe9a4 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x12a8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8a6b1 expref: 557 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690448:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12a8:0x0].0x0 (ffff9090cda8ae00) 00010000:00010000:2.0:1787508703.690458:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e35b8000/0xb126349c40ebda5b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12a6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8a258 expref: 556 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690467:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12a6:0x0].0x0 (ffff9090cda8a700) 00010000:00010000:2.0:1787508703.690477:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e61c3800/0xb126349c40ebd99e lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8a227 expref: 555 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690484:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12a5:0x0].0x0 (ffff9090cc98be00) 00010000:00010000:2.0:1787508703.690493:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e61c3a00/0xb126349c40ebd8ef lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12a4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8a204 expref: 554 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690500:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12a4:0x0].0x0 (ffff9090c6a3a700) 00010000:00010000:2.0:1787508703.690508:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9dc3800/0xb126349c40ebd8a2 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8a1e8 expref: 553 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690520:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12a3:0x0].0x0 (ffff9090cda8a600) 00010000:00010000:2.0:1787508703.690530:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c948da00/0xb126349c40ebd171 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x12a2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa89fe9 expref: 552 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690538:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12a2:0x0].0x0 (ffff9090d171f100) 00010000:00010000:2.0:1787508703.690546:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e35b9600/0xb126349c40ebcd34 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12a1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa89ebc expref: 551 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690554:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12a1:0x0].0x0 (ffff9090d6c66c00) 00010000:00010000:2.0:1787508703.690562:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9ef9800/0xb126349c40ebccd2 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x12a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa89e99 expref: 550 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690569:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x12a0:0x0].0x0 (ffff9090d6195a00) 00010000:00010000:2.0:1787508703.690578:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9ef9a00/0xb126349c40ebcc5b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x129f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa89e6f expref: 549 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690586:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x129f:0x0].0x0 (ffff9090ca4e2400) 00010000:00010000:2.0:1787508703.690594:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e35b8a00/0xb126349c40ebcbb3 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x129e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa89e3e expref: 548 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690602:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x129e:0x0].0x0 (ffff9090ca4e2d00) 00010000:00010000:2.0:1787508703.690610:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9ef8200/0xb126349c40ebc49e lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x129d:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa89c3f expref: 547 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690619:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x129d:0x0].0x0 (ffff9090c6913800) 00010000:00010000:2.0:1787508703.690630:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9ef9000/0xb126349c40ebc05a lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x129c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa89afd expref: 546 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690638:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x129c:0x0].0x0 (ffff9090d171f500) 00010000:00010000:2.0:1787508703.690645:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d1557800/0xb126349c40ebbf6c lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x129b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa89ac5 expref: 545 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690653:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x129b:0x0].0x0 (ffff9090cbeaf400) 00010000:00010000:2.0:1787508703.690662:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9dc3600/0xb126349c40ebbee7 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x129a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa89aa9 expref: 544 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690670:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x129a:0x0].0x0 (ffff9090c6913000) 00010000:00010000:2.0:1787508703.690679:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d4493800/0xb126349c40ebbe93 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1299:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa89a86 expref: 543 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690688:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1299:0x0].0x0 (ffff9090cbeaf300) 00010000:00010000:2.0:1787508703.690696:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d37cd800/0xb126349c40ebb3e2 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1297:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa89776 expref: 542 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690704:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1297:0x0].0x0 (ffff9090cbeafe00) 00010000:00010000:2.0:1787508703.690713:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0149c00/0xb126349c40ebb34f lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1296:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa89753 expref: 541 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690721:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1296:0x0].0x0 (ffff9090cbeafd00) 00010000:00010000:2.0:1787508703.690730:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9ef9e00/0xb126349c40ebb2ae lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1295:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa89737 expref: 540 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690743:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1295:0x0].0x0 (ffff9090cc98b700) 00010000:00010000:2.0:1787508703.690752:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e35b9400/0xb126349c40ebb25a lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1294:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8971b expref: 539 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.690760:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1294:0x0].0x0 (ffff9090cbeafb00) 00010000:00010000:2.0:1787508703.690769:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9ef9200/0xb126349c40ebabe6 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1293:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa89554 expref: 538 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691048:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1293:0x0].0x0 (ffff9090cc98bc00) 00010000:00010000:2.0:1787508703.691068:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5472e00/0xb126349c40eb9c65 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1291:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa890d1 expref: 537 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691078:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1291:0x0].0x0 (ffff9090c6987f00) 00010000:00010000:2.0:1787508703.691087:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e35b9e00/0xb126349c40eb9916 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1290:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa88fdc expref: 536 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691098:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1290:0x0].0x0 (ffff9090cbeaf600) 00010000:00010000:2.0:1787508703.691108:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9ef9c00/0xb126349c40eb98a6 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x128f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa88fb9 expref: 535 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691117:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x128f:0x0].0x0 (ffff9090cbeaf900) 00010000:00010000:2.0:1787508703.691127:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cee41e00/0xb126349c40eb91d7 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x128e:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa88dd6 expref: 534 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691136:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x128e:0x0].0x0 (ffff9090d6c66d00) 00010000:00010000:2.0:1787508703.691146:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d1c24e00/0xb126349c40eb8dbd lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x128d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa88cb7 expref: 533 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691156:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x128d:0x0].0x0 (ffff9090cc98bb00) 00010000:00010000:2.0:1787508703.691166:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d4104200/0xb126349c40eb8d5b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x128c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa88c94 expref: 532 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691175:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x128c:0x0].0x0 (ffff9090cc98b800) 00010000:00010000:2.0:1787508703.691184:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d4105e00/0xb126349c40eb8cf2 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x128b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa88c71 expref: 531 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691194:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x128b:0x0].0x0 (ffff9090c991f200) 00010000:00010000:2.0:1787508703.691204:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9dc2600/0xb126349c40eb8c20 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x128a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa88c32 expref: 530 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691213:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x128a:0x0].0x0 (ffff9090cbeae100) 00010000:00010000:2.0:1787508703.691221:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d4492e00/0xb126349c40eb84b0 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1289:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa88a2c expref: 529 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691230:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1289:0x0].0x0 (ffff9090c6a3be00) 00010000:00010000:2.0:1787508703.691239:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9dc3400/0xb126349c40eb80c0 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1288:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8890d expref: 528 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691248:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1288:0x0].0x0 (ffff9090c991f100) 00010000:00010000:2.0:1787508703.691256:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9dc2200/0xb126349c40eb802d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1287:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa888dc expref: 527 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691269:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1287:0x0].0x0 (ffff9090cbeae500) 00010000:00010000:2.0:1787508703.691278:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d4105200/0xb126349c40eb7f70 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1286:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa888ab expref: 526 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691286:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1286:0x0].0x0 (ffff9090c991f700) 00010000:00010000:2.0:1787508703.691293:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d4105400/0xb126349c40eb7ee4 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1285:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa88888 expref: 525 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691301:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1285:0x0].0x0 (ffff9090cbeae200) 00010000:00010000:2.0:1787508703.691309:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0149600/0xb126349c40eb73bc lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1283:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8855c expref: 524 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691317:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1283:0x0].0x0 (ffff9090c6a3ae00) 00010000:00010000:2.0:1787508703.691325:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e343a000/0xb126349c40eb7353 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1282:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa88539 expref: 523 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691332:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1282:0x0].0x0 (ffff9090ce7f6400) 00010000:00010000:2.0:1787508703.691341:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3462a00/0xb126349c40eb7281 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1281:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa88501 expref: 522 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691348:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1281:0x0].0x0 (ffff9090cbeae600) 00010000:00010000:2.0:1787508703.691356:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d1c25600/0xb126349c40eb7203 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1280:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa884e5 expref: 521 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691365:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1280:0x0].0x0 (ffff9090ce7f6800) 00010000:00010000:2.0:1787508703.691373:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0148000/0xb126349c40eb6d2c lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x127f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa88395 expref: 520 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691382:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x127f:0x0].0x0 (ffff9090d6195900) 00010000:00010000:2.0:1787508703.691391:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d37cd000/0xb126349c40eb6cd8 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x127e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa88379 expref: 519 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691399:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x127e:0x0].0x0 (ffff9090cbeaea00) 00010000:00010000:2.0:1787508703.691407:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c948d600/0xb126349c40eb6c1b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x127d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8833a expref: 518 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691415:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x127d:0x0].0x0 (ffff9090d6194d00) 00010000:00010000:2.0:1787508703.691423:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d37cdc00/0xb126349c40eb6b88 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x127c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa88317 expref: 517 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691431:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x127c:0x0].0x0 (ffff9090cbeaef00) 00010000:00010000:2.0:1787508703.691440:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a76400/0xb126349c40eb68a9 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x127a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8823e expref: 516 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691448:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x127a:0x0].0x0 (ffff9090d6195300) 00010000:00010000:2.0:1787508703.691456:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a3aa00/0xb126349c40eb6840 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1279:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa88230 expref: 515 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691465:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1279:0x0].0x0 (ffff9090d6194900) 00010000:00010000:2.0:1787508703.691473:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d34a3600/0xb126349c40eb67d7 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1278:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa88214 expref: 514 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691484:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1278:0x0].0x0 (ffff9090d6194400) 00010000:00010000:2.0:1787508703.691492:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a3b000/0xb126349c40eb6783 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1277:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa881f8 expref: 513 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691501:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1277:0x0].0x0 (ffff9090cbeae800) 00010000:00010000:2.0:1787508703.691509:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c948ce00/0xb126349c40eb6147 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1275:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8800e expref: 512 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691517:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1275:0x0].0x0 (ffff9090d6c69c00) 00010000:00010000:2.0:1787508703.691526:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d4493600/0xb126349c40eb60d7 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1274:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa87ff9 expref: 511 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691534:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1274:0x0].0x0 (ffff9090e7423d00) 00010000:00010000:2.0:1787508703.691542:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c948d000/0xb126349c40eb606e lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1273:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa87fe4 expref: 510 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691551:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1273:0x0].0x0 (ffff9090cbeae900) 00010000:00010000:2.0:1787508703.691558:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d4493a00/0xb126349c40eb601a lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1272:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa87fc8 expref: 509 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691566:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1272:0x0].0x0 (ffff9090ce7f6f00) 00010000:00010000:2.0:1787508703.691573:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d34a3000/0xb126349c40eb590c lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1271:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa87dc2 expref: 508 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691582:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1271:0x0].0x0 (ffff9090c6a3a100) 00010000:00010000:2.0:1787508703.691590:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d00ff600/0xb126349c40eb5102 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1270:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa87b61 expref: 507 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691599:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1270:0x0].0x0 (ffff9090e7423600) 00010000:00010000:2.0:1787508703.691607:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c948de00/0xb126349c40eb4cc5 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x126f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa87a34 expref: 506 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691615:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x126f:0x0].0x0 (ffff9090e7423100) 00010000:00010000:2.0:1787508703.691623:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d00fee00/0xb126349c40eb4c47 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x126e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa87a03 expref: 505 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691631:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x126e:0x0].0x0 (ffff9090d9e7ae00) 00010000:00010000:2.0:1787508703.691639:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c948c200/0xb126349c40eb4b60 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x126d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa879c4 expref: 504 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691648:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x126d:0x0].0x0 (ffff9090d54dbd00) 00010000:00010000:2.0:1787508703.691658:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cf774400/0xb126349c40eb4ad4 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x126c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa879a1 expref: 503 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691666:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x126c:0x0].0x0 (ffff9090e7423c00) 00010000:00010000:2.0:1787508703.691674:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0148e00/0xb126349c40eb4395 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x126b:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8778d expref: 502 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691681:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x126b:0x0].0x0 (ffff9090d6c69400) 00010000:00010000:2.0:1787508703.691689:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c948ca00/0xb126349c40eb3b8b lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x126a:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8753a expref: 501 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691701:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x126a:0x0].0x0 (ffff9090d6c66900) 00010000:00010000:2.0:1787508703.691710:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d34a3200/0xb126349c40eb375c lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1269:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa873ff expref: 500 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691717:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1269:0x0].0x0 (ffff9090d6c66300) 00010000:00010000:2.0:1787508703.691725:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9ff1000/0xb126349c40eb369f lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1268:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa873ce expref: 499 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691732:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1268:0x0].0x0 (ffff9090d6194e00) 00010000:00010000:2.0:1787508703.691740:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9dc3200/0xb126349c40eb35fe lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1267:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa873b2 expref: 498 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691748:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1267:0x0].0x0 (ffff9090d6c66500) 00010000:00010000:2.0:1787508703.691755:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d34a2800/0xb126349c40eb35aa lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1266:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa87396 expref: 497 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.691763:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1266:0x0].0x0 (ffff9090d9e7a500) 00010000:00010000:2.0:1787508703.691771:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d34a2400/0xb126349c40eb2a74 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1264:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa87071 expref: 496 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692209:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1264:0x0].0x0 (ffff9090d54db400) 00010000:00010000:2.0:1787508703.692230:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0148600/0xb126349c40eb29f6 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1263:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa87047 expref: 495 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692241:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1263:0x0].0x0 (ffff9090d6c69e00) 00010000:00010000:2.0:1787508703.692251:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0149200/0xb126349c40eb29b0 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1262:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa87032 expref: 494 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692259:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1262:0x0].0x0 (ffff9090d54dbb00) 00010000:00010000:2.0:1787508703.692268:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d7f7fe00/0xb126349c40eb290f lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1261:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa87001 expref: 493 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692278:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1261:0x0].0x0 (ffff9090cd063800) 00010000:00010000:2.0:1787508703.692289:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d34a2c00/0xb126349c40eb2198 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1260:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa86ded expref: 492 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692297:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1260:0x0].0x0 (ffff9090c5b0cd00) 00010000:00010000:2.0:1787508703.692305:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9ff1c00/0xb126349c40eb1d46 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x125f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa86cab expref: 491 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692313:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x125f:0x0].0x0 (ffff9090d54db800) 00010000:00010000:2.0:1787508703.692322:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cc80fe00/0xb126349c40eb1cf9 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x125e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa86c9d expref: 490 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692332:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x125e:0x0].0x0 (ffff9090c5b0cc00) 00010000:00010000:2.0:1787508703.692340:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d00ff200/0xb126349c40eb1c4a lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x125d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa86c7a expref: 489 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692348:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x125d:0x0].0x0 (ffff9090d54db700) 00010000:00010000:2.0:1787508703.692356:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c7ad8400/0xb126349c40eb1c04 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x125c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa86c65 expref: 488 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692370:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x125c:0x0].0x0 (ffff9090d54db200) 00010000:00010000:2.0:1787508703.692378:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d00ffa00/0xb126349c40eb1749 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x125b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa86b15 expref: 487 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692385:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x125b:0x0].0x0 (ffff9090c5b0ca00) 00010000:00010000:2.0:1787508703.692394:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cee40200/0xb126349c40eb16f5 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x125a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa86af9 expref: 486 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692401:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x125a:0x0].0x0 (ffff9090d9d2b600) 00010000:00010000:2.0:1787508703.692410:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d34a2600/0xb126349c40eb1662 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1259:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa86ac8 expref: 485 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692417:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1259:0x0].0x0 (ffff9091d43a5200) 00010000:00010000:2.0:1787508703.692426:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091e6a2ac00/0xb126349c40eb1589 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1258:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa86a97 expref: 484 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692433:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1258:0x0].0x0 (ffff9090c6406e00) 00010000:00010000:2.0:1787508703.692443:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091e6a2a600/0xb126349c40eb12db lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1256:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa869be expref: 483 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692451:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1256:0x0].0x0 (ffff9090d9d2b000) 00010000:00010000:2.0:1787508703.692460:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e343aa00/0xb126349c40eb1279 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1255:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa869b0 expref: 482 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692468:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1255:0x0].0x0 (ffff9091fde57300) 00010000:00010000:2.0:1787508703.692477:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d00fe000/0xb126349c40eb11f4 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1254:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa86994 expref: 481 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692485:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1254:0x0].0x0 (ffff9090d9d2b100) 00010000:00010000:2.0:1787508703.692493:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e36ce800/0xb126349c40eb11a0 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1253:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa86978 expref: 480 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692503:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1253:0x0].0x0 (ffff9090c6406600) 00010000:00010000:2.0:1787508703.692511:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9ff1200/0xb126349c40eb0a61 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1252:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa86764 expref: 479 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692520:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1252:0x0].0x0 (ffff9090c5b0c900) 00010000:00010000:2.0:1787508703.692528:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9d20600/0xb126349c40eb05d7 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1251:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa86606 expref: 478 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692537:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1251:0x0].0x0 (ffff9090ce78b000) 00010000:00010000:2.0:1787508703.692546:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c99e6c00/0xb126349c40eb0513 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1250:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa865dc expref: 477 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692553:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1250:0x0].0x0 (ffff9090ce7f6e00) 00010000:00010000:2.0:1787508703.692563:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a3b200/0xb126349c40eb046b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x124f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa865b9 expref: 476 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692570:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x124f:0x0].0x0 (ffff9091d43a5700) 00010000:00010000:2.0:1787508703.692579:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cee41200/0xb126349c40eb043a lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x124e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa865a4 expref: 475 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692592:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x124e:0x0].0x0 (ffff9090c5b0c500) 00010000:00010000:2.0:1787508703.692600:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3463000/0xb126349c40eafe1a lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x124c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa863ba expref: 474 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692608:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x124c:0x0].0x0 (ffff9090ce7f6900) 00010000:00010000:2.0:1787508703.692616:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3ee5000/0xb126349c40eafda3 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x124b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa863ac expref: 473 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692622:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x124b:0x0].0x0 (ffff9090ce7f6600) 00010000:00010000:2.0:1787508703.692630:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3463200/0xb126349c40eafd1e lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x124a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa86390 expref: 472 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692637:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x124a:0x0].0x0 (ffff9090c5b0c200) 00010000:00010000:2.0:1787508703.692646:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9ff1a00/0xb126349c40eafcbc lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1249:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8636d expref: 471 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692653:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1249:0x0].0x0 (ffff9090c6a3bd00) 00010000:00010000:2.0:1787508703.692661:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0148800/0xb126349c40eaf530 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1248:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa86144 expref: 470 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692668:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1248:0x0].0x0 (ffff9090d6c69000) 00010000:00010000:2.0:1787508703.692676:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9ff1e00/0xb126349c40eaf116 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1247:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa86010 expref: 469 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692684:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1247:0x0].0x0 (ffff9090c6987d00) 00010000:00010000:2.0:1787508703.692692:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9cb3c00/0xb126349c40eaf0ad lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1246:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa86002 expref: 468 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692700:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1246:0x0].0x0 (ffff9090c5b0ce00) 00010000:00010000:2.0:1787508703.692708:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c740c800/0xb126349c40eaf028 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1245:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa85fe6 expref: 467 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692716:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1245:0x0].0x0 (ffff9090c5b0cf00) 00010000:00010000:2.0:1787508703.692724:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0149400/0xb126349c40eaefcd lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1244:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa85fc3 expref: 466 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692731:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1244:0x0].0x0 (ffff9090d6c69b00) 00010000:00010000:2.0:1787508703.692740:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0ff0000/0xb126349c40eae89c lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1243:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa85db6 expref: 465 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692748:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1243:0x0].0x0 (ffff9090d6c69300) 00010000:00010000:2.0:1787508703.692758:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a3ba00/0xb126349c40eae482 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1242:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa85c97 expref: 464 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692766:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1242:0x0].0x0 (ffff9090d6c69f00) 00010000:00010000:2.0:1787508703.692774:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d00fe400/0xb126349c40eae435 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1241:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa85c7b expref: 463 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692899:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1241:0x0].0x0 (ffff9090ca0c8900) 00010000:00010000:2.0:1787508703.692920:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d00ff800/0xb126349c40eae3cc lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1240:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa85c58 expref: 462 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.692934:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1240:0x0].0x0 (ffff9090d6c69500) 00010000:00010000:2.0:1787508703.693000:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a3a600/0xb126349c40eae30f lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x123f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa85c19 expref: 461 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693010:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x123f:0x0].0x0 (ffff9090d6c69800) 00010000:00010000:2.0:1787508703.693020:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cee41a00/0xb126349c40eadd27 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x123d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa85a52 expref: 460 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693028:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x123d:0x0].0x0 (ffff9090ce111600) 00010000:00010000:2.0:1787508703.693038:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cee41000/0xb126349c40eadcda lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x123c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa85a44 expref: 459 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693046:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x123c:0x0].0x0 (ffff9090c6a3b400) 00010000:00010000:2.0:1787508703.693055:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a3b600/0xb126349c40eadc39 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x123b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa85a28 expref: 458 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693062:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x123b:0x0].0x0 (ffff9090ca0c8100) 00010000:00010000:2.0:1787508703.693071:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d00ffe00/0xb126349c40eadbe5 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x123a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa85a0c expref: 457 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693080:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x123a:0x0].0x0 (ffff9090ce111a00) 00010000:00010000:2.0:1787508703.693089:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3ee4c00/0xb126349c40ead498 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1239:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8580d expref: 456 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693099:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1239:0x0].0x0 (ffff9090d6195100) 00010000:00010000:2.0:1787508703.693110:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c10e0a00/0xb126349c40eacccd lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1238:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa855cf expref: 455 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693118:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1238:0x0].0x0 (ffff9090ce8a2d00) 00010000:00010000:2.0:1787508703.693128:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9ff1800/0xb126349c40eac8cf lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1237:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8549b expref: 454 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693139:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1237:0x0].0x0 (ffff9090c6a3bc00) 00010000:00010000:2.0:1787508703.693148:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9ff0c00/0xb126349c40eac827 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1236:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa85471 expref: 453 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693156:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1236:0x0].0x0 (ffff9090d6194500) 00010000:00010000:2.0:1787508703.693168:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9ff1600/0xb126349c40eac77f lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1235:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa85455 expref: 452 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693177:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1235:0x0].0x0 (ffff9090c6a3b700) 00010000:00010000:2.0:1787508703.693186:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9ff1400/0xb126349c40eac72b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1234:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa85439 expref: 451 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693195:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1234:0x0].0x0 (ffff9090ce78b100) 00010000:00010000:2.0:1787508703.693205:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a3bc00/0xb126349c40eabc2d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1232:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa850ff expref: 450 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693213:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1232:0x0].0x0 (ffff9090c6987100) 00010000:00010000:2.0:1787508703.693221:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0ff0600/0xb126349c40eabb62 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1231:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa850c7 expref: 449 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693233:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1231:0x0].0x0 (ffff9090c6987c00) 00010000:00010000:2.0:1787508703.693241:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cbcbb200/0xb126349c40eababa lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1230:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa850ab expref: 448 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693249:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1230:0x0].0x0 (ffff9090c6987e00) 00010000:00010000:2.0:1787508703.693257:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a3b800/0xb126349c40eaba66 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x122f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8508f expref: 447 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693265:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x122f:0x0].0x0 (ffff9090c6987b00) 00010000:00010000:2.0:1787508703.693273:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a3a800/0xb126349c40eab43f lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x122d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa84ea5 expref: 446 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693282:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x122d:0x0].0x0 (ffff9090ce78b600) 00010000:00010000:2.0:1787508703.693290:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a3a000/0xb126349c40eab3d6 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x122c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa84e97 expref: 445 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693298:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x122c:0x0].0x0 (ffff9090c6987000) 00010000:00010000:2.0:1787508703.693310:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9ff0000/0xb126349c40eab351 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x122b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa84e7b expref: 444 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693318:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x122b:0x0].0x0 (ffff9090d6c69700) 00010000:00010000:2.0:1787508703.693328:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3ee4800/0xb126349c40eab2fd lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x122a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa84e5f expref: 443 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693335:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x122a:0x0].0x0 (ffff9090ce78b700) 00010000:00010000:2.0:1787508703.693345:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cbcbb400/0xb126349c40eaa3ad lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1228:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa849ff expref: 442 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693353:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1228:0x0].0x0 (ffff9090c6406500) 00010000:00010000:2.0:1787508703.693362:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e343b800/0xb126349c40ea9ba3 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1227:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa847ac expref: 441 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693370:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1227:0x0].0x0 (ffff9090c6a3ab00) 00010000:00010000:2.0:1787508703.693380:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c8307e00/0xb126349c40ea9399 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1226:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa84559 expref: 440 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693389:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1226:0x0].0x0 (ffff9090cddfa100) 00010000:00010000:2.0:1787508703.693398:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cee41c00/0xb126349c40ea8f4e lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1225:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa84417 expref: 439 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693404:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1225:0x0].0x0 (ffff9090c6987a00) 00010000:00010000:2.0:1787508703.693412:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3ee4200/0xb126349c40ea8e83 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1224:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa843df expref: 438 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693420:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1224:0x0].0x0 (ffff9090c6987300) 00010000:00010000:2.0:1787508703.693428:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9d21000/0xb126349c40ea8ddb lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1223:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa843c3 expref: 437 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693437:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1223:0x0].0x0 (ffff9090d9e7bb00) 00010000:00010000:2.0:1787508703.693447:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a31c00/0xb126349c40ea8d87 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1222:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa843a7 expref: 436 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693460:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1222:0x0].0x0 (ffff9090c9878600) 00010000:00010000:2.0:1787508703.693470:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d1556800/0xb126349c40ea88cc lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1221:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa84250 expref: 435 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693479:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1221:0x0].0x0 (ffff9090c991fe00) 00010000:00010000:2.0:1787508703.693488:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3ee4600/0xb126349c40ea8871 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1220:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8422d expref: 434 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693496:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1220:0x0].0x0 (ffff9091d39d2100) 00010000:00010000:2.0:1787508703.693505:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cbcbb600/0xb126349c40ea87d7 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x121f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa841fc expref: 433 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693514:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x121f:0x0].0x0 (ffff9091d39d2c00) 00010000:00010000:2.0:1787508703.693523:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e61c3e00/0xb126349c40ea872f lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x121e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa841d2 expref: 432 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693531:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x121e:0x0].0x0 (ffff9090ca68e100) 00010000:00010000:2.0:1787508703.693541:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e61c3000/0xb126349c40ea847a lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x121c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa840f9 expref: 431 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693549:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x121c:0x0].0x0 (ffff9090d3e9a800) 00010000:00010000:2.0:1787508703.693558:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cbcbaa00/0xb126349c40ea841f lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x121b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa840eb expref: 430 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693564:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x121b:0x0].0x0 (ffff9090cd810000) 00010000:00010000:2.0:1787508703.693575:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cee40000/0xb126349c40ea837e lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x121a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa840cf expref: 429 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693582:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x121a:0x0].0x0 (ffff9090c6987500) 00010000:00010000:2.0:1787508703.693593:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cbcbae00/0xb126349c40ea832a lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1219:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa840b3 expref: 428 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693600:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1219:0x0].0x0 (ffff9090d02ad300) 00010000:00010000:2.0:1787508703.693609:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cee40e00/0xb126349c40ea737f lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1217:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa83c3e expref: 427 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693616:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1217:0x0].0x0 (ffff9090d08ec500) 00010000:00010000:2.0:1787508703.693624:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22cb400/0xb126349c40ea6f73 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1216:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa83b11 expref: 426 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693632:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1216:0x0].0x0 (ffff9090ce78b500) 00010000:00010000:2.0:1787508703.693642:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e343a200/0xb126349c40ea6f0a lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1215:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa83b03 expref: 425 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693650:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1215:0x0].0x0 (ffff9090ce78b400) 00010000:00010000:2.0:1787508703.693658:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cee40c00/0xb126349c40ea6e85 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1214:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa83ae7 expref: 424 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693667:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1214:0x0].0x0 (ffff9090c6a3af00) 00010000:00010000:2.0:1787508703.693677:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ce7cd200/0xb126349c40ea6e31 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa83acb expref: 423 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693689:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1213:0x0].0x0 (ffff9090cd063c00) 00010000:00010000:2.0:1787508703.693698:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a31000/0xb126349c40ea6945 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1212:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa83966 expref: 422 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693706:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1212:0x0].0x0 (ffff9090ca0c8200) 00010000:00010000:2.0:1787508703.693715:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e343a800/0xb126349c40ea68ce lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1211:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa83943 expref: 421 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693724:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1211:0x0].0x0 (ffff9090cd063300) 00010000:00010000:2.0:1787508703.693732:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cbcbbc00/0xb126349c40ea682d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1210:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa83912 expref: 420 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693739:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1210:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:2.0:1787508703.693749:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cbcba400/0xb126349c40ea67c4 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x120f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa83904 expref: 419 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693757:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x120f:0x0].0x0 (ffff9090cd063400) 00010000:00010000:2.0:1787508703.693765:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c8099000/0xb126349c40ea651d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x120d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8382b expref: 418 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693773:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x120d:0x0].0x0 (ffff9090ce78af00) 00010000:00010000:2.0:1787508703.693922:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e343ae00/0xb126349c40ea64b4 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x120c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8381d expref: 417 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.693932:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x120c:0x0].0x0 (ffff9090ca0c8c00) 00010000:00010000:2.0:1787508703.694022:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e343b000/0xb126349c40ea642f lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x120b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa83801 expref: 416 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694034:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x120b:0x0].0x0 (ffff9090d3e9ae00) 00010000:00010000:2.0:1787508703.694045:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d1557000/0xb126349c40ea63d4 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x120a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa837de expref: 415 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694055:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x120a:0x0].0x0 (ffff9090cd063600) 00010000:00010000:2.0:1787508703.694067:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3463600/0xb126349c40ea5d59 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1209:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa83609 expref: 414 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694076:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1209:0x0].0x0 (ffff9090ce78a000) 00010000:00010000:2.0:1787508703.694087:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ce7ccc00/0xb126349c40ea49cc lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1207:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa83075 expref: 413 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694098:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1207:0x0].0x0 (ffff9090c6a3a300) 00010000:00010000:2.0:1787508703.694111:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22cac00/0xb126349c40ea4581 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1206:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa82f48 expref: 412 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694119:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1206:0x0].0x0 (ffff9090ceaf3300) 00010000:00010000:2.0:1787508703.694128:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3ee4e00/0xb126349c40ea452d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1205:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa82f25 expref: 411 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694136:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1205:0x0].0x0 (ffff9090ceaf3f00) 00010000:00010000:2.0:1787508703.694145:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3ee5800/0xb126349c40ea44a8 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1204:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa82efb expref: 410 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694158:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1204:0x0].0x0 (ffff9090ce78bc00) 00010000:00010000:2.0:1787508703.694168:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9d21800/0xb126349c40ea4407 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1203:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa82eca expref: 409 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694177:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1203:0x0].0x0 (ffff9090d9e7ad00) 00010000:00010000:2.0:1787508703.694186:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0ff0e00/0xb126349c40ea3cba lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1202:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa82ccb expref: 408 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694194:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1202:0x0].0x0 (ffff9090d08ec700) 00010000:00010000:2.0:1787508703.694203:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3462000/0xb126349c40ea34ef lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1201:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa82a8d expref: 407 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694211:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1201:0x0].0x0 (ffff9090ca0c8700) 00010000:00010000:2.0:1787508703.694225:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3ee4400/0xb126349c40ea30c0 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1200:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa82952 expref: 406 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694235:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1200:0x0].0x0 (ffff9090c6406200) 00010000:00010000:2.0:1787508703.694246:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cf774c00/0xb126349c40ea305e lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11ff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa82944 expref: 405 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694254:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11ff:0x0].0x0 (ffff9090c6406800) 00010000:00010000:2.0:1787508703.694265:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091c0030400/0xb126349c40ea2fd9 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa82928 expref: 404 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694276:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11fe:0x0].0x0 (ffff9090ca44a200) 00010000:00010000:2.0:1787508703.694286:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0ff1000/0xb126349c40ea2f85 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8290c expref: 403 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694296:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11fd:0x0].0x0 (ffff9090ca0c8400) 00010000:00010000:2.0:1787508703.694306:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5528a00/0xb126349c40ea2800 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x11fc:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa826ea expref: 402 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694314:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11fc:0x0].0x0 (ffff9090c991fa00) 00010000:00010000:2.0:1787508703.694326:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0ff1a00/0xb126349c40ea1783 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11fa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8224b expref: 401 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694333:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11fa:0x0].0x0 (ffff9090cda8dc00) 00010000:00010000:2.0:1787508703.694341:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0ff0400/0xb126349c40ea16f0 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8221a expref: 400 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694348:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11f9:0x0].0x0 (ffff9090cda8d500) 00010000:00010000:2.0:1787508703.694356:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e61c3200/0xb126349c40ea163a lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa821e9 expref: 399 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694365:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11f8:0x0].0x0 (ffff9090cda8d900) 00010000:00010000:2.0:1787508703.694374:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9d20c00/0xb126349c40ea15b5 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11f7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa821cd expref: 398 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694383:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11f7:0x0].0x0 (ffff9090c6a3b200) 00010000:00010000:2.0:1787508703.694394:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c8307600/0xb126349c40ea0e45 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x11f6:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa81fb2 expref: 397 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694408:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11f6:0x0].0x0 (ffff9090d9e7b200) 00010000:00010000:2.0:1787508703.694418:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3462c00/0xb126349c40ea09ec lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11f5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa81e69 expref: 396 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694427:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11f5:0x0].0x0 (ffff9090d9e7b800) 00010000:00010000:2.0:1787508703.694436:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22cb000/0xb126349c40ea0936 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa81e38 expref: 395 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694446:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11f4:0x0].0x0 (ffff9090ce111c00) 00010000:00010000:2.0:1787508703.694456:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e61c2000/0xb126349c40ea0872 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa81e0e expref: 394 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694465:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11f3:0x0].0x0 (ffff9090c6a3ba00) 00010000:00010000:2.0:1787508703.694475:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3462800/0xb126349c40ea0841 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11f2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa81e00 expref: 393 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694484:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11f2:0x0].0x0 (ffff9090ce111e00) 00010000:00010000:2.0:1787508703.694494:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3463c00/0xb126349c40ea0133 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x11f1:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa81bfa expref: 392 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694504:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11f1:0x0].0x0 (ffff9090d9e7ba00) 00010000:00010000:2.0:1787508703.694514:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0ff0200/0xb126349c40e9f961 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x11f0:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa819b5 expref: 391 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694524:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11f0:0x0].0x0 (ffff9090d9e7a300) 00010000:00010000:2.0:1787508703.694534:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22cba00/0xb126349c40e9f150 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x11ef:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa81754 expref: 390 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694543:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11ef:0x0].0x0 (ffff9090ca0c8000) 00010000:00010000:2.0:1787508703.694554:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d613da00/0xb126349c40e9ed83 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8163c expref: 389 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694564:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11ee:0x0].0x0 (ffff9090e5bd2400) 00010000:00010000:2.0:1787508703.694574:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c740d800/0xb126349c40e9ec9c lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8160b expref: 388 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694584:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11ed:0x0].0x0 (ffff9090e5bd2e00) 00010000:00010000:2.0:1787508703.694593:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c740d600/0xb126349c40e9ec17 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11ec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa815e8 expref: 387 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694602:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11ec:0x0].0x0 (ffff9090e5bd2500) 00010000:00010000:2.0:1787508703.694613:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9d21200/0xb126349c40e9ebe6 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa815da expref: 386 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694623:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11eb:0x0].0x0 (ffff9090e5bd2d00) 00010000:00010000:2.0:1787508703.694634:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9cb3e00/0xb126349c40e9e0e1 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11e9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa812c3 expref: 385 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694643:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11e9:0x0].0x0 (ffff9090cf431400) 00010000:00010000:2.0:1787508703.694654:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22cb200/0xb126349c40e9e086 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11e8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa812a0 expref: 384 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694665:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11e8:0x0].0x0 (ffff9090e5bd2700) 00010000:00010000:2.0:1787508703.694673:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d22ca400/0xb126349c40e9e02b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8127d expref: 383 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694681:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11e7:0x0].0x0 (ffff9090ce111000) 00010000:00010000:2.0:1787508703.694690:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9814800/0xb126349c40e9df44 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa81237 expref: 382 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694698:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11e6:0x0].0x0 (ffff9091cc215300) 00010000:00010000:2.0:1787508703.694707:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5529000/0xb126349c40e9cfd1 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x11e4:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa80dd7 expref: 381 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694716:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11e4:0x0].0x0 (ffff9090c991f000) 00010000:00010000:2.0:1787508703.694726:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9d21c00/0xb126349c40e9cbb0 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11e3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa80c9c expref: 380 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694735:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11e3:0x0].0x0 (ffff9090ceaf3b00) 00010000:00010000:2.0:1787508703.694744:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c7ad9200/0xb126349c40e9caf3 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11e2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa80c6b expref: 379 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694753:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11e2:0x0].0x0 (ffff9091fde57e00) 00010000:00010000:2.0:1787508703.694763:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9cb3800/0xb126349c40e9ca52 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa80c4f expref: 378 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694773:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11e1:0x0].0x0 (ffff9090e465e300) 00010000:00010000:2.0:1787508703.694783:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e340f600/0xb126349c40e9c9fe lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa80c33 expref: 377 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694792:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11e0:0x0].0x0 (ffff9090e465e700) 00010000:00010000:2.0:1787508703.694801:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5528000/0xb126349c40e9c2d4 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x11df:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa80a2d expref: 376 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.694811:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11df:0x0].0x0 (ffff9090c6406d00) 00010000:00010000:2.0:1787508703.695035:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5529800/0xb126349c40e9be89 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11de:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa808f9 expref: 375 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695047:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11de:0x0].0x0 (ffff9090d9d2bf00) 00010000:00010000:2.0:1787508703.695059:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5528400/0xb126349c40e9be27 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11dd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa808dd expref: 374 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695069:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11dd:0x0].0x0 (ffff9090c6406400) 00010000:00010000:2.0:1787508703.695080:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9cb3a00/0xb126349c40e9bdb7 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11dc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa808ba expref: 373 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695089:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11dc:0x0].0x0 (ffff9090cd810500) 00010000:00010000:2.0:1787508703.695099:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5528600/0xb126349c40e9bd40 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11db:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa80897 expref: 372 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695106:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11db:0x0].0x0 (ffff9090cd810600) 00010000:00010000:2.0:1787508703.695116:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5528200/0xb126349c40e9b68d lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x11da:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa806b4 expref: 371 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695128:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11da:0x0].0x0 (ffff9090cda8da00) 00010000:00010000:2.0:1787508703.695139:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c8307c00/0xb126349c40e9b218 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa80579 expref: 370 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695148:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11d9:0x0].0x0 (ffff9090ca4f9100) 00010000:00010000:2.0:1787508703.695159:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0f95a00/0xb126349c40e9b193 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11d8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa80548 expref: 369 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695167:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11d8:0x0].0x0 (ffff9090ceaf3600) 00010000:00010000:2.0:1787508703.695177:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c8306400/0xb126349c40e9b100 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11d7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa80525 expref: 368 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695187:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11d7:0x0].0x0 (ffff9090ca4f9800) 00010000:00010000:2.0:1787508703.695197:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091c0030e00/0xb126349c40e9b07b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa80509 expref: 367 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695205:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11d6:0x0].0x0 (ffff9090ca4f9a00) 00010000:00010000:2.0:1787508703.695214:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091ecbeb800/0xb126349c40e9a97b lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x11d5:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8031f expref: 366 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695222:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11d5:0x0].0x0 (ffff9090d9d2b400) 00010000:00010000:2.0:1787508703.695231:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ce7cd600/0xb126349c40e9a50d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa801e4 expref: 365 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695240:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11d4:0x0].0x0 (ffff9090ce111b00) 00010000:00010000:2.0:1787508703.695250:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ce7cd800/0xb126349c40e9a4ce lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11d3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa801cf expref: 364 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695259:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11d3:0x0].0x0 (ffff9090ce111400) 00010000:00010000:2.0:1787508703.695269:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ce7cca00/0xb126349c40e9a3fc lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11d2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa80189 expref: 363 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695279:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11d2:0x0].0x0 (ffff9091da051c00) 00010000:00010000:2.0:1787508703.695289:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5528e00/0xb126349c40e9a370 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa80166 expref: 362 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695298:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11d1:0x0].0x0 (ffff9091d43a5e00) 00010000:00010000:2.0:1787508703.695308:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cdb24e00/0xb126349c40e99ca1 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x11d0:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7ff7c expref: 361 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695321:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11d0:0x0].0x0 (ffff9090ce111300) 00010000:00010000:2.0:1787508703.695331:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c740ce00/0xb126349c40e98fb9 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11ce:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7fbd9 expref: 360 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695339:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11ce:0x0].0x0 (ffff9090ce111d00) 00010000:00010000:2.0:1787508703.695349:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e36cf800/0xb126349c40e98f50 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7fbb6 expref: 359 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695358:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11cd:0x0].0x0 (ffff9090c9a22000) 00010000:00010000:2.0:1787508703.695367:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3584600/0xb126349c40e98ecb lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11cc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7fb8c expref: 358 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695380:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11cc:0x0].0x0 (ffff9090cda8d600) 00010000:00010000:2.0:1787508703.695390:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ca69e800/0xb126349c40e98e3f lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11cb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7fb69 expref: 357 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695399:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11cb:0x0].0x0 (ffff9090c9a22e00) 00010000:00010000:2.0:1787508703.695409:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a31600/0xb126349c40e98777 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x11ca:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7f978 expref: 356 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695418:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11ca:0x0].0x0 (ffff9090c991f500) 00010000:00010000:2.0:1787508703.695429:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c740d000/0xb126349c40e98325 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7f852 expref: 355 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695438:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11c9:0x0].0x0 (ffff9090cd810c00) 00010000:00010000:2.0:1787508703.695448:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c740c200/0xb126349c40e982df lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11c8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7f83d expref: 354 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695458:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11c8:0x0].0x0 (ffff9090cd810f00) 00010000:00010000:2.0:1787508703.695468:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9cb2000/0xb126349c40e9825a lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11c7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7f80c expref: 353 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695476:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11c7:0x0].0x0 (ffff9090ceaf3500) 00010000:00010000:2.0:1787508703.695486:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c7ad8a00/0xb126349c40e9819d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11c6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7f7cd expref: 352 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695495:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11c6:0x0].0x0 (ffff9091cc215700) 00010000:00010000:2.0:1787508703.695505:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e340ec00/0xb126349c40e9766e lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7f4b6 expref: 351 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695513:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11c4:0x0].0x0 (ffff9090ce111500) 00010000:00010000:2.0:1787508703.695522:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cf775a00/0xb126349c40e97605 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11c3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7f4a1 expref: 350 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695530:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11c3:0x0].0x0 (ffff9090d1b2b400) 00010000:00010000:2.0:1787508703.695540:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a30200/0xb126349c40e9758e lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7f485 expref: 349 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695549:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11c2:0x0].0x0 (ffff9090cda8d000) 00010000:00010000:2.0:1787508703.695558:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a76000/0xb126349c40e9753a lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7f469 expref: 348 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695566:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11c1:0x0].0x0 (ffff9090d0fe0000) 00010000:00010000:2.0:1787508703.695576:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ca69ec00/0xb126349c40e9705c lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11c0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7f312 expref: 347 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695586:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11c0:0x0].0x0 (ffff9090cda8d300) 00010000:00010000:2.0:1787508703.695594:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ca69e200/0xb126349c40e96fec lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7f2ef expref: 346 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695603:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11bf:0x0].0x0 (ffff9090d3e9ac00) 00010000:00010000:2.0:1787508703.695614:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c7ad8e00/0xb126349c40e96f6e lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11be:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7f2c5 expref: 345 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695629:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11be:0x0].0x0 (ffff9090e465ec00) 00010000:00010000:2.0:1787508703.695640:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c7ad9000/0xb126349c40e96efe lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11bd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7f2a9 expref: 344 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695648:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11bd:0x0].0x0 (ffff9091d62ded00) 00010000:00010000:2.0:1787508703.695660:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c740dc00/0xb126349c40e96c1f lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11bb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7f1d0 expref: 343 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695669:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11bb:0x0].0x0 (ffff9090e465e500) 00010000:00010000:2.0:1787508703.695678:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c740c000/0xb126349c40e96bd2 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11ba:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7f1c2 expref: 342 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695687:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11ba:0x0].0x0 (ffff9091d62de400) 00010000:00010000:2.0:1787508703.695696:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d301b800/0xb126349c40e96b38 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11b9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7f1a6 expref: 341 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695704:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11b9:0x0].0x0 (ffff9091d62de600) 00010000:00010000:2.0:1787508703.695713:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a30c00/0xb126349c40e96ae4 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7f18a expref: 340 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695720:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11b8:0x0].0x0 (ffff9090d3e9a700) 00010000:00010000:2.0:1787508703.695732:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c740ca00/0xb126349c40e964b6 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11b6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7efa0 expref: 339 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695740:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11b6:0x0].0x0 (ffff9091da051200) 00010000:00010000:2.0:1787508703.695750:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d02afc00/0xb126349c40e9641c lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11b5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7ef8b expref: 338 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695758:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11b5:0x0].0x0 (ffff9090d0fe0300) 00010000:00010000:2.0:1787508703.695765:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ce7cc400/0xb126349c40e963c1 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11b4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7ef6f expref: 337 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695774:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11b4:0x0].0x0 (ffff9090d0fe0b00) 00010000:00010000:2.0:1787508703.695926:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ce7cdc00/0xb126349c40e9637b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7ef5a expref: 336 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.695938:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11b3:0x0].0x0 (ffff9090d0fe0e00) 00010000:00010000:2.0:1787508703.696034:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c740c600/0xb126349c40e95c51 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x11b2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7ed5b expref: 335 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696045:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11b2:0x0].0x0 (ffff9090cd810300) 00010000:00010000:2.0:1787508703.696056:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ce7cd000/0xb126349c40e95424 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x11b1:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7eaf3 expref: 334 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696065:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11b1:0x0].0x0 (ffff9090d9d2be00) 00010000:00010000:2.0:1787508703.696078:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e6fc0c00/0xb126349c40e947ac lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11af:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7e749 expref: 333 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696086:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11af:0x0].0x0 (ffff9090e4bab300) 00010000:00010000:2.0:1787508703.696096:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d301a200/0xb126349c40e94766 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11ae:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7e73b expref: 332 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696111:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11ae:0x0].0x0 (ffff9091deebb400) 00010000:00010000:2.0:1787508703.696121:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c7ad9600/0xb126349c40e946c5 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11ad:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7e71f expref: 331 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696132:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11ad:0x0].0x0 (ffff9090cd810b00) 00010000:00010000:2.0:1787508703.696142:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a31e00/0xb126349c40e94671 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11ac:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7e703 expref: 330 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696151:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11ac:0x0].0x0 (ffff9090e4bab100) 00010000:00010000:2.0:1787508703.696162:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ce7cc800/0xb126349c40e93f01 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x11ab:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7e4da expref: 329 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696171:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11ab:0x0].0x0 (ffff9090c9878200) 00010000:00010000:2.0:1787508703.696181:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ce7cc200/0xb126349c40e93b57 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11aa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7e3d0 expref: 328 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696191:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11aa:0x0].0x0 (ffff9090e36b9400) 00010000:00010000:2.0:1787508703.696202:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c7ad8600/0xb126349c40e93aaf lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11a9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7e3a6 expref: 327 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696210:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11a9:0x0].0x0 (ffff9090e4bab600) 00010000:00010000:2.0:1787508703.696220:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ce7cc000/0xb126349c40e93a00 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7e383 expref: 326 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696229:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11a8:0x0].0x0 (ffff9090e5bd2900) 00010000:00010000:2.0:1787508703.696240:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c7ad8c00/0xb126349c40e939ba lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11a7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7e36e expref: 325 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696250:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11a7:0x0].0x0 (ffff9090e4babd00) 00010000:00010000:2.0:1787508703.696260:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d301bc00/0xb126349c40e933e0 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7e1a0 expref: 324 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696269:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11a5:0x0].0x0 (ffff9090e4bab700) 00010000:00010000:2.0:1787508703.696279:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9cb3600/0xb126349c40e9332a lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11a4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7e16f expref: 323 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696287:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11a4:0x0].0x0 (ffff9090e36b9e00) 00010000:00010000:2.0:1787508703.696296:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3585a00/0xb126349c40e93282 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7e153 expref: 322 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696305:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11a3:0x0].0x0 (ffff9090c9878300) 00010000:00010000:2.0:1787508703.696314:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3584e00/0xb126349c40e9322e lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11a2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7e137 expref: 321 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696322:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11a2:0x0].0x0 (ffff9090c9878400) 00010000:00010000:2.0:1787508703.696330:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d301b600/0xb126349c40e92b6d lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x11a1:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7df4d expref: 320 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696338:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11a1:0x0].0x0 (ffff9090e4bab400) 00010000:00010000:2.0:1787508703.696348:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c7ad9400/0xb126349c40e92761 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x11a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7de35 expref: 319 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696361:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x11a0:0x0].0x0 (ffff9090e5bd2f00) 00010000:00010000:2.0:1787508703.696372:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c740d400/0xb126349c40e92729 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x119f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7de20 expref: 318 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696381:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x119f:0x0].0x0 (ffff9090e5bd2200) 00010000:00010000:2.0:1787508703.696389:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a31a00/0xb126349c40e9269d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x119e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7ddef expref: 317 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696399:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x119e:0x0].0x0 (ffff9091d43a5000) 00010000:00010000:2.0:1787508703.696410:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c740c400/0xb126349c40e925d2 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x119d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7ddb7 expref: 316 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696419:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x119d:0x0].0x0 (ffff9090c9878f00) 00010000:00010000:2.0:1787508703.696429:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c740cc00/0xb126349c40e91f11 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x119c:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7dbd4 expref: 315 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696438:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x119c:0x0].0x0 (ffff9090d0fe0200) 00010000:00010000:2.0:1787508703.696447:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cf775400/0xb126349c40e91af7 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x119b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7dab5 expref: 314 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696457:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x119b:0x0].0x0 (ffff9090c991f400) 00010000:00010000:2.0:1787508703.696468:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cdb25000/0xb126349c40e91a87 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x119a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7da8b expref: 313 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696477:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x119a:0x0].0x0 (ffff9090c991ff00) 00010000:00010000:2.0:1787508703.696487:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d301b400/0xb126349c40e919ed lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1199:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7da5a expref: 312 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696496:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1199:0x0].0x0 (ffff9090e36b9f00) 00010000:00010000:2.0:1787508703.696508:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d301ac00/0xb126349c40e91961 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1198:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7da30 expref: 311 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696517:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1198:0x0].0x0 (ffff9090d0fe0600) 00010000:00010000:2.0:1787508703.696528:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c740de00/0xb126349c40e90ec5 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1196:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7d72e expref: 310 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696537:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1196:0x0].0x0 (ffff9090e465e800) 00010000:00010000:2.0:1787508703.696548:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a30000/0xb126349c40e90de5 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1195:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7d6ef expref: 309 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696557:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1195:0x0].0x0 (ffff9090e465e900) 00010000:00010000:2.0:1787508703.696568:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c8af0e00/0xb126349c40e90d3d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7d6d3 expref: 308 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696577:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1194:0x0].0x0 (ffff9091c8d58f00) 00010000:00010000:2.0:1787508703.696587:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e6fc1200/0xb126349c40e90ce9 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1193:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7d6b7 expref: 307 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696595:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1193:0x0].0x0 (ffff9090ceaf3a00) 00010000:00010000:2.0:1787508703.696604:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e6fc1600/0xb126349c40e906b4 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1191:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7d4cd expref: 306 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696617:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1191:0x0].0x0 (ffff9090ceaf3000) 00010000:00010000:2.0:1787508703.696626:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e6fc0a00/0xb126349c40e9064b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7d4bf expref: 305 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696634:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1190:0x0].0x0 (ffff9090ce8a2600) 00010000:00010000:2.0:1787508703.696643:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d301ba00/0xb126349c40e905c6 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x118f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7d4a3 expref: 304 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696651:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x118f:0x0].0x0 (ffff9090e465ef00) 00010000:00010000:2.0:1787508703.696661:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cc80f600/0xb126349c40e90572 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x118e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7d487 expref: 303 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696670:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x118e:0x0].0x0 (ffff9090e465e400) 00010000:00010000:2.0:1787508703.696680:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3584c00/0xb126349c40e8fe95 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x118d:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7d28f expref: 302 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696688:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x118d:0x0].0x0 (ffff9090e465ed00) 00010000:00010000:2.0:1787508703.696697:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d02af000/0xb126349c40e8f286 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x118b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7cf24 expref: 301 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696706:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x118b:0x0].0x0 (ffff9091fde57000) 00010000:00010000:2.0:1787508703.696715:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cc80e600/0xb126349c40e8f22b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x118a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7cf01 expref: 300 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696724:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x118a:0x0].0x0 (ffff9091fde57b00) 00010000:00010000:2.0:1787508703.696733:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3584a00/0xb126349c40e8f19f lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1189:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7ced0 expref: 299 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696741:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1189:0x0].0x0 (ffff9090d3e9a500) 00010000:00010000:2.0:1787508703.696750:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cc80fc00/0xb126349c40e8f0f7 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1188:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7ce98 expref: 298 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696758:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1188:0x0].0x0 (ffff9090d3e9aa00) 00010000:00010000:2.0:1787508703.696765:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090da371e00/0xb126349c40e8e9e9 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1187:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7cca0 expref: 297 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.696774:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1187:0x0].0x0 (ffff9090c9878800) 00010000:00010000:2.0:1787508703.696933:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9c6ea00/0xb126349c40e8e5ac lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1186:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7cb65 expref: 296 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697013:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1186:0x0].0x0 (ffff9090c9878500) 00010000:00010000:2.0:1787508703.697027:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cda83000/0xb126349c40e8e54a lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1185:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7cb57 expref: 295 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697035:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1185:0x0].0x0 (ffff9090d218e200) 00010000:00010000:2.0:1787508703.697046:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c8af0c00/0xb126349c40e8e4c5 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1184:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7cb3b expref: 294 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697055:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1184:0x0].0x0 (ffff9090e465ee00) 00010000:00010000:2.0:1787508703.697064:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cdb24400/0xb126349c40e8e471 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7cb1f expref: 293 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697076:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1183:0x0].0x0 (ffff9090e465e100) 00010000:00010000:2.0:1787508703.697086:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d02aec00/0xb126349c40e8ddb7 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1182:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7c92e expref: 292 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697094:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1182:0x0].0x0 (ffff9090cf431d00) 00010000:00010000:2.0:1787508703.697104:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e6fc1e00/0xb126349c40e8d9dc lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1181:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7c808 expref: 291 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697111:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1181:0x0].0x0 (ffff9090d218e100) 00010000:00010000:2.0:1787508703.697122:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d7f7ea00/0xb126349c40e8d8ee lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1180:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7c7d0 expref: 290 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697131:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1180:0x0].0x0 (ffff9090c9878e00) 00010000:00010000:2.0:1787508703.697141:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090da370400/0xb126349c40e8d84d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x117f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7c7b4 expref: 289 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697149:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x117f:0x0].0x0 (ffff9090ca4f9400) 00010000:00010000:2.0:1787508703.697159:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3585400/0xb126349c40e8d7f9 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x117e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7c798 expref: 288 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697168:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x117e:0x0].0x0 (ffff9090c9878c00) 00010000:00010000:2.0:1787508703.697183:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d54e4400/0xb126349c40e8d074 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x117d:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7c56f expref: 287 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697193:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x117d:0x0].0x0 (ffff9090e36b9500) 00010000:00010000:2.0:1787508703.697202:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c99e6e00/0xb126349c40e8cbff lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x117c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7c41f expref: 286 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697211:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x117c:0x0].0x0 (ffff9090cc80b100) 00010000:00010000:2.0:1787508703.697221:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ca69e000/0xb126349c40e8cb81 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x117b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7c3fc expref: 285 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697230:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x117b:0x0].0x0 (ffff9091d39d2000) 00010000:00010000:2.0:1787508703.697241:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9815400/0xb126349c40e8cacb lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x117a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7c3e0 expref: 284 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697251:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x117a:0x0].0x0 (ffff9090e36b9800) 00010000:00010000:2.0:1787508703.697260:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5dd8e00/0xb126349c40e8ca77 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1179:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7c3c4 expref: 283 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697271:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1179:0x0].0x0 (ffff9090d38d0500) 00010000:00010000:2.0:1787508703.697280:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9815800/0xb126349c40e8c35b lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1178:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7c1be expref: 282 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697287:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1178:0x0].0x0 (ffff9090cd063e00) 00010000:00010000:2.0:1787508703.697300:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a77000/0xb126349c40e8bf1e lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1177:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7c091 expref: 281 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697309:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1177:0x0].0x0 (ffff9090cd063f00) 00010000:00010000:2.0:1787508703.697318:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9815200/0xb126349c40e8bebc lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1176:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7c067 expref: 280 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697330:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1176:0x0].0x0 (ffff9090cc78b700) 00010000:00010000:2.0:1787508703.697339:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e3b19a00/0xb126349c40e8be5a lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1175:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7c04b expref: 279 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697347:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1175:0x0].0x0 (ffff9090cc78b100) 00010000:00010000:2.0:1787508703.697356:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9814a00/0xb126349c40e8bd9d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1174:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7c013 expref: 278 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697366:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1174:0x0].0x0 (ffff9091cc215600) 00010000:00010000:2.0:1787508703.697378:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9814400/0xb126349c40e8b6a4 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1173:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7be29 expref: 277 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697387:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1173:0x0].0x0 (ffff9091cc251f00) 00010000:00010000:2.0:1787508703.697397:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cc80ee00/0xb126349c40e8ae8c lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1172:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7bbcf expref: 276 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697408:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1172:0x0].0x0 (ffff9090cf0bfe00) 00010000:00010000:2.0:1787508703.697418:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e6fc1a00/0xb126349c40e8aa17 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1171:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7ba78 expref: 275 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697427:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1171:0x0].0x0 (ffff9090d1ceed00) 00010000:00010000:2.0:1787508703.697437:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ca69f600/0xb126349c40e8a96f lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1170:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7ba4e expref: 274 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697445:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1170:0x0].0x0 (ffff9090cd063000) 00010000:00010000:2.0:1787508703.697457:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ca69ee00/0xb126349c40e8a8ce lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x116f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7ba32 expref: 273 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697465:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x116f:0x0].0x0 (ffff9090cd063500) 00010000:00010000:2.0:1787508703.697475:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d7f7e000/0xb126349c40e8a87a lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x116e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7ba16 expref: 272 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697483:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x116e:0x0].0x0 (ffff9091deebc000) 00010000:00010000:2.0:1787508703.697494:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e6fc0000/0xb126349c40e89d75 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x116c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7b6e3 expref: 271 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697502:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x116c:0x0].0x0 (ffff9090ced0e600) 00010000:00010000:2.0:1787508703.697511:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ca69e400/0xb126349c40e89cb8 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x116b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7b6ab expref: 270 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697518:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x116b:0x0].0x0 (ffff9090c6946900) 00010000:00010000:2.0:1787508703.697528:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cc80ea00/0xb126349c40e89c02 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x116a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7b68f expref: 269 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697537:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x116a:0x0].0x0 (ffff9090ced0ec00) 00010000:00010000:2.0:1787508703.697546:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cc80e200/0xb126349c40e89bae lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1169:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7b673 expref: 268 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697554:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1169:0x0].0x0 (ffff9090c6946d00) 00010000:00010000:2.0:1787508703.697563:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e6fc1800/0xb126349c40e8946f lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1168:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7b474 expref: 267 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697575:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1168:0x0].0x0 (ffff9090ca4f9900) 00010000:00010000:2.0:1787508703.697585:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ca69f400/0xb126349c40e88477 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1166:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7afc0 expref: 266 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697594:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1166:0x0].0x0 (ffff9090d218e500) 00010000:00010000:2.0:1787508703.697602:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ce26a000/0xb126349c40e87c27 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1165:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7ad4a expref: 265 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697609:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1165:0x0].0x0 (ffff9090c6946f00) 00010000:00010000:2.0:1787508703.697618:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e340e800/0xb126349c40e877ea lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1164:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7ac2b expref: 264 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697626:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1164:0x0].0x0 (ffff9091da051600) 00010000:00010000:2.0:1787508703.697636:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d54e4000/0xb126349c40e87796 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1163:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7ac0f expref: 263 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697645:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1163:0x0].0x0 (ffff9092021f2800) 00010000:00010000:2.0:1787508703.697654:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e340e000/0xb126349c40e8770a lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1162:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7abde expref: 262 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697663:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1162:0x0].0x0 (ffff9090c984d000) 00010000:00010000:2.0:1787508703.697674:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ca69f800/0xb126349c40e8764d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1161:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7aba6 expref: 261 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697682:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1161:0x0].0x0 (ffff9091d2128f00) 00010000:00010000:2.0:1787508703.697691:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d02afe00/0xb126349c40e87096 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x115f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7a9f4 expref: 260 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697700:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x115f:0x0].0x0 (ffff9091deebb500) 00010000:00010000:2.0:1787508703.697710:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091e6a2b800/0xb126349c40e86fee lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x115e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7a9c3 expref: 259 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697717:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x115e:0x0].0x0 (ffff9090ce8a2200) 00010000:00010000:2.0:1787508703.697726:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9814000/0xb126349c40e86f8c lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x115d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7a9b5 expref: 258 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697735:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x115d:0x0].0x0 (ffff9090d751c800) 00010000:00010000:2.0:1787508703.697746:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d54e5600/0xb126349c40e86f1c lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x115c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7a992 expref: 257 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697755:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x115c:0x0].0x0 (ffff9092021f2300) 00010000:00010000:2.0:1787508703.697765:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d554fa00/0xb126349c40e86800 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x115b:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7a793 expref: 256 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697773:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x115b:0x0].0x0 (ffff9090c984dd00) 00010000:00010000:2.0:1787508703.697918:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d7f7f600/0xb126349c40e8638b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x115a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7a658 expref: 255 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.697931:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x115a:0x0].0x0 (ffff9090c984db00) 00010000:00010000:2.0:1787508703.698022:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ca69fa00/0xb126349c40e86337 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1159:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7a63c expref: 254 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.698037:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1159:0x0].0x0 (ffff9090e36b9600) 00010000:00010000:2.0:1787508703.698049:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a77200/0xb126349c40e8629d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1158:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7a604 expref: 253 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.698058:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1158:0x0].0x0 (ffff9090e36b9300) 00010000:00010000:2.0:1787508703.698070:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a77800/0xb126349c40e861e0 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1157:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7a5cc expref: 252 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.698080:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1157:0x0].0x0 (ffff9090d38d0900) 00010000:00010000:2.0:1787508703.698090:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e3b18000/0xb126349c40e85abd lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1156:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7a3d4 expref: 251 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.698101:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1156:0x0].0x0 (ffff9090cf431600) 00010000:00010000:2.0:1787508703.698115:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9815a00/0xb126349c40e8566b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1155:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7a2a7 expref: 250 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.698124:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1155:0x0].0x0 (ffff9091f95c0400) 00010000:00010000:2.0:1787508703.698134:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d02afa00/0xb126349c40e85609 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1154:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7a284 expref: 249 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.698143:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1154:0x0].0x0 (ffff9091d2a7e800) 00010000:00010000:2.0:1787508703.698152:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e340fe00/0xb126349c40e855a0 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1153:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7a261 expref: 248 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.698161:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1153:0x0].0x0 (ffff9091d2a7ea00) 00010000:00010000:2.0:1787508703.698171:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e340f000/0xb126349c40e854e3 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1152:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7a222 expref: 247 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.698180:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1152:0x0].0x0 (ffff9090c96b8800) 00010000:00010000:2.0:1787508703.698192:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a76c00/0xb126349c40e84eb5 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1150:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7a05b expref: 246 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.698201:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1150:0x0].0x0 (ffff9091d43a5800) 00010000:00010000:2.0:1787508703.698211:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091ecbea000/0xb126349c40e84e53 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x114f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7a04d expref: 245 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.698219:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x114f:0x0].0x0 (ffff9090c96b8200) 00010000:00010000:2.0:1787508703.698229:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9815e00/0xb126349c40e84dc7 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x114e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7a031 expref: 244 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.698236:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x114e:0x0].0x0 (ffff9090d08ec300) 00010000:00010000:2.0:1787508703.698246:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d02ae000/0xb126349c40e84d6c lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x114d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7a00e expref: 243 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.698254:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x114d:0x0].0x0 (ffff9090d08ec900) 00010000:00010000:2.0:1787508703.698265:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d7f7ee00/0xb126349c40e83f2d lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x114b:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa79bed expref: 242 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.698275:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x114b:0x0].0x0 (ffff9090cc78b600) 00010000:00010000:2.0:1787508703.698284:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c99e6200/0xb126349c40e83acd lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x114a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa79ac0 expref: 241 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.698297:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x114a:0x0].0x0 (ffff9091d213fa00) 00010000:00010000:2.0:1787508703.698306:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d554e000/0xb126349c40e83a64 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1149:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa79a96 expref: 240 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.698313:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1149:0x0].0x0 (ffff9090d751cd00) 00010000:00010000:2.0:1787508703.698318:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508703.698389:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9f18450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+239:288263:x1874324509602432:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 10757us (14139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508703.698399:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9806 00000100:00100000:1.0:1787508703.700307:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508703.700388:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509602560 00000100:00100000:2.0:1787508703.700397:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509602560 00000100:00100000:2.0:1787508703.700449:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9807 00000100:00100000:2.0:1787508703.700460:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9f18c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+599:287589:x1874324509602560:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508703.700474:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 409 locks, starting at 0 00010000:00010000:2.0:1787508703.700499:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cda82000/0xb126349c40e16e19 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xe82:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa58f64 expref: 599 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.700521:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce8ece00/0xb126349c40e16b4f lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0xe82:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa58f41 expref: 598 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.700533:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xe82:0x0].0x0 (ffff9090cc78b300) 00010000:00010000:2.0:1787508703.700548:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5dd8a00/0xb126349c40cd64e0 lrc: 0/0,0 mode: --/PR res: [0x2000013a0:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa2a248 expref: 597 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.700564:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0xb:0x0].0x0 (ffff9091d43a5c00) 00010000:00010000:2.0:1787508703.700576:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35203 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7ba expref: 596 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.700585:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508703.700593:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f3521f lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7c1 expref: 595 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.700604:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d6:0x0].0x0 (ffff9090ca4e2300) 00010000:00010000:2.0:1787508703.700613:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7c00/0xb126349c40f35123 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae76d expref: 594 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.700625:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7600/0xb126349c40f35162 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1263:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae782 expref: 593 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.700634:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1263:0x0].0x0 (ffff9091d43a5300) 00010000:00010000:2.0:1787508703.700645:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3509e lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1260:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae73c expref: 592 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.700672:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35074 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae727 expref: 591 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.700687:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f34ff6 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6f6 expref: 590 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.700697:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35035 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1260:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae70b expref: 589 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.700710:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1260:0x0].0x0 (ffff9090d171f300) 00010000:00010000:2.0:1787508703.700721:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6800/0xb126349c40f34f7f lrc: 0/0,0 mode: --/CW res: [0x2000013a3:0x555:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6c5 expref: 588 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.700732:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f34fa2 lrc: 0/0,0 mode: --/CR res: [0x2000013a3:0x555:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6d3 expref: 587 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.700743:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f34f94 lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x555:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae6cc expref: 586 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.700749:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a3:0x555:0x0].0x0 (ffff9090d36fd500) 00010000:00010000:2.0:1787508703.700759:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7e00/0xb126349c40f34e2f lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae65c expref: 585 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.700766:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125d:0x0].0x0 (ffff9090ccb87100) 00010000:00010000:2.0:1787508703.700772:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6c00/0xb126349c40f34dc6 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x125e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae639 expref: 584 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.701118:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125e:0x0].0x0 (ffff9090c6913600) 00010000:00010000:2.0:1787508703.701138:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f34d2c lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x125d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae608 expref: 583 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.701149:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x125d:0x0].0x0 (ffff9090ccb87100) 00010000:00010000:2.0:1787508703.701160:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22eca00/0xb126349c40ec7f7c lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1164:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8d152 expref: 582 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.701174:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1164:0x0].0x0 (ffff9090d2273600) 00010000:00010000:2.0:1787508703.701185:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c67d5800/0xb126349c40ec7ef0 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1163:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8d12f expref: 581 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.701194:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1163:0x0].0x0 (ffff9090ce8a2c00) 00010000:00010000:2.0:1787508703.701204:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ecc00/0xb126349c40ec7e4f lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1162:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8d0f0 expref: 580 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.701213:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1162:0x0].0x0 (ffff9090d6c69600) 00010000:00010000:2.0:1787508703.701226:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e35b8600/0xb126349c40ec7d5a lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1161:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8d0b1 expref: 579 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.701237:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1161:0x0].0x0 (ffff9090cda8a800) 00010000:00010000:2.0:1787508703.701247:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40ec66fc lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x115e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8ca67 expref: 578 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.701256:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x115e:0x0].0x0 (ffff9090d751c700) 00010000:00010000:2.0:1787508703.701265:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3ee5e00/0xb126349c40ec66a8 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x115d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8ca4b expref: 577 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.701273:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x115d:0x0].0x0 (ffff9090d6195400) 00010000:00010000:2.0:1787508703.701286:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3ee5a00/0xb126349c40ec6631 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x115c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8ca21 expref: 576 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.701293:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x115c:0x0].0x0 (ffff9090d6195d00) 00010000:00010000:2.0:1787508703.701303:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40ec6558 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x115b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8c9db expref: 575 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.701313:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x115b:0x0].0x0 (ffff9090d6195e00) 00010000:00010000:2.0:1787508703.701322:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9ccb400/0xb126349c40ec5eb3 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1159:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8c7f8 expref: 574 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.701330:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1159:0x0].0x0 (ffff9090cda8ab00) 00010000:00010000:2.0:1787508703.701340:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40ec5e4a lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1158:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8c7e3 expref: 573 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.701348:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1158:0x0].0x0 (ffff9090d9e7b100) 00010000:00010000:2.0:1787508703.701358:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40ec5de1 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1157:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8c7ce expref: 572 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.701367:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1157:0x0].0x0 (ffff9090d9e7b000) 00010000:00010000:2.0:1787508703.701377:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d54e5c00/0xb126349c40ec5d8d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1156:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8c7b2 expref: 571 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.701385:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1156:0x0].0x0 (ffff9090cbeafc00) 00010000:00010000:2.0:1787508703.701396:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9ccae00/0xb126349c40ec528f lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1154:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8c486 expref: 570 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.701405:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1154:0x0].0x0 (ffff9090d171f200) 00010000:00010000:2.0:1787508703.701414:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34b1600/0xb126349c40ec5193 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1153:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8c447 expref: 569 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.701427:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1153:0x0].0x0 (ffff9090d6195200) 00010000:00010000:2.0:1787508703.701439:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0149e00/0xb126349c40ec50f2 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1152:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8c42b expref: 568 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.701449:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1152:0x0].0x0 (ffff9090d6195f00) 00010000:00010000:2.0:1787508703.701461:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34b1800/0xb126349c40ec509e lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1151:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8c40f expref: 567 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.701470:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1151:0x0].0x0 (ffff9091d213fc00) 00010000:00010000:2.0:1787508703.701480:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f6a00/0xb126349c40ec4529 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x114f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8c0c7 expref: 566 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.701488:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x114f:0x0].0x0 (ffff9090ce7ba000) 00010000:00010000:2.0:1787508703.701497:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d56f7000/0xb126349c40ec448f lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x114e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8c0b2 expref: 565 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.701506:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x114e:0x0].0x0 (ffff9090cd6a4600) 00010000:00010000:2.0:1787508703.701543:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40ec441f lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x114d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8c08f expref: 564 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.701554:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x114d:0x0].0x0 (ffff9090d751c200) 00010000:00010000:2.0:1787508703.701564:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d20e3800/0xb126349c40ec43ee lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x114c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8c081 expref: 563 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.701574:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x114c:0x0].0x0 (ffff9090d0fe0d00) 00010000:00010000:2.0:1787508703.701587:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34b1a00/0xb126349c40ec38e9 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x114a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8bd71 expref: 562 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.701595:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x114a:0x0].0x0 (ffff9091d43a5600) 00010000:00010000:2.0:1787508703.701607:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d4492800/0xb126349c40ec386b lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1149:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8bd40 expref: 561 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.701616:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1149:0x0].0x0 (ffff9090c5b0c600) 00010000:00010000:2.0:1787508703.701626:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9ccbc00/0xb126349c40ec3810 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1148:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8bd24 expref: 560 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.701635:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1148:0x0].0x0 (ffff9090cd810200) 00010000:00010000:2.0:1787508703.701647:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34b1e00/0xb126349c40ec370d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1147:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8bcde expref: 559 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.701725:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1147:0x0].0x0 (ffff9090d6194600) 00010000:00010000:2.0:1787508703.701745:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d20e2c00/0xb126349c40ec3030 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1145:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8baca expref: 558 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.701754:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1145:0x0].0x0 (ffff9090c5b0c700) 00010000:00010000:2.0:1787508703.701764:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d20e2600/0xb126349c40ec2f57 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1144:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8baa7 expref: 557 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.701772:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1144:0x0].0x0 (ffff9090c5b9e400) 00010000:00010000:2.0:1787508703.701923:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9ccb800/0xb126349c40ec2f11 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1143:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8ba8b expref: 556 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702060:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1143:0x0].0x0 (ffff9090ca4e2c00) 00010000:00010000:2.0:1787508703.702078:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d20e2200/0xb126349c40ec2ecb lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1142:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8ba76 expref: 555 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702088:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1142:0x0].0x0 (ffff9090c5b9ee00) 00010000:00010000:2.0:1787508703.702098:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1557400/0xb126349c40ec23bf lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1140:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8b75f expref: 554 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702109:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1140:0x0].0x0 (ffff9090d9e7b400) 00010000:00010000:2.0:1787508703.702121:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d37cde00/0xb126349c40ec236b lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x113f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8b743 expref: 553 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702132:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x113f:0x0].0x0 (ffff9090d171f000) 00010000:00010000:2.0:1787508703.702142:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22caa00/0xb126349c40ec22df lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x113e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8b70b expref: 552 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702152:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x113e:0x0].0x0 (ffff9090d2273500) 00010000:00010000:2.0:1787508703.702185:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1c25000/0xb126349c40ec21dc lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x113d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8b6c5 expref: 551 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702196:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x113d:0x0].0x0 (ffff9090c6987400) 00010000:00010000:2.0:1787508703.702208:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e343b600/0xb126349c40ec166e lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x113b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8b399 expref: 550 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702216:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x113b:0x0].0x0 (ffff9090d6c66e00) 00010000:00010000:2.0:1787508703.702228:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d4104600/0xb126349c40ec160c lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x113a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8b376 expref: 549 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702237:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x113a:0x0].0x0 (ffff9090cbeaee00) 00010000:00010000:2.0:1787508703.702246:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d37cd200/0xb126349c40ec1580 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1139:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8b345 expref: 548 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702255:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1139:0x0].0x0 (ffff9090d6195000) 00010000:00010000:2.0:1787508703.702264:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e35b9000/0xb126349c40ec1492 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1138:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8b306 expref: 547 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702272:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1138:0x0].0x0 (ffff9090d6c66b00) 00010000:00010000:2.0:1787508703.702282:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9dc2000/0xb126349c40ec0d6f lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1136:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8b0e4 expref: 546 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702291:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1136:0x0].0x0 (ffff9090cd6a4f00) 00010000:00010000:2.0:1787508703.702315:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3585000/0xb126349c40ec0d14 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1135:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8b0d6 expref: 545 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702324:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1135:0x0].0x0 (ffff9090d2273200) 00010000:00010000:2.0:1787508703.702332:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9ccba00/0xb126349c40ec0c88 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1134:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8b0b3 expref: 544 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702340:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1134:0x0].0x0 (ffff9090cd6a4700) 00010000:00010000:2.0:1787508703.702349:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9ccbe00/0xb126349c40ec0c42 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1133:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8b09e expref: 543 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702362:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1133:0x0].0x0 (ffff9090cd6a4100) 00010000:00010000:2.0:1787508703.702371:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5473a00/0xb126349c40ec018a lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1131:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8ad95 expref: 542 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702380:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1131:0x0].0x0 (ffff9090d6c66800) 00010000:00010000:2.0:1787508703.702389:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5472800/0xb126349c40ec0105 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1130:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8ad5d expref: 541 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702398:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1130:0x0].0x0 (ffff9090d0b35700) 00010000:00010000:2.0:1787508703.702408:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9ccb200/0xb126349c40ebffd8 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x112f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8ad1e expref: 540 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702415:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x112f:0x0].0x0 (ffff9090cd6a4b00) 00010000:00010000:2.0:1787508703.702423:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1c24000/0xb126349c40ebff76 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x112e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8ad02 expref: 539 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702433:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x112e:0x0].0x0 (ffff9090cd6a4900) 00010000:00010000:2.0:1787508703.702457:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cf775800/0xb126349c40ebf432 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x112c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8a9cf expref: 538 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702467:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x112c:0x0].0x0 (ffff9090ce7ba400) 00010000:00010000:2.0:1787508703.702477:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3c00/0xb126349c40ebf3e5 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x112b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8a9b3 expref: 537 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702486:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x112b:0x0].0x0 (ffff9090d9d2b800) 00010000:00010000:2.0:1787508703.702498:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a3a400/0xb126349c40ebf360 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x112a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8a982 expref: 536 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702512:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x112a:0x0].0x0 (ffff9090ce78a800) 00010000:00010000:2.0:1787508703.702525:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cbcbb800/0xb126349c40ebf25d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1129:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8a93c expref: 535 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702536:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1129:0x0].0x0 (ffff9090ce78a700) 00010000:00010000:2.0:1787508703.702545:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d37cc200/0xb126349c40ebeb56 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1127:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8a728 expref: 534 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702555:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1127:0x0].0x0 (ffff9090d9e7be00) 00010000:00010000:2.0:1787508703.702564:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5472c00/0xb126349c40ebead1 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1126:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8a713 expref: 533 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702573:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1126:0x0].0x0 (ffff9090c5b0c400) 00010000:00010000:2.0:1787508703.702582:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5473c00/0xb126349c40ebea68 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1125:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8a6fe expref: 532 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702590:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1125:0x0].0x0 (ffff9090cda8a200) 00010000:00010000:2.0:1787508703.702600:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5473000/0xb126349c40ebea14 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1124:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8a6e2 expref: 531 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702609:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1124:0x0].0x0 (ffff9090c5b9e300) 00010000:00010000:2.0:1787508703.702619:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9ef8400/0xb126349c40ebe505 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1123:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8a57d expref: 530 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702633:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1123:0x0].0x0 (ffff9090cda8a000) 00010000:00010000:2.0:1787508703.702644:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3400/0xb126349c40ebe4b8 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1122:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8a561 expref: 529 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702733:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1122:0x0].0x0 (ffff9090c6a3a400) 00010000:00010000:2.0:1787508703.702753:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9ef8000/0xb126349c40ebe417 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1121:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8a529 expref: 528 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702763:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1121:0x0].0x0 (ffff9090d9e7a000) 00010000:00010000:2.0:1787508703.702775:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d4104c00/0xb126349c40ebe35a lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1120:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8a4f1 expref: 527 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702834:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1120:0x0].0x0 (ffff9090cda8a500) 00010000:00010000:2.0:1787508703.702847:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cbcba600/0xb126349c40ebe027 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x111e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8a3f5 expref: 526 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702857:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x111e:0x0].0x0 (ffff9090cc98bf00) 00010000:00010000:2.0:1787508703.702868:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e35b8c00/0xb126349c40ebdf78 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x111d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8a3d2 expref: 525 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702878:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x111d:0x0].0x0 (ffff9090cda8a100) 00010000:00010000:2.0:1787508703.702888:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e35b9200/0xb126349c40ebdec9 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x111c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8a3af expref: 524 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702897:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x111c:0x0].0x0 (ffff9090cc98b100) 00010000:00010000:2.0:1787508703.702919:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1c24a00/0xb126349c40ebde83 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x111b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8a39a expref: 523 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.702930:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x111b:0x0].0x0 (ffff9090c6a3b500) 00010000:00010000:2.0:1787508703.703010:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5472a00/0xb126349c40ebd3a1 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1119:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8a098 expref: 522 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703021:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1119:0x0].0x0 (ffff9090d9e7aa00) 00010000:00010000:2.0:1787508703.703032:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9ef8e00/0xb126349c40ebd362 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1118:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8a083 expref: 521 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703041:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1118:0x0].0x0 (ffff9090d6195700) 00010000:00010000:2.0:1787508703.703051:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ca69ea00/0xb126349c40ebd2cf lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1117:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8a04b expref: 520 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703060:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1117:0x0].0x0 (ffff9090d6195c00) 00010000:00010000:2.0:1787508703.703069:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d554f800/0xb126349c40ebd1d3 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1116:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8a005 expref: 519 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703078:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1116:0x0].0x0 (ffff9090c5b0cb00) 00010000:00010000:2.0:1787508703.703090:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9dc2a00/0xb126349c40ebc745 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1114:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa89d11 expref: 518 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703101:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1114:0x0].0x0 (ffff9090cbeaf700) 00010000:00010000:2.0:1787508703.703111:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d37cd400/0xb126349c40ebc6c0 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1113:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa89ce0 expref: 517 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703125:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1113:0x0].0x0 (ffff9090d6195800) 00010000:00010000:2.0:1787508703.703140:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9dc3a00/0xb126349c40ebc5c4 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1112:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa89c9a expref: 516 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703149:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1112:0x0].0x0 (ffff9090d171f800) 00010000:00010000:2.0:1787508703.703159:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9ef8a00/0xb126349c40ebc51c lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1111:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa89c77 expref: 515 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703168:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1111:0x0].0x0 (ffff9090c6a3a900) 00010000:00010000:2.0:1787508703.703180:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9dc3e00/0xb126349c40ebb9f4 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x110f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa89936 expref: 514 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703189:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x110f:0x0].0x0 (ffff9090cc98b600) 00010000:00010000:2.0:1787508703.703201:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d4493400/0xb126349c40ebb937 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x110e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8990c expref: 513 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703214:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x110e:0x0].0x0 (ffff9090ce7f6b00) 00010000:00010000:2.0:1787508703.703230:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a2a00/0xb126349c40ebb896 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x110d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa898f0 expref: 512 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703242:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x110d:0x0].0x0 (ffff9090cbeaf000) 00010000:00010000:2.0:1787508703.703255:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3a00/0xb126349c40ebb842 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x110c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa898d4 expref: 511 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703265:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x110c:0x0].0x0 (ffff9090cbeaf500) 00010000:00010000:2.0:1787508703.703276:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1c24c00/0xb126349c40ebae01 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x110a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa895fc expref: 510 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703287:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x110a:0x0].0x0 (ffff9090cbeae300) 00010000:00010000:2.0:1787508703.703298:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d37cc400/0xb126349c40ebadad lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1109:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa895d9 expref: 509 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703308:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1109:0x0].0x0 (ffff9090cbeae700) 00010000:00010000:2.0:1787508703.703318:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d4492000/0xb126349c40ebad2f lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1108:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa895af expref: 508 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703328:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1108:0x0].0x0 (ffff9090cbeaeb00) 00010000:00010000:2.0:1787508703.703340:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d4493200/0xb126349c40ebac41 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1107:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa89570 expref: 507 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703349:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1107:0x0].0x0 (ffff9090cc98ba00) 00010000:00010000:2.0:1787508703.703360:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0a00/0xb126349c40eba659 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1105:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa893b7 expref: 506 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703371:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1105:0x0].0x0 (ffff9090c6913e00) 00010000:00010000:2.0:1787508703.703381:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d4493c00/0xb126349c40eba5e2 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1104:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8938d expref: 505 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703391:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1104:0x0].0x0 (ffff9090d9d2b700) 00010000:00010000:2.0:1787508703.703401:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948c800/0xb126349c40eba59c lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1103:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa89378 expref: 504 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703416:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1103:0x0].0x0 (ffff9090c6913700) 00010000:00010000:2.0:1787508703.703426:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d4492200/0xb126349c40eba4ae lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1102:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa89339 expref: 503 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703435:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1102:0x0].0x0 (ffff9090cbeae000) 00010000:00010000:2.0:1787508703.703445:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e35b8800/0xb126349c40eb9ded lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1100:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8913a expref: 502 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703455:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1100:0x0].0x0 (ffff9090c6987200) 00010000:00010000:2.0:1787508703.703465:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d4104000/0xb126349c40eb9d92 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10ff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8912c expref: 501 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703474:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10ff:0x0].0x0 (ffff9090c6987800) 00010000:00010000:2.0:1787508703.703485:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e35b8e00/0xb126349c40eb9d0d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa89110 expref: 500 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703494:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10fe:0x0].0x0 (ffff9090c6913300) 00010000:00010000:2.0:1787508703.703505:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1c25400/0xb126349c40eb9cb9 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10fd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa890f4 expref: 499 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703516:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10fd:0x0].0x0 (ffff9090c6913b00) 00010000:00010000:2.0:1787508703.703526:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5dd9200/0xb126349c40eb9400 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10fb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa88e7e expref: 498 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703537:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10fb:0x0].0x0 (ffff9090d6194800) 00010000:00010000:2.0:1787508703.703552:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1c24400/0xb126349c40eb93ac lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10fa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa88e62 expref: 497 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703561:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10fa:0x0].0x0 (ffff9090cc98b900) 00010000:00010000:2.0:1787508703.703571:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5472200/0xb126349c40eb9320 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa88e31 expref: 496 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703581:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10f9:0x0].0x0 (ffff9090cc98b400) 00010000:00010000:2.0:1787508703.703591:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e61c2600/0xb126349c40eb925c lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10f8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa88df2 expref: 495 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703601:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10f8:0x0].0x0 (ffff9090d6c66000) 00010000:00010000:2.0:1787508703.703611:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1c25e00/0xb126349c40eb871f lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10f6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa88ae9 expref: 494 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703619:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10f6:0x0].0x0 (ffff9090d6194c00) 00010000:00010000:2.0:1787508703.703628:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d4105800/0xb126349c40eb86a1 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10f5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa88ab8 expref: 493 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703636:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10f5:0x0].0x0 (ffff9090d6194a00) 00010000:00010000:2.0:1787508703.703644:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d4492a00/0xb126349c40eb85a5 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa88a72 expref: 492 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703665:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10f4:0x0].0x0 (ffff9090d54dba00) 00010000:00010000:2.0:1787508703.703679:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1c25200/0xb126349c40eb8504 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10f3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa88a4f expref: 491 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703693:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10f3:0x0].0x0 (ffff9090d6194b00) 00010000:00010000:2.0:1787508703.703706:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9dc2e00/0xb126349c40eb79f1 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10f1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8872a expref: 490 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703715:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10f1:0x0].0x0 (ffff9090d54db000) 00010000:00010000:2.0:1787508703.703725:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce7cd400/0xb126349c40eb79ab lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8870e expref: 489 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703734:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10f0:0x0].0x0 (ffff9090e7423f00) 00010000:00010000:2.0:1787508703.703745:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0149800/0xb126349c40eb791f lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10ef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa886dd expref: 488 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703755:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10ef:0x0].0x0 (ffff9090e7423400) 00010000:00010000:2.0:1787508703.703765:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cee40600/0xb126349c40eb7831 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10ee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8869e expref: 487 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703774:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10ee:0x0].0x0 (ffff9090cbeaec00) 00010000:00010000:2.0:1787508703.703784:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a2e00/0xb126349c40eb5b51 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10ea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa87e78 expref: 486 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703796:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10ea:0x0].0x0 (ffff9090e7423500) 00010000:00010000:2.0:1787508703.703805:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d00ffc00/0xb126349c40eb5ae1 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10e9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa87e4e expref: 485 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703814:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10e9:0x0].0x0 (ffff9090e7423300) 00010000:00010000:2.0:1787508703.703822:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5529a00/0xb126349c40eb5a39 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10e8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa87e16 expref: 484 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703830:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10e8:0x0].0x0 (ffff9090ce7f6100) 00010000:00010000:2.0:1787508703.703838:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cbcba000/0xb126349c40eb5991 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa87de5 expref: 483 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703846:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10e7:0x0].0x0 (ffff9090ce7f6000) 00010000:00010000:2.0:1787508703.703855:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d00ff000/0xb126349c40eb52ad lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10e5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa87bdf expref: 482 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703863:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10e5:0x0].0x0 (ffff9090e7423900) 00010000:00010000:2.0:1787508703.703871:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d37ccc00/0xb126349c40eb5252 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10e4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa87bd1 expref: 481 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703879:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10e4:0x0].0x0 (ffff9090ce78be00) 00010000:00010000:2.0:1787508703.703891:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948cc00/0xb126349c40eb51cd lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10e3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa87bb5 expref: 480 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.703899:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10e3:0x0].0x0 (ffff9090c6a3a200) 00010000:00010000:2.0:1787508703.704284:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d37cc800/0xb126349c40eb5179 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10e2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa87b99 expref: 479 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704295:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10e2:0x0].0x0 (ffff9090e7423200) 00010000:00010000:2.0:1787508703.704306:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a3800/0xb126349c40eb45e1 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8783c expref: 478 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704319:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10e0:0x0].0x0 (ffff9090d54db100) 00010000:00010000:2.0:1787508703.704329:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9dc2400/0xb126349c40eb4540 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10df:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8780b expref: 477 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704337:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10df:0x0].0x0 (ffff9090d54dbc00) 00010000:00010000:2.0:1787508703.704346:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9dc2c00/0xb126349c40eb4483 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10de:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa877e1 expref: 476 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704353:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10de:0x0].0x0 (ffff9090d9e7bf00) 00010000:00010000:2.0:1787508703.704362:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9dc3000/0xb126349c40eb43f7 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10dd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa877be expref: 475 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704370:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10dd:0x0].0x0 (ffff9090ca0c8b00) 00010000:00010000:2.0:1787508703.704379:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948c000/0xb126349c40eb3d6e lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10db:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa875b8 expref: 474 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704389:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10db:0x0].0x0 (ffff9090d6c66100) 00010000:00010000:2.0:1787508703.704398:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d37cc600/0xb126349c40eb3d05 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10da:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa875aa expref: 473 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704406:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10da:0x0].0x0 (ffff9090d9e7ac00) 00010000:00010000:2.0:1787508703.704434:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d37cda00/0xb126349c40eb3c64 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8758e expref: 472 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704445:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10d9:0x0].0x0 (ffff9090ce78bf00) 00010000:00010000:2.0:1787508703.704457:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c948dc00/0xb126349c40eb3c10 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10d8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa87572 expref: 471 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704467:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10d8:0x0].0x0 (ffff9090d6c66600) 00010000:00010000:2.0:1787508703.704477:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c8306a00/0xb126349c40eb30b0 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa87231 expref: 470 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704486:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10d6:0x0].0x0 (ffff9090c6a3b300) 00010000:00010000:2.0:1787508703.704499:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d301a600/0xb126349c40eb3016 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa87200 expref: 469 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704508:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10d5:0x0].0x0 (ffff9090d6195b00) 00010000:00010000:2.0:1787508703.704518:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0148c00/0xb126349c40eb2f44 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa871cf expref: 468 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704528:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10d4:0x0].0x0 (ffff9090d9e7a200) 00010000:00010000:2.0:1787508703.704539:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d00fea00/0xb126349c40eb2eb8 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10d3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa871ac expref: 467 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704548:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10d3:0x0].0x0 (ffff9090d6c66f00) 00010000:00010000:2.0:1787508703.704560:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0148a00/0xb126349c40eb240e lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa86eb1 expref: 466 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704569:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10d1:0x0].0x0 (ffff9090d6c69100) 00010000:00010000:2.0:1787508703.704580:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e340ee00/0xb126349c40eb236d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10d0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa86e79 expref: 465 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704594:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10d0:0x0].0x0 (ffff9090cd17a300) 00010000:00010000:2.0:1787508703.704606:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d00fe600/0xb126349c40eb2294 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10cf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa86e41 expref: 464 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704615:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10cf:0x0].0x0 (ffff9090e4babb00) 00010000:00010000:2.0:1787508703.704626:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d34a2000/0xb126349c40eb21fa lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10ce:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa86e1e expref: 463 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704636:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10ce:0x0].0x0 (ffff9090e4bab000) 00010000:00010000:2.0:1787508703.704646:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9ff0200/0xb126349c40eb0cc9 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10cb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8680c expref: 462 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704656:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10cb:0x0].0x0 (ffff9090d6195600) 00010000:00010000:2.0:1787508703.704665:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0149000/0xb126349c40eb0bb8 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa867c6 expref: 461 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704673:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10ca:0x0].0x0 (ffff9090e4bab800) 00010000:00010000:2.0:1787508703.704683:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d00fe200/0xb126349c40eb0b17 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10c9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa867aa expref: 460 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704691:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10c9:0x0].0x0 (ffff9090c991f600) 00010000:00010000:2.0:1787508703.704702:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0148200/0xb126349c40eb0ac3 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10c8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8678e expref: 459 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704711:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10c8:0x0].0x0 (ffff9090c5b0c300) 00010000:00010000:2.0:1787508703.704722:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9ff0800/0xb126349c40eaf798 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10c5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa861f3 expref: 458 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704732:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10c5:0x0].0x0 (ffff9090ce7f6700) 00010000:00010000:2.0:1787508703.704742:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9ff0400/0xb126349c40eaf6b1 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10c4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa861bb expref: 457 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704751:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10c4:0x0].0x0 (ffff9090d08ec100) 00010000:00010000:2.0:1787508703.704761:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22cae00/0xb126349c40eaf5ed lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10c3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa86191 expref: 456 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704771:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10c3:0x0].0x0 (ffff9090e4bab200) 00010000:00010000:2.0:1787508703.704780:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e61c2c00/0xb126349c40eaf5a7 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa86175 expref: 455 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704789:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10c2:0x0].0x0 (ffff9090e4bab900) 00010000:00010000:2.0:1787508703.704798:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e61c2e00/0xb126349c40eaeada lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10c0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa85e57 expref: 454 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704806:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10c0:0x0].0x0 (ffff9090d9e7a100) 00010000:00010000:2.0:1787508703.704830:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cee40400/0xb126349c40eae9f3 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa85e18 expref: 453 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704842:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10bf:0x0].0x0 (ffff9090c6987600) 00010000:00010000:2.0:1787508703.704853:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e340f400/0xb126349c40eae952 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10be:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa85dfc expref: 452 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704866:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10be:0x0].0x0 (ffff9090d9e7a400) 00010000:00010000:2.0:1787508703.704876:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a3a200/0xb126349c40eae8fe lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10bd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa85de0 expref: 451 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704886:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10bd:0x0].0x0 (ffff9090d6c69a00) 00010000:00010000:2.0:1787508703.704895:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1556c00/0xb126349c40ead6eb lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10ba:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa858c3 expref: 450 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704913:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10ba:0x0].0x0 (ffff9090c5b0c100) 00010000:00010000:2.0:1787508703.704926:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1e00/0xb126349c40ead697 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10b9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa858ae expref: 449 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704934:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10b9:0x0].0x0 (ffff9090c5b0c000) 00010000:00010000:2.0:1787508703.704984:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cee40a00/0xb126349c40ead5ef lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa85876 expref: 448 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.704994:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10b8:0x0].0x0 (ffff9090c6a3b900) 00010000:00010000:2.0:1787508703.705004:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3ee5400/0xb126349c40ead51d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10b7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa85830 expref: 447 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705014:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10b7:0x0].0x0 (ffff9090c991f300) 00010000:00010000:2.0:1787508703.705025:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3ee5c00/0xb126349c40eaceef lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10b5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa85677 expref: 446 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705032:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10b5:0x0].0x0 (ffff9090ca0c8800) 00010000:00010000:2.0:1787508703.705043:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3ee4a00/0xb126349c40eace86 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10b4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8564d expref: 445 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705051:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10b4:0x0].0x0 (ffff9090d6194f00) 00010000:00010000:2.0:1787508703.705063:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff0800/0xb126349c40eacdec lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8561c expref: 444 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705072:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10b3:0x0].0x0 (ffff9090d2302200) 00010000:00010000:2.0:1787508703.705083:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e343be00/0xb126349c40eacd28 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10b2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa855eb expref: 443 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705092:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10b2:0x0].0x0 (ffff9090c6a3bf00) 00010000:00010000:2.0:1787508703.705102:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a3be00/0xb126349c40eac2fc lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa852fe expref: 442 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705113:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10b0:0x0].0x0 (ffff9091d43a5a00) 00010000:00010000:2.0:1787508703.705125:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1200/0xb126349c40eac1f2 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10af:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa852b8 expref: 441 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705133:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10af:0x0].0x0 (ffff9090ce78b300) 00010000:00010000:2.0:1787508703.705143:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21c00/0xb126349c40eac151 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10ae:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8529c expref: 440 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705152:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10ae:0x0].0x0 (ffff9090e36b9b00) 00010000:00010000:2.0:1787508703.705164:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e61c3600/0xb126349c40eac0ef lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10ad:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa85279 expref: 439 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705179:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10ad:0x0].0x0 (ffff9090ce78bb00) 00010000:00010000:2.0:1787508703.705191:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9ff0600/0xb126349c40eaadc4 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10aa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa84d08 expref: 438 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705199:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10aa:0x0].0x0 (ffff9090c6a3b000) 00010000:00010000:2.0:1787508703.705209:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb24200/0xb126349c40eaad62 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10a9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa84cde expref: 437 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705220:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10a9:0x0].0x0 (ffff9090cf431c00) 00010000:00010000:2.0:1787508703.705230:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cf775c00/0xb126349c40eaaceb lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa84cbb expref: 436 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705238:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10a8:0x0].0x0 (ffff9090c6406900) 00010000:00010000:2.0:1787508703.705251:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a3ae00/0xb126349c40eaabfd lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10a7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa84c7c expref: 435 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705260:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10a7:0x0].0x0 (ffff9091d62de500) 00010000:00010000:2.0:1787508703.705272:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cbcbac00/0xb126349c40eaa57b lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa84a7d expref: 434 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705281:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10a5:0x0].0x0 (ffff9090c6406100) 00010000:00010000:2.0:1787508703.705292:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ca69f200/0xb126349c40eaa520 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10a4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa84a6f expref: 433 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705302:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10a4:0x0].0x0 (ffff9090c9878000) 00010000:00010000:2.0:1787508703.705314:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cbcba200/0xb126349c40eaa471 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa84a4c expref: 432 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705322:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10a3:0x0].0x0 (ffff9090c6406b00) 00010000:00010000:2.0:1787508703.705332:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c10e0800/0xb126349c40eaa424 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10a2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa84a30 expref: 431 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705343:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10a2:0x0].0x0 (ffff9090c6406c00) 00010000:00010000:2.0:1787508703.705353:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c8307200/0xb126349c40ea9d6a lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x10a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa84831 expref: 430 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705363:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x10a0:0x0].0x0 (ffff9090d1b2b800) 00010000:00010000:2.0:1787508703.705373:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1557200/0xb126349c40ea9cd7 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x109f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8481c expref: 429 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705382:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x109f:0x0].0x0 (ffff9090cd810d00) 00010000:00010000:2.0:1787508703.705396:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e343ac00/0xb126349c40ea9c7c lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x109e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa84800 expref: 428 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705405:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x109e:0x0].0x0 (ffff9090ca44a700) 00010000:00010000:2.0:1787508703.705415:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e343bc00/0xb126349c40ea9c36 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x109d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa847eb expref: 427 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705424:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x109d:0x0].0x0 (ffff9090c9a22200) 00010000:00010000:2.0:1787508703.705434:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9d20400/0xb126349c40ea9560 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x109b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa845d7 expref: 426 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705448:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x109b:0x0].0x0 (ffff9090cd063900) 00010000:00010000:2.0:1787508703.705460:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091c983c200/0xb126349c40ea9505 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x109a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa845c9 expref: 425 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705469:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x109a:0x0].0x0 (ffff9090e4baba00) 00010000:00010000:2.0:1787508703.705479:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c8306600/0xb126349c40ea9472 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1099:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa845a6 expref: 424 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705488:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1099:0x0].0x0 (ffff9090e4bab500) 00010000:00010000:2.0:1787508703.705497:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e61c3c00/0xb126349c40ea942c lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1098:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa84591 expref: 423 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705505:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1098:0x0].0x0 (ffff9090ca68ea00) 00010000:00010000:2.0:1787508703.705517:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1556600/0xb126349c40ea7e37 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1095:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa83f6a expref: 422 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705526:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1095:0x0].0x0 (ffff9090e465e600) 00010000:00010000:2.0:1787508703.705538:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3ee5200/0xb126349c40ea7dc7 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1094:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa83f47 expref: 421 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705546:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1094:0x0].0x0 (ffff9090c991f900) 00010000:00010000:2.0:1787508703.705558:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1557600/0xb126349c40ea7d26 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1093:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa83f0f expref: 420 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705567:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1093:0x0].0x0 (ffff9090cf431500) 00010000:00010000:2.0:1787508703.705576:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e61c2400/0xb126349c40ea7c62 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1092:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa83ec9 expref: 419 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705584:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1092:0x0].0x0 (ffff9090cf093800) 00010000:00010000:2.0:1787508703.705592:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cee41600/0xb126349c40ea754d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1090:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa83cc3 expref: 418 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705602:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1090:0x0].0x0 (ffff9090cd810700) 00010000:00010000:2.0:1787508703.705612:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a77e00/0xb126349c40ea74eb lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x108f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa83cb5 expref: 417 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705620:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x108f:0x0].0x0 (ffff9090cd810400) 00010000:00010000:2.0:1787508703.705629:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1556a00/0xb126349c40ea7466 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x108e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa83c99 expref: 416 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705636:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x108e:0x0].0x0 (ffff9090c6a3b800) 00010000:00010000:2.0:1787508703.705646:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cee40800/0xb126349c40ea7412 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x108d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa83c7d expref: 415 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705654:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x108d:0x0].0x0 (ffff9090e465e200) 00010000:00010000:2.0:1787508703.705664:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e343a400/0xb126349c40ea5f04 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x108a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa83680 expref: 414 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705676:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x108a:0x0].0x0 (ffff9090d9e7af00) 00010000:00010000:2.0:1787508703.705687:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cbcbbe00/0xb126349c40ea5ea9 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1089:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa83672 expref: 413 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705701:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1089:0x0].0x0 (ffff9090ce78a100) 00010000:00010000:2.0:1787508703.705710:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e343b400/0xb126349c40ea5e24 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1088:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa83656 expref: 412 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705719:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1088:0x0].0x0 (ffff9090ce78ae00) 00010000:00010000:2.0:1787508703.705727:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e343b200/0xb126349c40ea5dd0 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1087:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8363a expref: 411 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705735:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1087:0x0].0x0 (ffff9090d9e7bc00) 00010000:00010000:2.0:1787508703.705746:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1556e00/0xb126349c40ea58c1 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1086:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa834dc expref: 410 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705754:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1086:0x0].0x0 (ffff9090ceaf3900) 00010000:00010000:2.0:1787508703.705766:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5528800/0xb126349c40ea5882 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1085:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa834c7 expref: 409 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705775:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1085:0x0].0x0 (ffff9090d3e9af00) 00010000:00010000:2.0:1787508703.705786:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1557e00/0xb126349c40ea57e8 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1084:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8348f expref: 408 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705796:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1084:0x0].0x0 (ffff9090ceaf3d00) 00010000:00010000:2.0:1787508703.705806:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3ee4000/0xb126349c40ea56d7 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1083:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa83449 expref: 407 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705817:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1083:0x0].0x0 (ffff9090ce78a300) 00010000:00010000:2.0:1787508703.705828:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1556400/0xb126349c40ea537a lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1081:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8333f expref: 406 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705837:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1081:0x0].0x0 (ffff9090ca0c8600) 00010000:00010000:2.0:1787508703.705848:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cbcbb000/0xb126349c40ea52f5 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1080:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8332a expref: 405 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705857:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1080:0x0].0x0 (ffff9090c9a22a00) 00010000:00010000:2.0:1787508703.705866:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1557c00/0xb126349c40ea528c lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x107f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa83315 expref: 404 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705874:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x107f:0x0].0x0 (ffff9090ceaf3200) 00010000:00010000:2.0:1787508703.705883:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3584000/0xb126349c40ea5238 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x107e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa832f9 expref: 403 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705893:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x107e:0x0].0x0 (ffff9090c9a22c00) 00010000:00010000:2.0:1787508703.705914:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1557a00/0xb126349c40ea4bb6 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x107c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa830f3 expref: 402 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.705925:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x107c:0x0].0x0 (ffff9090ceaf3100) 00010000:00010000:2.0:1787508703.705937:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5529600/0xb126349c40ea4b4d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x107b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa830e5 expref: 401 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706013:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x107b:0x0].0x0 (ffff9090ce8a2900) 00010000:00010000:2.0:1787508703.706030:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3462400/0xb126349c40ea4aac lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x107a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa830c9 expref: 400 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706045:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x107a:0x0].0x0 (ffff9090ceaf3700) 00010000:00010000:2.0:1787508703.706054:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce7cda00/0xb126349c40ea4a58 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1079:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa830ad expref: 399 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706064:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1079:0x0].0x0 (ffff9090ce8a2000) 00010000:00010000:2.0:1787508703.706074:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9d20000/0xb126349c40ea3f37 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1077:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa82d7a expref: 398 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706082:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1077:0x0].0x0 (ffff9090d9d2b300) 00010000:00010000:2.0:1787508703.706092:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5529c00/0xb126349c40ea3e50 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1076:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa82d42 expref: 397 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706100:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1076:0x0].0x0 (ffff9090ce8a2100) 00010000:00010000:2.0:1787508703.706109:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1600/0xb126349c40ea3daf lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1075:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa82d26 expref: 396 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706119:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1075:0x0].0x0 (ffff9090ceaf3e00) 00010000:00010000:2.0:1787508703.706129:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3ee5600/0xb126349c40ea3d54 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1074:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa82d03 expref: 395 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706138:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1074:0x0].0x0 (ffff9090ceaf3400) 00010000:00010000:2.0:1787508703.706147:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e36cee00/0xb126349c40ea369a lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1072:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa82b04 expref: 394 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706158:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1072:0x0].0x0 (ffff9090ce8a2300) 00010000:00010000:2.0:1787508703.706169:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22cb600/0xb126349c40ea363f lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1071:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa82af6 expref: 393 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706178:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1071:0x0].0x0 (ffff9090d9d2bd00) 00010000:00010000:2.0:1787508703.706188:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3462200/0xb126349c40ea35ba lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1070:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa82ada expref: 392 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706196:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1070:0x0].0x0 (ffff9090d02adc00) 00010000:00010000:2.0:1787508703.706207:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25400/0xb126349c40ea3566 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x106f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa82abe expref: 391 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706216:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x106f:0x0].0x0 (ffff9090c6a3a800) 00010000:00010000:2.0:1787508703.706227:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9d23600/0xb126349c40ea2aae lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x106d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa827a7 expref: 390 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706236:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x106d:0x0].0x0 (ffff9090d9e7b300) 00010000:00010000:2.0:1787508703.706246:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3462e00/0xb126349c40ea2949 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x106c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8275a expref: 389 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706255:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x106c:0x0].0x0 (ffff9090c991fb00) 00010000:00010000:2.0:1787508703.706266:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d554e600/0xb126349c40ea28d2 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x106b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa82737 expref: 388 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706274:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x106b:0x0].0x0 (ffff9090c991f800) 00010000:00010000:2.0:1787508703.706283:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9d20800/0xb126349c40ea288c lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x106a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa82722 expref: 387 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706298:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x106a:0x0].0x0 (ffff9090d9d2bb00) 00010000:00010000:2.0:1787508703.706309:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5529e00/0xb126349c40ea231b lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1069:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8259a expref: 386 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706317:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1069:0x0].0x0 (ffff9090c6406f00) 00010000:00010000:2.0:1787508703.706328:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9d20e00/0xb126349c40ea227a lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1068:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8257e expref: 385 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706337:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1068:0x0].0x0 (ffff9090cda8d400) 00010000:00010000:2.0:1787508703.706348:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3463400/0xb126349c40ea21ee lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1067:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8254d expref: 384 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706357:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1067:0x0].0x0 (ffff9090ca0c8a00) 00010000:00010000:2.0:1787508703.706368:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d7f7f400/0xb126349c40ea2107 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1066:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa82507 expref: 383 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706381:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1066:0x0].0x0 (ffff9090cda8d100) 00010000:00010000:2.0:1787508703.706392:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9d20a00/0xb126349c40ea1d48 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1064:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa823fd expref: 382 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706407:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1064:0x0].0x0 (ffff9090cda8d800) 00010000:00010000:2.0:1787508703.706418:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22cb800/0xb126349c40ea1cc3 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1063:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa823e1 expref: 381 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706428:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1063:0x0].0x0 (ffff9090d9d2b500) 00010000:00010000:2.0:1787508703.706440:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e61c2200/0xb126349c40ea1c6f lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1062:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa823c5 expref: 380 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706450:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1062:0x0].0x0 (ffff9090cda8db00) 00010000:00010000:2.0:1787508703.706459:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e61c2a00/0xb126349c40ea1c37 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1061:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa823b0 expref: 379 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706468:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1061:0x0].0x0 (ffff9090ca0c8f00) 00010000:00010000:2.0:1787508703.706478:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ca000/0xb126349c40ea10c2 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x105f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa82068 expref: 378 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706487:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x105f:0x0].0x0 (ffff9090ce78bd00) 00010000:00010000:2.0:1787508703.706498:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ca600/0xb126349c40ea1060 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x105e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8204c expref: 377 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706507:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x105e:0x0].0x0 (ffff9090c6a3b100) 00010000:00010000:2.0:1787508703.706517:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e5bd7600/0xb126349c40ea0f4f lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x105d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa82006 expref: 376 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706527:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x105d:0x0].0x0 (ffff9090c6406a00) 00010000:00010000:2.0:1787508703.706537:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d02ae400/0xb126349c40ea0ed1 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x105c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa81fea expref: 375 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706546:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x105c:0x0].0x0 (ffff9090ce78b900) 00010000:00010000:2.0:1787508703.706557:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1400/0xb126349c40ea034e lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x105a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa81ca2 expref: 374 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706571:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x105a:0x0].0x0 (ffff9090ce78aa00) 00010000:00010000:2.0:1787508703.706582:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e61c3400/0xb126349c40ea0308 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1059:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa81c86 expref: 373 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706593:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1059:0x0].0x0 (ffff9090ce78ad00) 00010000:00010000:2.0:1787508703.706603:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0ff1c00/0xb126349c40ea0267 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1058:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa81c4e expref: 372 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706613:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1058:0x0].0x0 (ffff9090c6406700) 00010000:00010000:2.0:1787508703.706623:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c8307800/0xb126349c40ea01aa lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1057:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa81c16 expref: 371 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706631:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1057:0x0].0x0 (ffff9090d9e7ab00) 00010000:00010000:2.0:1787508703.706640:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9d21600/0xb126349c40e9fb0c lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1055:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa81a25 expref: 370 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706649:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1055:0x0].0x0 (ffff9090ce78a600) 00010000:00010000:2.0:1787508703.706657:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9cb2e00/0xb126349c40e9fa87 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1054:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa81a10 expref: 369 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706667:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1054:0x0].0x0 (ffff9090d9e7bd00) 00010000:00010000:2.0:1787508703.706677:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cf775600/0xb126349c40e9fa10 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1053:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa819f4 expref: 368 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706686:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1053:0x0].0x0 (ffff9090ca0c8300) 00010000:00010000:2.0:1787508703.706697:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3463e00/0xb126349c40e9f9ca lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1052:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa819df expref: 367 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706705:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1052:0x0].0x0 (ffff9090ca0c8d00) 00010000:00010000:2.0:1787508703.706714:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ca800/0xb126349c40e9f34f lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1050:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa817e7 expref: 366 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706723:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1050:0x0].0x0 (ffff9090ca4f9700) 00010000:00010000:2.0:1787508703.706732:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d22ca200/0xb126349c40e9f28b lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x104f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa817b6 expref: 365 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706741:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x104f:0x0].0x0 (ffff9090d9e7a800) 00010000:00010000:2.0:1787508703.706751:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5529400/0xb126349c40e9f24c lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x104e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa817a8 expref: 364 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706759:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x104e:0x0].0x0 (ffff9090c6406300) 00010000:00010000:2.0:1787508703.706769:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3463a00/0xb126349c40e9f1ce lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x104d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8178c expref: 363 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706777:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x104d:0x0].0x0 (ffff9090ca4f9200) 00010000:00010000:2.0:1787508703.706786:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cf774800/0xb126349c40e9e7a9 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x104b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa814a6 expref: 362 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706795:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x104b:0x0].0x0 (ffff9090e5bd2100) 00010000:00010000:2.0:1787508703.706804:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cf774600/0xb126349c40e9e698 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x104a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa81459 expref: 361 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706816:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x104a:0x0].0x0 (ffff9090ce78ba00) 00010000:00010000:2.0:1787508703.706827:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9cb2a00/0xb126349c40e9e5f7 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1049:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8143d expref: 360 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706835:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1049:0x0].0x0 (ffff9090ca68e800) 00010000:00010000:2.0:1787508703.706846:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c8307000/0xb126349c40e9e5a3 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1048:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa81421 expref: 359 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706855:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1048:0x0].0x0 (ffff9090ce78b200) 00010000:00010000:2.0:1787508703.706866:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c8306200/0xb126349c40e9da82 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1046:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa810ee expref: 358 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706875:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1046:0x0].0x0 (ffff9090c96b8700) 00010000:00010000:2.0:1787508703.706887:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce7cce00/0xb126349c40e9d9b7 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1045:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa810a8 expref: 357 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706897:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1045:0x0].0x0 (ffff9090ce111f00) 00010000:00010000:2.0:1787508703.706921:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d301ae00/0xb126349c40e9d8d0 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1044:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8108c expref: 356 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.706932:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1044:0x0].0x0 (ffff9090cd063b00) 00010000:00010000:2.0:1787508703.707012:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d7f7ec00/0xb126349c40e9d883 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1043:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa81070 expref: 355 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707023:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1043:0x0].0x0 (ffff9090d218e300) 00010000:00010000:2.0:1787508703.707035:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9d21400/0xb126349c40e9d1bb lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1041:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa80e6a expref: 354 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707044:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1041:0x0].0x0 (ffff9090d218eb00) 00010000:00010000:2.0:1787508703.707054:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a30600/0xb126349c40e9d128 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1040:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa80e55 expref: 353 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707062:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1040:0x0].0x0 (ffff9091d2128700) 00010000:00010000:2.0:1787508703.707071:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cf774200/0xb126349c40e9d0c6 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x103f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa80e32 expref: 352 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707079:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x103f:0x0].0x0 (ffff9090c991fd00) 00010000:00010000:2.0:1787508703.707090:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9d21e00/0xb126349c40e9d072 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x103e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa80e0f expref: 351 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707099:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x103e:0x0].0x0 (ffff9090d0fe0500) 00010000:00010000:2.0:1787508703.707108:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cc80f200/0xb126349c40e9c4f6 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x103c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa80ac7 expref: 350 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707117:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x103c:0x0].0x0 (ffff9091d62dea00) 00010000:00010000:2.0:1787508703.707127:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3585800/0xb126349c40e9c439 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x103b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa80aab expref: 349 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707137:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x103b:0x0].0x0 (ffff9090d3e9a400) 00010000:00010000:2.0:1787508703.707147:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5529200/0xb126349c40e9c3c9 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x103a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa80a88 expref: 348 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707158:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x103a:0x0].0x0 (ffff9090cd810100) 00010000:00010000:2.0:1787508703.707170:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0f95800/0xb126349c40e9c383 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1039:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa80a6c expref: 347 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707179:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1039:0x0].0x0 (ffff9090d3e9ab00) 00010000:00010000:2.0:1787508703.707187:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d554f400/0xb126349c40e9b8e7 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1037:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8075c expref: 346 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707196:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1037:0x0].0x0 (ffff9090cd810e00) 00010000:00010000:2.0:1787508703.707207:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cc80f800/0xb126349c40e9b7eb lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1036:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8071d expref: 345 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707216:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1036:0x0].0x0 (ffff9090c984d500) 00010000:00010000:2.0:1787508703.707228:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c7ad9e00/0xb126349c40e9b74a lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1035:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa80701 expref: 344 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707238:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1035:0x0].0x0 (ffff9090cd810800) 00010000:00010000:2.0:1787508703.707249:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a31200/0xb126349c40e9b6f6 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1034:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa806e5 expref: 343 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707259:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1034:0x0].0x0 (ffff9090cda8df00) 00010000:00010000:2.0:1787508703.707268:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c99e7200/0xb126349c40e9ab81 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1032:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa803b9 expref: 342 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707277:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1032:0x0].0x0 (ffff9090d0fe0a00) 00010000:00010000:2.0:1787508703.707288:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c8306c00/0xb126349c40e9ab0a lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1031:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8038f expref: 341 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707297:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1031:0x0].0x0 (ffff9090d9d2bc00) 00010000:00010000:2.0:1787508703.707306:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb24800/0xb126349c40e9aa85 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1030:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa80365 expref: 340 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707316:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1030:0x0].0x0 (ffff9090ca4f9b00) 00010000:00010000:2.0:1787508703.707326:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d301a000/0xb126349c40e9a9f2 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x102f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8033b expref: 339 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707334:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x102f:0x0].0x0 (ffff9090ce111200) 00010000:00010000:2.0:1787508703.707344:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c8307a00/0xb126349c40e99ef4 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x102d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa8001d expref: 338 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707352:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x102d:0x0].0x0 (ffff9090ce111800) 00010000:00010000:2.0:1787508703.707371:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce8edc00/0xb126349c40e99df8 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x102c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7ffde expref: 337 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707381:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x102c:0x0].0x0 (ffff9090ce111700) 00010000:00010000:2.0:1787508703.707390:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c8306000/0xb126349c40e99d57 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x102b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7ffc2 expref: 336 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707398:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x102b:0x0].0x0 (ffff9090ce111100) 00010000:00010000:2.0:1787508703.707406:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5528c00/0xb126349c40e99cfc lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x102a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7ffa6 expref: 335 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707419:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x102a:0x0].0x0 (ffff9090cd810900) 00010000:00010000:2.0:1787508703.707428:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce26a800/0xb126349c40e9965e lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1028:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7fdb5 expref: 334 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707436:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1028:0x0].0x0 (ffff9090cda8d200) 00010000:00010000:2.0:1787508703.707445:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c7ad8200/0xb126349c40e995d9 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1027:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7fd99 expref: 333 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707453:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1027:0x0].0x0 (ffff9090cda8de00) 00010000:00010000:2.0:1787508703.707461:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c7ad8000/0xb126349c40e9953f lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1026:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7fd61 expref: 332 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707469:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1026:0x0].0x0 (ffff9091d43a5d00) 00010000:00010000:2.0:1787508703.707479:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9cb2200/0xb126349c40e9943c lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1025:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7fd1b expref: 331 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707486:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1025:0x0].0x0 (ffff9090cda8dd00) 00010000:00010000:2.0:1787508703.707495:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c99e7600/0xb126349c40e98930 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1023:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7f9fd expref: 330 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707503:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1023:0x0].0x0 (ffff9090e36b9900) 00010000:00010000:2.0:1787508703.707513:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c7ad9800/0xb126349c40e988b9 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1022:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7f9e8 expref: 329 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707521:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1022:0x0].0x0 (ffff9090e36b9d00) 00010000:00010000:2.0:1787508703.707530:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a31400/0xb126349c40e98850 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1021:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7f9d3 expref: 328 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707538:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1021:0x0].0x0 (ffff9090e36b9100) 00010000:00010000:2.0:1787508703.707547:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a30800/0xb126349c40e987fc lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1020:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7f9b7 expref: 327 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707555:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1020:0x0].0x0 (ffff9090e36b9000) 00010000:00010000:2.0:1787508703.707564:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c8af1600/0xb126349c40e97d21 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x101e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7f699 expref: 326 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707571:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x101e:0x0].0x0 (ffff9090d0fe0900) 00010000:00010000:2.0:1787508703.707579:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c7ad9a00/0xb126349c40e97c09 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x101d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7f65a expref: 325 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707587:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x101d:0x0].0x0 (ffff9091d62de700) 00010000:00010000:2.0:1787508703.707597:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9cb2600/0xb126349c40e97b84 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x101c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7f63e expref: 324 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707606:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x101c:0x0].0x0 (ffff9090cf093000) 00010000:00010000:2.0:1787508703.707614:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce7cc600/0xb126349c40e97b30 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x101b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7f61b expref: 323 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707623:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x101b:0x0].0x0 (ffff9091d62dee00) 00010000:00010000:2.0:1787508703.707633:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091c588a400/0xb126349c40e95e88 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1017:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7ee0a expref: 322 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707647:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1017:0x0].0x0 (ffff9090d0fe0c00) 00010000:00010000:2.0:1787508703.707657:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb24000/0xb126349c40e95e26 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1016:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7ede7 expref: 321 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707666:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1016:0x0].0x0 (ffff9091da051100) 00010000:00010000:2.0:1787508703.707678:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3584200/0xb126349c40e95dcb lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1015:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7edc4 expref: 320 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707686:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1015:0x0].0x0 (ffff9090d0fe0400) 00010000:00010000:2.0:1787508703.707696:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce7cde00/0xb126349c40e95cd6 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1014:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7ed77 expref: 319 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707707:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1014:0x0].0x0 (ffff9090e5bd2000) 00010000:00010000:2.0:1787508703.707717:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3585200/0xb126349c40e955dd lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1012:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7eb71 expref: 318 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707724:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1012:0x0].0x0 (ffff9090d3e9a600) 00010000:00010000:2.0:1787508703.707733:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5554c00/0xb126349c40e95566 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1011:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7eb5c expref: 317 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707740:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1011:0x0].0x0 (ffff9090d0fe0f00) 00010000:00010000:2.0:1787508703.707749:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cf775e00/0xb126349c40e954fd lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1010:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7eb47 expref: 316 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707756:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1010:0x0].0x0 (ffff9090d3e9a200) 00010000:00010000:2.0:1787508703.707766:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3584400/0xb126349c40e954a9 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x100f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7eb2b expref: 315 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707775:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x100f:0x0].0x0 (ffff9090cd810a00) 00010000:00010000:2.0:1787508703.707783:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ca69fe00/0xb126349c40e94e7b lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x100d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7e941 expref: 314 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707791:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x100d:0x0].0x0 (ffff9090e5bd2a00) 00010000:00010000:2.0:1787508703.707799:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c740d200/0xb126349c40e94da9 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x100c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7e910 expref: 313 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707806:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x100c:0x0].0x0 (ffff9090e5bd2c00) 00010000:00010000:2.0:1787508703.707814:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9815600/0xb126349c40e94d08 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x100b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7e8f4 expref: 312 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707822:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x100b:0x0].0x0 (ffff9090d0fe0700) 00010000:00010000:2.0:1787508703.707830:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a30a00/0xb126349c40e94cb4 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x100a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7e8d8 expref: 311 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707838:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x100a:0x0].0x0 (ffff9090e4babc00) 00010000:00010000:2.0:1787508703.707846:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9cb2c00/0xb126349c40e941af lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1008:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7e5b3 expref: 310 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707854:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1008:0x0].0x0 (ffff9090e465e000) 00010000:00010000:2.0:1787508703.707861:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9cb2400/0xb126349c40e94058 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1007:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7e54a expref: 309 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707873:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1007:0x0].0x0 (ffff9091d43a5b00) 00010000:00010000:2.0:1787508703.707881:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9cb2800/0xb126349c40e94019 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1006:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7e53c expref: 308 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.707889:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1006:0x0].0x0 (ffff9090e4babf00) 00010000:00010000:2.0:1787508703.707897:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9cb3200/0xb126349c40e93f8d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1005:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7e519 expref: 307 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508703.709311:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508703.709412:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509602688 00000100:00100000:3.0:1787508703.709422:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509602688 00000100:00100000:3.0:1787508703.709494:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9808 00000100:00100000:3.0:1787508703.709506:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9f18850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+239:288263:x1874324509602688:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508703.709521:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 226 locks, starting at 0 00010000:00010000:3.0:1787508703.709544:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d7f7fc00/0xb126349c40e839ed lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1148:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa79a73 expref: 239 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.709565:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1148:0x0].0x0 (ffff9091d213f400) 00010000:00010000:3.0:1787508703.709582:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d554f000/0xb126349c40e83945 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1147:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa79a42 expref: 238 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.709592:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1147:0x0].0x0 (ffff9090d751c600) 00010000:00010000:3.0:1787508703.709603:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9d22800/0xb126349c40e834d7 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1146:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa79915 expref: 237 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.709612:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1146:0x0].0x0 (ffff9090c6946400) 00010000:00010000:3.0:1787508703.709626:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091ecbeaa00/0xb126349c40e83483 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1145:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa79900 expref: 236 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.709636:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1145:0x0].0x0 (ffff9090c6946b00) 00010000:00010000:3.0:1787508703.709646:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c99e7e00/0xb126349c40e833f7 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1144:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa798c8 expref: 235 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.709783:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1144:0x0].0x0 (ffff9090cc78b000) 00010000:00010000:3.0:1787508703.709801:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9814c00/0xb126349c40e83341 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1143:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa79890 expref: 234 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.709813:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1143:0x0].0x0 (ffff9090d751c900) 00010000:00010000:3.0:1787508703.709835:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c8af1c00/0xb126349c40e8304d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1141:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa797b7 expref: 233 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.709845:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1141:0x0].0x0 (ffff9090cc78b900) 00010000:00010000:3.0:1787508703.709856:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c10e1000/0xb126349c40e82ff9 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1140:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa797a9 expref: 232 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.709866:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1140:0x0].0x0 (ffff9090c6946200) 00010000:00010000:3.0:1787508703.709877:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e340fc00/0xb126349c40e82f74 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x113f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7978d expref: 231 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.709887:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x113f:0x0].0x0 (ffff9090d751ce00) 00010000:00010000:3.0:1787508703.709898:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d1c1d800/0xb126349c40e82f20 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x113e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa79771 expref: 230 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.709918:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x113e:0x0].0x0 (ffff9090c6946300) 00010000:00010000:3.0:1787508703.709931:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d7f7e200/0xb126349c40e827f6 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x113d:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa79572 expref: 229 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710013:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x113d:0x0].0x0 (ffff9090d751c500) 00010000:00010000:3.0:1787508703.710029:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d54e4c00/0xb126349c40e823b9 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x113c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa79445 expref: 228 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710039:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x113c:0x0].0x0 (ffff9090ca68e500) 00010000:00010000:3.0:1787508703.710052:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e340e400/0xb126349c40e82357 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x113b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7941b expref: 227 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710068:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x113b:0x0].0x0 (ffff9091d2a7e600) 00010000:00010000:3.0:1787508703.710079:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d02aea00/0xb126349c40e822d9 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x113a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa793f8 expref: 226 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710088:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x113a:0x0].0x0 (ffff9091d2a7ee00) 00010000:00010000:3.0:1787508703.710096:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d7f7e800/0xb126349c40e82231 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1139:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa793c7 expref: 225 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710105:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1139:0x0].0x0 (ffff9091d2a7e500) 00010000:00010000:3.0:1787508703.710114:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c8af1a00/0xb126349c40e81baf lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1138:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa79207 expref: 224 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710123:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1138:0x0].0x0 (ffff9090c984df00) 00010000:00010000:3.0:1787508703.710134:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e340e600/0xb126349c40e8132e lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1137:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa78f83 expref: 223 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710148:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1137:0x0].0x0 (ffff9090d218ee00) 00010000:00010000:3.0:1787508703.710160:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091f9b20c00/0xb126349c40e80b6a lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1136:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa78d45 expref: 222 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710169:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1136:0x0].0x0 (ffff9090d751cc00) 00010000:00010000:3.0:1787508703.710181:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d554f200/0xb126349c40e8036e lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1135:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa78aeb expref: 221 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710191:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1135:0x0].0x0 (ffff9090d751c400) 00010000:00010000:3.0:1787508703.710201:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091ecbea200/0xb126349c40e7ff1c lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1134:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa789b7 expref: 220 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710211:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1134:0x0].0x0 (ffff9090c9a22400) 00010000:00010000:3.0:1787508703.710222:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091ecbea400/0xb126349c40e7fe97 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1133:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7898d expref: 219 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710230:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1133:0x0].0x0 (ffff9091da051800) 00010000:00010000:3.0:1787508703.710239:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c99e7800/0xb126349c40e7fdda lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1132:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7895c expref: 218 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710248:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1132:0x0].0x0 (ffff9091d213f100) 00010000:00010000:3.0:1787508703.710259:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c8af0200/0xb126349c40e7fd5c lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1131:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa78940 expref: 217 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710266:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1131:0x0].0x0 (ffff9091da051300) 00010000:00010000:3.0:1787508703.710276:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091c588b600/0xb126349c40e7f69b lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1130:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7874f expref: 216 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710285:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1130:0x0].0x0 (ffff9090cf0bf300) 00010000:00010000:3.0:1787508703.710296:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091c57f8000/0xb126349c40e7eebb lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x112f:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7850a expref: 215 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710305:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x112f:0x0].0x0 (ffff9090d4d92500) 00010000:00010000:3.0:1787508703.710315:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d554e200/0xb126349c40e7eafc lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x112e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa783f9 expref: 214 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710325:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x112e:0x0].0x0 (ffff9090c96b8100) 00010000:00010000:3.0:1787508703.710334:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e36cfa00/0xb126349c40e7ea5b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x112d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa783c8 expref: 213 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710343:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x112d:0x0].0x0 (ffff9090cf0bf700) 00010000:00010000:3.0:1787508703.710353:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e340ea00/0xb126349c40e7e9c8 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x112c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa783a5 expref: 212 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710362:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x112c:0x0].0x0 (ffff9090d00cdd00) 00010000:00010000:3.0:1787508703.710373:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d554ea00/0xb126349c40e7e94a lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x112b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa78389 expref: 211 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710382:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x112b:0x0].0x0 (ffff9090cf0bff00) 00010000:00010000:3.0:1787508703.710392:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0f94000/0xb126349c40e7e26d lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x112a:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa78191 expref: 210 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710404:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x112a:0x0].0x0 (ffff9091d552d900) 00010000:00010000:3.0:1787508703.710414:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e36cfe00/0xb126349c40e7deae lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1129:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa78079 expref: 209 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710424:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1129:0x0].0x0 (ffff9091d552d300) 00010000:00010000:3.0:1787508703.710433:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd4a8a00/0xb126349c40e7de0d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1128:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7804f expref: 208 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710442:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1128:0x0].0x0 (ffff9090ca44af00) 00010000:00010000:3.0:1787508703.710452:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd4a8400/0xb126349c40e7dd65 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1127:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa78033 expref: 207 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710460:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1127:0x0].0x0 (ffff9091c816fb00) 00010000:00010000:3.0:1787508703.710470:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e1600/0xb126349c40e7dd0a lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1126:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa78010 expref: 206 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710480:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1126:0x0].0x0 (ffff9091d552dc00) 00010000:00010000:3.0:1787508703.710491:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d54e4800/0xb126349c40e7d61f lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1125:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa77e1f expref: 205 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710501:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1125:0x0].0x0 (ffff9091da051e00) 00010000:00010000:3.0:1787508703.710511:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e5bd6a00/0xb126349c40e7ce15 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1124:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa77bcc expref: 204 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710521:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1124:0x0].0x0 (ffff9091cc215d00) 00010000:00010000:3.0:1787508703.710533:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c8af1e00/0xb126349c40e7c1ab lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1122:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa77829 expref: 203 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710543:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1122:0x0].0x0 (ffff9090cc80b000) 00010000:00010000:3.0:1787508703.710554:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d54e5a00/0xb126349c40e7c126 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1121:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa77814 expref: 202 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710564:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1121:0x0].0x0 (ffff9090d38d0600) 00010000:00010000:3.0:1787508703.710575:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d54e5200/0xb126349c40e7c0bd lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1120:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa777ff expref: 201 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710584:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1120:0x0].0x0 (ffff9090d38d0f00) 00010000:00010000:3.0:1787508703.710595:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d54e5000/0xb126349c40e7c069 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x111f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa777e3 expref: 200 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710604:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x111f:0x0].0x0 (ffff9090c9a22300) 00010000:00010000:3.0:1787508703.710615:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c9a76200/0xb126349c40e7bbae lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x111e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa77693 expref: 199 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710624:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x111e:0x0].0x0 (ffff9090d38d0400) 00010000:00010000:3.0:1787508703.710634:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d554e800/0xb126349c40e7bb6f lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x111d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7767e expref: 198 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710644:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x111d:0x0].0x0 (ffff9090c9a22500) 00010000:00010000:3.0:1787508703.710795:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3fac400/0xb126349c40e7badc lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x111c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7764d expref: 197 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710865:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x111c:0x0].0x0 (ffff9090cc80bf00) 00010000:00010000:3.0:1787508703.710880:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d554ec00/0xb126349c40e7ba0a lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x111b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa77615 expref: 196 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710890:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x111b:0x0].0x0 (ffff9090d38d0800) 00010000:00010000:3.0:1787508703.710900:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c99e6600/0xb126349c40e7b747 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1119:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa77543 expref: 195 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710919:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1119:0x0].0x0 (ffff9090d38d0700) 00010000:00010000:3.0:1787508703.710929:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c99e7c00/0xb126349c40e7b67c lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1118:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa77519 expref: 194 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710958:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1118:0x0].0x0 (ffff9091d552df00) 00010000:00010000:3.0:1787508703.710972:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c99e7000/0xb126349c40e7b5f7 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1117:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa774e8 expref: 193 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.710983:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1117:0x0].0x0 (ffff9090d38d0a00) 00010000:00010000:3.0:1787508703.710994:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d613ce00/0xb126349c40e7b52c lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1116:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa774a9 expref: 192 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711004:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1116:0x0].0x0 (ffff9090d38d0d00) 00010000:00010000:3.0:1787508703.711014:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c99e6a00/0xb126349c40e7ae02 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1115:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa772aa expref: 191 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711025:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1115:0x0].0x0 (ffff9090d2302f00) 00010000:00010000:3.0:1787508703.711036:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0f94600/0xb126349c40e7a9be lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1114:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa77184 expref: 190 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711046:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1114:0x0].0x0 (ffff9090cc80bb00) 00010000:00010000:3.0:1787508703.711056:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d1c8a000/0xb126349c40e7a95c lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1113:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa77161 expref: 189 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711065:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1113:0x0].0x0 (ffff9091c8b72f00) 00010000:00010000:3.0:1787508703.711075:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cf74ac00/0xb126349c40e7a8b4 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1112:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa77129 expref: 188 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711088:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1112:0x0].0x0 (ffff9090cc80bc00) 00010000:00010000:3.0:1787508703.711098:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e0600/0xb126349c40e7a813 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1111:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa770ff expref: 187 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711108:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1111:0x0].0x0 (ffff9091c76ce000) 00010000:00010000:3.0:1787508703.711119:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d6245600/0xb126349c40e7a13d lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1110:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa76f1c expref: 186 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711129:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1110:0x0].0x0 (ffff9090ca44a300) 00010000:00010000:3.0:1787508703.711140:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ce8ec000/0xb126349c40e79217 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x110e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa76ad8 expref: 185 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711151:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x110e:0x0].0x0 (ffff9090ca44a800) 00010000:00010000:3.0:1787508703.711163:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9c6e400/0xb126349c40e79192 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x110d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa76aa7 expref: 184 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711178:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x110d:0x0].0x0 (ffff9090d2302a00) 00010000:00010000:3.0:1787508703.711189:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d6245e00/0xb126349c40e79106 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x110c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa76a8b expref: 183 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711198:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x110c:0x0].0x0 (ffff9091c816f000) 00010000:00010000:3.0:1787508703.711208:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e36ce200/0xb126349c40e79073 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x110b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa76a68 expref: 182 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711219:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x110b:0x0].0x0 (ffff9090ca44ad00) 00010000:00010000:3.0:1787508703.711228:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e36dce00/0xb126349c40e7891f lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x110a:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7684d expref: 181 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711237:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x110a:0x0].0x0 (ffff9090c984d700) 00010000:00010000:3.0:1787508703.711247:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e36cec00/0xb126349c40e78146 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1109:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7660f expref: 180 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711257:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1109:0x0].0x0 (ffff9090c6946000) 00010000:00010000:3.0:1787508703.711269:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d613ca00/0xb126349c40e77cc3 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1108:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa764cd expref: 179 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711279:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1108:0x0].0x0 (ffff9090d2302e00) 00010000:00010000:3.0:1787508703.711291:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e5bd7200/0xb126349c40e77c7d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1107:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa764b1 expref: 178 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711301:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1107:0x0].0x0 (ffff9090c96b8f00) 00010000:00010000:3.0:1787508703.711310:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e0c00/0xb126349c40e77bd5 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1106:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa76479 expref: 177 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711318:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1106:0x0].0x0 (ffff9091d213f700) 00010000:00010000:3.0:1787508703.711327:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091ecbeac00/0xb126349c40e77b34 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1105:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7644f expref: 176 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711337:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1105:0x0].0x0 (ffff9090c984d100) 00010000:00010000:3.0:1787508703.711348:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091c588ac00/0xb126349c40e76c69 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1103:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa76019 expref: 175 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711360:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1103:0x0].0x0 (ffff9090d38d0e00) 00010000:00010000:3.0:1787508703.711371:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0b2be00/0xb126349c40e76905 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1102:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa75f1d expref: 174 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711380:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1102:0x0].0x0 (ffff9090cf431300) 00010000:00010000:3.0:1787508703.711392:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e5bd6200/0xb126349c40e76443 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1101:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa75dc6 expref: 173 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711402:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1101:0x0].0x0 (ffff9090cf431b00) 00010000:00010000:3.0:1787508703.711412:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cdd4a400/0xb126349c40e763e1 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1100:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa75da3 expref: 172 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711424:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1100:0x0].0x0 (ffff9090cd17a000) 00010000:00010000:3.0:1787508703.711434:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091c588b000/0xb126349c40e7636a lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10ff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa75d80 expref: 171 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711448:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10ff:0x0].0x0 (ffff9090cf431000) 00010000:00010000:3.0:1787508703.711460:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9092021c9e00/0xb126349c40e762b4 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10fe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa75d4f expref: 170 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711469:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10fe:0x0].0x0 (ffff9091d552d400) 00010000:00010000:3.0:1787508703.711479:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d1c8b800/0xb126349c40e75ff8 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10fc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa75c76 expref: 169 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711490:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10fc:0x0].0x0 (ffff9090cd17a600) 00010000:00010000:3.0:1787508703.711501:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9c6e000/0xb126349c40e75f65 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10fb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa75c68 expref: 168 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711509:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10fb:0x0].0x0 (ffff9090cd17ac00) 00010000:00010000:3.0:1787508703.711519:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cdd4a800/0xb126349c40e75efc lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10fa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa75c4c expref: 167 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711528:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10fa:0x0].0x0 (ffff9090cf431200) 00010000:00010000:3.0:1787508703.711537:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cdd4a200/0xb126349c40e75ea8 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10f9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa75c30 expref: 166 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711547:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10f9:0x0].0x0 (ffff9090cd17a700) 00010000:00010000:3.0:1787508703.711557:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c10e0400/0xb126349c40e757d2 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x10f8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa75a3f expref: 165 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711567:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10f8:0x0].0x0 (ffff9091cc251100) 00010000:00010000:3.0:1787508703.711579:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e36ce600/0xb126349c40e75413 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10f7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7592e expref: 164 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711588:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10f7:0x0].0x0 (ffff9090cf431800) 00010000:00010000:3.0:1787508703.711599:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090da371000/0xb126349c40e75356 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10f6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa758fd expref: 163 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711608:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10f6:0x0].0x0 (ffff9090d2302b00) 00010000:00010000:3.0:1787508703.711618:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090da370800/0xb126349c40e752b5 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10f5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa758e1 expref: 162 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711628:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10f5:0x0].0x0 (ffff9090cf431a00) 00010000:00010000:3.0:1787508703.711638:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c10e1600/0xb126349c40e75261 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10f4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa758c5 expref: 161 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.711647:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10f4:0x0].0x0 (ffff9091cc251900) 00010000:00010000:2.0:1787508703.711797:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1005:0x0].0x0 (ffff9091d43a5400) 00010000:00010000:2.0:1787508703.711885:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c99e6400/0xb126349c40e92dce lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1002:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7dff5 expref: 306 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.711899:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1002:0x0].0x0 (ffff9090d218ea00) 00010000:00010000:2.0:1787508703.711924:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d301a400/0xb126349c40e92cee lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1001:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7dfb6 expref: 305 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.711934:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1001:0x0].0x0 (ffff9090e4babe00) 00010000:00010000:3.0:1787508703.712129:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090da370c00/0xb126349c40e74c25 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10f2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa756d4 expref: 160 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.712139:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10f2:0x0].0x0 (ffff9090d38d0100) 00010000:00010000:3.0:1787508703.712150:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e36cfc00/0xb126349c40e74bd1 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10f1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa756c6 expref: 159 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.712158:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10f1:0x0].0x0 (ffff9090d1ceee00) 00010000:00010000:3.0:1787508703.712168:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e36cf200/0xb126349c40e74b37 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10f0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa756aa expref: 158 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.712183:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10f0:0x0].0x0 (ffff9090d2302d00) 00010000:00010000:3.0:1787508703.712194:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090da371600/0xb126349c40e74ae3 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10ef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7568e expref: 157 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.712203:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10ef:0x0].0x0 (ffff9090d38d0b00) 00010000:00010000:3.0:1787508703.712214:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c10e0e00/0xb126349c40e7444c lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x10ee:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa754b2 expref: 156 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.712226:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10ee:0x0].0x0 (ffff9091f95c0f00) 00010000:00010000:3.0:1787508703.712236:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e5bd7a00/0xb126349c40e73b46 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x10ed:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa75219 expref: 155 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.712246:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10ed:0x0].0x0 (ffff9091c76ce100) 00010000:00010000:3.0:1787508703.712256:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cdd4b400/0xb126349c40e73764 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10ec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa75101 expref: 154 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.712269:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10ec:0x0].0x0 (ffff9090d4d92900) 00010000:00010000:3.0:1787508703.712280:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e5bd7800/0xb126349c40e736df lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa750d7 expref: 153 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.712288:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10eb:0x0].0x0 (ffff9090d4d92300) 00010000:00010000:3.0:1787508703.712298:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cdd4be00/0xb126349c40e7364c lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10ea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa750b4 expref: 152 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.712308:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10ea:0x0].0x0 (ffff9091d213f900) 00010000:00010000:3.0:1787508703.712320:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090da371800/0xb126349c40e735c0 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10e9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa75091 expref: 151 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.712330:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10e9:0x0].0x0 (ffff9090d4d92e00) 00010000:00010000:3.0:1787508703.712341:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9d22600/0xb126349c40e72e9d lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x10e8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa74e8b expref: 150 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.712353:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10e8:0x0].0x0 (ffff9092021f2000) 00010000:00010000:3.0:1787508703.712363:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9d23000/0xb126349c40e729f7 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10e7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa74d3b expref: 149 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.712373:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10e7:0x0].0x0 (ffff9092021f2d00) 00010000:00010000:3.0:1787508703.712383:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090da370600/0xb126349c40e72980 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10e6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa74d18 expref: 148 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.712392:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10e6:0x0].0x0 (ffff9091d39d2f00) 00010000:00010000:3.0:1787508703.712403:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e5bd6800/0xb126349c40e72909 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10e5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa74cee expref: 147 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.712413:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10e5:0x0].0x0 (ffff9091d213f500) 00010000:00010000:3.0:1787508703.712423:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cf74a200/0xb126349c40e7288b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10e4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa74ccb expref: 146 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.712434:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10e4:0x0].0x0 (ffff9091d39d2e00) 00010000:00010000:3.0:1787508703.712444:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cf74a600/0xb126349c40e71965 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x10e2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa74872 expref: 145 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.712457:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10e2:0x0].0x0 (ffff9091cc251300) 00010000:00010000:3.0:1787508703.712469:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e36dd600/0xb126349c40e71567 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10e1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7475a expref: 144 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.712479:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10e1:0x0].0x0 (ffff9091c8d58d00) 00010000:00010000:3.0:1787508703.712490:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c8098400/0xb126349c40e714e9 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10e0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa74729 expref: 143 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.712499:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10e0:0x0].0x0 (ffff9090d38d0200) 00010000:00010000:3.0:1787508703.712510:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3fad400/0xb126349c40e713ed lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10df:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa746e3 expref: 142 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.712518:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10df:0x0].0x0 (ffff9090e33ff500) 00010000:00010000:3.0:1787508703.712529:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e5bd6000/0xb126349c40e7135a lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10de:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa746c0 expref: 141 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.712540:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10de:0x0].0x0 (ffff9091c8d58600) 00010000:00010000:3.0:1787508703.712549:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091f9b20e00/0xb126349c40e70c22 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x10dd:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa744ba expref: 140 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.712559:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10dd:0x0].0x0 (ffff9091cc251700) 00010000:00010000:3.0:1787508703.712570:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5555400/0xb126349c40e7038c lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x10dc:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa74228 expref: 139 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.712581:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10dc:0x0].0x0 (ffff9091c8b72200) 00010000:00010000:3.0:1787508703.712592:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cdd4ba00/0xb126349c40e6ff5d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10db:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa74102 expref: 138 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.712601:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10db:0x0].0x0 (ffff9091c8b72300) 00010000:00010000:3.0:1787508703.712610:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3fac800/0xb126349c40e6ff17 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10da:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa740e6 expref: 137 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.712619:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10da:0x0].0x0 (ffff9090c984de00) 00010000:00010000:3.0:1787508703.712628:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e0800/0xb126349c40e6fe84 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa740b5 expref: 136 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.712637:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10d9:0x0].0x0 (ffff9090cf093f00) 00010000:00010000:3.0:1787508703.712647:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3fac600/0xb126349c40e6fddc lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10d8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa74084 expref: 135 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.712779:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d301aa00/0xb126349c40e92c4d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1000:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7dfa1 expref: 304 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.712790:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1000:0x0].0x0 (ffff9090c9878700) 00010000:00010000:2.0:1787508703.712802:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d301b200/0xb126349c40e92bd6 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfff:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7df77 expref: 303 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.712811:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfff:0x0].0x0 (ffff9091d43a5f00) 00010000:00010000:2.0:1787508703.712898:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c7ad8800/0xb126349c40e9214f lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xffd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7dc8a expref: 302 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.712919:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xffd:0x0].0x0 (ffff9091d62de100) 00010000:00010000:2.0:1787508703.712933:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25a00/0xb126349c40e920f4 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xffc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7dc6e expref: 301 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.712977:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xffc:0x0].0x0 (ffff9090d3e9a100) 00010000:00010000:2.0:1787508703.712992:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb24600/0xb126349c40e9208b lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xffb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7dc3d expref: 300 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713001:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xffb:0x0].0x0 (ffff9090d1cee900) 00010000:00010000:2.0:1787508703.713010:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e6fc0600/0xb126349c40e91f96 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xffa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7dbf0 expref: 299 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713018:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xffa:0x0].0x0 (ffff9090c9878a00) 00010000:00010000:2.0:1787508703.713028:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3585c00/0xb126349c40e914de lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xff8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7d8ee expref: 298 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713037:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xff8:0x0].0x0 (ffff9090d0fe0800) 00010000:00010000:2.0:1787508703.713049:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a30400/0xb126349c40e91395 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xff7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7d8a1 expref: 297 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713057:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xff7:0x0].0x0 (ffff9090cf431100) 00010000:00010000:2.0:1787508703.713070:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a31800/0xb126349c40e9132c lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xff6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7d88c expref: 296 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713085:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xff6:0x0].0x0 (ffff9090d0fe0100) 00010000:00010000:2.0:1787508703.713096:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cc80f400/0xb126349c40e912d8 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xff5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7d870 expref: 295 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713105:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xff5:0x0].0x0 (ffff9090c96b8a00) 00010000:00010000:2.0:1787508703.713116:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d7f7e400/0xb126349c40e90119 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xff2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7d345 expref: 294 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713128:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xff2:0x0].0x0 (ffff9090cc78b500) 00010000:00010000:2.0:1787508703.713138:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cf775000/0xb126349c40e8ffd0 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xff1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7d2f8 expref: 293 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713148:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xff1:0x0].0x0 (ffff9090cc78b800) 00010000:00010000:2.0:1787508703.713159:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d54e5800/0xb126349c40e8ff59 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xff0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7d2dc expref: 292 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713169:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xff0:0x0].0x0 (ffff9090ce8a2b00) 00010000:00010000:2.0:1787508703.713182:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d301b000/0xb126349c40e8ff13 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfef:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7d2c7 expref: 291 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713192:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfef:0x0].0x0 (ffff9090e33ff800) 00010000:00010000:2.0:1787508703.713202:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25200/0xb126349c40e8f916 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7d0f9 expref: 290 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713209:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfed:0x0].0x0 (ffff9090e33ff400) 00010000:00010000:2.0:1787508703.713220:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3584800/0xb126349c40e8f87c lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7d0c8 expref: 289 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713229:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfec:0x0].0x0 (ffff9090d2302800) 00010000:00010000:2.0:1787508703.713239:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cf774000/0xb126349c40e8f7b8 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfeb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7d097 expref: 288 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713249:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfeb:0x0].0x0 (ffff9090d2302400) 00010000:00010000:2.0:1787508703.713259:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d301be00/0xb126349c40e8f71e lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfea:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7d074 expref: 287 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713268:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfea:0x0].0x0 (ffff9090d3e9a300) 00010000:00010000:2.0:1787508703.713277:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a76e00/0xb126349c40e8ec5f lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfe8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7cd64 expref: 286 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713286:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfe8:0x0].0x0 (ffff9090d3e9a000) 00010000:00010000:2.0:1787508703.713294:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3585600/0xb126349c40e8ebd3 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfe7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7cd33 expref: 285 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713301:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfe7:0x0].0x0 (ffff9091d39d2a00) 00010000:00010000:2.0:1787508703.713311:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cf774a00/0xb126349c40e8ead7 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfe6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7ccf4 expref: 284 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713319:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfe6:0x0].0x0 (ffff9090c9878900) 00010000:00010000:2.0:1787508703.713328:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e6fc1400/0xb126349c40e8ea4b lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfe5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7ccd1 expref: 283 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713342:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfe5:0x0].0x0 (ffff9090ca4f9500) 00010000:00010000:2.0:1787508703.713369:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25c00/0xb126349c40e8e003 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfe3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7c9d6 expref: 282 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713380:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfe3:0x0].0x0 (ffff9090cddfaa00) 00010000:00010000:2.0:1787508703.713391:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb24a00/0xb126349c40e8df3f lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfe2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7c99e expref: 281 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713400:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfe2:0x0].0x0 (ffff9090cf431900) 00010000:00010000:2.0:1787508703.713415:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25800/0xb126349c40e8de90 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfe1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7c982 expref: 280 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713424:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfe1:0x0].0x0 (ffff9091f95c0700) 00010000:00010000:2.0:1787508703.713433:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c8099e00/0xb126349c40e8de3c lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfe0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7c966 expref: 279 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713443:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfe0:0x0].0x0 (ffff9090cddfa900) 00010000:00010000:2.0:1787508703.713452:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdb25600/0xb126349c40e8d322 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfde:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7c648 expref: 278 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713461:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfde:0x0].0x0 (ffff9090e36b9a00) 00010000:00010000:2.0:1787508703.713473:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3585e00/0xb126349c40e8d29d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfdd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7c617 expref: 277 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713481:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfdd:0x0].0x0 (ffff9091c76ceb00) 00010000:00010000:2.0:1787508703.713499:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce8eb400/0xb126349c40e8d19a lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfdc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7c5d1 expref: 276 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713511:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfdc:0x0].0x0 (ffff9090d218e400) 00010000:00010000:2.0:1787508703.713523:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c99e6000/0xb126349c40e8d100 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfdb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7c5ae expref: 275 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713533:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfdb:0x0].0x0 (ffff9090ca4f9f00) 00010000:00010000:2.0:1787508703.713544:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdd4a600/0xb126349c40e8c57d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfd9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7c266 expref: 274 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713557:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfd9:0x0].0x0 (ffff9091d2128e00) 00010000:00010000:2.0:1787508703.713568:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c8af1200/0xb126349c40e8c51b lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfd8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7c23c expref: 273 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713577:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfd8:0x0].0x0 (ffff9091d213f800) 00010000:00010000:2.0:1787508703.713587:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d02af200/0xb126349c40e8c481 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfd7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7c20b expref: 272 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713595:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfd7:0x0].0x0 (ffff9091d213f300) 00010000:00010000:2.0:1787508703.713606:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d554e400/0xb126349c40e8c3e0 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfd6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7c1da expref: 271 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713616:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfd6:0x0].0x0 (ffff9090ca68e400) 00010000:00010000:2.0:1787508703.713627:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d7f7f800/0xb126349c40e8b905 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfd4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7bed1 expref: 270 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.713645:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfd4:0x0].0x0 (ffff9090d218e000) 00010000:00010000:3.0:1787508703.713763:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10d8:0x0].0x0 (ffff9090c984d800) 00010000:00010000:3.0:1787508703.713780:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cf74b400/0xb126349c40e6f2ad lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10d6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa73d4a expref: 134 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.713796:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10d6:0x0].0x0 (ffff9090d1b2b200) 00010000:00010000:3.0:1787508703.713809:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d1c8b200/0xb126349c40e6f1e9 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa73d20 expref: 133 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.713897:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10d5:0x0].0x0 (ffff9090cd17a500) 00010000:00010000:3.0:1787508703.713923:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d1c8a600/0xb126349c40e6f164 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10d4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa73d04 expref: 132 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714030:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10d4:0x0].0x0 (ffff9090cd17a400) 00010000:00010000:3.0:1787508703.714047:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d1c8b600/0xb126349c40e6f110 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10d3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa73ce8 expref: 131 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714057:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10d3:0x0].0x0 (ffff9090d1b2be00) 00010000:00010000:3.0:1787508703.714066:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3fad000/0xb126349c40e6ec47 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10d2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa73b98 expref: 130 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714074:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10d2:0x0].0x0 (ffff9090e33ff000) 00010000:00010000:3.0:1787508703.714082:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cdd4ae00/0xb126349c40e6ebd7 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10d1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa73b6e expref: 129 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714092:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10d1:0x0].0x0 (ffff9090cd17a100) 00010000:00010000:3.0:1787508703.714100:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cdd4a000/0xb126349c40e6eb60 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10d0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa73b4b expref: 128 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714107:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10d0:0x0].0x0 (ffff9090e33ff300) 00010000:00010000:3.0:1787508703.714116:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3faca00/0xb126349c40e6eabf lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10cf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa73b1a expref: 127 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714126:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10cf:0x0].0x0 (ffff9090e33ffe00) 00010000:00010000:3.0:1787508703.714136:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cf74a800/0xb126349c40e6e793 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa73a3a expref: 126 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714148:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10cd:0x0].0x0 (ffff9090cd17a900) 00010000:00010000:3.0:1787508703.714157:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cda82400/0xb126349c40e6e70e lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10cc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa73a1e expref: 125 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714166:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10cc:0x0].0x0 (ffff9090e33ff600) 00010000:00010000:3.0:1787508703.714174:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091ecbeb600/0xb126349c40e6e6ba lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10cb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa73a02 expref: 124 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714182:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10cb:0x0].0x0 (ffff9090e33ff900) 00010000:00010000:3.0:1787508703.714190:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9c6f400/0xb126349c40e6e682 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10ca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa739ed expref: 123 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714198:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10ca:0x0].0x0 (ffff9090ca68e300) 00010000:00010000:3.0:1787508703.714210:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091e6a2b200/0xb126349c40e6e054 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10c8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa73803 expref: 122 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714219:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10c8:0x0].0x0 (ffff9090cd17aa00) 00010000:00010000:3.0:1787508703.714230:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0f94a00/0xb126349c40e6dff9 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10c7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa737f5 expref: 121 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714240:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10c7:0x0].0x0 (ffff9090cd17af00) 00010000:00010000:3.0:1787508703.714250:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0f95e00/0xb126349c40e6df58 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10c6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa737d9 expref: 120 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714260:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10c6:0x0].0x0 (ffff9090cf093400) 00010000:00010000:3.0:1787508703.714269:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d1c8ae00/0xb126349c40e6df04 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10c5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa737bd expref: 119 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714282:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10c5:0x0].0x0 (ffff9090cd17a800) 00010000:00010000:3.0:1787508703.714291:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3facc00/0xb126349c40e6d7c5 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x10c4:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa735b7 expref: 118 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714301:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10c4:0x0].0x0 (ffff9090d1ceeb00) 00010000:00010000:3.0:1787508703.714310:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3fad800/0xb126349c40e6d388 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10c3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7348a expref: 117 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714318:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10c3:0x0].0x0 (ffff9091f95c0c00) 00010000:00010000:3.0:1787508703.714327:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d1c8aa00/0xb126349c40e6d357 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10c2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7347c expref: 116 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714335:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10c2:0x0].0x0 (ffff9090c96b8c00) 00010000:00010000:3.0:1787508703.714343:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ce8ebe00/0xb126349c40e6d2b6 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa73444 expref: 115 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714351:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10c1:0x0].0x0 (ffff9091c8b72000) 00010000:00010000:3.0:1787508703.714360:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d3fad200/0xb126349c40e6d20e lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10c0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa73413 expref: 114 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714367:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10c0:0x0].0x0 (ffff9091c8b72d00) 00010000:00010000:3.0:1787508703.714377:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d1c1c200/0xb126349c40e6cd8b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa732df expref: 113 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714385:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10bf:0x0].0x0 (ffff9090cc80b300) 00010000:00010000:3.0:1787508703.714396:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5554e00/0xb126349c40e6cd06 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10be:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa732ae expref: 112 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714405:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10be:0x0].0x0 (ffff9091f95c0800) 00010000:00010000:3.0:1787508703.714414:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ce26ae00/0xb126349c40e6ccab lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10bd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa73292 expref: 111 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714422:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10bd:0x0].0x0 (ffff9091f95c0e00) 00010000:00010000:3.0:1787508703.714431:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0f95000/0xb126349c40e6cc0a lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10bc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa73261 expref: 110 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714440:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10bc:0x0].0x0 (ffff9090cddfa600) 00010000:00010000:3.0:1787508703.714448:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5554600/0xb126349c40e6c963 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10ba:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa73196 expref: 109 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714457:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10ba:0x0].0x0 (ffff9090cc80b800) 00010000:00010000:3.0:1787508703.714466:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cf74aa00/0xb126349c40e6c8d0 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10b9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa73173 expref: 108 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714476:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10b9:0x0].0x0 (ffff9090c96b8000) 00010000:00010000:3.0:1787508703.714486:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ce26a600/0xb126349c40e6c80c lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10b8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa73149 expref: 107 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714494:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10b8:0x0].0x0 (ffff9090c96b8b00) 00010000:00010000:3.0:1787508703.714503:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ce26aa00/0xb126349c40e6c7d4 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10b7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa73134 expref: 106 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714515:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10b7:0x0].0x0 (ffff9090cc80b200) 00010000:00010000:3.0:1787508703.714525:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d1c1c000/0xb126349c40e6c09c lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x10b6:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa72f20 expref: 105 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714534:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10b6:0x0].0x0 (ffff9090d1b2b600) 00010000:00010000:3.0:1787508703.714543:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cf74ae00/0xb126349c40e6bc0b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10b5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa72dde expref: 104 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714551:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10b5:0x0].0x0 (ffff9090d1b2ba00) 00010000:00010000:3.0:1787508703.714560:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cf74b600/0xb126349c40e6bbb7 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10b4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa72dbb expref: 103 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714567:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10b4:0x0].0x0 (ffff9091d39d2400) 00010000:00010000:3.0:1787508703.714576:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d1c8ba00/0xb126349c40e6bb32 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa72d91 expref: 102 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714585:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10b3:0x0].0x0 (ffff9091d39d2600) 00010000:00010000:3.0:1787508703.714594:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ce26b400/0xb126349c40e6ba7c lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10b2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa72d60 expref: 101 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714601:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10b2:0x0].0x0 (ffff9091c8d58b00) 00010000:00010000:3.0:1787508703.714611:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cf74b000/0xb126349c40e6b44e lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa72b8b expref: 100 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714620:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10b0:0x0].0x0 (ffff9090e33ffc00) 00010000:00010000:3.0:1787508703.714631:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cf74b800/0xb126349c40e6b3c9 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10af:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa72b6f expref: 99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.714640:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10af:0x0].0x0 (ffff9091c8d58700) 00010000:00010000:3.0:1787508703.714649:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091f9b20200/0xb126349c40e6b37c lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10ae:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa72b53 expref: 98 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.714786:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e6fc0e00/0xb126349c40e8b833 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfd3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7bea0 expref: 269 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.714798:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfd3:0x0].0x0 (ffff9091cc215100) 00010000:00010000:2.0:1787508703.714809:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e6fc0800/0xb126349c40e8b792 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfd2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7be84 expref: 268 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.714887:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfd2:0x0].0x0 (ffff9090d218e600) 00010000:00010000:2.0:1787508703.714911:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cc80f000/0xb126349c40e8b73e lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfd1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7be68 expref: 267 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.714922:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfd1:0x0].0x0 (ffff9090cc78b200) 00010000:00010000:2.0:1787508703.714934:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cc80e800/0xb126349c40e8b029 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfcf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7bc46 expref: 266 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.714984:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfcf:0x0].0x0 (ffff9090e36b9200) 00010000:00010000:2.0:1787508703.714999:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e36dc600/0xb126349c40e8afdc lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfce:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7bc38 expref: 265 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715008:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfce:0x0].0x0 (ffff9090c6946a00) 00010000:00010000:2.0:1787508703.715019:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e6fc0400/0xb126349c40e8af57 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfcd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7bc1c expref: 264 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715027:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfcd:0x0].0x0 (ffff9090cf431700) 00010000:00010000:2.0:1787508703.715040:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d613c200/0xb126349c40e8af03 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfcc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7bc00 expref: 263 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715049:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfcc:0x0].0x0 (ffff9090e36b9700) 00010000:00010000:2.0:1787508703.715059:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d7f7f000/0xb126349c40e8a41a lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7b8cd expref: 262 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715071:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfca:0x0].0x0 (ffff9091f95c0000) 00010000:00010000:2.0:1787508703.715081:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e340fa00/0xb126349c40e8a2fb lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfc9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7b88e expref: 261 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715090:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfc9:0x0].0x0 (ffff9091c816f500) 00010000:00010000:2.0:1787508703.715099:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a77c00/0xb126349c40e8a284 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfc8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7b872 expref: 260 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715108:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfc8:0x0].0x0 (ffff9091c816f900) 00010000:00010000:2.0:1787508703.715117:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a77a00/0xb126349c40e8a23e lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfc7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7b85d expref: 259 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715126:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfc7:0x0].0x0 (ffff9090cddfac00) 00010000:00010000:2.0:1787508703.715137:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e36cf000/0xb126349c40e896a6 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfc5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7b523 expref: 258 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715146:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfc5:0x0].0x0 (ffff9091c76ce500) 00010000:00010000:2.0:1787508703.715156:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cc80fa00/0xb126349c40e89644 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfc4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7b500 expref: 257 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715170:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfc4:0x0].0x0 (ffff9091cb980400) 00010000:00010000:2.0:1787508703.715180:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cc80ec00/0xb126349c40e895cd lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfc3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7b4d6 expref: 256 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715190:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfc3:0x0].0x0 (ffff9091cb980f00) 00010000:00010000:2.0:1787508703.715200:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e6fc1c00/0xb126349c40e894e6 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfc2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7b490 expref: 255 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715208:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfc2:0x0].0x0 (ffff9090d3c50000) 00010000:00010000:2.0:1787508703.715220:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d7f7f200/0xb126349c40e88ed4 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfc0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7b2b4 expref: 254 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715230:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfc0:0x0].0x0 (ffff9090cd063700) 00010000:00010000:2.0:1787508703.715241:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cc80e000/0xb126349c40e88e1e lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfbf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7b28a expref: 253 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715250:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfbf:0x0].0x0 (ffff9090ce8a2700) 00010000:00010000:2.0:1787508703.715262:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d02aee00/0xb126349c40e88d61 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfbe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7b267 expref: 252 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715271:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfbe:0x0].0x0 (ffff9090ce8a2800) 00010000:00010000:2.0:1787508703.715280:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cc80e400/0xb126349c40e88d1b lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfbd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7b252 expref: 251 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715288:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfbd:0x0].0x0 (ffff9090cd063200) 00010000:00010000:2.0:1787508703.715299:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090da371a00/0xb126349c40e88630 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfbb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7b03e expref: 250 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715308:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfbb:0x0].0x0 (ffff9090ca4f9c00) 00010000:00010000:2.0:1787508703.715319:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d7f7e600/0xb126349c40e885d5 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfba:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7b030 expref: 249 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715329:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfba:0x0].0x0 (ffff9090ca4f9000) 00010000:00010000:2.0:1787508703.715339:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c10e0600/0xb126349c40e88550 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfb9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7b014 expref: 248 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715349:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfb9:0x0].0x0 (ffff9091cb980700) 00010000:00010000:2.0:1787508703.715372:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ca69e600/0xb126349c40e884ee lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfb8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7aff1 expref: 247 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715384:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfb8:0x0].0x0 (ffff9091c816f300) 00010000:00010000:2.0:1787508703.715396:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e36dcc00/0xb126349c40e87de7 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfb6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7add6 expref: 246 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715404:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfb6:0x0].0x0 (ffff9091c8d58300) 00010000:00010000:2.0:1787508703.715414:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d02ae600/0xb126349c40e87d2a lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfb5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7adb3 expref: 245 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715422:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfb5:0x0].0x0 (ffff9090cddfa500) 00010000:00010000:2.0:1787508703.715432:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c10e1e00/0xb126349c40e87cd6 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfb4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7ad97 expref: 244 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715446:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfb4:0x0].0x0 (ffff9091d2128300) 00010000:00010000:2.0:1787508703.715456:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c8af1800/0xb126349c40e87c9e lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfb3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7ad82 expref: 243 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715466:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfb3:0x0].0x0 (ffff9090cd063100) 00010000:00010000:2.0:1787508703.715478:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d02af800/0xb126349c40e86a37 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfb0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7a842 expref: 242 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715487:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfb0:0x0].0x0 (ffff9091fde57800) 00010000:00010000:2.0:1787508703.715497:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ca69fc00/0xb126349c40e869e3 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfaf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7a826 expref: 241 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715505:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfaf:0x0].0x0 (ffff9090cc78ba00) 00010000:00010000:2.0:1787508703.715515:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d02af600/0xb126349c40e86950 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfae:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7a7ee expref: 240 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715523:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfae:0x0].0x0 (ffff9092021f2c00) 00010000:00010000:2.0:1787508703.715532:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d554f600/0xb126349c40e86877 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfad:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7a7af expref: 239 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715541:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfad:0x0].0x0 (ffff9090cc78b400) 00010000:00010000:2.0:1787508703.715552:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1c8bc00/0xb126349c40e85d56 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7a49f expref: 238 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715562:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfab:0x0].0x0 (ffff9090ce8a2400) 00010000:00010000:2.0:1787508703.715575:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a77600/0xb126349c40e85cae lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfaa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7a460 expref: 237 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715584:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfaa:0x0].0x0 (ffff9090ce8a2f00) 00010000:00010000:2.0:1787508703.715594:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ca69f000/0xb126349c40e85bb2 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfa9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7a421 expref: 236 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715605:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfa9:0x0].0x0 (ffff9090ce8a2a00) 00010000:00010000:2.0:1787508703.715615:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d02af400/0xb126349c40e85b34 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfa8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7a405 expref: 235 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715623:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfa8:0x0].0x0 (ffff9090ce8a2500) 00010000:00010000:2.0:1787508703.715634:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a76a00/0xb126349c40e84960 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfa5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa79f04 expref: 234 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.715644:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfa5:0x0].0x0 (ffff9090cf431f00) 00010000:00010000:3.0:1787508703.715762:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10ae:0x0].0x0 (ffff9090e33ff700) 00010000:00010000:3.0:1787508703.715777:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cf74ba00/0xb126349c40e6b336 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10ad:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa72b3e expref: 97 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.715790:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10ad:0x0].0x0 (ffff9091c816fa00) 00010000:00010000:3.0:1787508703.715801:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cf74b200/0xb126349c40e6ad0f lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa72954 expref: 96 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.715812:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10ab:0x0].0x0 (ffff9091d2a7e300) 00010000:00010000:3.0:1787508703.715895:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0b2aa00/0xb126349c40e6acb4 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10aa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa72946 expref: 95 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.715915:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10aa:0x0].0x0 (ffff9091d2a7e000) 00010000:00010000:3.0:1787508703.715925:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d1c8ac00/0xb126349c40e6ac13 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10a9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7292a expref: 94 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.715935:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10a9:0x0].0x0 (ffff9091d2a7e100) 00010000:00010000:3.0:1787508703.716128:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ce26a200/0xb126349c40e6abbf lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7290e expref: 93 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.716145:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10a8:0x0].0x0 (ffff9091d2a7e900) 00010000:00010000:3.0:1787508703.716156:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0f94e00/0xb126349c40e6a46b lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x10a7:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa726ec expref: 92 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.716166:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10a7:0x0].0x0 (ffff9090e33fff00) 00010000:00010000:3.0:1787508703.716177:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ce8ec800/0xb126349c40e69c30 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x10a6:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa72484 expref: 91 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.716187:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10a6:0x0].0x0 (ffff9090d4d92d00) 00010000:00010000:3.0:1787508703.716197:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9092021c9800/0xb126349c40e69894 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa72388 expref: 90 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.716205:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10a5:0x0].0x0 (ffff9091f95c0600) 00010000:00010000:3.0:1787508703.716214:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9092021c8c00/0xb126349c40e69816 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10a4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7235e expref: 89 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.716223:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10a4:0x0].0x0 (ffff9090ced0e700) 00010000:00010000:3.0:1787508703.716231:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9092021c9600/0xb126349c40e69744 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa72326 expref: 88 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.716240:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10a3:0x0].0x0 (ffff9090ca68eb00) 00010000:00010000:3.0:1787508703.716252:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9c6e800/0xb126349c40e696b8 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x10a2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa72303 expref: 87 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.716261:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10a2:0x0].0x0 (ffff9090ca68ef00) 00010000:00010000:3.0:1787508703.716270:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0f94800/0xb126349c40e68f2c lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x10a1:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa720e8 expref: 86 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.716279:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x10a1:0x0].0x0 (ffff9090ca68ee00) 00010000:00010000:3.0:1787508703.716287:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091ecbeb400/0xb126349c40e67f0a lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x109f:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa71c42 expref: 85 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.716297:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x109f:0x0].0x0 (ffff9090ced0e200) 00010000:00010000:3.0:1787508703.716306:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091f9b20600/0xb126349c40e67af7 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x109e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa71b0e expref: 84 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.716317:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x109e:0x0].0x0 (ffff9090cf0bfc00) 00010000:00010000:3.0:1787508703.716327:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9d22e00/0xb126349c40e67a8e lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x109d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa71b00 expref: 83 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.716336:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x109d:0x0].0x0 (ffff9090d218e700) 00010000:00010000:3.0:1787508703.716345:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5dd8000/0xb126349c40e67a09 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x109c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa71ae4 expref: 82 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.716353:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x109c:0x0].0x0 (ffff9090d218e800) 00010000:00010000:3.0:1787508703.716361:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e3b19400/0xb126349c40e679b5 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x109b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa71ac8 expref: 81 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.716369:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x109b:0x0].0x0 (ffff9090d218ed00) 00010000:00010000:3.0:1787508703.716378:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091f9b21200/0xb126349c40e67508 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x109a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa71978 expref: 80 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.716392:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x109a:0x0].0x0 (ffff9090cc78be00) 00010000:00010000:3.0:1787508703.716402:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5dd9400/0xb126349c40e674ad lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1099:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa71955 expref: 79 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.716411:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1099:0x0].0x0 (ffff9090cc78bf00) 00010000:00010000:3.0:1787508703.716418:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5dd9600/0xb126349c40e6741a lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1098:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa71924 expref: 78 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.716426:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1098:0x0].0x0 (ffff9090d218e900) 00010000:00010000:3.0:1787508703.716436:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5dd8200/0xb126349c40e67387 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1097:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa718f3 expref: 77 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.716447:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1097:0x0].0x0 (ffff9092021f2e00) 00010000:00010000:3.0:1787508703.716457:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091c983ce00/0xb126349c40e67085 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1095:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7181a expref: 76 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.716466:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1095:0x0].0x0 (ffff9090d2302300) 00010000:00010000:3.0:1787508703.716476:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0f94400/0xb126349c40e67015 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1094:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa71805 expref: 75 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.716485:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1094:0x0].0x0 (ffff9090ced0ef00) 00010000:00010000:3.0:1787508703.716495:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5554000/0xb126349c40e66fac lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1093:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa717f0 expref: 74 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.716504:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1093:0x0].0x0 (ffff9091d2128100) 00010000:00010000:3.0:1787508703.716514:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5555e00/0xb126349c40e66f58 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1092:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa717d4 expref: 73 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.716522:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1092:0x0].0x0 (ffff9092021f2600) 00010000:00010000:3.0:1787508703.716530:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5555600/0xb126349c40e668c1 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1091:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa715f1 expref: 72 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.716537:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1091:0x0].0x0 (ffff9090d2302000) 00010000:00010000:3.0:1787508703.716545:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e1800/0xb126349c40e65cff lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1090:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7129b expref: 71 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.716553:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1090:0x0].0x0 (ffff9090cf0bf200) 00010000:00010000:3.0:1787508703.716561:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d5dd8c00/0xb126349c40e650aa lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x108e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa70f0d expref: 70 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.716568:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x108e:0x0].0x0 (ffff9090cf0bf000) 00010000:00010000:3.0:1787508703.716577:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091ecbebc00/0xb126349c40e64ff4 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x108d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa70ece expref: 69 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.716584:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x108d:0x0].0x0 (ffff9090ca68e900) 00010000:00010000:3.0:1787508703.716592:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9c6fa00/0xb126349c40e64f61 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x108c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa70ea4 expref: 68 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.716599:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x108c:0x0].0x0 (ffff9090d3c50500) 00010000:00010000:3.0:1787508703.716608:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9d23e00/0xb126349c40e64ed5 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x108b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa70e88 expref: 67 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.716621:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x108b:0x0].0x0 (ffff9091da398600) 00010000:00010000:3.0:1787508703.716630:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9d23200/0xb126349c40e647c7 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x108a:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa70c97 expref: 66 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.716638:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x108a:0x0].0x0 (ffff9090d3c50a00) 00010000:00010000:3.0:1787508703.716646:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d613d800/0xb126349c40e63fbd lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1089:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa70a36 expref: 65 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.716792:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a77400/0xb126349c40e8490c lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfa4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa79ee8 expref: 233 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.716807:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfa4:0x0].0x0 (ffff9090cf0bf500) 00010000:00010000:2.0:1787508703.716895:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e340f800/0xb126349c40e848a3 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfa3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa79ebe expref: 232 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.716914:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfa3:0x0].0x0 (ffff9090cf093900) 00010000:00010000:2.0:1787508703.716928:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9814600/0xb126349c40e847ae lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfa2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa79e6a expref: 231 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.716983:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfa2:0x0].0x0 (ffff9090d1cee300) 00010000:00010000:2.0:1787508703.716996:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9814200/0xb126349c40e84109 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xfa0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa79c80 expref: 230 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717004:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xfa0:0x0].0x0 (ffff9090c6946600) 00010000:00010000:2.0:1787508703.717015:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d02ae200/0xb126349c40e8404c lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf9f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa79c5d expref: 229 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717024:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf9f:0x0].0x0 (ffff9090e33ff100) 00010000:00010000:2.0:1787508703.717034:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9d23a00/0xb126349c40e83fea lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf9e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa79c3a expref: 228 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717043:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf9e:0x0].0x0 (ffff9090c6946c00) 00010000:00010000:2.0:1787508703.717052:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cf74a400/0xb126349c40e83fa4 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf9d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa79c1e expref: 227 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717063:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf9d:0x0].0x0 (ffff9091d43a5500) 00010000:00010000:2.0:1787508703.717075:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c8af0400/0xb126349c40e82a2d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf9a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa79621 expref: 226 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717084:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf9a:0x0].0x0 (ffff9091c8d58100) 00010000:00010000:2.0:1787508703.717094:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c8af0000/0xb126349c40e829cb lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf99:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa795fe expref: 225 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717102:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf99:0x0].0x0 (ffff9091c8d58e00) 00010000:00010000:2.0:1787508703.717111:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d7f7fa00/0xb126349c40e82954 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf98:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa795d4 expref: 224 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717122:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf98:0x0].0x0 (ffff9090ca68ec00) 00010000:00010000:2.0:1787508703.717133:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c8af0800/0xb126349c40e82889 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf97:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7958e expref: 223 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717141:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf97:0x0].0x0 (ffff9090cc78bd00) 00010000:00010000:2.0:1787508703.717151:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1c8b400/0xb126349c40e81db5 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf95:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa792a1 expref: 222 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717162:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf95:0x0].0x0 (ffff9091c8b72600) 00010000:00010000:2.0:1787508703.717173:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d02ae800/0xb126349c40e81d3e lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf94:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7927e expref: 221 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717182:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf94:0x0].0x0 (ffff9090c984da00) 00010000:00010000:2.0:1787508703.717194:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c8af0600/0xb126349c40e81ce3 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf93:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7925b expref: 220 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717203:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf93:0x0].0x0 (ffff9091c8b72800) 00010000:00010000:2.0:1787508703.717214:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e340f200/0xb126349c40e81c0a lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf92:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa79223 expref: 219 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717224:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf92:0x0].0x0 (ffff9090cc80be00) 00010000:00010000:2.0:1787508703.717234:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d54e4a00/0xb126349c40e814ee lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa79008 expref: 218 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717248:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf90:0x0].0x0 (ffff9090d1cee100) 00010000:00010000:2.0:1787508703.717258:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9092021c8600/0xb126349c40e81493 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf8f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa78ffa expref: 217 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717267:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf8f:0x0].0x0 (ffff9090d751cb00) 00010000:00010000:2.0:1787508703.717280:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d54e5400/0xb126349c40e8140e lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa78fde expref: 216 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717289:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf8e:0x0].0x0 (ffff9090d751ca00) 00010000:00010000:2.0:1787508703.717298:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c10e1800/0xb126349c40e813ba lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf8d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa78fc2 expref: 215 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717307:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf8d:0x0].0x0 (ffff9090d1ceec00) 00010000:00010000:2.0:1787508703.717316:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d54e4e00/0xb126349c40e80d0e lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf8b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa78dbc expref: 214 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717326:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf8b:0x0].0x0 (ffff9090d751c000) 00010000:00010000:2.0:1787508703.717335:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21000/0xb126349c40e80c97 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa78da7 expref: 213 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717344:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf8a:0x0].0x0 (ffff9090d751cf00) 00010000:00010000:2.0:1787508703.717354:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c8af1400/0xb126349c40e80c2e lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf89:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa78d92 expref: 212 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717364:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf89:0x0].0x0 (ffff9091c76cec00) 00010000:00010000:2.0:1787508703.717375:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c10e1200/0xb126349c40e80bda lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf88:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa78d76 expref: 211 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717385:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf88:0x0].0x0 (ffff9091c816fd00) 00010000:00010000:2.0:1787508703.717395:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c99e6800/0xb126349c40e80543 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf86:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa78b69 expref: 210 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717406:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf86:0x0].0x0 (ffff9090ca44a000) 00010000:00010000:2.0:1787508703.717417:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d54e4200/0xb126349c40e804da lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf85:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa78b5b expref: 209 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717426:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf85:0x0].0x0 (ffff9090d751c100) 00010000:00010000:2.0:1787508703.717437:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e3b19c00/0xb126349c40e80416 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf84:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa78b31 expref: 208 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717445:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf84:0x0].0x0 (ffff9090d218ef00) 00010000:00010000:2.0:1787508703.717456:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d554ee00/0xb126349c40e803e5 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf83:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa78b23 expref: 207 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717466:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf83:0x0].0x0 (ffff9090ca44a100) 00010000:00010000:2.0:1787508703.717477:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1c1ca00/0xb126349c40e7f93b lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf81:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7880c expref: 206 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717486:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf81:0x0].0x0 (ffff9090c9a22800) 00010000:00010000:2.0:1787508703.717496:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c99e7400/0xb126349c40e7f7f2 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf80:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa787bf expref: 205 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717509:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf80:0x0].0x0 (ffff9090ca44a500) 00010000:00010000:2.0:1787508703.717518:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9092021c8000/0xb126349c40e7f76d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf7f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa787a3 expref: 204 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717526:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf7f:0x0].0x0 (ffff9090ca68e600) 00010000:00010000:2.0:1787508703.717536:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9092021c9400/0xb126349c40e7f719 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf7e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa78787 expref: 203 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717544:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf7e:0x0].0x0 (ffff9091d552d100) 00010000:00010000:2.0:1787508703.717553:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5554400/0xb126349c40e7f10e lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf7c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa785ab expref: 202 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717562:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf7c:0x0].0x0 (ffff9091d213fe00) 00010000:00010000:2.0:1787508703.717573:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5dd9e00/0xb126349c40e7f012 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf7b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7856c expref: 201 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717583:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf7b:0x0].0x0 (ffff9090cf0bf600) 00010000:00010000:2.0:1787508703.717593:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d54e5e00/0xb126349c40e7ef8d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf7a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa78557 expref: 200 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717602:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf7a:0x0].0x0 (ffff9090e33ffb00) 00010000:00010000:2.0:1787508703.717612:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e36dca00/0xb126349c40e7ef1d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf79:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa78534 expref: 199 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717623:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf79:0x0].0x0 (ffff9091cb980d00) 00010000:00010000:2.0:1787508703.717634:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090da371c00/0xb126349c40e7e49d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf77:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa78239 expref: 198 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.717643:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf77:0x0].0x0 (ffff9091d39d2800) 00010000:00010000:3.0:1787508703.717755:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1089:0x0].0x0 (ffff9090d3c50600) 00010000:00010000:3.0:1787508703.717771:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c8099200/0xb126349c40e63b6b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1088:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa70909 expref: 64 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.717780:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1088:0x0].0x0 (ffff9091cb980200) 00010000:00010000:3.0:1787508703.717791:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e0400/0xb126349c40e63b17 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1087:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa708ed expref: 63 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.717800:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1087:0x0].0x0 (ffff9090cf093300) 00010000:00010000:3.0:1787508703.717809:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e0200/0xb126349c40e63a92 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1086:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa708bc expref: 62 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.717893:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1086:0x0].0x0 (ffff9091cb980e00) 00010000:00010000:3.0:1787508703.717918:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c8098c00/0xb126349c40e639d5 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1085:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7087d expref: 61 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.717929:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1085:0x0].0x0 (ffff9090d08ece00) 00010000:00010000:3.0:1787508703.717955:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c8098600/0xb126349c40e6331b lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1084:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa706bd expref: 60 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.717964:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1084:0x0].0x0 (ffff9091cc251800) 00010000:00010000:3.0:1787508703.717975:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9d22a00/0xb126349c40e62403 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1082:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa70280 expref: 59 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.717984:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1082:0x0].0x0 (ffff9090d1cee500) 00010000:00010000:3.0:1787508703.717995:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091c588bc00/0xb126349c40e623af lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1081:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7025d expref: 58 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718003:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1081:0x0].0x0 (ffff9090d1ceea00) 00010000:00010000:3.0:1787508703.718012:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9d22000/0xb126349c40e62315 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1080:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7022c expref: 57 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718021:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1080:0x0].0x0 (ffff9090d00cd100) 00010000:00010000:3.0:1787508703.718030:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091c57f8600/0xb126349c40e62282 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x107f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa70202 expref: 56 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718039:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x107f:0x0].0x0 (ffff9090d1cee600) 00010000:00010000:3.0:1787508703.718049:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091c57f9600/0xb126349c40e61b89 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x107e:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7000a expref: 55 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718059:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x107e:0x0].0x0 (ffff9090d3c50300) 00010000:00010000:3.0:1787508703.718068:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d613d000/0xb126349c40e61753 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x107d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6feeb expref: 54 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718081:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x107d:0x0].0x0 (ffff9091f95c0d00) 00010000:00010000:3.0:1787508703.718092:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d613cc00/0xb126349c40e616ff lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x107c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6fecf expref: 53 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718101:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x107c:0x0].0x0 (ffff9090d02ad100) 00010000:00010000:3.0:1787508703.718111:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9c6e600/0xb126349c40e61681 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x107b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6fe9e expref: 52 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718120:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x107b:0x0].0x0 (ffff9090d02ad500) 00010000:00010000:3.0:1787508703.718130:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d613c600/0xb126349c40e615c4 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x107a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6fe5f expref: 51 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718138:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x107a:0x0].0x0 (ffff9090d02ade00) 00010000:00010000:3.0:1787508703.718147:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c8098a00/0xb126349c40e60ee0 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1079:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6fc83 expref: 50 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718156:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1079:0x0].0x0 (ffff9090d08eca00) 00010000:00010000:3.0:1787508703.718165:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091e6a2a800/0xb126349c40e60af0 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1078:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6fb64 expref: 49 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718175:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1078:0x0].0x0 (ffff9091f95c0900) 00010000:00010000:3.0:1787508703.718185:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e36dd000/0xb126349c40e60a5d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1077:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6fb33 expref: 48 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718195:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1077:0x0].0x0 (ffff9090d00cda00) 00010000:00010000:3.0:1787508703.718204:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091e6a2bc00/0xb126349c40e609b5 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1076:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6fb02 expref: 47 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718215:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1076:0x0].0x0 (ffff9090d00cd200) 00010000:00010000:3.0:1787508703.718225:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091e6a2be00/0xb126349c40e60914 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1075:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6fadf expref: 46 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718233:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1075:0x0].0x0 (ffff9090d08ec400) 00010000:00010000:3.0:1787508703.718243:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0b2a400/0xb126349c40e5fa26 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1073:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6f694 expref: 45 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718253:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1073:0x0].0x0 (ffff9090ced0e300) 00010000:00010000:3.0:1787508703.718263:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d1c1d200/0xb126349c40e5f5f0 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1072:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6f575 expref: 44 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718272:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1072:0x0].0x0 (ffff9090ced0e100) 00010000:00010000:3.0:1787508703.718281:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cda83e00/0xb126349c40e5f59c lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1071:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6f559 expref: 43 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718290:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1071:0x0].0x0 (ffff9090cd17a200) 00010000:00010000:3.0:1787508703.718302:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cda83200/0xb126349c40e5f4d1 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1070:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6f513 expref: 42 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718313:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1070:0x0].0x0 (ffff9090cd17ab00) 00010000:00010000:3.0:1787508703.718323:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d1c1d000/0xb126349c40e5f445 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x106f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6f4f0 expref: 41 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718338:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x106f:0x0].0x0 (ffff9090cd17ad00) 00010000:00010000:3.0:1787508703.718347:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e36dde00/0xb126349c40e5ed76 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x106e:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6f30d expref: 40 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718356:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x106e:0x0].0x0 (ffff9090ced0ee00) 00010000:00010000:3.0:1787508703.718366:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd4a8200/0xb126349c40e5e95c lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x106d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6f1d9 expref: 39 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718373:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x106d:0x0].0x0 (ffff9091fde57d00) 00010000:00010000:3.0:1787508703.718384:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cda82600/0xb126349c40e5e8bb lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x106c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6f1a8 expref: 38 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718393:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x106c:0x0].0x0 (ffff9091cc215400) 00010000:00010000:3.0:1787508703.718403:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cda83400/0xb126349c40e5e852 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x106b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6f19a expref: 37 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718412:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x106b:0x0].0x0 (ffff9090d02ad600) 00010000:00010000:3.0:1787508703.718421:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d1c1c600/0xb126349c40e5e7e2 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x106a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6f177 expref: 36 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718430:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x106a:0x0].0x0 (ffff9091cc215c00) 00010000:00010000:3.0:1787508703.718440:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091c983c600/0xb126349c40e5dcac lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1068:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6ee52 expref: 35 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718450:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1068:0x0].0x0 (ffff9090d4d92a00) 00010000:00010000:3.0:1787508703.718461:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d9c6f200/0xb126349c40e5dc6d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1067:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6ee3d expref: 34 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718470:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1067:0x0].0x0 (ffff9091d552dd00) 00010000:00010000:3.0:1787508703.718479:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ce8ed400/0xb126349c40e5dbbe lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1066:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6edfe expref: 33 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718489:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1066:0x0].0x0 (ffff9091fde57900) 00010000:00010000:3.0:1787508703.718500:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090ce8ec200/0xb126349c40e5db2b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1065:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6edd4 expref: 32 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718509:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1065:0x0].0x0 (ffff9091d552de00) 00010000:00010000:3.0:1787508703.718519:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e3b19e00/0xb126349c40e5d3d7 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x1064:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6ebc7 expref: 31 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718528:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1064:0x0].0x0 (ffff9090d4d92200) 00010000:00010000:3.0:1787508703.718536:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091c588aa00/0xb126349c40e5cfa1 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1063:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6ea93 expref: 30 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718545:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1063:0x0].0x0 (ffff9091d39d2200) 00010000:00010000:3.0:1787508703.718555:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091e6a2a400/0xb126349c40e5cef2 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1062:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6ea5b expref: 29 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718563:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1062:0x0].0x0 (ffff9090d02adf00) 00010000:00010000:3.0:1787508703.718571:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd4a9400/0xb126349c40e5ce7b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1061:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6ea38 expref: 28 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718585:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1061:0x0].0x0 (ffff9090d4d92400) 00010000:00010000:3.0:1787508703.718596:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091e6a2aa00/0xb126349c40e5cde8 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1060:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6ea1c expref: 27 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718604:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1060:0x0].0x0 (ffff9090d4d92800) 00010000:00010000:3.0:1787508703.718613:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091e6a2a200/0xb126349c40e5c72e lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x105f:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6e84e expref: 26 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718621:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x105f:0x0].0x0 (ffff9090d4d92600) 00010000:00010000:3.0:1787508703.718630:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cda82200/0xb126349c40e5bf1d lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x105e:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6e5ed expref: 25 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.718638:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x105e:0x0].0x0 (ffff9091cc251000) 00010000:00010000:3.0:1787508703.718649:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d613de00/0xb126349c40e5bb18 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x105d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6e4c7 expref: 24 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.718794:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091ecbea600/0xb126349c40e7e442 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf76:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7821d expref: 197 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.718808:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf76:0x0].0x0 (ffff9090d751c300) 00010000:00010000:2.0:1787508703.718895:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cf74be00/0xb126349c40e7e385 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf75:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa781f3 expref: 196 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.718916:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf75:0x0].0x0 (ffff9090d1b2bd00) 00010000:00010000:2.0:1787508703.718928:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091ecbeba00/0xb126349c40e7e2f9 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf74:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa781d0 expref: 195 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.718937:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf74:0x0].0x0 (ffff9090d1b2b900) 00010000:00010000:2.0:1787508703.718991:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce26ba00/0xb126349c40e7d8d4 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf72:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa77ee3 expref: 194 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.718999:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf72:0x0].0x0 (ffff9090c9a22100) 00010000:00010000:2.0:1787508703.719009:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad600/0xb126349c40e7d799 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf71:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa77e8f expref: 193 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.719017:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf71:0x0].0x0 (ffff9090ca44ab00) 00010000:00010000:2.0:1787508703.719026:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d54e4600/0xb126349c40e7d6f8 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf70:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa77e73 expref: 192 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.719040:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf70:0x0].0x0 (ffff9090c9a22900) 00010000:00010000:2.0:1787508703.719048:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091e6a2ba00/0xb126349c40e7d6a4 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf6f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa77e57 expref: 191 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508703.719056:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf6f:0x0].0x0 (ffff9090ca44a400) 00010000:00010000:2.0:1787508703.719062:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508703.720196:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x105d:0x0].0x0 (ffff9090c984d900) 00010000:00010000:3.0:1787508703.720218:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0b2ae00/0xb126349c40e5ba7e lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x105c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6e496 expref: 23 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.720227:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x105c:0x0].0x0 (ffff9091cb980100) 00010000:00010000:3.0:1787508703.720236:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd4a8e00/0xb126349c40e5b9dd lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x105b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6e46c expref: 22 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.720244:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x105b:0x0].0x0 (ffff9091cb980c00) 00010000:00010000:3.0:1787508703.720253:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091c983c400/0xb126349c40e5b94a lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x105a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6e449 expref: 21 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.720261:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x105a:0x0].0x0 (ffff9090c984dc00) 00010000:00010000:3.0:1787508703.720269:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d0b2a600/0xb126349c40e5ac62 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1058:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6e07c expref: 20 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.720276:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1058:0x0].0x0 (ffff9091fde57700) 00010000:00010000:3.0:1787508703.720284:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091c588ba00/0xb126349c40e5abb3 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1057:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6e059 expref: 19 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.720292:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1057:0x0].0x0 (ffff9091fde57200) 00010000:00010000:3.0:1787508703.720300:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c8099800/0xb126349c40e5ab4a lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1056:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6e02f expref: 18 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.720307:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1056:0x0].0x0 (ffff9091fde57400) 00010000:00010000:3.0:1787508703.720315:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091c588b200/0xb126349c40e5aa5c lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1055:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6dfe9 expref: 17 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.720322:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1055:0x0].0x0 (ffff9090d1b2b500) 00010000:00010000:3.0:1787508703.720331:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9091c588a200/0xb126349c40e5a76f lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1053:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6df10 expref: 16 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.720339:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1053:0x0].0x0 (ffff9091cb980b00) 00010000:00010000:3.0:1787508703.720347:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd4a9800/0xb126349c40e5a6ff lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1052:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6defb expref: 15 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.720360:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1052:0x0].0x0 (ffff9090d02ad200) 00010000:00010000:3.0:1787508703.720368:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd4a9e00/0xb126349c40e5a696 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x1051:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6dee6 expref: 14 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.720375:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x1051:0x0].0x0 (ffff9091cb980a00) 00010000:00010000:3.0:1787508703.720379:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508703.720447:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9f18850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:288263:x1874324509602688:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 10943us (11144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508703.720456:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9808 00000100:00100000:3.0:1787508703.720510:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9f18c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+190:287589:x1874324509602560:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 20053us (20212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508703.720516:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9807 00000100:00100000:1.0:1787508703.737178:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508703.737260:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509602816 00000100:00100000:3.0:1787508703.737271:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509602816 00000100:00100000:3.0:1787508703.737335:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9809 00000100:00100000:3.0:1787508703.737344:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+190:287589:x1874324509602816:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508703.737358:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 180 locks, starting at 0 00010000:00010000:3.0:1787508703.737380:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d554fe00/0xb126349c40e7d076 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf6d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa77c74 expref: 190 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.737399:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf6d:0x0].0x0 (ffff9091da051000) 00010000:00010000:3.0:1787508703.737413:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21800/0xb126349c40e7cf8f lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf6c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa77c3c expref: 189 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.737423:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf6c:0x0].0x0 (ffff9090cf093b00) 00010000:00010000:3.0:1787508703.737432:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e5bd7c00/0xb126349c40e7cee0 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf6b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa77c19 expref: 188 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.741883:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf6b:0x0].0x0 (ffff9090cf093d00) 00010000:00010000:3.0:1787508703.741933:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e5bd6400/0xb126349c40e7ce9a lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf6a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa77c04 expref: 187 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.741960:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf6a:0x0].0x0 (ffff9091da398200) 00010000:00010000:3.0:1787508703.741972:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d554fc00/0xb126349c40e7c834 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf68:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa77a0c expref: 186 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.741981:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf68:0x0].0x0 (ffff9091d39d2300) 00010000:00010000:3.0:1787508703.741992:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fada00/0xb126349c40e7c746 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf67:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa779cd expref: 185 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742000:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf67:0x0].0x0 (ffff9090d08ec200) 00010000:00010000:3.0:1787508703.742011:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c8af1000/0xb126349c40e7c6a5 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf66:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa779b1 expref: 184 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742019:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf66:0x0].0x0 (ffff9091d39d2500) 00010000:00010000:3.0:1787508703.742029:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091ecbea800/0xb126349c40e7c651 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf65:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa77995 expref: 183 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742038:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf65:0x0].0x0 (ffff9091d39d2900) 00010000:00010000:3.0:1787508703.742047:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c9a76800/0xb126349c40e7b071 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf62:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa77359 expref: 182 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742066:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf62:0x0].0x0 (ffff9090c9a22600) 00010000:00010000:3.0:1787508703.742076:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e36dc000/0xb126349c40e7af75 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf61:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7731a expref: 181 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742085:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf61:0x0].0x0 (ffff9090ca44aa00) 00010000:00010000:3.0:1787508703.742107:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cf74bc00/0xb126349c40e7aec6 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf60:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa772f7 expref: 180 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742117:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf60:0x0].0x0 (ffff9090c6946100) 00010000:00010000:3.0:1787508703.742127:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5555c00/0xb126349c40e7ae79 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf5f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa772db expref: 179 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742135:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf5f:0x0].0x0 (ffff9090cc80b600) 00010000:00010000:3.0:1787508703.742145:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c99e7a00/0xb126349c40e7a390 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf5d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa76fe0 expref: 178 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742153:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf5d:0x0].0x0 (ffff9091c8b72b00) 00010000:00010000:3.0:1787508703.742162:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1c8a200/0xb126349c40e7a32e lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf5c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa76fb6 expref: 177 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742172:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf5c:0x0].0x0 (ffff9091c8b72700) 00010000:00010000:3.0:1787508703.742183:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac200/0xb126349c40e7a2a9 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf5b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa76f8c expref: 176 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742193:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf5b:0x0].0x0 (ffff9091deebba00) 00010000:00010000:3.0:1787508703.742204:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3face00/0xb126349c40e7a1d0 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf5a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa76f54 expref: 175 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742212:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf5a:0x0].0x0 (ffff9091cc251400) 00010000:00010000:3.0:1787508703.742220:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac000/0xb126349c40e79cc8 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf59:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa76df6 expref: 174 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742228:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf59:0x0].0x0 (ffff9090c6946e00) 00010000:00010000:3.0:1787508703.742236:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c10e0200/0xb126349c40e79c5f lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf58:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa76dcc expref: 173 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742244:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf58:0x0].0x0 (ffff9090ca44a600) 00010000:00010000:3.0:1787508703.742251:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c10e1400/0xb126349c40e79bef lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf57:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa76da9 expref: 172 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742258:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf57:0x0].0x0 (ffff9090c6946800) 00010000:00010000:3.0:1787508703.742266:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9092021c8a00/0xb126349c40e79b1d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf56:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa76d6a expref: 171 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742275:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf56:0x0].0x0 (ffff9090ca44a900) 00010000:00010000:3.0:1787508703.742283:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e36ce400/0xb126349c40e79781 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf54:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa76c60 expref: 170 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742292:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf54:0x0].0x0 (ffff9090c6946700) 00010000:00010000:3.0:1787508703.742299:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091c0031200/0xb126349c40e79711 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf53:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa76c4b expref: 169 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742312:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf53:0x0].0x0 (ffff9090ca44ac00) 00010000:00010000:3.0:1787508703.742321:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e36ce000/0xb126349c40e796a8 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf52:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa76c36 expref: 168 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742329:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf52:0x0].0x0 (ffff9090d2302500) 00010000:00010000:3.0:1787508703.742339:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c10e0c00/0xb126349c40e7964d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf51:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa76c13 expref: 167 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742345:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf51:0x0].0x0 (ffff9091d2ae5d00) 00010000:00010000:3.0:1787508703.742354:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21400/0xb126349c40e78b56 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf4f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7690a expref: 166 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742361:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf4f:0x0].0x0 (ffff9090ca44ae00) 00010000:00010000:3.0:1787508703.742369:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c10e1c00/0xb126349c40e78af4 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf4e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa768e0 expref: 165 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742376:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf4e:0x0].0x0 (ffff9090c9a22700) 00010000:00010000:3.0:1787508703.742383:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce26be00/0xb126349c40e78a6f lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf4d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa768b6 expref: 164 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742390:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf4d:0x0].0x0 (ffff9090c9a22d00) 00010000:00010000:3.0:1787508703.742398:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091c57f9400/0xb126349c40e78988 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf4c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7687e expref: 163 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742407:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf4c:0x0].0x0 (ffff9090c9a22f00) 00010000:00010000:3.0:1787508703.742416:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091c0031000/0xb126349c40e782dc lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf4a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7667f expref: 162 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742423:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf4a:0x0].0x0 (ffff9090c984d200) 00010000:00010000:3.0:1787508703.742431:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e5bd6600/0xb126349c40e7829d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf49:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa76671 expref: 161 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742440:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf49:0x0].0x0 (ffff9090c984d600) 00010000:00010000:3.0:1787508703.742448:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c8099600/0xb126349c40e781fc lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf48:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa76655 expref: 160 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742457:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf48:0x0].0x0 (ffff9090d2302c00) 00010000:00010000:3.0:1787508703.742464:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090da370e00/0xb126349c40e781a1 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf47:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa76632 expref: 159 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742472:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf47:0x0].0x0 (ffff9090c96b8900) 00010000:00010000:3.0:1787508703.742480:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cf74a000/0xb126349c40e7768e lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf45:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7631b expref: 158 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742490:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf45:0x0].0x0 (ffff9090e33ff200) 00010000:00010000:3.0:1787508703.742498:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdd4b000/0xb126349c40e7761e lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa762f1 expref: 157 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742507:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf44:0x0].0x0 (ffff9090c96b8500) 00010000:00010000:3.0:1787508703.742515:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e36cf600/0xb126349c40e77599 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf43:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa762c7 expref: 156 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742527:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf43:0x0].0x0 (ffff9090c9a22b00) 00010000:00010000:3.0:1787508703.742535:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce8ea200/0xb126349c40e774ce lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf42:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7628f expref: 155 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742544:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf42:0x0].0x0 (ffff9090e33ffd00) 00010000:00010000:3.0:1787508703.742552:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c8099c00/0xb126349c40e76e37 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf40:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7609e expref: 154 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742559:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf40:0x0].0x0 (ffff9090cc80b500) 00010000:00010000:3.0:1787508703.742567:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdd4b600/0xb126349c40e76df8 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf3f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa76090 expref: 153 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742575:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf3f:0x0].0x0 (ffff9090c96b8400) 00010000:00010000:3.0:1787508703.742584:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091e6a2ae00/0xb126349c40e76d50 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa76074 expref: 152 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742591:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf3e:0x0].0x0 (ffff9090cc80b700) 00010000:00010000:3.0:1787508703.742600:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c10e1a00/0xb126349c40e76cfc lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf3d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa76058 expref: 151 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742608:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf3d:0x0].0x0 (ffff9091d213fb00) 00010000:00010000:3.0:1787508703.742616:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdd4aa00/0xb126349c40e7598b lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf3a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa75ac4 expref: 150 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742626:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf3a:0x0].0x0 (ffff9090cc80ba00) 00010000:00010000:3.0:1787508703.742635:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdd4ac00/0xb126349c40e7593e lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa75ab6 expref: 149 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742643:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf39:0x0].0x0 (ffff9090cc80bd00) 00010000:00010000:3.0:1787508703.742665:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdd4b800/0xb126349c40e758b2 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa75a9a expref: 148 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742675:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf38:0x0].0x0 (ffff9090cf431e00) 00010000:00010000:3.0:1787508703.742686:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e36cea00/0xb126349c40e7585e lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa75a7e expref: 147 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742694:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf37:0x0].0x0 (ffff9091cc215200) 00010000:00010000:3.0:1787508703.742702:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e5bd6e00/0xb126349c40e746c2 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa75561 expref: 146 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742709:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf34:0x0].0x0 (ffff9091f95c0a00) 00010000:00010000:3.0:1787508703.742717:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090da371200/0xb126349c40e745b1 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf33:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7551b expref: 145 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742725:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf33:0x0].0x0 (ffff9091d2a7ed00) 00010000:00010000:3.0:1787508703.742735:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d613d600/0xb126349c40e74510 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa754ff expref: 144 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742744:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf32:0x0].0x0 (ffff9090d3c50d00) 00010000:00010000:3.0:1787508703.742754:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090da370200/0xb126349c40e744bc lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa754e3 expref: 143 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742766:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf31:0x0].0x0 (ffff9090d3c50200) 00010000:00010000:3.0:1787508703.742775:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e36dd200/0xb126349c40e73e17 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa752e4 expref: 142 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742783:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf2f:0x0].0x0 (ffff9090d00cd300) 00010000:00010000:3.0:1787508703.742793:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1c1de00/0xb126349c40e73d5a lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa752c1 expref: 141 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742801:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf2e:0x0].0x0 (ffff9091fde57500) 00010000:00010000:3.0:1787508703.742810:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd4a8800/0xb126349c40e73cf8 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7529e expref: 140 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742818:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf2d:0x0].0x0 (ffff9091cc215a00) 00010000:00010000:3.0:1787508703.742827:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090da370000/0xb126349c40e73bbd lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa75243 expref: 139 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742834:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf2c:0x0].0x0 (ffff9091fde57c00) 00010000:00010000:3.0:1787508703.742843:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090da370a00/0xb126349c40e730b8 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa74f33 expref: 138 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742849:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf2a:0x0].0x0 (ffff9091cc215800) 00010000:00010000:3.0:1787508703.742857:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1c1c800/0xb126349c40e73064 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa74f10 expref: 137 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742866:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf29:0x0].0x0 (ffff9091d213fd00) 00010000:00010000:3.0:1787508703.742876:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090da371400/0xb126349c40e72fe6 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa74ee6 expref: 136 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742883:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf28:0x0].0x0 (ffff9091deebb700) 00010000:00010000:3.0:1787508703.742891:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6244000/0xb126349c40e72f30 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf27:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa74ea7 expref: 135 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742898:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf27:0x0].0x0 (ffff9091deebb200) 00010000:00010000:3.0:1787508703.742916:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e5bd6c00/0xb126349c40e723f3 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa74b97 expref: 134 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742925:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf25:0x0].0x0 (ffff9090d1b2b100) 00010000:00010000:3.0:1787508703.742935:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9d22c00/0xb126349c40e723b4 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa74b82 expref: 133 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742977:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf24:0x0].0x0 (ffff9090d1b2b300) 00010000:00010000:3.0:1787508703.742991:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e5bd7400/0xb126349c40e7232f lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa74b51 expref: 132 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.742999:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf23:0x0].0x0 (ffff9091d213ff00) 00010000:00010000:3.0:1787508703.743009:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091c0031400/0xb126349c40e72256 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa74b0b expref: 131 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743018:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf22:0x0].0x0 (ffff9090c96b8e00) 00010000:00010000:3.0:1787508703.743027:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d613c000/0xb126349c40e71b1e lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa748f7 expref: 130 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743040:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf20:0x0].0x0 (ffff9090e33ffa00) 00010000:00010000:3.0:1787508703.743048:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce26a400/0xb126349c40e71ad1 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa748e9 expref: 129 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743055:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf1f:0x0].0x0 (ffff9090d38d0000) 00010000:00010000:3.0:1787508703.743063:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e5bd7e00/0xb126349c40e71a4c lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa748cd expref: 128 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743071:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf1e:0x0].0x0 (ffff9090c96b8d00) 00010000:00010000:3.0:1787508703.743080:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fadc00/0xb126349c40e719f8 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa748b1 expref: 127 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743088:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf1d:0x0].0x0 (ffff9090d38d0c00) 00010000:00010000:3.0:1787508703.743096:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0f94c00/0xb126349c40e70e67 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa74570 expref: 126 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743104:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf1b:0x0].0x0 (ffff9091cc251a00) 00010000:00010000:3.0:1787508703.743112:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdd4bc00/0xb126349c40e70e13 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa74554 expref: 125 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743120:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf1a:0x0].0x0 (ffff9091cc251600) 00010000:00010000:3.0:1787508703.743129:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e5bd7000/0xb126349c40e70d8e lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa74523 expref: 124 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743137:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf19:0x0].0x0 (ffff9090d1b2bf00) 00010000:00010000:3.0:1787508703.743145:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cdd4b200/0xb126349c40e70ca7 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa744dd expref: 123 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743154:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf18:0x0].0x0 (ffff9090d1b2bb00) 00010000:00010000:3.0:1787508703.743162:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5554200/0xb126349c40e70561 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa742c2 expref: 122 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743170:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf16:0x0].0x0 (ffff9090cddfad00) 00010000:00010000:3.0:1787508703.743181:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9d22200/0xb126349c40e704dc lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa742a6 expref: 121 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743192:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf15:0x0].0x0 (ffff9091c8b72900) 00010000:00010000:3.0:1787508703.743202:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e36dc200/0xb126349c40e70481 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa74283 expref: 120 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743212:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf14:0x0].0x0 (ffff9090cf093c00) 00010000:00010000:3.0:1787508703.743220:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5555200/0xb126349c40e7042d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa74260 expref: 119 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743228:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf13:0x0].0x0 (ffff9091c8b72500) 00010000:00010000:3.0:1787508703.743238:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce26ac00/0xb126349c40e6f98a lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa73f50 expref: 118 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743246:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf11:0x0].0x0 (ffff9091c816f800) 00010000:00010000:3.0:1787508703.743257:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce26bc00/0xb126349c40e6f8fe lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa73f2d expref: 117 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743269:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf10:0x0].0x0 (ffff9091c8b72a00) 00010000:00010000:3.0:1787508703.743287:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce26b000/0xb126349c40e6f83a lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf0f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa73ef5 expref: 116 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743297:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf0f:0x0].0x0 (ffff9091f95c0300) 00010000:00010000:3.0:1787508703.743307:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9c6fe00/0xb126349c40e6f7a0 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf0e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa73ed2 expref: 115 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743316:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf0e:0x0].0x0 (ffff9091c816f400) 00010000:00010000:3.0:1787508703.743325:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1c8b000/0xb126349c40e6d9e0 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf0a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7365f expref: 114 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743334:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf0a:0x0].0x0 (ffff9090cf093700) 00010000:00010000:3.0:1787508703.743343:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce26b600/0xb126349c40e6d993 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf09:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa73643 expref: 113 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743350:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf09:0x0].0x0 (ffff9091f95c0b00) 00010000:00010000:3.0:1787508703.743359:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cda82a00/0xb126349c40e6d90e lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf08:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa73612 expref: 112 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743366:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf08:0x0].0x0 (ffff9091f95c0200) 00010000:00010000:3.0:1787508703.743375:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1c1c400/0xb126349c40e6d820 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf07:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa735d3 expref: 111 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743383:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf07:0x0].0x0 (ffff9090cddfab00) 00010000:00010000:3.0:1787508703.743394:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0f95600/0xb126349c40e6c2f6 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf04:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa72fcf expref: 110 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743402:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf04:0x0].0x0 (ffff9090cddfa400) 00010000:00010000:3.0:1787508703.743410:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0f95c00/0xb126349c40e6c29b lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf03:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa72fb3 expref: 109 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743417:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf03:0x0].0x0 (ffff9091c8d58900) 00010000:00010000:3.0:1787508703.743426:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0f95200/0xb126349c40e6c198 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf02:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa72f6d expref: 108 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743433:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf02:0x0].0x0 (ffff9090cddfa300) 00010000:00010000:3.0:1787508703.743441:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0f95400/0xb126349c40e6c0fe lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xf01:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa72f4a expref: 107 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743448:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xf01:0x0].0x0 (ffff9090cddfae00) 00010000:00010000:3.0:1787508703.743456:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce26b800/0xb126349c40e6a6ef lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xefd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa727b0 expref: 106 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743463:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xefd:0x0].0x0 (ffff9091c8d58800) 00010000:00010000:3.0:1787508703.743472:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091ecbeae00/0xb126349c40e6a671 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xefc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa72786 expref: 105 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743481:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xefc:0x0].0x0 (ffff9091c816f100) 00010000:00010000:3.0:1787508703.743489:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1c8a400/0xb126349c40e6a575 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xefb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa72747 expref: 104 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743502:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xefb:0x0].0x0 (ffff9091c816fc00) 00010000:00010000:3.0:1787508703.743509:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce26b200/0xb126349c40e6a4e9 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xefa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa72724 expref: 103 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743517:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xefa:0x0].0x0 (ffff9091c816f200) 00010000:00010000:3.0:1787508703.743525:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0f94200/0xb126349c40e69dfe lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xef8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa72502 expref: 102 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743533:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xef8:0x0].0x0 (ffff9090d1cee700) 00010000:00010000:3.0:1787508703.743542:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5555800/0xb126349c40e69da3 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xef7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa724f4 expref: 101 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743549:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xef7:0x0].0x0 (ffff9091da051900) 00010000:00010000:3.0:1787508703.743558:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1c8be00/0xb126349c40e69d02 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xef6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa724d8 expref: 100 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743565:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xef6:0x0].0x0 (ffff9091da051b00) 00010000:00010000:3.0:1787508703.743574:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1c8a800/0xb126349c40e69cae lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xef5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa724bc expref: 99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743582:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xef5:0x0].0x0 (ffff9090d1cee400) 00010000:00010000:3.0:1787508703.743590:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fade00/0xb126349c40e691b7 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xef3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa721ac expref: 98 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743596:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xef3:0x0].0x0 (ffff9091da051400) 00010000:00010000:3.0:1787508703.743606:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9c6ec00/0xb126349c40e69140 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xef2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa72182 expref: 97 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743620:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xef2:0x0].0x0 (ffff9091da398900) 00010000:00010000:3.0:1787508703.743633:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9c6fc00/0xb126349c40e6904b lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xef1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7213c expref: 96 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743641:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xef1:0x0].0x0 (ffff9091cc215e00) 00010000:00010000:3.0:1787508703.743650:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce8ed000/0xb126349c40e68fb1 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xef0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa72120 expref: 95 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743662:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xef0:0x0].0x0 (ffff9091da398b00) 00010000:00010000:3.0:1787508703.743670:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce8ec600/0xb126349c40e6892f lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xeee:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa71f1a expref: 94 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743680:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xeee:0x0].0x0 (ffff9090d00cd600) 00010000:00010000:3.0:1787508703.743689:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091c983d800/0xb126349c40e68856 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xeed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa71ef0 expref: 93 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743698:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xeed:0x0].0x0 (ffff9090ca68e700) 00010000:00010000:3.0:1787508703.743708:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5555000/0xb126349c40e687d1 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xeec:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa71ed4 expref: 92 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743717:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xeec:0x0].0x0 (ffff9090d4d92f00) 00010000:00010000:3.0:1787508703.743725:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5554a00/0xb126349c40e6877d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xeeb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa71eb8 expref: 91 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743738:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xeeb:0x0].0x0 (ffff9091cb980300) 00010000:00010000:3.0:1787508703.743747:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0b2ba00/0xb126349c40e680a0 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xee9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa71cb2 expref: 90 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743757:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xee9:0x0].0x0 (ffff9091d2128400) 00010000:00010000:3.0:1787508703.743767:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9d23400/0xb126349c40e68029 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xee8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa71c9d expref: 89 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743777:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xee8:0x0].0x0 (ffff9091d2128200) 00010000:00010000:3.0:1787508703.743785:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e36dd800/0xb126349c40e67fb2 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xee7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa71c81 expref: 88 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743794:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xee7:0x0].0x0 (ffff9091d2128d00) 00010000:00010000:3.0:1787508703.743802:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5dd9000/0xb126349c40e67f65 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xee6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa71c65 expref: 87 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743811:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xee6:0x0].0x0 (ffff9091da398300) 00010000:00010000:3.0:1787508703.743821:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40e66b14 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xee3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa71692 expref: 86 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743831:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xee3:0x0].0x0 (ffff9091da398e00) 00010000:00010000:3.0:1787508703.743840:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd4a8c00/0xb126349c40e66a18 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xee2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa71653 expref: 85 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743848:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xee2:0x0].0x0 (ffff9092021f2100) 00010000:00010000:3.0:1787508703.743858:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e0000/0xb126349c40e66977 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xee1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa71637 expref: 84 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743867:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xee1:0x0].0x0 (ffff9091da051d00) 00010000:00010000:3.0:1787508703.743876:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5555a00/0xb126349c40e66923 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xee0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7161b expref: 83 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743885:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xee0:0x0].0x0 (ffff9091da398a00) 00010000:00010000:3.0:1787508703.743895:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091c57f9800/0xb126349c40e663ff lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xedf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa714af expref: 82 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743916:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xedf:0x0].0x0 (ffff9090d3c50700) 00010000:00010000:3.0:1787508703.743927:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0b2b200/0xb126349c40e6639d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xede:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7148c expref: 81 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743935:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xede:0x0].0x0 (ffff9090d3c50b00) 00010000:00010000:3.0:1787508703.743974:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091ecbeb200/0xb126349c40e6632d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xedd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa71469 expref: 80 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743982:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xedd:0x0].0x0 (ffff9092021f2a00) 00010000:00010000:3.0:1787508703.743990:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091c983ca00/0xb126349c40e6625b lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xedc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7142a expref: 79 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.743999:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xedc:0x0].0x0 (ffff9090d3c50100) 00010000:00010000:3.0:1787508703.744008:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c8099a00/0xb126349c40e65ec6 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xeda:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa71320 expref: 78 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744021:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xeda:0x0].0x0 (ffff9091da398c00) 00010000:00010000:3.0:1787508703.744030:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5dd9c00/0xb126349c40e65e87 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xed9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa71312 expref: 77 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744039:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xed9:0x0].0x0 (ffff9090d3c50800) 00010000:00010000:3.0:1787508703.744046:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091c588a800/0xb126349c40e65de6 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xed8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa712f6 expref: 76 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744055:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xed8:0x0].0x0 (ffff9090cf0bfa00) 00010000:00010000:3.0:1787508703.744064:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5dd8800/0xb126349c40e65d92 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xed7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa712da expref: 75 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744072:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xed7:0x0].0x0 (ffff9092021f2500) 00010000:00010000:3.0:1787508703.744081:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091ecbeb000/0xb126349c40e65741 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xed5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa710e2 expref: 74 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744089:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xed5:0x0].0x0 (ffff9090cf0bf900) 00010000:00010000:3.0:1787508703.744097:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9092021c9200/0xb126349c40e65653 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xed4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa710a3 expref: 73 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744104:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xed4:0x0].0x0 (ffff9091da398700) 00010000:00010000:3.0:1787508703.744113:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9092021c8e00/0xb126349c40e655a4 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xed3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa71087 expref: 72 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744122:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xed3:0x0].0x0 (ffff9091da398500) 00010000:00010000:3.0:1787508703.744132:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091e6a2a000/0xb126349c40e65550 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xed2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7106b expref: 71 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744140:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xed2:0x0].0x0 (ffff9090cf0bf800) 00010000:00010000:3.0:1787508703.744148:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce8eac00/0xb126349c40e649f7 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xed0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa70d3f expref: 70 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744156:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xed0:0x0].0x0 (ffff9090cf0bf400) 00010000:00010000:3.0:1787508703.744165:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5dd8400/0xb126349c40e64980 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xecf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa70d0e expref: 69 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744174:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xecf:0x0].0x0 (ffff9090d3c50900) 00010000:00010000:3.0:1787508703.744184:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e3b18e00/0xb126349c40e648f4 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xece:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa70ce4 expref: 68 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744193:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xece:0x0].0x0 (ffff9091d2a7e700) 00010000:00010000:3.0:1787508703.744202:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d5dd9a00/0xb126349c40e6484c lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xecd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa70cb3 expref: 67 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744210:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xecd:0x0].0x0 (ffff9090d3c50400) 00010000:00010000:3.0:1787508703.744219:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce8ede00/0xb126349c40e64168 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xecb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa70aad expref: 66 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744227:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xecb:0x0].0x0 (ffff9090ced0ed00) 00010000:00010000:3.0:1787508703.744236:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9092021c9a00/0xb126349c40e6410d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xeca:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa70a9f expref: 65 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744249:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xeca:0x0].0x0 (ffff9090cf093a00) 00010000:00010000:3.0:1787508703.744257:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9092021c9000/0xb126349c40e64088 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xec9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa70a7c expref: 64 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744265:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xec9:0x0].0x0 (ffff9090cf093600) 00010000:00010000:3.0:1787508703.744273:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091c983dc00/0xb126349c40e64034 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xec8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa70a67 expref: 63 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744281:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xec8:0x0].0x0 (ffff9090ced0e000) 00010000:00010000:3.0:1787508703.744289:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d613d200/0xb126349c40e6353d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xec6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa70765 expref: 62 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744297:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xec6:0x0].0x0 (ffff9090d08ecf00) 00010000:00010000:3.0:1787508703.744306:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21e00/0xb126349c40e634b8 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xec5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa70734 expref: 61 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744313:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xec5:0x0].0x0 (ffff9090d08ecd00) 00010000:00010000:3.0:1787508703.744321:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20400/0xb126349c40e63448 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xec4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa70711 expref: 60 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744329:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xec4:0x0].0x0 (ffff9091cc251c00) 00010000:00010000:3.0:1787508703.744337:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cda82e00/0xb126349c40e63399 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xec3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa706e0 expref: 59 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744344:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xec3:0x0].0x0 (ffff9091cb980900) 00010000:00010000:3.0:1787508703.744353:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0b2ac00/0xb126349c40e62ec9 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xec2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7059e expref: 58 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744361:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xec2:0x0].0x0 (ffff9090d1ceef00) 00010000:00010000:3.0:1787508703.744369:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0b2b000/0xb126349c40e62e91 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xec1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa70589 expref: 57 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744376:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xec1:0x0].0x0 (ffff9090d1cee800) 00010000:00010000:3.0:1787508703.744383:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cda83800/0xb126349c40e62de2 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xec0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7054a expref: 56 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744391:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xec0:0x0].0x0 (ffff9091cc251e00) 00010000:00010000:3.0:1787508703.744400:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091c983d000/0xb126349c40e62cca lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xebf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7050b expref: 55 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744408:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xebf:0x0].0x0 (ffff9090d1cee200) 00010000:00010000:3.0:1787508703.744417:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cda83a00/0xb126349c40e6297b lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xebd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa70401 expref: 54 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744426:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xebd:0x0].0x0 (ffff9091c76cee00) 00010000:00010000:3.0:1787508703.744436:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090ce8eae00/0xb126349c40e6293c lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xebc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa703f3 expref: 53 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744443:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xebc:0x0].0x0 (ffff9090d08ecc00) 00010000:00010000:3.0:1787508703.744451:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20800/0xb126349c40e6289b lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xebb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa703d7 expref: 52 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744462:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xebb:0x0].0x0 (ffff9090d08ec600) 00010000:00010000:3.0:1787508703.744470:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c8098000/0xb126349c40e62840 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xeba:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa703b4 expref: 51 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744478:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xeba:0x0].0x0 (ffff9090d00cd800) 00010000:00010000:3.0:1787508703.744486:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091e6a2b600/0xb126349c40e61d65 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xeb8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa7008f expref: 50 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744494:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xeb8:0x0].0x0 (ffff9090d2302600) 00010000:00010000:3.0:1787508703.744503:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e3b18a00/0xb126349c40e61cee lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xeb7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa70081 expref: 49 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744510:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xeb7:0x0].0x0 (ffff9090d1cee000) 00010000:00010000:3.0:1787508703.744520:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091c57f9a00/0xb126349c40e61c69 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xeb6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa70065 expref: 48 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744528:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xeb6:0x0].0x0 (ffff9091c76ce200) 00010000:00010000:3.0:1787508703.744536:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d613c800/0xb126349c40e61c15 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xeb5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa70049 expref: 47 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744543:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xeb5:0x0].0x0 (ffff9091c76ce400) 00010000:00010000:3.0:1787508703.744550:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e3b19000/0xb126349c40e61117 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xeb3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6fd32 expref: 46 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744557:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xeb3:0x0].0x0 (ffff9090d02adb00) 00010000:00010000:3.0:1787508703.744566:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1c1d600/0xb126349c40e610b5 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xeb2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6fd0f expref: 45 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744573:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xeb2:0x0].0x0 (ffff9091f95c0100) 00010000:00010000:3.0:1787508703.744592:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9c6e200/0xb126349c40e61029 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xeb1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6fcde expref: 44 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744600:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xeb1:0x0].0x0 (ffff9090ced0e900) 00010000:00010000:3.0:1787508703.744610:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e36dc800/0xb126349c40e60f57 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xeb0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6fc9f expref: 43 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744620:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xeb0:0x0].0x0 (ffff9090d02add00) 00010000:00010000:3.0:1787508703.744628:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091c0030c00/0xb126349c40e604ad lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xeae:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6f99d expref: 42 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744636:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xeae:0x0].0x0 (ffff9090d00cd000) 00010000:00010000:3.0:1787508703.744643:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1c1ce00/0xb126349c40e603bf lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xead:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6f95e expref: 41 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744651:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xead:0x0].0x0 (ffff9090d00cde00) 00010000:00010000:3.0:1787508703.744659:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e36dc400/0xb126349c40e60310 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xeac:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6f942 expref: 40 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744667:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xeac:0x0].0x0 (ffff9090d08ecb00) 00010000:00010000:3.0:1787508703.744676:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e36dd400/0xb126349c40e602bc lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xeab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6f926 expref: 39 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744689:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xeab:0x0].0x0 (ffff9090d08ec000) 00010000:00010000:3.0:1787508703.744699:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cda83600/0xb126349c40e5fbfb lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xea9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6f719 expref: 38 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744706:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xea9:0x0].0x0 (ffff9090ced0eb00) 00010000:00010000:3.0:1787508703.744715:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1c1d400/0xb126349c40e5fb92 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xea8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6f70b expref: 37 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744722:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xea8:0x0].0x0 (ffff9090d00cd700) 00010000:00010000:3.0:1787508703.744730:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd4a9c00/0xb126349c40e5fb0d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xea7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6f6ef expref: 36 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744738:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xea7:0x0].0x0 (ffff9090d00cd500) 00010000:00010000:3.0:1787508703.744746:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0b2b400/0xb126349c40e5fab9 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xea6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6f6d3 expref: 35 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.744756:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xea6:0x0].0x0 (ffff9090ced0e400) 00010000:00010000:3.0:1787508703.744773:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d9c6f600/0xb126349c40e5efb4 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xea4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6f3c3 expref: 34 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.746967:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xea4:0x0].0x0 (ffff9090d00cdb00) 00010000:00010000:3.0:1787508703.747001:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1c1da00/0xb126349c40e5ef60 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xea3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6f3a7 expref: 33 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.747011:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xea3:0x0].0x0 (ffff9090ced0ea00) 00010000:00010000:3.0:1787508703.747023:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e36ddc00/0xb126349c40e5eefe lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xea2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6f37d expref: 32 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.747032:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xea2:0x0].0x0 (ffff9090d2302700) 00010000:00010000:3.0:1787508703.747043:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cda83c00/0xb126349c40e5ee09 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xea1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6f329 expref: 31 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.747052:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xea1:0x0].0x0 (ffff9090ced0e500) 00010000:00010000:3.0:1787508703.747061:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d1c1cc00/0xb126349c40e5e3b3 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xe9f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6f043 expref: 30 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.747068:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xe9f:0x0].0x0 (ffff9090d02ad400) 00010000:00010000:3.0:1787508703.747077:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091c983d400/0xb126349c40e5e286 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xe9e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6eff6 expref: 29 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.747086:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xe9e:0x0].0x0 (ffff9091fde57f00) 00010000:00010000:3.0:1787508703.747095:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091c983d600/0xb126349c40e5e201 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xe9d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6efe1 expref: 28 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.747103:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xe9d:0x0].0x0 (ffff9091fde57600) 00010000:00010000:3.0:1787508703.747111:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd4a9200/0xb126349c40e5e191 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xe9c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6efbe expref: 27 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.747119:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xe9c:0x0].0x0 (ffff9090d4d92b00) 00010000:00010000:3.0:1787508703.747129:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0b2b800/0xb126349c40e5d685 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xe9a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6ec84 expref: 26 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.747141:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xe9a:0x0].0x0 (ffff9091d39d2700) 00010000:00010000:3.0:1787508703.747152:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0b2b600/0xb126349c40e5d558 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xe99:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6ec37 expref: 25 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.747159:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xe99:0x0].0x0 (ffff9090d02ad800) 00010000:00010000:3.0:1787508703.747168:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd4a9000/0xb126349c40e5d4b7 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xe98:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6ec1b expref: 24 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.747176:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xe98:0x0].0x0 (ffff9091fde57100) 00010000:00010000:3.0:1787508703.747184:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e3b19800/0xb126349c40e5d463 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xe97:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6ebff expref: 23 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.747192:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xe97:0x0].0x0 (ffff9090d4d92000) 00010000:00010000:3.0:1787508703.747201:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c8098800/0xb126349c40e5c942 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xe95:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6e8ef expref: 22 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.747210:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xe95:0x0].0x0 (ffff9091d39d2d00) 00010000:00010000:3.0:1787508703.747220:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091e6a2b400/0xb126349c40e5c8e7 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xe94:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6e8cc expref: 21 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.747228:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xe94:0x0].0x0 (ffff9091cc251d00) 00010000:00010000:3.0:1787508703.747238:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd4a9600/0xb126349c40e5c862 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xe93:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6e8a2 expref: 20 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.747247:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xe93:0x0].0x0 (ffff9090cddfaf00) 00010000:00010000:3.0:1787508703.747257:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c8098200/0xb126349c40e5c79e lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xe92:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6e86a expref: 19 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.747265:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xe92:0x0].0x0 (ffff9090cddfa700) 00010000:00010000:3.0:1787508703.747275:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c8099400/0xb126349c40e5c0cf lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xe90:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6e65d expref: 18 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.747283:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xe90:0x0].0x0 (ffff9090d3c50e00) 00010000:00010000:3.0:1787508703.747293:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091c983d200/0xb126349c40e5c058 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xe8f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6e64f expref: 17 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.747301:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xe8f:0x0].0x0 (ffff9091cb980600) 00010000:00010000:3.0:1787508703.747327:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0b2a000/0xb126349c40e5bfd3 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xe8e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6e633 expref: 16 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.747336:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xe8e:0x0].0x0 (ffff9090cddfa800) 00010000:00010000:3.0:1787508703.747346:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d0b2bc00/0xb126349c40e5bf7f lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xe8d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6e617 expref: 15 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.747355:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xe8d:0x0].0x0 (ffff9090cddfa000) 00010000:00010000:3.0:1787508703.747364:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d613dc00/0xb126349c40e5b457 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xe8b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6e2eb expref: 14 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.747374:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xe8b:0x0].0x0 (ffff9090d1b2bc00) 00010000:00010000:3.0:1787508703.747385:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091c57f8a00/0xb126349c40e5b3f5 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xe8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6e2c8 expref: 13 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.747400:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xe8a:0x0].0x0 (ffff9090d02ad700) 00010000:00010000:3.0:1787508703.747410:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cda82c00/0xb126349c40e5b385 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xe89:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6e29e expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.747419:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xe89:0x0].0x0 (ffff9090d1b2b700) 00010000:00010000:3.0:1787508703.747428:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d613c400/0xb126349c40e5b2a5 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0xe88:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfa6e25f expref: 11 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.747435:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0xe88:0x0].0x0 (ffff9090d02ad000) 00010000:00010000:3.0:1787508703.747441:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508703.747880:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:287589:x1874324509602816:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 10531us (10707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508703.747895:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9809 00000100:00100000:2.0:1787508703.784382:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508703.784540:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509602944 00000100:00100000:1.0:1787508703.784550:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509602944 00000100:00100000:1.0:1787508703.784639:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94071 00000100:00100000:1.0:1787508703.784649:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:339999:x1874324509602944:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:1.0:1787508703.784674:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508703.784694:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f352e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae800 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.784756:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f352ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.784771:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f352ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.784795:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f352ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508703.784854:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508703.784858:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508703.784901:0:203348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f352ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.784937:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f352e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae800 expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.784999:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f352ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae800 expref: 11 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508703.785014:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508703.785016:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508703.785021:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a400, rc 0) 00000100:00100000:1.0:1787508703.785073:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:339999:x1874324509602944:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 426us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508703.785081:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94071 00000100:00100000:0.0:1787508703.788535:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508703.788628:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509603072 00000100:00100000:3.0:1787508703.788638:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509603072 00000100:00100000:3.0:1787508703.788699:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94072 00000100:00100000:3.0:1787508703.788709:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:339999:x1874324509603072:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:3.0:1787508703.788729:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508703.788750:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f352f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae807 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.788837:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f352f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.788851:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f352f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.788863:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f352f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.788883:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f352ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.788891:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f352ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.788897:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f352ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.789023:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35306 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.789032:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35306 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.789038:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35306 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508703.789062:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35306 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.789076:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f352f8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.789082:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f352f8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.789089:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f352f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.789096:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f352f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.789106:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fa00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508703.789110:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f352f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.789117:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f352f8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.789128:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508703.789131:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508703.789135:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f352f8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.789141:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f352f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.789156:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f352ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.789162:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f352ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.789168:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f352ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.789173:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508703.789176:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f352ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.789181:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f352ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.789191:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2a8ecdf (ffff9090cc088300) 00010000:00010000:3.0:1787508703.789193:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508703.789196:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f352ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.789201:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f352ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2a8ecdf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.789230:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f352f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae807 expref: 13 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.789244:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35306 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae807 expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.789251:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d6:0x0].0x0 (ffff9090cc088e00) 00010000:00010000:3.0:1787508703.789254:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508703.789256:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f600, rc 0) 00000100:00100000:3.0:1787508703.789318:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:339999:x1874324509603072:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 610us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508703.789326:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94072 00000100:00100000:3.0:1787508703.792607:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508703.792699:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509603200 00000100:00100000:0.0:1787508703.792708:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509603200 00000100:00100000:0.0:1787508703.792773:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94073 00000100:00100000:0.0:1787508703.792798:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:339999:x1874324509603200:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:0.0:1787508703.792831:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508703.792853:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f3530d lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae80e expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.793092:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4e00/0xb126349c40f35314 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.793106:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4e00/0xb126349c40f35314 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.793127:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4e00/0xb126349c40f35314 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508703.793185:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d6:0x0]: returning size 4096 00000004:00200000:0.0:1787508703.793189:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1787508703.793265:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f3530d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae80e expref: 15 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.793284:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4e00/0xb126349c40f35314 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae80e expref: 14 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508703.793293:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d6:0x0].0x0 (ffff9090d36fd100) 00010000:00010000:0.0:1787508703.793296:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1787508703.793312:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4e00, rc 0) 00000100:00100000:0.0:1787508703.793386:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:339999:x1874324509603200:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 590us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508703.793393:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94073 00000100:00100000:1.0:1787508703.796446:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508703.796532:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509603328 00000100:00100000:3.0:1787508703.796541:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509603328 00000100:00100000:3.0:1787508703.796647:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94074 00000100:00100000:3.0:1787508703.796668:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:339999:x1874324509603328:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:3.0:1787508703.796689:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508703.796709:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ee00/0xb126349c40f3531b lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae815 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.796799:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f35322 lrc: 3/1,0 mode: --/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.796814:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f35322 lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.796833:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f35322 lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.796845:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f35329 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.796853:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f35329 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.796859:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f35329 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.796998:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e000/0xb126349c40f35330 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.797007:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e000/0xb126349c40f35330 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.797015:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e000/0xb126349c40f35330 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508703.797055:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508703.797079:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e000/0xb126349c40f35330 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508703.797102:0:202228:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d7:0x0] updating lvb size from disk: 4096 -> 4096 00000004:00010000:3.0:1787508703.797106:0:202228:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d7:0x0] updating lvb mtime from disk: 1787508704 -> 1787508704 00000004:00010000:3.0:1787508703.797108:0:202228:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d7:0x0] updating lvb atime from disk: 1787508704 -> 1787508704 00000004:00010000:3.0:1787508703.797110:0:202228:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d7:0x0] updating lvb ctime from disk: 1787508704 -> 1787508704 00000004:00010000:3.0:1787508703.797112:0:202228:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d7:0x0] updating lvb blocks from disk: 8 -> 8 00002000:00010000:3.0:1787508703.797115:0:202228:0:(mdt_io.c:1552:mdt_lvb2reply()) size 4096 00010000:00010000:3.0:1787508703.797121:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f35322 lrc: 4/1,0 mode: CR/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.797128:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f35322 lrc: 4/1,0 mode: CR/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.797133:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f35322 lrc: 3/0,0 mode: CR/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.797139:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f35322 lrc: 4/0,0 mode: CR/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.797145:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508703.797149:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f35322 lrc: 4/0,0 mode: CR/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.797156:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f35322 lrc: 5/0,0 mode: CR/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.797168:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d6:0x0].0x0 (ffff9090d36fd100) 00010000:00010000:3.0:1787508703.797171:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508703.797176:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f35322 lrc: 3/0,0 mode: --/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.797186:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f35322 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.797199:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f35329 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.797205:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f35329 lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.797212:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f35329 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.797218:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fa00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508703.797220:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f35329 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.797227:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f35329 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.797234:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d6:0x0].0xfe058dd8 (ffff9090cc088200) 00010000:00010000:3.0:1787508703.797237:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508703.797239:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f35329 lrc: 2/0,0 mode: --/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.797246:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f35329 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.797272:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ee00/0xb126349c40f3531b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae815 expref: 16 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.797290:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e000/0xb126349c40f35330 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae815 expref: 15 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508703.797296:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d7:0x0].0x0 (ffff9090ca4e2900) 00010000:00010000:3.0:1787508703.797298:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:3.0:1787508703.797301:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e000, rc 0) 00000100:00100000:3.0:1787508703.797369:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:339999:x1874324509603328:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 703us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508703.797376:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94074 00010000:00010000:1.0:1787508703.802934:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508704.442932:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480185472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787508704.443085:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508704.443216:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480185472 00000100:00100000:2.0:1787508704.443225:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480185472 00000100:00100000:2.0:1787508704.443293:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1695 00000100:00100000:2.0:1787508704.443304:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480185472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787508704.443334:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33829440 pending 0 free 3910815744 avail 3679293440 00000100:00100000:2.0:1787508704.443395:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480185472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508704.443402:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1695 00000100:00100000:2.0:1787508704.443449:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480185472:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787508704.443971:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787508704.446627:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480185600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787508704.446710:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508704.448419:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480185600 00000100:00100000:0.0:1787508704.448433:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480185600 00000100:00100000:0.0:1787508704.448525:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1696 00000100:00100000:0.0:1787508704.448535:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480185600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787508704.448559:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33829440 pending 0 free 3910815744 avail 3679293440 00000100:00100000:0.0:1787508704.448632:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480185600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (1921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508704.448646:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1696 00000100:00100000:3.0:1787508704.448747:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480185600:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787508704.448842:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787508704.834774:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508705.466726:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787508705.466750:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480185856:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787508705.466837:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508705.466981:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480185856 00000100:00100000:2.0:1787508705.466989:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480185856 00000100:00100000:2.0:1787508705.467034:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29859 00000100:00100000:2.0:1787508705.467042:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480185856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787508705.467077:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1441763328 avail 1295523840 00000100:00100000:2.0:1787508705.467137:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480185856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508705.467144:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29859 00000100:00100000:2.0:1787508705.467190:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480185856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787508705.467601:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787508705.467614:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480185728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787508705.467664:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508705.467772:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480185728 00000100:00100000:3.0:1787508705.467790:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480185728 00000100:00100000:3.0:1787508705.467835:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29860 00000100:00100000:3.0:1787508705.467843:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480185728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787508705.467866:0:202232:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6438912 pending 28672 free 1442775040 avail 1296535552 00000100:00100000:3.0:1787508705.467918:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480185728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508705.467925:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29860 00000100:00100000:3.0:1787508705.467988:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480185728:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787508705.850251:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508705.978235:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480186112:0@lo:400:kworker.0 00000100:00100000:2.0:1787508705.978317:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508705.978353:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d021aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480186624:0@lo:400:kworker.0 00000100:00100000:2.0:1787508705.978376:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508705.978395:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d021b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874324480187136:0@lo:400:kworker.0 00000100:00100000:2.0:1787508705.978420:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508705.978445:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787508705.978451:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480186240:0@lo:400:kworker.0 00000100:00100000:2.0:1787508705.978475:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508705.978494:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d021a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480186752:0@lo:400:kworker.0 00000100:00100000:2.0:1787508705.978515:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508705.978531:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480187264:0@lo:400:kworker.0 00000100:00100000:2.0:1787508705.978552:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508705.978587:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480186112 00000100:00100000:2.0:1787508705.978596:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480186112 00000100:00100000:2.0:1787508705.978635:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480186624 00000100:00100000:2.0:1787508705.978638:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480186624 00000100:00100000:2.0:1787508705.978658:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29861 00000100:00100000:1.0:1787508705.978794:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d021b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480186368:0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.978826:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508705.978843:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480186880:0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.978874:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508705.978893:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480187392:0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.978913:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508705.978932:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1787508705.978938:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480185984:0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.979010:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508705.979038:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d021bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480186496:0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.979060:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508705.979076:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480187008:0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.979098:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508705.979115:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480187520:0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.979136:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508705.979164:0:225843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480186240 00000100:00100000:1.0:1787508705.979168:0:225843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480186240 00000100:00100000:1.0:1787508705.979196:0:225843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480186752 00000100:00100000:1.0:1787508705.979199:0:225843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480186752 00000100:00100000:1.0:1787508705.979213:0:225843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480186368 00000100:00100000:1.0:1787508705.979215:0:225843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480186368 00000100:00100000:1.0:1787508705.979236:0:225843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480186880 00000100:00100000:1.0:1787508705.979239:0:225843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480186880 00000100:00100000:1.0:1787508705.979253:0:225843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2396 00000100:00100000:1.0:1787508705.979260:0:225843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480186240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.979306:0:225843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480186240:12345-0@lo:400:kworker.0 Request processed in 47us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508705.979313:0:225843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2396 00000100:00100000:1.0:1787508705.979328:0:225843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2397 00000100:00100000:1.0:1787508705.979334:0:225843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480186752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.979357:0:225843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480186752:12345-0@lo:400:kworker.0 Request processed in 24us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508705.979362:0:225843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2397 00000100:00100000:1.0:1787508705.979373:0:225843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2398 00000100:00100000:1.0:1787508705.979378:0:225843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480186368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.979405:0:225843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480186368:12345-0@lo:400:kworker.0 Request processed in 27us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508705.979410:0:225843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2398 00000100:00100000:1.0:1787508705.979420:0:225843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2399 00000100:00100000:1.0:1787508705.979426:0:225843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480186880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.979449:0:225843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480186880:12345-0@lo:400:kworker.0 Request processed in 23us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508705.979455:0:225843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2399 00000100:00100000:1.0:1787508705.979471:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480185984 00000100:00100000:1.0:1787508705.979475:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480185984 00000100:00100000:1.0:1787508705.979496:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:1.0:1787508705.979501:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fccc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480185984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.979526:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fccc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480185984:12345-0@lo:400:kworker.0 Request processed in 25us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508705.979532:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00100000:1.0:1787508705.979556:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480187136 00000100:00100000:1.0:1787508705.979559:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480187136 00000100:00100000:1.0:1787508705.979581:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480187264 00000100:00100000:1.0:1787508705.979583:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480187264 00000100:00100000:1.0:1787508705.979592:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480187392 00000100:00100000:1.0:1787508705.979594:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480187392 00000100:00100000:1.0:1787508705.979603:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480186496 00000100:00100000:1.0:1787508705.979605:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480186496 00000100:00100000:1.0:1787508705.979612:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480187008 00000100:00100000:1.0:1787508705.979614:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480187008 00000100:00100000:1.0:1787508705.979622:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480187520 00000100:00100000:1.0:1787508705.979623:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480187520 00000100:00100000:1.0:1787508705.979634:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3025 00000100:00100000:1.0:1787508705.979638:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874324480187136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.979663:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874324480187136:12345-0@lo:400:kworker.0 Request processed in 25us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508705.979683:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3025 00000100:00100000:1.0:1787508705.979694:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3026 00000100:00100000:1.0:1787508705.979700:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480187264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.979726:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480187264:12345-0@lo:400:kworker.0 Request processed in 27us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508705.979731:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3026 00000100:00100000:1.0:1787508705.979744:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3027 00000100:00100000:1.0:1787508705.979749:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480187392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.979776:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480187392:12345-0@lo:400:kworker.0 Request processed in 27us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508705.979782:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3027 00000100:00100000:1.0:1787508705.979793:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3028 00000100:00100000:1.0:1787508705.979799:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480186496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.979825:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480186496:12345-0@lo:400:kworker.0 Request processed in 26us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508705.979830:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3028 00000100:00100000:1.0:1787508705.979840:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3029 00000100:00100000:1.0:1787508705.979846:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480187008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.979881:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480187008:12345-0@lo:400:kworker.0 Request processed in 35us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508705.979887:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3029 00000100:00100000:1.0:1787508705.979899:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3030 00000100:00100000:1.0:1787508705.979905:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480187520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.979930:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480187520:12345-0@lo:400:kworker.0 Request processed in 26us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508705.979936:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3030 00000100:00100000:1.0:1787508705.979995:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480185984:0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.980008:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d021bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480186496:0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.980016:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480187008:0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.980025:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0219f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480187520:0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.980033:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d021b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480186368:0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.980042:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480186880:0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.980049:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480187392:0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.980120:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29862 00000100:00100000:1.0:1787508705.980127:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480186624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.980164:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480186624:12345-0@lo:400:kworker.0 Request processed in 37us (1786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508705.980169:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29862 00000100:00080000:1.0:1787508705.980203:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787508705.980208:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787508705.980210:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508705.980244:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0219880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480186240:0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.980255:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d021a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480186752:0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.980265:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480187264:0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.980274:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d021aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480186624:0@lo:400:kworker.0 00000100:00100000:1.0:1787508705.980281:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d021b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874324480187136:0@lo:400:kworker.0 00000100:00100000:2.0:1787508705.980522:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480186112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508705.980563:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480186112:12345-0@lo:400:kworker.0 Request processed in 1898us (2247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508705.980570:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29861 00000100:00100000:1.0:1787508705.982148:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480186112:0@lo:400:kworker.0 00010000:00010000:0.0:1787508706.874244:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508707.436506:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508707.436554:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508707.436573:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508707.436593:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508707.436618:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508707.436646:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508707.436665:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508707.436681:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508707.436705:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508707.436739:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509603584 00000100:00100000:1.0:1787508707.436751:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509603584 00000100:00100000:1.0:1787508707.436805:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509604096 00000100:00100000:1.0:1787508707.436807:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509604096 00000100:00100000:1.0:1787508707.436821:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509603712 00000100:00100000:1.0:1787508707.436823:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509603712 00000100:00100000:1.0:1787508707.436836:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509604224 00000100:00100000:1.0:1787508707.436838:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509604224 00000100:00100000:1.0:1787508707.436867:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3031 00000100:00100000:1.0:1787508707.436876:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:2400:x1874324509603584:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508707.436974:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:2400:x1874324509603584:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 98us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508707.436980:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3031 00000100:00100000:1.0:1787508707.436997:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3032 00000100:00100000:1.0:1787508707.437003:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2400:x1874324509604096:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508707.437029:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2400:x1874324509604096:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508707.437035:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3032 00000100:00100000:1.0:1787508707.437047:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3033 00000100:00100000:1.0:1787508707.437054:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:2400:x1874324509603712:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508707.437075:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:2400:x1874324509603712:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508707.437080:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3033 00000100:00100000:1.0:1787508707.437091:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3034 00000100:00100000:1.0:1787508707.437096:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2400:x1874324509604224:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508707.437116:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2400:x1874324509604224:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508707.437121:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3034 00000100:00100000:1.0:1787508707.437136:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509603840 00000100:00100000:1.0:1787508707.437139:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509603840 00000100:00100000:1.0:1787508707.437164:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509604352 00000100:00100000:1.0:1787508707.437167:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509604352 00000100:00100000:0.0:1787508707.437286:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509604480 00000100:00100000:0.0:1787508707.437290:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509604480 00000100:00100000:0.0:1787508707.437319:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2400 00000100:00100000:0.0:1787508707.437326:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2400:x1874324509603840:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508707.437352:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2400:x1874324509603840:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 28us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508707.437358:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2400 00000100:00100000:0.0:1787508707.437367:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2401 00000100:00100000:0.0:1787508707.437372:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509604352:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508707.437389:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509604352:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 17us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508707.437394:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2401 00000100:00100000:0.0:1787508707.437402:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2402 00000100:00100000:0.0:1787508707.437406:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509604480:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508707.437422:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509604480:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 16us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508707.437428:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2402 00000100:00080000:0.0:1787508707.437474:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787508707.437479:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787508707.437481:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508707.437483:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787508707.437663:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509603456 00000100:00100000:0.0:1787508707.437668:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509603456 00000100:00100000:0.0:1787508707.437694:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1014 00000100:00100000:0.0:1787508707.437700:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fccc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2400:x1874324509603456:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508707.437729:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fccc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2400:x1874324509603456:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 29us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508707.437736:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1014 00000100:00100000:1.0:1787508707.438330:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509603968 00000100:00100000:1.0:1787508707.438336:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509603968 00000100:00100000:1.0:1787508707.438404:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2403 00000100:00100000:1.0:1787508707.438410:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2400:x1874324509603968:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508707.438443:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2400:x1874324509603968:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 33us (1778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508707.438449:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2403 00000100:00080000:0.0:1787508707.443429:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787508707.901334:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508708.029520:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d021aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480187648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787508708.029599:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508708.029656:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787508708.029664:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480187776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508708.029693:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508708.029749:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480187648 00000100:00100000:1.0:1787508708.029757:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480187648 00000100:00100000:1.0:1787508708.029808:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480187776 00000100:00100000:1.0:1787508708.029811:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480187776 00000100:00100000:1.0:1787508708.029841:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1697 00000100:00100000:1.0:1787508708.029850:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480187648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787508708.029878:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 124211776 pending 0 free 3881955328 avail 3650433024 00000100:00100000:1.0:1787508708.029923:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480187648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508708.029929:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1697 00000100:00100000:1.0:1787508708.029975:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1698 00000100:00100000:1.0:1787508708.029982:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480187776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787508708.029992:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 124211776 pending 0 free 3881955328 avail 3650433024 00000100:00100000:1.0:1787508708.030015:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480187776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508708.030020:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1698 00000100:00080000:1.0:1787508708.030038:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508708.030071:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0218700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480187776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508708.030083:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d021aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480187648:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787508708.922164:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787508709.056878:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589962046 is committed 00000001:00080000:1.0:1787508709.056916:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589962041 is committed 00000020:00080000:1.0:1787508709.056928:0:202955:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9090cc084300 refcount 2 committed 0 result 0 batchid 4294998389 00000020:00080000:1.0:1787508709.056958:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090ced0f900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9090cc084600 00000020:00080000:1.0:1787508709.056962:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a2:0x5:0x0].598 00000020:00080000:1.0:1787508709.056965:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090ced0f600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090cc49ac00 00000020:00080000:1.0:1787508709.056968:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd1:0xf:0x0].54 00010000:00010000:2.0:1787508709.057074:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f351f5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.057085:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f351f5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.057092:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f351f5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.057097:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508709.057102:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f351f5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.057108:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f351f5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.057126:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d6:0x0].0x0 (ffff9090d36fd100) 00010000:00010000:2.0:1787508709.057129:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508709.057133:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f351f5 lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.057138:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f351f5 lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.057157:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f35257 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.057163:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f35257 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.057169:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f35257 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.057177:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508709.057180:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f35257 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.057185:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f35257 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.057192:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d6:0x0].0xfe058dd8 (ffff9090cc088200) 00010000:00010000:2.0:1787508709.057195:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508709.057198:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f35257 lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.057203:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f35257 lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x13d6:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.057327:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f352dc lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.057335:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f352dc lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.057346:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f352dc lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.057350:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508709.057354:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f352dc lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.057359:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f352dc lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.057369:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d7:0x0].0x0 (ffff9090ca4e2900) 00010000:00010000:0.0:1787508709.057371:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508709.057374:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f352dc lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.057379:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f352dc lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787508709.057420:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294998389 committed batchid 4294998388 00000020:00080000:0.0:1787508709.057487:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998388 00000001:00080000:0.0:1787508709.057920:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944163 is committed 00000001:00080000:0.0:1787508709.057928:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944161 is committed 00000100:00100000:1.0:1787508709.563391:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480187904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787508709.563470:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508709.563594:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480187904 00000100:00100000:0.0:1787508709.563603:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480187904 00000100:00100000:0.0:1787508709.563658:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1699 00000100:00100000:0.0:1787508709.563669:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480187904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787508709.563697:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33829440 pending 0 free 3910815744 avail 3679293440 00000100:00100000:2.0:1787508709.569393:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480188032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787508709.569471:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508709.569531:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480188032 00000100:00100000:2.0:1787508709.569551:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480188032 00000100:00100000:2.0:1787508709.569600:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1700 00000100:00100000:2.0:1787508709.569608:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480188032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787508709.569631:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33829440 pending 0 free 3910815744 avail 3679293440 00000100:00100000:2.0:1787508709.569672:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480188032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508709.569680:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1700 00000100:00100000:2.0:1787508709.569727:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480188032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787508709.570074:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480187904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6405us (6602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508709.570084:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1699 00000100:00080000:0.0:1787508709.571893:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508709.575718:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480187904:0@lo:13:osp-pre-0-1.0 00000001:02000400:3.0:1787508709.642529:0:233303:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 100c: DoM: write vs stat without IO lock (combined file) ========================================================== 14:11:49 (1787508709) 00000100:00100000:1.0:1787508709.765430:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508709.765467:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508709.765545:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509604608 00000100:00100000:2.0:1787508709.765557:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509604608 00000100:00100000:3.0:1787508709.765624:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509604864 00000100:00100000:3.0:1787508709.765630:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509604864 00000100:00100000:3.0:1787508709.765681:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94075 00000100:00100000:3.0:1787508709.765692:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:340583:x1874324509604864:12345-192.168.201.30@tcp:36:mkdir.0 00010000:00010000:3.0:1787508709.765748:0:202228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508709.765789:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f352ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae800 expref: 9 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.765817:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508709.765822:0:202228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508709.765898:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f35337 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.765912:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f35337 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.765922:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f35337 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.765935:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3533e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe561df9a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.765962:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3533e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.765968:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3533e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.766407:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35345 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1265:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.766423:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35345 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.766430:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35345 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508709.766445:0:202228:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043338636 reply state 000000003ea84749 transno 12884944164 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35345 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.766455:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35345 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.766461:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1265:0x0].0x0 (ffff9090cc088f00) 00010000:00010000:3.0:1787508709.766464:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508709.766466:0:202228:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787508709.766470:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1265:0x0]: returning size 4096 00010000:00010000:3.0:1787508709.766477:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f35337 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.766483:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f35337 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.766489:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f35337 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.766495:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f35337 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.766501:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fa00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508709.766506:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f35337 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.766518:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f35337 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.766527:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508709.766529:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508709.766532:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f35337 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.766539:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f35337 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508709.766548:0:202228:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043338636 reply state 000000003ea84749 transno 12884944164 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3533e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.766556:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3533e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.766562:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe561df9a (ffff9090cc088300) 00010000:00010000:3.0:1787508709.766563:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508709.766565:0:202228:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787508709.766642:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:340583:x1874324509604864:12345-192.168.201.30@tcp:36:mkdir.0 Request processed in 951us (1173us total) trans 12884944164 rc 0/0 00000100:00100000:3.0:1787508709.766650:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94075 00000100:00100000:2.0:1787508709.767223:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94076 00000100:00100000:2.0:1787508709.767233:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:2400:x1874324509604608:12345-192.168.201.30@tcp:41:mkdir.0 00000004:00000024:2.0:1787508709.767259:0:203348:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1441759232 avail 1295519744 00000100:00100000:2.0:1787508709.767292:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:2400:x1874324509604608:12345-192.168.201.30@tcp:41:mkdir.0 Request processed in 62us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508709.767300:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94076 00000100:00080000:1.0:1787508709.773270:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787508709.794030:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508709.794065:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509604992 00000100:00100000:0.0:1787508709.794075:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509604992 00000100:00100000:0.0:1787508709.794126:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94077 00000100:00100000:0.0:1787508709.794136:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:340584:x1874324509604992:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508709.794161:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508709.794182:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3534c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae81c expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.794245:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35353 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.794259:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35353 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.794270:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35353 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508709.794314:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787508709.794318:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508709.794338:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35353 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.794361:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3534c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae81c expref: 11 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.794375:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35353 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae81c expref: 10 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.794384:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508709.794387:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508709.794391:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5200, rc 0) 00000100:00100000:0.0:1787508709.794439:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:340584:x1874324509604992:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 305us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508709.794446:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94077 00000100:00100000:0.0:1787508709.798603:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508709.798666:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509605120 00000100:00100000:1.0:1787508709.798676:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509605120 00000100:00100000:1.0:1787508709.798725:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94078 00000100:00100000:1.0:1787508709.798732:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:340584:x1874324509605120:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508709.798750:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508709.798766:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3535a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae823 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.798838:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f35361 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.798853:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f35361 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.798865:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f35361 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.798873:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f35368 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe561df9a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.798878:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f35368 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.798882:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f35368 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.799001:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f3536f lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.799008:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f3536f lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.799015:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f3536f lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508709.799052:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1265:0x0]: returning size 4096 00000004:00200000:1.0:1787508709.799056:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508709.799074:0:209004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f3536f lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.799087:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f35361 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.799093:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f35361 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.799099:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f35361 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.799106:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f35361 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.799112:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508709.799116:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f35361 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.799123:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f35361 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.799136:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508709.799139:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508709.799143:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f35361 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.799150:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f35361 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.799160:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f35368 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.799166:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f35368 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.799172:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f35368 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.799177:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508709.799180:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f35368 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.799185:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f35368 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.799192:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe561df9a (ffff9090cc088300) 00010000:00010000:1.0:1787508709.799194:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508709.799197:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f35368 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.799203:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f35368 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.799224:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f3535a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae823 expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.799235:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f3536f lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae823 expref: 11 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.799241:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1265:0x0].0x0 (ffff9090cc088f00) 00010000:00010000:1.0:1787508709.799243:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787508709.799246:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247aa00, rc 0) 00000100:00100000:1.0:1787508709.799301:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:340584:x1874324509605120:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 570us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508709.799308:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94078 00000100:00100000:1.0:1787508709.803052:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508709.803298:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509605248 00000100:00100000:3.0:1787508709.803308:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509605248 00000100:00100000:3.0:1787508709.803366:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94079 00000100:00100000:3.0:1787508709.803376:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:340584:x1874324509605248:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508709.803400:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508709.803422:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f35376 lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae82a expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.803494:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f3537d lrc: 3/1,0 mode: --/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.803514:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f3537d lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.803527:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f3537d lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.803551:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f35384 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.803558:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f35384 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.803565:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f35384 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.803608:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f3537d lrc: 4/1,0 mode: CR/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.803615:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f3537d lrc: 4/1,0 mode: CR/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.803621:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f3537d lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.803628:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f3537d lrc: 4/0,0 mode: CR/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.803634:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ec00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508709.803639:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f3537d lrc: 4/0,0 mode: CR/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.803646:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f3537d lrc: 5/0,0 mode: CR/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.803658:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1265:0x0].0x0 (ffff9090cc088f00) 00010000:00010000:3.0:1787508709.803661:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508709.803666:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f3537d lrc: 3/0,0 mode: --/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.803672:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f3537d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.803690:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f35384 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.803696:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f35384 lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.803755:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f35384 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.803761:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508709.803764:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f35384 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.803774:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f35384 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.803782:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1265:0x0].0xfe058dd8 (ffff9090cc088700) 00010000:00010000:3.0:1787508709.803784:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508709.803787:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f35384 lrc: 2/0,0 mode: --/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.803796:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f35384 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.803840:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f35376 lrc: 1/0,0 mode: --/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae82a expref: 12 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.803851:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1265:0x0].0x0 (ffff9090cc088f00) 00010000:00010000:3.0:1787508709.803853:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508709.803857:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f35376 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae82a expref: 12 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.803870:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fa00, rc 0) 00000100:00100000:3.0:1787508709.803937:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:340584:x1874324509605248:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 563us (895us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508709.804101:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94079 00000100:00100000:0.0:1787508709.807404:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508709.807446:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509605504 00000100:00100000:3.0:1787508709.807455:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509605504 00000100:00100000:3.0:1787508709.807513:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94080 00000100:00100000:3.0:1787508709.807524:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:340584:x1874324509605504:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508709.807670:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508709.807695:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f3538b lrc: 2/0,0 mode: --/CW res: [0x2000013a4:0x1265:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae831 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.807823:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35392 lrc: 3/0,1 mode: --/CW res: [0x2000013a4:0x1265:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.807844:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35392 lrc: 3/0,1 mode: CW/CW res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.807855:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35392 lrc: 3/0,1 mode: CW/CW res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.807869:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35399 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.807876:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35399 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.807883:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35399 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.808432:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f353a0 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1266:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.808444:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f353a0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1266:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.808452:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f353a0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1266:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508709.808463:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1266:0x0]: returning size 0 00010000:00010000:3.0:1787508709.808486:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35392 lrc: 4/0,1 mode: CW/CW res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.808494:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35392 lrc: 4/0,1 mode: CW/CW res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.808501:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35392 lrc: 3/0,0 mode: CW/CW res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.808508:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35392 lrc: 4/0,0 mode: CW/CW res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.808514:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ea00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508709.808518:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35392 lrc: 4/0,0 mode: CW/CW res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.808526:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35392 lrc: 5/0,0 mode: CW/CW res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.808612:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1265:0x0].0x0 (ffff9090cc088f00) 00010000:00010000:3.0:1787508709.808617:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508709.808621:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35392 lrc: 3/0,0 mode: --/CW res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.808628:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35392 lrc: 0/0,0 mode: --/CW res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508709.808643:0:205405:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007165b0b reply state 000000009a836564 transno 12884944165 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35399 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.808654:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35399 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.808661:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1265:0x0].0xfe058dd8 (ffff9090cc088c00) 00010000:00010000:3.0:1787508709.808663:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508709.808666:0:205405:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787508709.808694:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f3538b lrc: 0/0,0 mode: --/CW res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae831 expref: 14 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.808715:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f353a0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1266:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae831 expref: 13 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.808723:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1266:0x0].0x0 (ffff9090cc088400) 00010000:00010000:3.0:1787508709.808726:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787508709.808728:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e200, rc 0) 00000100:00100000:3.0:1787508709.808854:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:340584:x1874324509605504:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1331us (1455us total) trans 12884944165 rc 0/0 00000100:00100000:3.0:1787508709.808863:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94080 00000100:00100000:0.0:1787508709.813866:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508709.813989:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509605760 00000100:00100000:2.0:1787508709.813999:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509605760 00000100:00100000:2.0:1787508709.814053:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94081 00000100:00100000:2.0:1787508709.814063:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:340584:x1874324509605760:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508709.814088:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508709.814110:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f353ae lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae838 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.814217:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f353b5 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x1266:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.814228:0:202226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f353a0 lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x1266:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae831 expref: 15 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.814234:0:202226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f353b5 lrc: 4/0,1 mode: --/EX res: [0x2000013a4:0x1266:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.814259:0:202226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f353a0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1266:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae831 expref: 15 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.814271:0:202226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f353a0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1266:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae831 expref: 15 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508709.814281:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480188160:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508709.814347:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090ce980b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787508709.817908:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508709.818130:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480188160:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508709.818142:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509605888 00000100:00100000:3.0:1787508709.818149:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509605888 00010000:00010000:2.0:1787508709.818157:0:202226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f353b5 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x1266:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.818185:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f353a0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1266:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae831 expref: 16 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508709.818213:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27927 00000100:00100000:3.0:1787508709.818222:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9f19050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:2400:x1874324509605888:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508709.818237:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508709.818244:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f353a0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1266:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae831 expref: 16 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.818258:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f353a0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1266:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae831 expref: 16 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.818280:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f353a0 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1266:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae831 expref: 16 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.818300:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1266:0x0].0x0 (ffff9090cc088400) 00010000:00010000:3.0:1787508709.818305:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f353b5 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x1266:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.818315:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f353b5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1266:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.818322:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f353b5 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x1266:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.818350:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508709.818402:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9f19050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:2400:x1874324509605888:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 180us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508709.818410:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27927 00010000:00010000:2.0:1787508709.818453:0:202226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f353b5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1266:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.818466:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f353b5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1266:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508709.818484:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1266:0x0]: returning size 0 00010000:00010000:2.0:1787508709.818690:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f353b5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1266:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.818698:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f353b5 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x1266:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.818704:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f353b5 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1266:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.818710:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508709.818715:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f353b5 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1266:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.818721:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f353b5 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x1266:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.818734:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1266:0x0].0x0 (ffff9090cc088400) 00010000:00010000:2.0:1787508709.818736:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787508709.818739:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f353b5 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x1266:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.818745:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f353b5 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x1266:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.818795:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f353ae lrc: 1/0,0 mode: --/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae838 expref: 15 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.818816:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1265:0x0].0x0 (ffff9090cc088f00) 00010000:00010000:2.0:1787508709.818819:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508709.818823:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f353ae lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae838 expref: 15 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.818833:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aba00, rc 0) 00000100:00100000:2.0:1787508709.818870:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:340584:x1874324509605760:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 4808us (5014us total) trans 12884944166 rc 301/301 00000100:00100000:2.0:1787508709.818879:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94081 00000100:00100000:1.0:1787508709.824250:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508709.824318:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509606144 00000100:00100000:0.0:1787508709.824329:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509606144 00000100:00100000:0.0:1787508709.824391:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15448 00000100:00100000:0.0:1787508709.824401:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:340584:x1874324509606144:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1787508709.824650:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:340584:x1874324509606144:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 250us (409us total) trans 12884944167 rc 0/0 00000100:00100000:0.0:1787508709.824656:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15448 00000100:00100000:0.0:1787508709.826165:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508709.826211:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509606400 00000100:00100000:2.0:1787508709.826220:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509606400 00000100:00100000:2.0:1787508709.826261:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15449 00000100:00100000:2.0:1787508709.826270:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde33850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:340584:x1874324509606400:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1787508709.826434:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde33850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:340584:x1874324509606400:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 165us (272us total) trans 12884944168 rc 0/0 00000100:00100000:2.0:1787508709.826445:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15449 00000100:00100000:2.0:1787508709.845452:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508709.845625:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509606528 00000100:00100000:1.0:1787508709.845636:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509606528 00000100:00100000:1.0:1787508709.845758:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94082 00000100:00100000:1.0:1787508709.845769:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:340587:x1874324509606528:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:1.0:1787508709.845809:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508709.845831:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f353c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae83f expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.845903:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f353ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.845919:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f353ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.845930:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f353ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508709.846009:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508709.846014:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508709.846034:0:209004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f353ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.846060:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f353c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae83f expref: 7 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.846077:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f353ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae83f expref: 6 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.846087:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508709.846091:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508709.846095:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b200, rc 0) 00000100:00100000:1.0:1787508709.846152:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:340587:x1874324509606528:12345-192.168.201.30@tcp:101:dd.0 Request processed in 384us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508709.846159:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94082 00000100:00080000:0.0:1787508709.848165:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787508709.848705:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508709.848783:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509606656 00000100:00100000:3.0:1787508709.848793:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509606656 00000100:00100000:3.0:1787508709.848859:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94083 00000100:00100000:3.0:1787508709.848869:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:340587:x1874324509606656:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:3.0:1787508709.848890:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508709.848909:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f353d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae846 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.849001:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f353d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.849015:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f353d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.849030:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f353d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.849041:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f353df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe561df9a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.849047:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f353df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.849053:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f353df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.849143:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f353e6 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.849151:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f353e6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.849157:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f353e6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508709.849188:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1265:0x0]: returning size 4096 00000004:00200000:3.0:1787508709.849192:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508709.849211:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f353e6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.849224:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f353d8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.849230:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f353d8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.849240:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f353d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.849246:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f353d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.849251:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508709.849255:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f353d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.849262:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f353d8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.849273:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508709.849276:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508709.849280:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f353d8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.849285:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f353d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.849299:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f353df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.849305:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f353df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.849310:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f353df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.849315:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ea00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508709.849318:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f353df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.849323:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f353df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.849328:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe561df9a (ffff9090cc088300) 00010000:00010000:3.0:1787508709.849330:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508709.849333:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f353df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.849338:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f353df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.849361:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f353d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae846 expref: 8 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.849373:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f353e6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae846 expref: 7 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.849380:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1265:0x0].0x0 (ffff9090cc088f00) 00010000:00010000:3.0:1787508709.849382:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787508709.849384:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fa00, rc 0) 00000100:00100000:3.0:1787508709.849442:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:340587:x1874324509606656:12345-192.168.201.30@tcp:101:dd.0 Request processed in 574us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508709.849449:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94083 00000100:00100000:3.0:1787508709.852579:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508709.852657:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509606912 00000100:00100000:0.0:1787508709.852667:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509606912 00000100:00100000:0.0:1787508709.852735:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94084 00000100:00100000:0.0:1787508709.852745:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:340587:x1874324509606912:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1787508709.852765:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508709.852795:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f353ed lrc: 2/0,0 mode: --/CW res: [0x2000013a4:0x1265:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae84d expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.852992:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f353f4 lrc: 3/1,0 mode: --/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.853007:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f353f4 lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.853019:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f353f4 lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.853030:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f353fb lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.853037:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f353fb lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.853044:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f353fb lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.853105:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.853114:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.853121:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508709.853208:0:205405:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1266:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1787508709.853212:0:205405:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1266:0x0] updating lvb mtime from disk: 0 -> 1787508710 00000004:00010000:0.0:1787508709.853214:0:205405:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1266:0x0] updating lvb atime from disk: 0 -> 1787508710 00000004:00010000:0.0:1787508709.853217:0:205405:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1266:0x0] updating lvb ctime from disk: 0 -> 1787508710 00000004:00010000:0.0:1787508709.853218:0:205405:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1266:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:0.0:1787508709.853222:0:205405:0:(mdt_io.c:1552:mdt_lvb2reply()) size 0 00010000:00010000:0.0:1787508709.853228:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f353f4 lrc: 4/1,0 mode: CR/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.853234:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f353f4 lrc: 4/1,0 mode: CR/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.853240:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f353f4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.853246:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f353f4 lrc: 4/0,0 mode: CR/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.853252:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508709.853256:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f353f4 lrc: 4/0,0 mode: CR/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.853264:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f353f4 lrc: 5/0,0 mode: CR/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.853276:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1265:0x0].0x0 (ffff9090cc088f00) 00010000:00010000:0.0:1787508709.853279:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508709.853283:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f353f4 lrc: 3/0,0 mode: --/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.853290:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f353f4 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.853303:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f353fb lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.853312:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f353fb lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.853318:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f353fb lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.853323:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508709.853326:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f353fb lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.853333:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f353fb lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.853339:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1265:0x0].0xfe058dd8 (ffff9090cc088c00) 00010000:00010000:0.0:1787508709.853341:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508709.853344:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f353fb lrc: 2/0,0 mode: --/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.853349:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f353fb lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.853386:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f353ed lrc: 0/0,0 mode: --/CW res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 10 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.853399:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 9 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.853406:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1266:0x0].0x0 (ffff9090ca4e2800) 00010000:00010000:0.0:1787508709.853409:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:0.0:1787508709.853411:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4600, rc 0) 00000100:00100000:0.0:1787508709.853464:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:340587:x1874324509606912:12345-192.168.201.30@tcp:101:dd.0 Request processed in 720us (894us total) trans 12884944169 rc 0/0 00000100:00100000:0.0:1787508709.853471:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94084 00000100:00100000:2.0:1787508709.856157:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508709.856219:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509607168 00000100:00100000:0.0:1787508709.856227:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509607168 00000100:00100000:0.0:1787508709.856276:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94085 00000100:00100000:0.0:1787508709.856283:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:340587:x1874324509607168:12345-192.168.201.30@tcp:36:dd.0 00010000:00010000:0.0:1787508709.856385:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35410 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.856398:0:202226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 9 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.856403:0:202226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35410 lrc: 4/0,1 mode: --/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.856428:0:202226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 9 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.856438:0:202226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 9 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508709.856449:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0877b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480188288:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508709.856511:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cdd73c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787508709.858237:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0877b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480188288:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508709.858267:0:202226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35410 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508709.858695:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508709.858912:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509607296 00000100:00100000:3.0:1787508709.858919:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509607296 00010000:00010000:3.0:1787508709.858965:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 10 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508709.859002:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27928 00000100:00100000:3.0:1787508709.859012:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2401:x1874324509607296:12345-192.168.201.30@tcp:102:ldlm_bl.0 00010000:00010000:3.0:1787508709.859028:0:205406:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 10 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.859039:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 10 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.859047:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 10 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.859054:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1266:0x0].0x0 (ffff9090ca4e2800) 00010000:00010000:3.0:1787508709.859055:0:205406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:3.0:1787508709.859058:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35410 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.859064:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35410 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.859068:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35410 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.859092:0:205406:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 10 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508709.859136:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2401:x1874324509607296:12345-192.168.201.30@tcp:102:ldlm_bl.0 Request processed in 127us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508709.859143:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27928 00010000:00010000:2.0:1787508709.859469:0:202226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35410 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.859475:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35410 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508709.859602:0:202226:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1266:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:2.0:1787508709.859606:0:202226:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1266:0x0] updating lvb mtime from disk: 1787508710 -> 1787508710 00000004:00010000:2.0:1787508709.859608:0:202226:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1266:0x0] updating lvb atime from disk: 1787508710 -> 1787508710 00000004:00010000:2.0:1787508709.859610:0:202226:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1266:0x0] updating lvb ctime from disk: 1787508710 -> 1787508710 00000004:00010000:2.0:1787508709.859612:0:202226:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1266:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:2.0:1787508709.859619:0:202226:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a5ee29e reply state 000000007239fc62 transno 12884944170 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35410 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.859632:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35410 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1266:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.859639:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1266:0x0].0x0 (ffff9090ca4e2800) 00010000:00010000:2.0:1787508709.859642:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787508709.859644:0:202226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787508709.859731:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:340587:x1874324509607168:12345-192.168.201.30@tcp:36:dd.0 Request processed in 3447us (3582us total) trans 12884944170 rc 0/0 00000100:00100000:2.0:1787508709.859739:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94085 00000100:00100000:2.0:1787508709.863702:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508709.863905:0:228420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509607424 00000100:00100000:0.0:1787508709.863916:0:228420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509607424 00002000:00010000:0.0:1787508709.863977:0:228420:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x2000013a4:0x1266:0x0] 00002000:00100000:0.0:1787508709.863983:0:228420:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9091f9ac6d80 with x1874324509607424 00000100:00100000:0.0:1787508709.864064:0:228420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7750 00000100:00100000:0.0:1787508709.864075:0:228420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2402:x1874324509607424:12345-192.168.201.30@tcp:10:dd.0 00000004:00010000:0.0:1787508709.864267:0:228420:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1266:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1787508709.864271:0:228420:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1266:0x0] updating lvb mtime from disk: 1787508710 -> 1787508710 00000004:00010000:0.0:1787508709.864274:0:228420:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1266:0x0] updating lvb atime from disk: 1787508710 -> 1787508710 00000004:00010000:0.0:1787508709.864276:0:228420:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1266:0x0] updating lvb ctime from disk: 1787508710 -> 1787508710 00000004:00010000:0.0:1787508709.864278:0:228420:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1266:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787508709.864404:0:228420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2402:x1874324509607424:12345-192.168.201.30@tcp:10:dd.0 Request processed in 330us (712us total) trans 12884944171 rc 0/0 00000100:00100000:0.0:1787508709.864413:0:228420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7750 00002000:00010000:0.0:1787508709.864417:0:228420:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x2000013a4:0x1266:0x0] 00002000:00100000:0.0:1787508709.864419:0:228420:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9091f9ac6d80 with x1874324509607424 00000100:00100000:1.0:1787508709.870473:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508709.870617:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509607680 00000100:00100000:2.0:1787508709.870627:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509607680 00000100:00100000:2.0:1787508709.870716:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94086 00000100:00100000:2.0:1787508709.870724:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:340587:x1874324509607680:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:2.0:1787508709.870748:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508709.870766:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f35417 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x1266:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae854 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.870823:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3541e lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x1266:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.870836:0:203348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x59/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 13 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.870842:0:203348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3541e lrc: 4/0,1 mode: --/EX res: [0x2000013a4:0x1266:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.870868:0:203348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x59/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 13 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.870878:0:203348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x59/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 13 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508709.870887:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:203348:1874324480188416:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508709.870982:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090ce980f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787508709.873108:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:203348:1874324480188416:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508709.873139:0:203348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3541e lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x1266:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508709.873413:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508709.873519:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509607808 00000100:00100000:2.0:1787508709.873526:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509607808 00010000:00010000:2.0:1787508709.873566:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x59/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 14 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508709.873603:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27929 00000100:00100000:2.0:1787508709.873613:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2400:x1874324509607808:12345-192.168.201.30@tcp:102:ldlm_bl.0 00010000:00010000:2.0:1787508709.873630:0:202212:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x59/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 14 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.873642:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x59/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 14 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.873653:0:202212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x51/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 14 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.873662:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1266:0x0].0x0 (ffff9090ca4e2800) 00010000:00010000:2.0:1787508709.873664:0:202212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 59 00010000:00010000:2.0:1787508709.873668:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3541e lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x1266:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.873678:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3541e lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1266:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.873684:0:202212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3541e lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x1266:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508709.873859:0:202212:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x51/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 14 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508709.873988:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2400:x1874324509607808:12345-192.168.201.30@tcp:102:ldlm_bl.0 Request processed in 377us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508709.873996:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27929 00010000:00010000:3.0:1787508709.874070:0:203348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3541e lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1266:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.874078:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3541e lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1266:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787508709.874223:0:203348:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x152e:0x0], index 0: 0 00010000:00010000:3.0:1787508709.874324:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3541e lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x1266:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae854 expref: 15 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.874332:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1266:0x0].0x0 (ffff9090ca4e2800) 00010000:00010000:3.0:1787508709.874334:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1787508709.874348:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f35417 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x1266:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae854 expref: 15 pid: 203348 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.874361:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3541e lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x1266:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae854 expref: 14 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.874385:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1266:0x0].0x0 (ffff9090ca4e2800) 00010000:00010000:3.0:1787508709.874387:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1787508709.874389:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aac00, rc 0) 00000100:00100000:3.0:1787508709.874416:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:340587:x1874324509607680:12345-192.168.201.30@tcp:101:dd.0 Request processed in 3692us (3951us total) trans 12884944172 rc 0/0 00000100:00100000:3.0:1787508709.874423:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94086 00000100:00100000:0.0:1787508709.880005:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508709.880117:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508709.880207:0:205404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509608064 00000100:00100000:1.0:1787508709.880218:0:205404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509608064 00000100:00100000:1.0:1787508709.880361:0:205404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:1.0:1787508709.880373:0:205404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2403:x1874324509608064:12345-192.168.201.30@tcp:4:dd.0 00002000:00010000:1.0:1787508709.880421:0:205404:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x152e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787508709.880431:0:205404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000298fbfe3/0xb126349c40f35425 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x152e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 205404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.880447:0:205404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x152e:0x0].0x0 since=13680s v=(0 0) 00010000:00010000:1.0:1787508709.880451:0:205404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x152e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787508709.880458:0:205404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000298fbfe3/0xb126349c40f35425 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x152e:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 205404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.880475:0:205404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000298fbfe3/0xb126349c40f35425 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x152e:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 205404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787508709.880867:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787508709.881667:0:202239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509607936 00000100:00100000:3.0:1787508709.881676:0:202239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509607936 00000100:00100000:3.0:1787508709.881746:0:202239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7751 00000100:00100000:3.0:1787508709.881756:0:202239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2403:x1874324509607936:12345-192.168.201.30@tcp:4:dd.0 00010000:00010000:3.0:1787508709.881814:0:202239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3542c lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.881831:0:202239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x51/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 14 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.881840:0:202239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3542c lrc: 4/0,1 mode: --/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.881873:0:202239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x51/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 14 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.881887:0:202239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x51/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 14 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508709.881902:0:202239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea3800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:202239:1874324480188544:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508709.882000:0:202239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3455900 going to sleep for 11 seconds 00000100:00100000:3.0:1787508709.894120:0:202239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea3800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:202239:1874324480188544:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508709.894153:0:202239:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3542c lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508709.906655:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508709.907006:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509608192 00000100:00100000:1.0:1787508709.907016:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509608192 00010000:00010000:1.0:1787508709.907056:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x51/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 15 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508709.907090:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27930 00000100:00100000:1.0:1787508709.907101:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2401:x1874324509608192:12345-192.168.201.30@tcp:102:ldlm_bl.0 00010000:00010000:1.0:1787508709.907120:0:202211:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x51/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 15 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.907139:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x51/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 15 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.907151:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 15 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.907161:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1266:0x0].0x0 (ffff9090ca4e2800) 00010000:00010000:1.0:1787508709.907164:0:202211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 51 00010000:00010000:1.0:1787508709.907169:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 6 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3542c lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.907178:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3542c lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40090000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.907185:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3542c lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40090000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.907221:0:202211:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 15 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508709.907271:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2401:x1874324509608192:12345-192.168.201.30@tcp:102:ldlm_bl.0 Request processed in 171us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508709.907278:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27930 00010000:00010000:0.0:1787508709.907345:0:202239:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3542c lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.907353:0:202239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3542c lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787508709.916244:0:203722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589941253 is committed 00002000:00010000:1.0:1787508709.916408:0:205404:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x152e:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1787508709.916413:0:205404:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x152e:0x0] updating lvb mtime from disk: 0 -> 1787508710 00002000:00010000:1.0:1787508709.916416:0:205404:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x152e:0x0] updating lvb ctime from disk: 0 -> 1787508710 00002000:00010000:1.0:1787508709.916418:0:205404:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x152e:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:1.0:1787508709.916434:0:205404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000298fbfe3/0xb126349c40f35425 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x152e:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 205404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.916447:0:205404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000298fbfe3/0xb126349c40f35425 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x152e:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 205404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.916457:0:205404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000298fbfe3/0xb126349c40f35425 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x152e:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 205404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.916465:0:205404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a000 already unused, calling callback (ffffffffc0d0a230) 00010000:00010000:1.0:1787508709.916470:0:205404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000298fbfe3/0xb126349c40f35425 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x152e:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 205404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.916480:0:205404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000298fbfe3/0xb126349c40f35425 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x152e:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 205404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.916500:0:205404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000298fbfe3/0xb126349c40f35425 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x152e:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 205404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.916508:0:205404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000298fbfe3/0xb126349c40f35425 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x152e:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 205404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508709.916835:0:205404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2403:x1874324509608064:12345-192.168.201.30@tcp:4:dd.0 Request processed in 36459us (36712us total) trans 8589941253 rc 0/0 00000100:00100000:1.0:1787508709.916847:0:205404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 48 00000001:00080000:2.0:1787508709.926876:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944173 is committed 00000001:00080000:2.0:1787508709.927004:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944168 is committed 00000004:00010000:1.0:1787508709.927144:0:202239:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1266:0x0] updating lvb size from disk: 0 -> 1048576 00000004:00010000:1.0:1787508709.927150:0:202239:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1266:0x0] updating lvb mtime from disk: 1787508710 -> 1787508710 00000004:00010000:1.0:1787508709.927153:0:202239:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1266:0x0] updating lvb atime from disk: 1787508710 -> 1787508710 00000004:00010000:1.0:1787508709.927156:0:202239:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1266:0x0] updating lvb ctime from disk: 1787508710 -> 1787508710 00000004:00010000:1.0:1787508709.927158:0:202239:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1266:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:1.0:1787508709.927175:0:202239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3542c lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.927187:0:202239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3542c lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.927195:0:202239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3542c lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.927201:0:202239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e200 already unused, calling callback (ffffffffc0d0a230) 00010000:00010000:1.0:1787508709.927206:0:202239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3542c lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.927214:0:202239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3542c lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.927231:0:202239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1266:0x0].0x0 (ffff9090ca4e2800) 00010000:00010000:1.0:1787508709.927234:0:202239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787508709.927239:0:202239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3542c lrc: 2/0,0 mode: --/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.927246:0:202239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f3542c lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508709.927348:0:202239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2403:x1874324509607936:12345-192.168.201.30@tcp:4:dd.0 Request processed in 45589us (47347us total) trans 12884944173 rc 0/0 00000100:00100000:1.0:1787508709.927358:0:202239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7751 00010000:00010000:0.0:1787508709.927465:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35410 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1266:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.927473:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35410 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x1266:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.927480:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35410 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1266:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.927486:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5a00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508709.927491:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35410 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1266:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.927497:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35410 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x1266:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.927508:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1266:0x0].0x0 (ffff9090ca4e2800) 00010000:00010000:0.0:1787508709.927511:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508709.927514:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35410 lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x1266:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.927521:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35410 lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x1266:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.929793:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3533e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.929822:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3533e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.929835:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3533e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.929842:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ee00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508709.929846:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3533e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.929854:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3533e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.929870:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe561df9a (ffff9090cc088300) 00010000:00010000:3.0:1787508709.929873:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508709.929878:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3533e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.929884:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3533e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe561df9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.929906:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35345 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.929913:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35345 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.929920:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35345 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.929924:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508709.929928:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35345 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.930094:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35345 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.930107:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1265:0x0].0x0 (ffff9090cc088f00) 00010000:00010000:3.0:1787508709.930110:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508709.930113:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35345 lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.930118:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35345 lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.930136:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35399 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.930142:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35399 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.930147:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35399 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.930153:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508709.930155:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35399 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.930160:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35399 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.930167:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1265:0x0].0xfe058dd8 (ffff9090cc088c00) 00010000:00010000:3.0:1787508709.930169:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508709.930172:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35399 lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.930178:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35399 lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508709.932330:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508709.932412:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509608448 00000100:00100000:3.0:1787508709.932422:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509608448 00000100:00100000:3.0:1787508709.932481:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15450 00000100:00100000:3.0:1787508709.932493:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:340587:x1874324509608448:12345-192.168.201.30@tcp:35:dd.0 00000100:00100000:3.0:1787508709.932840:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:340587:x1874324509608448:12345-192.168.201.30@tcp:35:dd.0 Request processed in 348us (517us total) trans 12884944174 rc 0/0 00000100:00100000:3.0:1787508709.932848:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15450 00000100:00100000:2.0:1787508709.945581:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508709.945657:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509608576 00000100:00100000:0.0:1787508709.945665:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509608576 00000100:00100000:0.0:1787508709.945728:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94087 00000100:00100000:0.0:1787508709.945738:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:340588:x1874324509608576:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:0.0:1787508709.945765:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508709.945803:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35433 lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae85b expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.945863:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3543a lrc: 3/1,0 mode: --/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.945877:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3543a lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.945887:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3543a lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.945899:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f35441 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.945906:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f35441 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.945913:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f35441 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.946023:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35448 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1266:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.946034:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 9 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.946041:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35448 lrc: 4/1,0 mode: --/PR res: [0x2000013a4:0x1266:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.946074:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 9 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.946088:0:230618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 9 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508709.946101:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b24380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480188672:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508709.946165:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cdd733c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787508709.946827:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508709.948903:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508709.949034:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509608704 00000100:00100000:3.0:1787508709.949043:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509608704 00010000:00010000:3.0:1787508709.949081:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 5/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 10 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508709.949126:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27931 00000100:00100000:3.0:1787508709.949136:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2401:x1874324509608704:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508709.949149:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508709.949156:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 5/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 10 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.949169:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 10 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.949190:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1266:0x0].0x0 (ffff9090ca4e2800) 00010000:00010000:3.0:1787508709.949195:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35448 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1266:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.949205:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35448 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1266:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.949212:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35448 lrc: 4/1,0 mode: PR/PR res: [0x2000013a4:0x1266:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508709.949230:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508709.949285:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2401:x1874324509608704:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 150us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508709.949292:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27931 00010000:00010000:0.0:1787508709.949849:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35402 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x1266:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae84d expref: 9 pid: 205405 timeout: 13780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508709.949868:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b24380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480188672:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508709.949890:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35448 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1266:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.949899:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35448 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1266:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.949906:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35448 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1266:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508709.949997:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1266:0x0]: returning size 2097152 00000004:00200000:0.0:1787508709.950004:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508709.950030:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35448 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1266:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508709.950057:0:230618:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1266:0x0] updating lvb size from disk: 1048576 -> 1048576 00000004:00010000:0.0:1787508709.950061:0:230618:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1266:0x0] updating lvb mtime from disk: 1787508710 -> 1787508710 00000004:00010000:0.0:1787508709.950064:0:230618:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1266:0x0] updating lvb atime from disk: 1787508710 -> 1787508710 00000004:00010000:0.0:1787508709.950066:0:230618:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1266:0x0] updating lvb ctime from disk: 1787508710 -> 1787508710 00000004:00010000:0.0:1787508709.950068:0:230618:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1266:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:0.0:1787508709.950072:0:230618:0:(mdt_io.c:1552:mdt_lvb2reply()) size 1048576 00010000:00010000:0.0:1787508709.950079:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3543a lrc: 4/1,0 mode: CR/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.950084:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3543a lrc: 4/1,0 mode: CR/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.950090:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3543a lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.950097:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3543a lrc: 4/0,0 mode: CR/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.950104:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508709.950108:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3543a lrc: 4/0,0 mode: CR/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.950115:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3543a lrc: 5/0,0 mode: CR/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.950127:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1265:0x0].0x0 (ffff9090cc088f00) 00010000:00010000:0.0:1787508709.950130:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508709.950134:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3543a lrc: 3/0,0 mode: --/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.950140:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3543a lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.950154:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f35441 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.950160:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f35441 lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.950164:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f35441 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.950169:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508709.950172:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f35441 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.950177:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f35441 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.950183:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1265:0x0].0xfe058dd8 (ffff9090ca4e2e00) 00010000:00010000:0.0:1787508709.950185:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508709.950188:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f35441 lrc: 2/0,0 mode: --/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.950193:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f35441 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1265:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.950227:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35433 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae85b expref: 11 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.950241:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35448 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1266:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae85b expref: 10 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508709.950253:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1266:0x0].0x0 (ffff9090ca4e2800) 00010000:00010000:0.0:1787508709.950256:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:0.0:1787508709.950259:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4000, rc 0) 00000100:00100000:0.0:1787508709.950313:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:340588:x1874324509608576:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 4575us (4741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508709.950320:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94087 00000100:00100000:2.0:1787508709.955631:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508709.955740:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509608832 00000100:00100000:1.0:1787508709.955751:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509608832 00000100:00100000:1.0:1787508709.955849:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15071 00000100:00100000:1.0:1787508709.955860:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2402:x1874324509608832:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:1.0:1787508709.955878:0:225837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508709.955898:0:225837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb12f5b6/0xb126349c40f3544f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x152e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae862 expref: -99 pid: 225837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787508709.955925:0:225837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x152e:0x0] initial LVB size: 2097152, mtime: 0x6a8b37e6, atime: 0x0, ctime: 0x6a8b37e6, blocks: 0x800 00000100:00080000:0.0:1787508709.956028:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787508709.956245:0:225837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x152e:0x0].0x0 since=13681s v=(0 0) 00010000:00010000:1.0:1787508709.956251:0:225837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x152e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787508709.956262:0:225837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb12f5b6/0xb126349c40f3544f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x152e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae862 expref: 6 pid: 225837 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.956282:0:225837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eb12f5b6/0xb126349c40f3544f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x152e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae862 expref: 6 pid: 225837 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508709.956295:0:225837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247bc00, rc 0) 00000100:00100000:1.0:1787508709.956353:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509608832:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 495us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508709.956360:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15071 00000100:00100000:3.0:1787508710.586217:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787508710.586242:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d021b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480188800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787508710.586328:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508710.586476:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480188800 00000100:00100000:1.0:1787508710.586484:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480188800 00000100:00100000:1.0:1787508710.586540:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29863 00000100:00100000:1.0:1787508710.586549:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480188800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787508710.586583:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6410240 pending 0 free 1442775040 avail 1296535552 00000100:00100000:1.0:1787508710.586644:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480188800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508710.586650:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29863 00000100:00100000:0.0:1787508710.586765:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d021b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480188800:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787508710.587185:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787508710.587196:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480188928:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787508710.587232:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508710.587306:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480188928 00000100:00100000:3.0:1787508710.587312:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480188928 00000100:00100000:3.0:1787508710.587350:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29864 00000100:00100000:3.0:1787508710.587357:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480188928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787508710.587377:0:202232:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 5316608 pending 0 free 1440710656 avail 1294471168 00000100:00100000:3.0:1787508710.587431:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480188928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508710.587438:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29864 00000100:00100000:2.0:1787508710.587820:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480188928:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787508710.970469:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508711.098345:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480189440:0@lo:400:kworker.0 00000100:00100000:1.0:1787508711.098447:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508711.098481:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480189952:0@lo:400:kworker.0 00000100:00100000:1.0:1787508711.098510:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508711.098543:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480190464:0@lo:400:kworker.0 00000100:00100000:1.0:1787508711.098570:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508711.098596:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787508711.098603:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480189312:0@lo:400:kworker.0 00000100:00100000:1.0:1787508711.098628:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508711.098645:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480189824:0@lo:400:kworker.0 00000100:00100000:1.0:1787508711.098671:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508711.098805:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d021b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480189056:0@lo:400:kworker.0 00000100:00100000:2.0:1787508711.098843:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508711.098877:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480189568:0@lo:400:kworker.0 00000100:00100000:2.0:1787508711.098900:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508711.098918:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480190080:0@lo:400:kworker.0 00000100:00100000:2.0:1787508711.098963:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508711.098983:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480190592:0@lo:400:kworker.0 00000100:00100000:2.0:1787508711.099020:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508711.099043:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787508711.099050:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480189184:0@lo:400:kworker.0 00000100:00100000:2.0:1787508711.099078:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508711.099100:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480189696:0@lo:400:kworker.0 00000100:00100000:2.0:1787508711.099121:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508711.099139:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874324480190208:0@lo:400:kworker.0 00000100:00100000:2.0:1787508711.099159:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508711.099192:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480189056 00000100:00100000:2.0:1787508711.099199:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480189056 00000100:00100000:2.0:1787508711.099247:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:2.0:1787508711.099256:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fccc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480189056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508711.099313:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fccc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480189056:12345-0@lo:400:kworker.0 Request processed in 58us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508711.099321:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000100:00100000:2.0:1787508711.099354:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480190464 00000100:00100000:2.0:1787508711.099359:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480190464 00000100:00100000:2.0:1787508711.099388:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480189568 00000100:00100000:2.0:1787508711.099391:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480189568 00000100:00100000:2.0:1787508711.099404:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480190080 00000100:00100000:2.0:1787508711.099406:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480190080 00000100:00100000:2.0:1787508711.099414:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480190592 00000100:00100000:2.0:1787508711.099416:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480190592 00000100:00100000:2.0:1787508711.099427:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480190208 00000100:00100000:2.0:1787508711.099429:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480190208 00000100:00100000:2.0:1787508711.099441:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3035 00000100:00100000:2.0:1787508711.099447:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480190464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508711.099476:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480190464:12345-0@lo:400:kworker.0 Request processed in 30us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508711.099481:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3035 00000100:00100000:2.0:1787508711.099492:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3036 00000100:00100000:2.0:1787508711.099496:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480189568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508711.099522:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480189568:12345-0@lo:400:kworker.0 Request processed in 25us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508711.099528:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3036 00000100:00100000:2.0:1787508711.099540:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3037 00000100:00100000:2.0:1787508711.099546:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480190080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508711.099573:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480190080:12345-0@lo:400:kworker.0 Request processed in 27us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508711.099579:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3037 00000100:00100000:2.0:1787508711.099592:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3038 00000100:00100000:2.0:1787508711.099598:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480190592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508711.099619:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480190592:12345-0@lo:400:kworker.0 Request processed in 23us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508711.099625:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3038 00000100:00100000:2.0:1787508711.099636:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3039 00000100:00100000:2.0:1787508711.099642:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874324480190208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508711.099662:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874324480190208:12345-0@lo:400:kworker.0 Request processed in 21us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508711.099668:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3039 00000100:00100000:2.0:1787508711.099706:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480189184 00000100:00100000:2.0:1787508711.099710:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480189184 00000100:00100000:2.0:1787508711.099730:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480189696 00000100:00100000:2.0:1787508711.099733:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480189696 00000100:00100000:2.0:1787508711.099749:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29865 00000100:00100000:2.0:1787508711.099754:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480189184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508711.099796:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480189184:12345-0@lo:400:kworker.0 Request processed in 41us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508711.099802:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29865 00000100:00100000:2.0:1787508711.099813:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29866 00000100:00100000:2.0:1787508711.099818:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480189696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508711.099842:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480189696:12345-0@lo:400:kworker.0 Request processed in 24us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508711.099848:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29866 00000100:00080000:2.0:1787508711.099872:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787508711.099877:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508711.099911:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480189184:0@lo:400:kworker.0 00000100:00100000:2.0:1787508711.099921:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480189696:0@lo:400:kworker.0 00000100:00100000:2.0:1787508711.099931:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874324480190208:0@lo:400:kworker.0 00000100:00100000:2.0:1787508711.099956:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d021b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480189056:0@lo:400:kworker.0 00000100:00100000:2.0:1787508711.099967:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480189568:0@lo:400:kworker.0 00000100:00100000:2.0:1787508711.099974:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480190080:0@lo:400:kworker.0 00000100:00100000:2.0:1787508711.099983:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480190592:0@lo:400:kworker.0 00000100:00100000:1.0:1787508711.100223:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874324480190336:0@lo:400:kworker.0 00000100:00100000:1.0:1787508711.100255:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508711.100279:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480190464:0@lo:400:kworker.0 00000100:00100000:1.0:1787508711.100300:0:225833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480189440 00000100:00100000:1.0:1787508711.100304:0:225833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480189440 00000100:00100000:1.0:1787508711.100335:0:225833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480189952 00000100:00100000:1.0:1787508711.100338:0:225833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480189952 00000100:00100000:1.0:1787508711.100350:0:225833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2404 00000100:00100000:1.0:1787508711.100354:0:225833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480189440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508711.100379:0:225833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480189440:12345-0@lo:400:kworker.0 Request processed in 25us (1934us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508711.100384:0:225833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2404 00000100:00100000:1.0:1787508711.100521:0:225833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480189312 00000100:00100000:1.0:1787508711.100523:0:225833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480189312 00000100:00100000:1.0:1787508711.100536:0:225833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480189824 00000100:00100000:1.0:1787508711.100538:0:225833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480189824 00000100:00100000:1.0:1787508711.100549:0:225833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2405 00000100:00100000:1.0:1787508711.100552:0:225833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480189952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508711.100569:0:225833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480189952:12345-0@lo:400:kworker.0 Request processed in 17us (2060us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508711.100573:0:225833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2405 00000100:00100000:1.0:1787508711.100579:0:225833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2406 00000100:00100000:1.0:1787508711.100582:0:225833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480189312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508711.100596:0:225833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480189312:12345-0@lo:400:kworker.0 Request processed in 14us (1970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508711.100600:0:225833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2406 00000100:00100000:1.0:1787508711.100604:0:225833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2407 00000100:00100000:1.0:1787508711.100608:0:225833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480189824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508711.100620:0:225833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480189824:12345-0@lo:400:kworker.0 Request processed in 12us (1950us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508711.100624:0:225833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2407 00000100:00100000:1.0:1787508711.100641:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480190336 00000100:00100000:1.0:1787508711.100643:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480190336 00000100:00100000:1.0:1787508711.100656:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3040 00000100:00100000:1.0:1787508711.100660:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874324480190336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508711.100677:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874324480190336:12345-0@lo:400:kworker.0 Request processed in 17us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508711.100683:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3040 00000100:00080000:1.0:1787508711.101441:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787508711.101447:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787508711.101448:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508711.101470:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480189312:0@lo:400:kworker.0 00000100:00100000:1.0:1787508711.101477:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480189824:0@lo:400:kworker.0 00000100:00100000:1.0:1787508711.101483:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874324480190336:0@lo:400:kworker.0 00000100:00100000:1.0:1787508711.101490:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480189440:0@lo:400:kworker.0 00000100:00100000:1.0:1787508711.101496:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480189952:0@lo:400:kworker.0 00010000:00010000:3.0:1787508711.996843:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508712.553765:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508712.553811:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508712.553850:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508712.553865:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509608960 00000100:00100000:0.0:1787508712.553875:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509608960 00000100:00100000:0.0:1787508712.553966:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1016 00000100:00100000:0.0:1787508712.553977:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fccc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509608960:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508712.554050:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fccc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509608960:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 75us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508712.554057:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1016 00000100:00100000:0.0:1787508712.554194:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509609472 00000100:00100000:0.0:1787508712.554198:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509609472 00000100:00100000:0.0:1787508712.554234:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2408 00000100:00100000:0.0:1787508712.554241:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2402:x1874324509609472:12345-192.168.201.30@tcp:400:kworker.0 00000100:00080000:1.0:1787508712.554320:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787508712.554348:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508712.554353:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2402:x1874324509609472:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 32us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508712.554360:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2408 00000100:00100000:2.0:1787508712.554394:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508712.554420:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508712.554439:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508712.554457:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508712.554478:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509609216 00000100:00100000:3.0:1787508712.554483:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509609216 00000100:00100000:2.0:1787508712.554490:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508712.554523:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509609728 00000100:00100000:2.0:1787508712.554526:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509609728 00000100:00100000:2.0:1787508712.554552:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509609088 00000100:00100000:2.0:1787508712.554556:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509609088 00000100:00100000:2.0:1787508712.554572:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509609600 00000100:00100000:2.0:1787508712.554575:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509609600 00000100:00100000:2.0:1787508712.554594:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3041 00000100:00100000:2.0:1787508712.554600:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509609728:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508712.554636:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509609728:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 36us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508712.554642:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3041 00000100:00100000:2.0:1787508712.554655:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3042 00000100:00100000:2.0:1787508712.554660:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2402:x1874324509609088:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508712.554682:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2402:x1874324509609088:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508712.554688:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3042 00000100:00100000:2.0:1787508712.554698:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3043 00000100:00100000:2.0:1787508712.554704:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2402:x1874324509609600:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508712.554727:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2402:x1874324509609600:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508712.554733:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3043 00000100:00100000:2.0:1787508712.554749:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509609984 00000100:00100000:2.0:1787508712.554767:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509609984 00000100:00100000:2.0:1787508712.554790:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509609344 00000100:00100000:2.0:1787508712.554793:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509609344 00000100:00100000:3.0:1787508712.554799:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3044 00000100:00100000:3.0:1787508712.554807:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2402:x1874324509609216:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508712.554810:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509609856 00000100:00100000:2.0:1787508712.554812:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509609856 00000100:00100000:3.0:1787508712.554835:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2402:x1874324509609216:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 29us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508712.554843:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3044 00000100:00100000:2.0:1787508712.554843:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2409 00000100:00100000:2.0:1787508712.554849:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509609984:12345-192.168.201.30@tcp:400:kworker.0 00000100:00080000:3.0:1787508712.554864:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787508712.554867:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787508712.554869:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787508712.554871:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787508712.554882:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509609984:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 33us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508712.554937:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2410 00000100:00100000:0.0:1787508712.554970:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509609344:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508712.554994:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509609344:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 27us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508712.555000:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2410 00000100:00100000:0.0:1787508712.555012:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2411 00000100:00100000:0.0:1787508712.555018:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509609856:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508712.555037:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509609856:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 20us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508712.555043:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2411 00000100:00100000:2.0:1787508712.555409:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2409 00010000:00010000:0.0:1787508713.019472:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508713.146226:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787508713.146251:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480190720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787508713.146325:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787508713.146326:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508713.146334:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c818f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480190848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787508713.146363:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508713.146391:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480190848 00000100:00100000:0.0:1787508713.146391:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480190720 00000100:00100000:2.0:1787508713.146397:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480190848 00000100:00100000:0.0:1787508713.146397:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480190720 00000100:00100000:2.0:1787508713.146516:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1701 00000100:00080000:3.0:1787508713.146778:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508713.146990:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1702 00000100:00100000:0.0:1787508713.147000:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480190720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787508713.147030:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 124211776 pending 0 free 3881955328 avail 3650433024 00000100:00100000:0.0:1787508713.147078:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480190720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508713.147085:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1702 00000100:00100000:1.0:1787508713.153346:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480190720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787508713.153863:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480190848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787508713.153894:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 124211776 pending 0 free 3881955328 avail 3650433024 00000100:00100000:2.0:1787508713.153994:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480190848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7469us (7629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508713.154004:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1701 00000100:00100000:2.0:1787508713.154070:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c818f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480190848:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787508714.044218:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508714.682219:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787508714.682251:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480190976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787508714.682335:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508714.682405:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480190976 00000100:00100000:1.0:1787508714.682412:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480190976 00000100:00100000:1.0:1787508714.682480:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1703 00000100:00100000:1.0:1787508714.682488:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480190976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787508714.682528:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 41194048 pending 0 free 3909767168 avail 3678244864 00000100:00100000:1.0:1787508714.682586:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480190976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508714.682593:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1703 00000100:00080000:1.0:1787508714.682626:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508714.682662:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480190976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787508714.685016:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787508714.685038:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480191104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787508714.685121:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508714.686376:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480191104 00000100:00100000:0.0:1787508714.686384:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480191104 00000100:00100000:0.0:1787508714.688664:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1704 00000100:00100000:0.0:1787508714.688689:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480191104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787508714.688731:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 41194048 pending 0 free 3909767168 avail 3678244864 00000100:00100000:0.0:1787508714.688865:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480191104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 188us (3742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508714.688873:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1704 00000100:00080000:0.0:1787508714.688915:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787508714.688971:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480191104:0@lo:13:osp-pre-0-0.0 00000020:00080000:2.0:1787508714.696108:0:202955:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 4294998389 batchid updated 00000020:00080000:0.0:1787508714.698276:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998389 00000004:00080000:0.0:1787508714.698353:0:202975:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090cdd73f00 with version 13624 00000020:00080000:0.0:1787508714.698375:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294998389 cancel update log [0x2000013a2:0x5:0x0].598: rc = 0 00000020:00080000:0.0:1787508714.698530:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294998389 cancel update log [0x240000bd1:0xf:0x0].54: rc = 0 00000020:00080000:0.0:1787508714.698540:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998389 00000004:00080000:3.0:1787508714.698649:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13624 rpc_version 13624 00000020:00100000:3.0:1787508714.698688:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787508714.698699:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090cdea1c00 x1874324480191360/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787508714.698735:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea1c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480191360:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508714.698830:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508714.698872:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d00cb300 going to sleep for 11 seconds 00000100:00100000:2.0:1787508714.698930:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480191360 00000100:00100000:2.0:1787508714.698961:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480191360 00000100:00100000:2.0:1787508714.699012:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29867 00000100:00100000:2.0:1787508714.699021:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:202961:x1874324480191360:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508714.699214:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:202961:x1874324480191360:12345-0@lo:1000:osp_up0-1.0 Request processed in 193us (383us total) trans 12884944175 rc 0/0 00000100:00100000:2.0:1787508714.699226:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29867 00000100:00100000:0.0:1787508714.699413:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea1c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480191360:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1787508715.067544:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508715.706316:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787508715.706775:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787508715.706795:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480191616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787508715.706873:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508715.706966:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480191616 00000100:00100000:0.0:1787508715.706973:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480191616 00000100:00100000:0.0:1787508715.707028:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29868 00000100:00100000:0.0:1787508715.707037:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3617:x1874324480191616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787508715.707073:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 5316608 pending 0 free 1440710656 avail 1294471168 00000100:00100000:0.0:1787508715.707114:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3617:x1874324480191616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508715.707121:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29868 00000100:00100000:0.0:1787508715.707160:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480191616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787508715.712559:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480191488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787508715.712641:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508715.712929:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480191488 00000100:00100000:2.0:1787508715.712969:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480191488 00000100:00100000:2.0:1787508715.713025:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29869 00000100:00100000:2.0:1787508715.713035:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480191488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787508715.713083:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6410240 pending 0 free 1442775040 avail 1296535552 00000100:00100000:2.0:1787508715.713139:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480191488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508715.713146:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29869 00000100:00100000:0.0:1787508715.713328:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480191488:0@lo:41:osp-pre-1-0.0 00000001:00080000:2.0:1787508715.715152:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944175 is committed 00000001:00080000:2.0:1787508715.715166:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944174 is committed 00010000:00010000:3.0:1787508716.090743:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508716.218435:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787508716.219752:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480191872:0@lo:400:kworker.0 00000100:00100000:3.0:1787508716.219820:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508716.219884:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787508716.219891:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480192000:0@lo:400:kworker.0 00000100:00100000:3.0:1787508716.219918:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508716.219977:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480192000 00000100:00100000:3.0:1787508716.219985:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480192000 00000100:00100000:3.0:1787508716.220042:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2412 00000100:00100000:3.0:1787508716.220052:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480192000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508716.220100:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480192000:12345-0@lo:400:kworker.0 Request processed in 51us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508716.220107:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2412 00000100:00100000:3.0:1787508716.220151:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480192000:0@lo:400:kworker.0 00000100:00100000:1.0:1787508716.220233:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787508716.220248:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480192128:0@lo:400:kworker.0 00000100:00100000:1.0:1787508716.220277:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508716.220540:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480192128 00000100:00100000:3.0:1787508716.220545:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480192128 00000100:00100000:3.0:1787508716.220582:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2413 00000100:00100000:3.0:1787508716.220589:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480192128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508716.220641:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480192128:12345-0@lo:400:kworker.0 Request processed in 53us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508716.220647:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2413 00000100:00100000:3.0:1787508716.220676:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480192128:0@lo:400:kworker.0 00000100:00100000:2.0:1787508716.221785:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480191744:0@lo:400:kworker.0 00000100:00100000:2.0:1787508716.221856:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508716.222171:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480192512:0@lo:400:kworker.0 00000100:00100000:0.0:1787508716.222215:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508716.222240:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480193024:0@lo:400:kworker.0 00000100:00100000:0.0:1787508716.222264:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508716.222284:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787508716.222289:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480192384:0@lo:400:kworker.0 00000100:00100000:0.0:1787508716.222311:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508716.222330:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480192896:0@lo:400:kworker.0 00000100:00100000:0.0:1787508716.222350:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508716.222383:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480191872 00000100:00100000:0.0:1787508716.222390:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480191872 00000100:00100000:0.0:1787508716.222431:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480192384 00000100:00100000:0.0:1787508716.222434:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480192384 00000100:00100000:0.0:1787508716.222456:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29870 00000100:00100000:0.0:1787508716.222464:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480191872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508716.222510:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480191872:12345-0@lo:400:kworker.0 Request processed in 47us (2690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508716.222517:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29870 00000100:00100000:0.0:1787508716.222534:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29871 00000100:00100000:0.0:1787508716.222540:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480192384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508716.222574:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480192384:12345-0@lo:400:kworker.0 Request processed in 35us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508716.222580:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29871 00000100:00080000:0.0:1787508716.222598:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787508716.222618:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787508716.222630:0:225833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480192512 00000100:00100000:0.0:1787508716.222634:0:225833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480192512 00000100:00100000:0.0:1787508716.222667:0:225833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2414 00000100:00100000:0.0:1787508716.222673:0:225833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480192512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508716.222716:0:225833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480192512:12345-0@lo:400:kworker.0 Request processed in 43us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508716.222722:0:225833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2414 00000100:00100000:0.0:1787508716.222740:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480193024 00000100:00100000:0.0:1787508716.222744:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480193024 00000100:00100000:0.0:1787508716.222770:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480192896 00000100:00100000:0.0:1787508716.222773:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480192896 00000100:00100000:0.0:1787508716.222938:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3045 00000100:00100000:0.0:1787508716.222966:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480193024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508716.222997:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480193024:12345-0@lo:400:kworker.0 Request processed in 34us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508716.223004:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3045 00000100:00100000:0.0:1787508716.223016:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3046 00000100:00100000:0.0:1787508716.223022:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480192896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508716.223047:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480192896:12345-0@lo:400:kworker.0 Request processed in 26us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508716.223052:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3046 00000100:00080000:0.0:1787508716.223154:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787508716.223157:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508716.223160:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787508716.223185:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944175 gen 2 00000004:00080000:0.0:1787508716.223191:0:3619:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944175 committed transno 12884944175 00000100:00100000:0.0:1787508716.223213:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480192384:0@lo:400:kworker.0 00000100:00100000:0.0:1787508716.223226:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480192896:0@lo:400:kworker.0 00000100:00100000:0.0:1787508716.223237:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480192512:0@lo:400:kworker.0 00000100:00100000:0.0:1787508716.223245:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480193024:0@lo:400:kworker.0 00000100:00100000:0.0:1787508716.223271:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874324480192256:0@lo:400:kworker.0 00000100:00100000:0.0:1787508716.223299:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508716.223321:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480192768:0@lo:400:kworker.0 00000100:00100000:0.0:1787508716.223341:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508716.223357:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480193280:0@lo:400:kworker.0 00000100:00100000:0.0:1787508716.223377:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508716.223396:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787508716.223402:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480192640:0@lo:400:kworker.0 00000100:00100000:0.0:1787508716.223423:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508716.223442:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480193152:0@lo:400:kworker.0 00000100:00100000:0.0:1787508716.223462:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508716.223486:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480192256 00000100:00100000:0.0:1787508716.223490:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480192256 00000100:00100000:0.0:1787508716.223513:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480192768 00000100:00100000:0.0:1787508716.223516:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480192768 00000100:00100000:0.0:1787508716.223530:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480193280 00000100:00100000:0.0:1787508716.223532:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480193280 00000100:00100000:0.0:1787508716.223552:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480193152 00000100:00100000:0.0:1787508716.223555:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480193152 00000100:00100000:0.0:1787508716.223568:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3047 00000100:00100000:0.0:1787508716.223573:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874324480192256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508716.223971:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874324480192256:12345-0@lo:400:kworker.0 Request processed in 397us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508716.223980:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3047 00000100:00100000:0.0:1787508716.223995:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3048 00000100:00100000:0.0:1787508716.224002:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480192768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508716.224030:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480192768:12345-0@lo:400:kworker.0 Request processed in 30us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508716.224036:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3048 00000100:00100000:0.0:1787508716.224047:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3049 00000100:00100000:0.0:1787508716.224053:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480193280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508716.224078:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480193280:12345-0@lo:400:kworker.0 Request processed in 26us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508716.224084:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3049 00000100:00100000:0.0:1787508716.224095:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3050 00000100:00100000:0.0:1787508716.224101:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480193152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508716.224125:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480193152:12345-0@lo:400:kworker.0 Request processed in 25us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508716.224130:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3050 00000100:00100000:0.0:1787508716.224153:0:225843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480192640 00000100:00100000:0.0:1787508716.224157:0:225843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480192640 00000100:00100000:0.0:1787508716.224193:0:225843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2415 00000100:00100000:0.0:1787508716.224199:0:225843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480192640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508716.224226:0:225843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480192640:12345-0@lo:400:kworker.0 Request processed in 28us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508716.224232:0:225843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2415 00000100:00080000:0.0:1787508716.224252:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787508716.224256:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787508716.224258:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787508716.224283:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480191872:0@lo:400:kworker.0 00000100:00100000:1.0:1787508716.224483:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480191744 00000100:00100000:1.0:1787508716.224489:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480191744 00000100:00100000:1.0:1787508716.224516:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:1.0:1787508716.224522:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fccc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480191744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508716.224574:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fccc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480191744:12345-0@lo:400:kworker.0 Request processed in 52us (2718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508716.224580:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00100000:3.0:1787508716.224734:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480191744:0@lo:400:kworker.0 00000100:00100000:2.0:1787508716.224930:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874324480192256:0@lo:400:kworker.0 00000100:00100000:2.0:1787508716.225078:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480192768:0@lo:400:kworker.0 00000100:00100000:2.0:1787508716.225091:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480193280:0@lo:400:kworker.0 00000100:00100000:2.0:1787508716.225108:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480192640:0@lo:400:kworker.0 00000100:00100000:2.0:1787508716.225116:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480193152:0@lo:400:kworker.0 00000001:02000400:2.0:1787508716.460656:0:233498:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 100d: DoM: write+truncate vs stat without IO lock (combined file) ========================================================== 14:11:55 (1787508715) 00000100:00100000:2.0:1787508716.635326:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508716.635864:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509610240 00000100:00100000:0.0:1787508716.635875:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509610240 00000100:00100000:0.0:1787508716.637636:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94088 00000100:00100000:0.0:1787508716.637650:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c818f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:341165:x1874324509610240:12345-192.168.201.30@tcp:36:mkdir.0 00000100:00100000:0.0:1787508716.637777:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b25c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480193408:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787508716.637851:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508716.637893:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cdd73cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508716.639118:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480193408 00000100:00100000:1.0:1787508716.639130:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480193408 00000100:00100000:1.0:1787508716.639181:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29872 00000100:00100000:1.0:1787508716.639190:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:202228:x1874324480193408:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787508716.639294:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:202228:x1874324480193408:12345-0@lo:1000:mdt00_002.0 Request processed in 103us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508716.639301:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29872 00000100:00100000:3.0:1787508716.639442:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b25c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480193408:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787508716.639512:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480193536:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787508716.639548:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508716.639579:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d00cbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787508716.639589:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480193536 00000100:00100000:0.0:1787508716.639594:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480193536 00000100:00100000:0.0:1787508716.639630:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29873 00000100:00100000:0.0:1787508716.639636:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:202228:x1874324480193536:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787508716.639739:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:202228:x1874324480193536:12345-0@lo:1000:mdt00_002.0 Request processed in 103us (190us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787508716.639746:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29873 00000100:00100000:1.0:1787508716.639970:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480193536:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787508716.640033:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b400/0xb126349c40f35456 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.640043:0:202228:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b400/0xb126349c40f35456 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.640058:0:202228:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b400/0xb126349c40f35456 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508716.640072:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6352d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480193664:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1787508716.640100:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508716.640120:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1967cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787508716.640344:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480193664 00000100:00100000:0.0:1787508716.640349:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480193664 00000100:00100000:0.0:1787508716.640374:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29874 00000100:00100000:0.0:1787508716.640381:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:202228:x1874324480193664:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1787508716.640392:0:202231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508716.640406:0:202231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3545d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f35456 expref: -99 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.640430:0:202231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35353 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae81c expref: 9 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.640445:0:202231:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f353ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae83f expref: 7 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.640454:0:202231:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3545d lrc: 5/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f35456 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.640478:0:202231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f353ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae83f expref: 7 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.640492:0:202231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f353ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae83f expref: 7 pid: 209004 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508716.640503:0:202231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b25c00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480193792:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508716.640585:0:202231:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35353 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae81c expref: 9 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.640596:0:202231:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35353 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae81c expref: 9 pid: 230618 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508716.640605:0:202231:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b24380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480193920:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508716.640628:0:202231:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cdd73e40 going to sleep for 11 seconds 00000100:00080000:2.0:1787508716.641675:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787508716.644496:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508716.644606:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508716.644720:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509610368 00000100:00100000:1.0:1787508716.644729:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509610368 00000100:00100000:0.0:1787508716.644746:0:202231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b25c00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480193792:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508716.644795:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f353ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae83f expref: 8 pid: 209004 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508716.644827:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509610496 00000100:00100000:1.0:1787508716.644830:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509610496 00010000:00010000:1.0:1787508716.644845:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35353 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae81c expref: 10 pid: 230618 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508716.644868:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27932 00000100:00100000:1.0:1787508716.644876:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2400:x1874324509610368:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508716.644890:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508716.644897:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f353ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae83f expref: 8 pid: 209004 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.644910:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f353ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae83f expref: 8 pid: 209004 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508716.644926:0:202231:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b24380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:202231:1874324480193920:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508716.644932:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f353ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae83f expref: 8 pid: 209004 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.644981:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508716.644988:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3545d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f35456 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.644999:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508716.645046:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2400:x1874324509610368:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 169us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508716.645053:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27932 00000100:00100000:1.0:1787508716.645083:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27933 00000100:00100000:1.0:1787508716.645090:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2403:x1874324509610496:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508716.645098:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508716.645103:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35353 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae81c expref: 10 pid: 230618 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.645105:0:202231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3545d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f35456 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.645113:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35353 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae81c expref: 10 pid: 230618 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787508716.645214:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787508716.649846:0:202231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508716.649854:0:202231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508716.649863:0:202231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3545d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f35456 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.649879:0:202231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5400, rc 0) 00010000:00010000:1.0:1787508716.649899:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35353 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae81c expref: 10 pid: 230618 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.649915:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508716.649919:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3545d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f35456 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.649928:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3545d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f35456 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.649937:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3545d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f35456 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.650203:0:202211:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3545d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f35456 expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508716.650218:0:202211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6353100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:202211:1874324480194048:0@lo:105: 00000100:00100000:1.0:1787508716.650259:0:202211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508716.650308:0:202211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d19676c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787508716.650378:0:202209:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787508716.650392:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480194048 00000100:00100000:2.0:1787508716.650399:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480194048 00000100:00100000:2.0:1787508716.650452:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18199 00000100:00100000:2.0:1787508716.650463:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1713050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:202211:x1874324480194048:12345-0@lo:105: 00010000:00010000:2.0:1787508716.650475:0:202209:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b400/0xb126349c40f35456 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3545d expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.650484:0:202209:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b400/0xb126349c40f35456 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3545d expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.650495:0:202209:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b400/0xb126349c40f35456 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3545d expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.650502:0:202209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b400/0xb126349c40f35456 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f3545d expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.650509:0:202209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b400/0xb126349c40f35456 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f3545d expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.650518:0:202209:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b400/0xb126349c40f35456 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f3545d expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.650531:0:202209:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d247b400) 00000100:00100000:2.0:1787508716.650584:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1713050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:202211:x1874324480194048:12345-0@lo:105: Request processed in 123us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508716.650591:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18199 00000100:00100000:3.0:1787508716.650760:0:202211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6353100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:202211:1874324480194048:0@lo:105: 00010000:00010000:3.0:1787508716.650779:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508716.650831:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:2403:x1874324509610496:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 5740us (6225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508716.650840:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27933 00000100:00100000:0.0:1787508716.651709:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:202228:x1874324480193664:12345-0@lo:101:mdt00_002.0 Request processed in 11325us (11604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508716.651718:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29874 00000100:00100000:1.0:1787508716.651754:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6352d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480193664:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1787508716.651774:0:202228:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b400/0xb126349c40f35456 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3545d expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787508716.651798:0:202228:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787508716.651844:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a200/0xb126349c40f35464 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x11daadca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.651852:0:202228:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a200/0xb126349c40f35464 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.651860:0:202228:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a200/0xb126349c40f35464 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508716.651876:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6352d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480194176:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1787508716.651917:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508716.652161:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1967cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787508716.652273:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480194176 00000100:00100000:0.0:1787508716.652280:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480194176 00000100:00100000:0.0:1787508716.652334:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29875 00000100:00100000:0.0:1787508716.652342:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:202228:x1874324480194176:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1787508716.652358:0:225829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508716.652444:0:225829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f3546b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x11daadca bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f35464 expref: -99 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.652470:0:225829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f3546b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f35464 expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.652483:0:225829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f3546b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f35464 expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.652491:0:225829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x11daadca (ffff9090ca4e2000) 00010000:00010000:0.0:1787508716.652494:0:225829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508716.652497:0:225829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4a00, rc 0) 00000100:00100000:0.0:1787508716.652546:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202228:x1874324480194176:12345-0@lo:101:mdt00_002.0 Request processed in 204us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508716.652552:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29875 00000100:00100000:1.0:1787508716.653196:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6352d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480194176:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1787508716.653214:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a200/0xb126349c40f35464 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3546b expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.653224:0:202228:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a200/0xb126349c40f35464 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3546b expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787508716.653242:0:202228:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1787508716.653285:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6352d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480194304:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787508716.653320:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508716.653345:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1967f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787508716.653931:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480194304 00000100:00100000:0.0:1787508716.653952:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480194304 00000100:00100000:0.0:1787508716.654093:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29876 00000100:00100000:0.0:1787508716.654106:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202228:x1874324480194304:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787508716.654203:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202228:x1874324480194304:12345-0@lo:1000:mdt00_002.0 Request processed in 100us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508716.654244:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6352d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480194304:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787508716.654295:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480194432:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787508716.654326:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508716.654345:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d00cbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787508716.654358:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480194432 00000100:00100000:3.0:1787508716.654362:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480194432 00000100:00100000:0.0:1787508716.654479:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29876 00000100:00100000:0.0:1787508716.654500:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29877 00000100:00100000:0.0:1787508716.654506:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202228:x1874324480194432:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787508716.654597:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202228:x1874324480194432:12345-0@lo:1000:mdt00_002.0 Request processed in 91us (270us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787508716.654605:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29877 00000100:00100000:1.0:1787508716.655246:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480194432:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787508716.655335:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6351500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480194560:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787508716.655371:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508716.655390:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1967600 going to sleep for 11 seconds 00000100:00100000:2.0:1787508716.655450:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480194560 00000100:00100000:2.0:1787508716.655455:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480194560 00000100:00100000:2.0:1787508716.655491:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29878 00000100:00100000:2.0:1787508716.655498:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:202228:x1874324480194560:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787508716.655588:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:202228:x1874324480194560:12345-0@lo:1000:mdt00_002.0 Request processed in 90us (216us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787508716.655701:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6351500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480194560:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787508716.655748:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6351500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480194688:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787508716.655772:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508716.655787:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1967600 going to sleep for 11 seconds 00000100:00100000:2.0:1787508716.655824:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29878 00000100:00100000:2.0:1787508716.655839:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480194688 00000100:00100000:2.0:1787508716.655843:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480194688 00000100:00100000:2.0:1787508716.655857:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29879 00000100:00100000:2.0:1787508716.655863:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:202228:x1874324480194688:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787508716.658825:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:202228:x1874324480194688:12345-0@lo:1000:mdt00_002.0 Request processed in 2950us (3040us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508716.658840:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29879 00000100:00100000:0.0:1787508716.658927:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6351500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480194688:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787508716.659115:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b24380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480194816:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787508716.659165:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508716.659205:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480194816 00000100:00100000:1.0:1787508716.659213:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480194816 00000100:00100000:0.0:1787508716.659260:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cdd739c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508716.659298:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29880 00000100:00100000:1.0:1787508716.659308:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202228:x1874324480194816:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787508716.659403:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202228:x1874324480194816:12345-0@lo:1000:mdt00_002.0 Request processed in 96us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508716.659409:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29880 00000100:00100000:0.0:1787508716.659483:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b24380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480194816:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787508716.659523:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b24380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480194944:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787508716.659545:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508716.659564:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cdd739c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787508716.659582:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480194944 00000100:00100000:2.0:1787508716.659586:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480194944 00000100:00100000:2.0:1787508716.659742:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29881 00000100:00100000:2.0:1787508716.659750:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:202228:x1874324480194944:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787508716.659810:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:202228:x1874324480194944:12345-0@lo:1000:mdt00_002.0 Request processed in 61us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508716.659817:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29881 00000100:00100000:0.0:1787508716.660144:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b24380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:202228:1874324480194944:0@lo:1000:mdt00_002.0 00000040:00080000:0.0:1787508716.661782:0:202228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xf:0x0].55, 984 off90096 00000040:00080000:0.0:1787508716.663932:0:202228:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x5:0x0].599, 1136 off759832 00000004:00080000:0.0:1787508716.663978:0:202228:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090cdd73e40 with version 13625 00000004:00080000:3.0:1787508716.664314:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13625 rpc_version 13625 00000020:00100000:3.0:1787508716.664352:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787508716.664363:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090c788f480 x1874324480195200/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2416/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787508716.664396:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788f480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480195200:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508716.664465:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508716.664505:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d00cbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787508716.664585:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480195200 00000100:00100000:2.0:1787508716.664604:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480195200 00000100:00100000:2.0:1787508716.664650:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29882 00000100:00100000:2.0:1787508716.664664:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202961:x1874324480195200:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508716.665111:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:202961:x1874324480195200:12345-0@lo:1000:osp_up0-1.0 Request processed in 447us (644us total) trans 12884944176 rc 0/0 00000100:00100000:2.0:1787508716.665122:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29882 00000100:00100000:3.0:1787508716.665472:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788f480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480195200:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1787508716.665605:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f35472 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.665622:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f35472 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.665633:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f35472 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508716.665652:0:202228:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c8ae0d7 reply state 0000000064a76a85 transno 8589962047 ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f35472 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.665664:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f35472 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.665671:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d8:0x0].0x0 (ffff9090ca4e2f00) 00010000:00010000:0.0:1787508716.665674:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787508716.665677:0:202228:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787508716.665691:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d8:0x0]: returning size 4096 00000004:00080000:0.0:1787508716.665701:0:202228:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787508716.665710:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b400/0xb126349c40f35456 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3545d expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.665719:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b400/0xb126349c40f35456 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f3545d expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.665727:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b400/0xb126349c40f35456 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f3545d expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.665754:0:202228:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787508716.665759:0:202228:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787508716.665764:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a200/0xb126349c40f35464 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3546b expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.665771:0:202228:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a200/0xb126349c40f35464 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3546b expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508716.665856:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c818f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:341165:x1874324509610240:12345-192.168.201.30@tcp:36:mkdir.0 Request processed in 28207us (30538us total) trans 8589962047 rc 0/0 00000100:00100000:0.0:1787508716.665864:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94088 00010000:00010000:2.0:1787508716.665924:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787508716.665931:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b400/0xb126349c40f35456 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xb126349c40f3545d expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.665974:0:204785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b400 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:2.0:1787508716.665981:0:204785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b400/0xb126349c40f35456 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xb126349c40f3545d expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508716.665989:0:204785:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b400/0xb126349c40f35456 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xb126349c40f3545d expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.666018:0:204785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b400/0xb126349c40f35456 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f3545d expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.666025:0:204785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787508716.666048:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b400/0xb126349c40f35456 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f3545d expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.666056:0:204785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b400/0xb126349c40f35456 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f3545d expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.666192:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508716.666195:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508716.666197:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508716.666205:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787508716.666218:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480195328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787508716.666258:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508716.666298:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480195328 00000100:00100000:2.0:1787508716.666304:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480195328 00000100:00100000:2.0:1787508716.666341:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9810 00000100:00100000:2.0:1787508716.666349:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9f1b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+9:3619:x1874324480195328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508716.666360:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508716.666377:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3545d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f35456 expref: 9 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.666390:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508716.666394:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508716.666422:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9f1b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3619:x1874324480195328:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508716.666428:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9810 00000100:00100000:2.0:1787508716.666483:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480195328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787508716.691794:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508716.692503:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509610624 00000100:00100000:0.0:1787508716.692515:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509610624 00000100:00100000:0.0:1787508716.692594:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94089 00000100:00100000:0.0:1787508716.692605:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:341170:x1874324509610624:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508716.703797:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508716.703836:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f35479 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae869 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.703913:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f35480 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.703929:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f35480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.703959:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f35480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508716.705254:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508716.705259:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508716.705284:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f35480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.705318:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f35479 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae869 expref: 11 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.705339:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f35480 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae869 expref: 10 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.705348:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508716.705351:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508716.705355:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b600, rc 0) 00000100:00100000:1.0:1787508716.705447:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:341170:x1874324509610624:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 12842us (13661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508716.705457:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94089 00000100:00100000:3.0:1787508716.708318:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508716.708859:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509610752 00000100:00100000:0.0:1787508716.708871:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509610752 00000100:00100000:0.0:1787508716.709039:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94090 00000100:00100000:0.0:1787508716.709052:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:341170:x1874324509610752:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508716.709071:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508716.709167:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f35487 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae870 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.709287:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f3548e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.709302:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f3548e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.709313:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f3548e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.709323:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35495 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x11daadca bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.709333:0:202227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f3546b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f35464 expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.709341:0:202227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35495 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.709379:0:202227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f3546b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f35464 expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508716.709394:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b24380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:202227:1874324480195456:0@lo:104: 00000100:00100000:0.0:1787508716.709518:0:202227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508716.709629:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cdd73c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787508716.709746:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480195456 00000100:00100000:3.0:1787508716.709752:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480195456 00000100:00100000:3.0:1787508716.709888:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18200 00000100:00100000:3.0:1787508716.709899:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:202227:x1874324480195456:12345-0@lo:104: 00010000:00010000:3.0:1787508716.709912:0:229363:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a200/0xb126349c40f35464 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f3546b expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.710222:0:229363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787508716.710230:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:202227:x1874324480195456:12345-0@lo:104: Request processed in 334us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508716.710237:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18200 00000100:00100000:0.0:1787508716.710344:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b24380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:202227:1874324480195456:0@lo:104: 00010000:00010000:1.0:1787508716.710364:0:202215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508716.710364:0:202227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35495 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.710375:0:202215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a200/0xb126349c40f35464 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f3546b expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.710386:0:202215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a200 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:1.0:1787508716.710393:0:202215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a200/0xb126349c40f35464 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f3546b expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508716.710402:0:202215:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a200/0xb126349c40f35464 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f3546b expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.710510:0:202215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a200/0xb126349c40f35464 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3546b expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.710519:0:202215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787508716.710553:0:202215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a200/0xb126349c40f35464 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3546b expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.710562:0:202215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a200/0xb126349c40f35464 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3546b expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.710580:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508716.710582:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508716.710584:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508716.710700:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787508716.710716:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6350e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480195584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508716.710753:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508716.711187:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480195584 00000100:00100000:3.0:1787508716.711194:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480195584 00010000:00010000:3.0:1787508716.711273:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f3546b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f35464 expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508716.711353:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27934 00000100:00100000:3.0:1787508716.711363:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:3618:x1874324480195584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787508716.711375:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:2.0:1787508716.715793:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944176 is committed 00010000:00010000:3.0:1787508716.715937:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f3546b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f35464 expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.715987:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x11daadca (ffff9090ca4e2000) 00010000:00010000:3.0:1787508716.715993:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35495 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.716003:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35495 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.716011:0:202212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35495 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.716045:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508716.716137:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480195584:12345-0@lo:103:ldlm_bl.0 Request processed in 4775us (5382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508716.716147:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27934 00000100:00100000:1.0:1787508716.716764:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6350e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480195584:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508716.717777:0:202227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35495 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.717790:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35495 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508716.717985:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:202227:1874324480195712:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787508716.718049:0:202227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508716.718082:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cdd733c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508716.718122:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480195712 00000100:00100000:3.0:1787508716.718130:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480195712 00000100:00100000:3.0:1787508716.718176:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29883 00000100:00100000:3.0:1787508716.718185:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:202227:x1874324480195712:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787508716.718277:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:202227:x1874324480195712:12345-0@lo:1000:mdt00_001.0 Request processed in 92us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508716.718284:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29883 00000100:00100000:0.0:1787508716.718761:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:202227:1874324480195712:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787508716.718817:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3549c lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.718831:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3549c lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.718841:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3549c lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508716.718877:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3549c lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.718891:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f3548e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.718897:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f3548e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.718904:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f3548e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.718910:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f3548e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.718916:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508716.718921:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f3548e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.718929:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f3548e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.718962:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508716.718966:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508716.718970:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f3548e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.718977:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f3548e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.718992:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35495 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.718998:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35495 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.719004:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35495 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.719010:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508716.719013:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35495 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.719019:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35495 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.719027:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x11daadca (ffff9090ca4e2000) 00010000:00010000:0.0:1787508716.719030:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508716.719033:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35495 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.719039:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35495 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.719072:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f35487 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae870 expref: 12 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.719082:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3549c lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae870 expref: 11 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.719088:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d8:0x0].0x0 (ffff9090d1b2bf00) 00010000:00010000:0.0:1787508716.719090:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508716.719092:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5e00, rc 0) 00000100:00100000:0.0:1787508716.719148:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:341170:x1874324509610752:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 10100us (11212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508716.719157:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94090 00000100:00100000:3.0:1787508716.721233:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508716.722255:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509610880 00000100:00100000:0.0:1787508716.722266:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509610880 00000100:00100000:0.0:1787508716.725868:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94091 00000100:00100000:0.0:1787508716.725893:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:341170:x1874324509610880:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508716.725922:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508716.725973:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4c00/0xb126349c40f354a3 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae877 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.726044:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5a00/0xb126349c40f354aa lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.726060:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5a00/0xb126349c40f354aa lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.726072:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5a00/0xb126349c40f354aa lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508716.726126:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d8:0x0]: returning size 4096 00000004:00200000:0.0:1787508716.726130:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1787508716.726169:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4c00/0xb126349c40f354a3 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae877 expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.726188:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5a00/0xb126349c40f354aa lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae877 expref: 11 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.726197:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d8:0x0].0x0 (ffff9090ca4e2f00) 00010000:00010000:0.0:1787508716.726199:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1787508716.726203:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5a00, rc 0) 00000100:00100000:0.0:1787508716.726272:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:341170:x1874324509610880:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 393us (5046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508716.726278:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94091 00000100:00100000:2.0:1787508716.729719:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508716.731103:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509611008 00000100:00100000:1.0:1787508716.731117:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509611008 00000100:00100000:1.0:1787508716.731198:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94092 00000100:00100000:1.0:1787508716.731209:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:341170:x1874324509611008:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508716.731228:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508716.731249:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f354b1 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae87e expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.731316:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f354b8 lrc: 3/1,0 mode: --/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.731330:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f354b8 lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.731341:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f354b8 lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.731355:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f354bf lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.731362:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f354bf lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.731368:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f354bf lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.731415:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f354b8 lrc: 4/1,0 mode: CR/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.731422:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f354b8 lrc: 4/1,0 mode: CR/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.731428:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f354b8 lrc: 3/0,0 mode: CR/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.731435:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f354b8 lrc: 4/0,0 mode: CR/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.731441:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508716.731445:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f354b8 lrc: 4/0,0 mode: CR/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.731453:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f354b8 lrc: 5/0,0 mode: CR/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.731465:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d8:0x0].0x0 (ffff9090ca4e2f00) 00010000:00010000:1.0:1787508716.731468:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508716.731473:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f354b8 lrc: 3/0,0 mode: --/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.731479:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f354b8 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.731495:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f354bf lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.731513:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f354bf lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.731519:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f354bf lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.731524:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508716.731526:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f354bf lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.731821:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f354bf lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.731839:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d8:0x0].0xfe058dd8 (ffff9090d02ad800) 00010000:00010000:1.0:1787508716.731842:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508716.731845:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f354bf lrc: 2/0,0 mode: --/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.732992:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f354bf lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.733065:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f354b1 lrc: 1/0,0 mode: --/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae87e expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.733078:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d8:0x0].0x0 (ffff9090ca4e2f00) 00010000:00010000:1.0:1787508716.733081:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508716.733086:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f354b1 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae87e expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.733096:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a200, rc 0) 00000100:00100000:3.0:1787508716.733235:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:341170:x1874324509611008:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 2025us (3524us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508716.733245:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94092 00000100:00100000:3.0:1787508716.736848:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508716.736983:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509611264 00000100:00100000:1.0:1787508716.736993:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509611264 00000100:00100000:1.0:1787508716.737046:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94093 00000100:00100000:1.0:1787508716.737056:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:341170:x1874324509611264:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508716.737077:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508716.737098:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f354c6 lrc: 2/0,0 mode: --/CW res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae885 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.737209:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b000/0xb126349c40f354cd lrc: 3/0,1 mode: --/CW res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.737232:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b000/0xb126349c40f354cd lrc: 3/0,1 mode: CW/CW res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.737243:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b000/0xb126349c40f354cd lrc: 3/0,1 mode: CW/CW res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.737258:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b400/0xb126349c40f354d4 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.737265:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b400/0xb126349c40f354d4 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.737270:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b400/0xb126349c40f354d4 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508716.737409:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6350e00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480195840:0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1787508716.737485:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508716.737727:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1967780 going to sleep for 11 seconds 00000100:00100000:0.0:1787508716.740863:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480195840 00000100:00100000:0.0:1787508716.740878:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480195840 00000100:00100000:1.0:1787508716.741228:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29884 00000100:00100000:1.0:1787508716.741240:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:230618:x1874324480195840:12345-0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1787508716.741379:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:230618:x1874324480195840:12345-0@lo:1000:mdt00_006.0 Request processed in 141us (3893us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508716.741386:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29884 00000100:00100000:2.0:1787508716.744673:0:230618:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944176 gen 2 00000004:00080000:2.0:1787508716.744698:0:230618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944176 committed transno 12884944176 00000100:00100000:2.0:1787508716.744729:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6350e00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480195840:0@lo:1000:mdt00_006.0 00010000:00010000:2.0:1787508716.745374:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f354db lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.745394:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f354db lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.745406:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f354db lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508716.745733:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d9:0x0]: returning size 0 00010000:00010000:2.0:1787508716.746212:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b000/0xb126349c40f354cd lrc: 4/0,1 mode: CW/CW res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.746222:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b000/0xb126349c40f354cd lrc: 4/0,1 mode: CW/CW res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.746229:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b000/0xb126349c40f354cd lrc: 3/0,0 mode: CW/CW res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.746236:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b000/0xb126349c40f354cd lrc: 4/0,0 mode: CW/CW res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.746241:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508716.746246:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b000/0xb126349c40f354cd lrc: 4/0,0 mode: CW/CW res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.746253:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b000/0xb126349c40f354cd lrc: 5/0,0 mode: CW/CW res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.746267:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d8:0x0].0x0 (ffff9090ca4e2f00) 00010000:00010000:2.0:1787508716.746271:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508716.746276:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b000/0xb126349c40f354cd lrc: 3/0,0 mode: --/CW res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.746283:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b000/0xb126349c40f354cd lrc: 0/0,0 mode: --/CW res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508716.746301:0:230618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000341eda3d reply state 000000005bb0d5bb transno 8589962048 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b400/0xb126349c40f354d4 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.746318:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b400/0xb126349c40f354d4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.746325:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d8:0x0].0xfe058dd8 (ffff9090d02ad700) 00010000:00010000:2.0:1787508716.746328:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787508716.746331:0:230618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787508716.746373:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f354c6 lrc: 0/0,0 mode: --/CW res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae885 expref: 14 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.746389:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f354db lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae885 expref: 13 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.746396:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d9:0x0].0x0 (ffff9091c816f100) 00010000:00010000:2.0:1787508716.746398:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787508716.746401:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab000, rc 0) 00000100:00100000:2.0:1787508716.746963:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:341170:x1874324509611264:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 9885us (10103us total) trans 8589962048 rc 0/0 00000100:00100000:2.0:1787508716.746973:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94093 00000100:00100000:1.0:1787508716.758099:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508716.758275:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509611520 00000100:00100000:0.0:1787508716.758288:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509611520 00000100:00100000:0.0:1787508716.758365:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94094 00000100:00100000:0.0:1787508716.758378:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:341170:x1874324509611520:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508716.758418:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508716.758445:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4c00/0xb126349c40f354e9 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae88c expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.758599:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f354f0 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.758617:0:202227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f354db lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae885 expref: 15 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.758626:0:202227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f354f0 lrc: 4/0,1 mode: --/EX res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.758667:0:202227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f354db lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae885 expref: 15 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.758714:0:202227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f354db lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae885 expref: 15 pid: 230618 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508716.758730:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:202227:1874324480195968:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508716.758832:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cdd730c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787508716.761566:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:202227:1874324480195968:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508716.761661:0:202227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f354f0 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508716.762071:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508716.762310:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509611648 00000100:00100000:2.0:1787508716.762319:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509611648 00010000:00010000:2.0:1787508716.762359:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f354db lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae885 expref: 16 pid: 230618 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508716.762405:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27935 00000100:00100000:2.0:1787508716.762415:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6351500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:2401:x1874324509611648:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508716.762437:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508716.762447:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f354db lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae885 expref: 16 pid: 230618 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.762462:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f354db lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae885 expref: 16 pid: 230618 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.762487:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f354db lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae885 expref: 16 pid: 230618 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.762506:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d9:0x0].0x0 (ffff9091c816f100) 00010000:00010000:2.0:1787508716.762511:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f354f0 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.762522:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f354f0 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.762529:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f354f0 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.762560:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508716.762636:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6351500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:2401:x1874324509611648:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 221us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508716.762644:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27935 00010000:00010000:0.0:1787508716.762805:0:202227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f354f0 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.762814:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f354f0 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508716.762836:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d9:0x0]: returning size 0 00010000:00010000:0.0:1787508716.763113:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f354f0 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.763122:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f354f0 lrc: 2/0,0 mode: EX/EX res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.763128:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f354f0 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.763134:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508716.763138:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f354f0 lrc: 3/0,0 mode: EX/EX res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.763146:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f354f0 lrc: 4/0,0 mode: EX/EX res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.763158:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d9:0x0].0x0 (ffff9091c816f100) 00010000:00010000:0.0:1787508716.763161:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787508716.763165:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f354f0 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.763172:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f354f0 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.763232:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4c00/0xb126349c40f354e9 lrc: 1/0,0 mode: --/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae88c expref: 15 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.763242:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d8:0x0].0x0 (ffff9090ca4e2f00) 00010000:00010000:0.0:1787508716.763244:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508716.763249:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4c00/0xb126349c40f354e9 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae88c expref: 15 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.763257:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4c00, rc 0) 00000100:00100000:0.0:1787508716.763289:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:341170:x1874324509611520:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 4914us (5201us total) trans 8589962049 rc 301/301 00000100:00100000:0.0:1787508716.763295:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94094 00000100:00100000:3.0:1787508716.773509:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508716.773601:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509611904 00000100:00100000:2.0:1787508716.773611:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509611904 00000100:00100000:2.0:1787508716.773675:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15451 00000100:00100000:2.0:1787508716.773694:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:341170:x1874324509611904:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1787508716.774015:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:341170:x1874324509611904:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 321us (525us total) trans 8589962050 rc 0/0 00000100:00100000:2.0:1787508716.774027:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15451 00000100:00100000:1.0:1787508716.776793:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508716.776985:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509612160 00000100:00100000:0.0:1787508716.776995:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509612160 00000100:00100000:0.0:1787508716.777062:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15452 00000100:00100000:0.0:1787508716.777073:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:341170:x1874324509612160:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1787508716.777349:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:341170:x1874324509612160:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 276us (574us total) trans 8589962051 rc 0/0 00000100:00100000:0.0:1787508716.777357:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15452 00000100:00100000:1.0:1787508716.794196:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508716.794299:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509612288 00000100:00100000:0.0:1787508716.794311:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509612288 00000100:00100000:0.0:1787508716.794375:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94095 00000100:00100000:0.0:1787508716.794386:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:341175:x1874324509612288:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1787508716.794408:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508716.794438:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f354fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae893 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.794694:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f35505 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.794710:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f35505 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.794726:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f35505 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508716.794840:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787508716.794845:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508716.794869:0:203348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f35505 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.794894:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f354fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae893 expref: 9 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.794911:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f35505 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae893 expref: 8 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.794919:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508716.794922:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508716.794926:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5400, rc 0) 00000100:00100000:1.0:1787508716.795391:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:341175:x1874324509612288:12345-192.168.201.30@tcp:101:dd.0 Request processed in 1005us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508716.795401:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94095 00000100:00100000:2.0:1787508716.799195:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508716.799306:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509612416 00000100:00100000:3.0:1787508716.799316:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509612416 00000100:00100000:3.0:1787508716.799405:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94096 00000100:00100000:3.0:1787508716.799416:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:341175:x1874324509612416:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:3.0:1787508716.799444:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508716.799465:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3550c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae89a expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.799542:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35513 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.799558:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35513 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.799570:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35513 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.799585:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3551a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x11daadca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.799602:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3551a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.799609:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3551a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.799690:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35521 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.799699:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35521 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.799706:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35521 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508716.799727:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35521 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.799743:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35513 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.799750:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35513 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.799756:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35513 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.799762:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35513 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.799768:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508716.799772:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35513 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.799851:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35513 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.799866:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508716.799869:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508716.799873:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35513 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.799879:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35513 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.799891:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3551a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.799897:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3551a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.799903:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3551a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.799908:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ee00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508716.799911:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3551a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.799917:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3551a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.799923:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x11daadca (ffff9090cc088700) 00010000:00010000:3.0:1787508716.799926:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508716.799929:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3551a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.799934:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3551a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x11daadca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.800116:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3550c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae89a expref: 10 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.800136:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35521 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae89a expref: 9 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.800144:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d8:0x0].0x0 (ffff9090d1b2bf00) 00010000:00010000:3.0:1787508716.800146:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508716.800148:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ea00, rc 0) 00000100:00100000:3.0:1787508716.800274:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:341175:x1874324509612416:12345-192.168.201.30@tcp:101:dd.0 Request processed in 858us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508716.800283:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94096 00000100:00100000:3.0:1787508716.803718:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508716.803813:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509612544 00000100:00100000:2.0:1787508716.803824:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509612544 00000100:00100000:2.0:1787508716.803909:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94097 00000100:00100000:2.0:1787508716.803920:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:341175:x1874324509612544:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:2.0:1787508716.803981:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508716.804005:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab800/0xb126349c40f35528 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae8a1 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.804064:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f3552f lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.804079:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f3552f lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.804090:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f3552f lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508716.804132:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d8:0x0]: returning size 4096 00000004:00200000:2.0:1787508716.804135:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1787508716.804171:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab800/0xb126349c40f35528 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a1 expref: 7 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.804189:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f3552f lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a1 expref: 6 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.804198:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d8:0x0].0x0 (ffff9090ca4e2f00) 00010000:00010000:2.0:1787508716.804202:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1787508716.804206:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abe00, rc 0) 00000100:00100000:2.0:1787508716.804269:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:341175:x1874324509612544:12345-192.168.201.30@tcp:101:dd.0 Request processed in 350us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508716.804276:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94097 00000100:00080000:3.0:1787508716.805178:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787508716.807658:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508716.807784:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509612800 00000100:00100000:0.0:1787508716.807794:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509612800 00000100:00100000:0.0:1787508716.807869:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94098 00000100:00100000:0.0:1787508716.807880:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:341175:x1874324509612800:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1787508716.807900:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508716.807920:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4600/0xb126349c40f35536 lrc: 2/0,0 mode: --/CW res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae8a8 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.808107:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f3553d lrc: 3/1,0 mode: --/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.808126:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f3553d lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.808137:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f3553d lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.808148:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f35544 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.808154:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f35544 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.808161:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f35544 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.808219:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.808228:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.808235:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508716.808336:0:202227:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1787508716.808339:0:202227:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb mtime from disk: 0 -> 1787508717 00000004:00010000:0.0:1787508716.808342:0:202227:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb atime from disk: 0 -> 1787508717 00000004:00010000:0.0:1787508716.808344:0:202227:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb ctime from disk: 0 -> 1787508717 00000004:00010000:0.0:1787508716.808346:0:202227:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:0.0:1787508716.808350:0:202227:0:(mdt_io.c:1552:mdt_lvb2reply()) size 0 00010000:00010000:0.0:1787508716.808357:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f3553d lrc: 4/1,0 mode: CR/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.808363:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f3553d lrc: 4/1,0 mode: CR/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.808369:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f3553d lrc: 3/0,0 mode: CR/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.808375:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f3553d lrc: 4/0,0 mode: CR/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.808380:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508716.808384:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f3553d lrc: 4/0,0 mode: CR/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.808391:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f3553d lrc: 5/0,0 mode: CR/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.808404:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d8:0x0].0x0 (ffff9090ca4e2f00) 00010000:00010000:0.0:1787508716.808406:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508716.808410:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f3553d lrc: 3/0,0 mode: --/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.808416:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f3553d lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.808563:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f35544 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.808570:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f35544 lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.808575:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f35544 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.808581:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508716.808584:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f35544 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.808661:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f35544 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.808671:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d8:0x0].0xfe058dd8 (ffff9090d02ad700) 00010000:00010000:0.0:1787508716.808674:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508716.808686:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f35544 lrc: 2/0,0 mode: --/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.808692:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f35544 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.808733:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4600/0xb126349c40f35536 lrc: 0/0,0 mode: --/CW res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 9 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.808747:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 8 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.808755:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d9:0x0].0x0 (ffff9090d1b2bb00) 00010000:00010000:0.0:1787508716.808757:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:0.0:1787508716.808760:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5800, rc 0) 00000100:00100000:0.0:1787508716.808825:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:341175:x1874324509612800:12345-192.168.201.30@tcp:101:dd.0 Request processed in 947us (1175us total) trans 8589962052 rc 0/0 00000100:00100000:0.0:1787508716.808833:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94098 00000100:00100000:0.0:1787508716.812420:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508716.812507:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509613056 00000100:00100000:1.0:1787508716.812519:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509613056 00000100:00100000:1.0:1787508716.812580:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94099 00000100:00100000:1.0:1787508716.812599:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:341175:x1874324509613056:12345-192.168.201.30@tcp:36:dd.0 00010000:00010000:1.0:1787508716.812743:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ba00/0xb126349c40f35559 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.812759:0:203348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 8 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.812768:0:203348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ba00/0xb126349c40f35559 lrc: 4/0,1 mode: --/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.812801:0:203348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 8 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.812816:0:203348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 4/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 8 pid: 202227 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508716.812830:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6352300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:203348:1874324480196096:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508716.812910:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1967d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787508716.815343:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6352300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:203348:1874324480196096:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508716.815373:0:203348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ba00/0xb126349c40f35559 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508716.816367:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508716.816450:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509613184 00000100:00100000:2.0:1787508716.816459:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509613184 00010000:00010000:2.0:1787508716.816499:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 4/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 9 pid: 202227 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508716.816544:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27936 00000100:00100000:2.0:1787508716.816555:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2400:x1874324509613184:12345-192.168.201.30@tcp:102:ldlm_bl.0 00010000:00010000:2.0:1787508716.816572:0:229383:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 4/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 9 pid: 202227 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.816584:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 9 pid: 202227 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.816601:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 9 pid: 202227 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.816610:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d9:0x0].0x0 (ffff9090d1b2bb00) 00010000:00010000:2.0:1787508716.816612:0:229383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:2.0:1787508716.816616:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ba00/0xb126349c40f35559 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.816626:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ba00/0xb126349c40f35559 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.816636:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ba00/0xb126349c40f35559 lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.816671:0:229383:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 9 pid: 202227 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508716.816744:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2400:x1874324509613184:12345-192.168.201.30@tcp:102:ldlm_bl.0 Request processed in 191us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508716.816752:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27936 00010000:00010000:1.0:1787508716.816925:0:203348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ba00/0xb126349c40f35559 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.816933:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ba00/0xb126349c40f35559 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508716.817096:0:203348:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:1.0:1787508716.817099:0:203348:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb mtime from disk: 1787508717 -> 1787508717 00000004:00010000:1.0:1787508716.817102:0:203348:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb atime from disk: 1787508717 -> 1787508717 00000004:00010000:1.0:1787508716.817104:0:203348:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb ctime from disk: 1787508717 -> 1787508717 00000004:00010000:1.0:1787508716.817107:0:203348:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:1.0:1787508716.817113:0:203348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009cdfe323 reply state 00000000cd2a0ff4 transno 8589962053 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ba00/0xb126349c40f35559 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.817125:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ba00/0xb126349c40f35559 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.817132:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d9:0x0].0x0 (ffff9090d1b2bb00) 00010000:00010000:1.0:1787508716.817135:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787508716.817137:0:203348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787508716.817214:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:341175:x1874324509613056:12345-192.168.201.30@tcp:36:dd.0 Request processed in 4624us (4805us total) trans 8589962053 rc 0/0 00000100:00100000:1.0:1787508716.817222:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94099 00000100:00100000:0.0:1787508716.823441:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508716.823715:0:202240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509613312 00000100:00100000:1.0:1787508716.823725:0:202240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509613312 00002000:00010000:1.0:1787508716.823770:0:202240:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0001: refresh DOM lock for [0x240000bd0:0x13d9:0x0] 00002000:00100000:1.0:1787508716.823775:0:202240:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9090d0b4d180 with x1874324509613312 00000100:00100000:1.0:1787508716.823812:0:202240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7752 00000100:00100000:1.0:1787508716.823822:0:202240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2401:x1874324509613312:12345-192.168.201.30@tcp:10:dd.0 00000004:00010000:1.0:1787508716.824033:0:202240:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:1.0:1787508716.824036:0:202240:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb mtime from disk: 1787508717 -> 1787508717 00000004:00010000:1.0:1787508716.824039:0:202240:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb atime from disk: 1787508717 -> 1787508717 00000004:00010000:1.0:1787508716.824042:0:202240:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb ctime from disk: 1787508717 -> 1787508717 00000004:00010000:1.0:1787508716.824044:0:202240:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787508716.824110:0:202240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2401:x1874324509613312:12345-192.168.201.30@tcp:10:dd.0 Request processed in 289us (695us total) trans 8589962054 rc 0/0 00000100:00100000:1.0:1787508716.824117:0:202240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7752 00002000:00010000:1.0:1787508716.824120:0:202240:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0001: refresh DOM lock for [0x240000bd0:0x13d9:0x0] 00002000:00100000:1.0:1787508716.824123:0:202240:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9090d0b4d180 with x1874324509613312 00000100:00100000:3.0:1787508716.838401:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508716.838574:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509613568 00000100:00100000:0.0:1787508716.838585:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509613568 00000100:00100000:0.0:1787508716.838660:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94100 00000100:00100000:0.0:1787508716.838670:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:341175:x1874324509613568:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1787508716.838706:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508716.838727:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4600/0xb126349c40f35560 lrc: 2/0,0 mode: --/EX res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae8af expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.838790:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f35567 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.838805:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x59/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 12 pid: 202227 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.838814:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f35567 lrc: 4/0,1 mode: --/EX res: [0x240000bd0:0x13d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.838846:0:202228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x59/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 12 pid: 202227 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.838861:0:202228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 4/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x59/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 12 pid: 202227 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508716.838873:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:202228:1874324480196224:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508716.838997:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cdd73480 going to sleep for 11 seconds 00000100:00100000:3.0:1787508716.841327:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508716.841472:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:202228:1874324480196224:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508716.841510:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f35567 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508716.841662:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509613696 00000100:00100000:2.0:1787508716.841671:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509613696 00010000:00010000:2.0:1787508716.841722:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 4/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x59/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 13 pid: 202227 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508716.841762:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27937 00000100:00100000:2.0:1787508716.841772:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9681f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2401:x1874324509613696:12345-192.168.201.30@tcp:102:ldlm_bl.0 00010000:00010000:2.0:1787508716.841789:0:205406:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 4/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x59/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 13 pid: 202227 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.841802:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x59/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 13 pid: 202227 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.841813:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x51/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 13 pid: 202227 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.841822:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d9:0x0].0x0 (ffff9090d1b2bb00) 00010000:00010000:2.0:1787508716.841825:0:205406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 59 00010000:00010000:2.0:1787508716.841829:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f35567 lrc: 3/0,1 mode: --/EX res: [0x240000bd0:0x13d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.841840:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f35567 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.841846:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f35567 lrc: 4/0,1 mode: EX/EX res: [0x240000bd0:0x13d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.841889:0:205406:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x51/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 13 pid: 202227 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508716.841980:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9681f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2401:x1874324509613696:12345-192.168.201.30@tcp:102:ldlm_bl.0 Request processed in 210us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508716.841989:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27937 00010000:00010000:0.0:1787508716.843467:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f35567 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.843484:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f35567 lrc: 3/0,1 mode: EX/EX res: [0x240000bd0:0x13d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787508716.843693:0:202228:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xe0c:0x0], index 1: 0 00010000:00010000:0.0:1787508716.843868:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f35567 lrc: 3/0,0 mode: CR/CR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8af expref: 14 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.843880:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d9:0x0].0x0 (ffff9090d1b2bb00) 00010000:00010000:0.0:1787508716.843883:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1787508716.843900:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4600/0xb126349c40f35560 lrc: 0/0,0 mode: --/EX res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8af expref: 14 pid: 202228 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.843917:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f35567 lrc: 3/0,0 mode: CR/CR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8af expref: 13 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.844517:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d9:0x0].0x0 (ffff9090d1b2bb00) 00010000:00010000:0.0:1787508716.844522:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1787508716.844527:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4200, rc 0) 00000100:00100000:0.0:1787508716.844607:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:341175:x1874324509613568:12345-192.168.201.30@tcp:101:dd.0 Request processed in 5935us (6216us total) trans 8589962055 rc 0/0 00000100:00100000:0.0:1787508716.844616:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94100 00000100:00100000:3.0:1787508716.850351:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508716.850401:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508716.850516:0:202241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509613824 00000100:00100000:1.0:1787508716.850527:0:202241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509613824 00000100:00100000:1.0:1787508716.850622:0:202241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7753 00000100:00100000:1.0:1787508716.850633:0:202241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2401:x1874324509613824:12345-192.168.201.30@tcp:4:dd.0 00010000:00010000:1.0:1787508716.850699:0:202241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f3556e lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.850718:0:202241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x51/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 13 pid: 202227 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.850728:0:202241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f3556e lrc: 4/0,1 mode: --/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010000000000 pid: 202241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.850760:0:202241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x51/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 13 pid: 202227 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.850780:0:202241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 4/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x51/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 13 pid: 202227 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508716.850794:0:202241:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6352300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001_UUID:202241:1874324480196352:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508716.850867:0:202241:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1967240 going to sleep for 11 seconds 00000100:00100000:0.0:1787508716.852301:0:203733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509613952 00000100:00100000:0.0:1787508716.852316:0:203733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509613952 00000100:00100000:0.0:1787508716.852429:0:203733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:0.0:1787508716.852443:0:203733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2401:x1874324509613952:12345-192.168.201.30@tcp:4:dd.0 00002000:00010000:0.0:1787508716.852506:0:203733:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xe0c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787508716.852516:0:203733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013498933/0xb126349c40f35575 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xe0c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 203733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.852532:0:203733:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xe0c:0x0].0x0 since=13687s v=(0 0) 00010000:00010000:0.0:1787508716.852537:0:203733:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xe0c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787508716.852545:0:203733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013498933/0xb126349c40f35575 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xe0c:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 203733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.852560:0:203733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013498933/0xb126349c40f35575 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xe0c:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 203733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787508716.853957:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508716.854448:0:202241:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6352300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001_UUID:202241:1874324480196352:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508716.854480:0:202241:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f3556e lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010000000000 pid: 202241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508716.861388:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508716.861816:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509614080 00000100:00100000:2.0:1787508716.861827:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509614080 00010000:00010000:2.0:1787508716.861867:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 4/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x51/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 14 pid: 202227 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508716.861905:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27938 00000100:00100000:2.0:1787508716.861915:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2400:x1874324509614080:12345-192.168.201.30@tcp:102:ldlm_bl.0 00010000:00010000:2.0:1787508716.861932:0:202213:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 4/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x51/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 14 pid: 202227 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.861973:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x51/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 14 pid: 202227 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.861992:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 14 pid: 202227 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.862002:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d9:0x0].0x0 (ffff9090d1b2bb00) 00010000:00010000:2.0:1787508716.862004:0:202213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 51 00010000:00010000:2.0:1787508716.862008:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 6 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f3556e lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010000000000 pid: 202241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.862017:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f3556e lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40090000000000 pid: 202241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.862024:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f3556e lrc: 4/0,1 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40090000000000 pid: 202241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.862062:0:202213:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 14 pid: 202227 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508716.862127:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2400:x1874324509614080:12345-192.168.201.30@tcp:102:ldlm_bl.0 Request processed in 212us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508716.862136:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27938 00010000:00010000:1.0:1787508716.862524:0:202241:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f3556e lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010000000000 pid: 202241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.862534:0:202241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f3556e lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010000000000 pid: 202241 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787508716.881744:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589962056 is committed 00000001:00080000:2.0:1787508716.881781:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589962051 is committed 00000020:00080000:2.0:1787508716.881792:0:202955:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9090cdd73600 refcount 2 committed 0 result 0 batchid 4294998390 00000020:00080000:2.0:1787508716.881797:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cd9a9d00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9090cdd73e40 00000020:00080000:2.0:1787508716.881801:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a2:0x5:0x0].599 00000020:00080000:2.0:1787508716.881804:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cd9a9100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090cca8fa00 00000020:00080000:2.0:1787508716.881807:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd1:0xf:0x0].55 00000020:00080000:1.0:1787508716.881891:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294998390 committed batchid 4294998389 00000020:00080000:1.0:1787508716.881973:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998389 00010000:00010000:3.0:1787508716.882108:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f35472 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.882120:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f35472 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.882128:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f35472 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.882134:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508716.882140:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f35472 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.882147:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f35472 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.882164:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d8:0x0].0x0 (ffff9090ca4e2f00) 00010000:00010000:3.0:1787508716.882167:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508716.882172:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f35472 lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.882178:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f35472 lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.882199:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b400/0xb126349c40f354d4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.882206:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b400/0xb126349c40f354d4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.882212:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b400/0xb126349c40f354d4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.882218:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508716.882221:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b400/0xb126349c40f354d4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.882227:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b400/0xb126349c40f354d4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.882239:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d8:0x0].0xfe058dd8 (ffff9090d02ad700) 00010000:00010000:3.0:1787508716.882242:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508716.882245:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b400/0xb126349c40f354d4 lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508716.882251:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b400/0xb126349c40f354d4 lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.882319:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ba00/0xb126349c40f35559 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.882328:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ba00/0xb126349c40f35559 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.882335:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ba00/0xb126349c40f35559 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.882340:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508716.882343:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ba00/0xb126349c40f35559 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.882355:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ba00/0xb126349c40f35559 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.882365:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d9:0x0].0x0 (ffff9090d1b2bb00) 00010000:00010000:0.0:1787508716.882368:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508716.882370:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ba00/0xb126349c40f35559 lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.882376:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ba00/0xb126349c40f35559 lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508716.882461:0:202241:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb size from disk: 0 -> 1048576 00000004:00010000:0.0:1787508716.882465:0:202241:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb mtime from disk: 1787508717 -> 1787508717 00000004:00010000:0.0:1787508716.882468:0:202241:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb atime from disk: 1787508717 -> 1787508717 00000004:00010000:0.0:1787508716.882471:0:202241:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb ctime from disk: 1787508717 -> 1787508717 00000004:00010000:0.0:1787508716.882473:0:202241:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:0.0:1787508716.882485:0:202241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f3556e lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010000000000 pid: 202241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.882491:0:202241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f3556e lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010400000000 pid: 202241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.882498:0:202241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f3556e lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010400000000 pid: 202241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.882504:0:202241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a600 already unused, calling callback (ffffffffc0d0a230) 00010000:00010000:0.0:1787508716.882508:0:202241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f3556e lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010400000000 pid: 202241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.882517:0:202241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f3556e lrc: 4/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018400000000 pid: 202241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.882525:0:202241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d9:0x0].0x0 (ffff9090d1b2bb00) 00010000:00010000:0.0:1787508716.882527:0:202241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787508716.882530:0:202241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f3556e lrc: 2/0,0 mode: --/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819400000000 pid: 202241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.882536:0:202241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f3556e lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819400000000 pid: 202241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508716.882633:0:202241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2401:x1874324509613824:12345-192.168.201.30@tcp:4:dd.0 Request processed in 31996us (32288us total) trans 8589962056 rc 0/0 00000100:00100000:0.0:1787508716.882643:0:202241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7753 00000001:00080000:1.0:1787508716.886820:0:204539:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589940561 is committed 00002000:00010000:2.0:1787508716.887145:0:203733:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0xe0c:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:2.0:1787508716.887150:0:203733:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0xe0c:0x0] updating lvb mtime from disk: 0 -> 1787508717 00002000:00010000:2.0:1787508716.887152:0:203733:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0xe0c:0x0] updating lvb ctime from disk: 0 -> 1787508717 00002000:00010000:2.0:1787508716.887154:0:203733:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0xe0c:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:2.0:1787508716.887168:0:203733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013498933/0xb126349c40f35575 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xe0c:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 203733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.887181:0:203733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013498933/0xb126349c40f35575 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xe0c:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 203733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.887188:0:203733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013498933/0xb126349c40f35575 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xe0c:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 203733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.887196:0:203733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5200 already unused, calling callback (ffffffffc0d0a230) 00010000:00010000:2.0:1787508716.887201:0:203733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013498933/0xb126349c40f35575 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xe0c:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 203733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.887209:0:203733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013498933/0xb126349c40f35575 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xe0c:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 203733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.887228:0:203733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013498933/0xb126349c40f35575 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xe0c:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 203733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.887235:0:203733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013498933/0xb126349c40f35575 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xe0c:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 203733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508716.887376:0:203733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2401:x1874324509613952:12345-192.168.201.30@tcp:4:dd.0 Request processed in 34932us (36968us total) trans 8589940561 rc 0/0 00000100:00100000:2.0:1787508716.887388:0:203733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:2.0:1787508716.891008:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508716.891100:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509614336 00000100:00100000:0.0:1787508716.891110:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509614336 00000100:00100000:0.0:1787508716.891167:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15453 00000100:00100000:0.0:1787508716.891178:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:341175:x1874324509614336:12345-192.168.201.30@tcp:35:dd.0 00000100:00100000:0.0:1787508716.891473:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:341175:x1874324509614336:12345-192.168.201.30@tcp:35:dd.0 Request processed in 297us (474us total) trans 8589962057 rc 0/0 00000100:00100000:0.0:1787508716.891482:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15453 00000100:00100000:3.0:1787508716.922769:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508716.922840:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509614592 00000100:00100000:1.0:1787508716.922853:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509614592 00000100:00100000:1.0:1787508716.922923:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94101 00000100:00100000:1.0:1787508716.922934:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:341177:x1874324509614592:12345-192.168.201.30@tcp:36:truncate.0 00010000:00010000:1.0:1787508716.923026:0:205405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508716.923052:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f35567 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8af expref: 9 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.923073:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d9:0x0].0x0 (ffff9090d1b2bb00) 00010000:00010000:1.0:1787508716.923079:0:205405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787508716.923253:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f3557c lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.923273:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f3557c lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.923283:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f3557c lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787508716.923323:0:205405:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589962058 00000004:00010000:1.0:1787508716.923342:0:205405:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb size from disk: 1048576 -> 1048576 00000004:00010000:1.0:1787508716.923345:0:205405:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb mtime from disk: 1787508717 -> 1787508717 00000004:00010000:1.0:1787508716.923347:0:205405:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb atime from disk: 1787508717 -> 1787508717 00000004:00010000:1.0:1787508716.923350:0:205405:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb ctime from disk: 1787508717 -> 1787508717 00000004:00010000:1.0:1787508716.923352:0:205405:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb blocks from disk: 2048 -> 2048 00000004:00010000:1.0:1787508716.923358:0:205405:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e896085d reply state 00000000e283fa3e transno 8589962059 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f3557c lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.923370:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f3557c lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.923376:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d9:0x0].0x0 (ffff9090d1b2bb00) 00010000:00010000:1.0:1787508716.923379:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787508716.923382:0:205405:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787508716.923860:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:341177:x1874324509614592:12345-192.168.201.30@tcp:36:truncate.0 Request processed in 925us (1099us total) trans 8589962059 rc 0/0 00000100:00100000:1.0:1787508716.923869:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94101 00000020:00080000:1.0:1787508716.923874:0:205405:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787508716.927113:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508716.927200:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509614720 00000100:00100000:2.0:1787508716.927211:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509614720 00000100:00100000:2.0:1787508716.927327:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94102 00000100:00100000:2.0:1787508716.927338:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:341177:x1874324509614720:12345-192.168.201.30@tcp:101:truncate.0 00010000:00010000:2.0:1787508716.927361:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508716.927383:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa800/0xb126349c40f35583 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae8b6 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.927455:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa800/0xb126349c40f35583 lrc: 3/0,0 mode: CR/CR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8b6 expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.927466:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa800/0xb126349c40f35583 lrc: 3/0,0 mode: CR/CR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8b6 expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.927479:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d9:0x0].0x0 (ffff9090d1b2bb00) 00010000:00010000:2.0:1787508716.927481:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787508716.927484:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa800, rc 0) 00000100:00100000:2.0:1787508716.928252:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:341177:x1874324509614720:12345-192.168.201.30@tcp:101:truncate.0 Request processed in 912us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508716.928262:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94102 00000100:00100000:2.0:1787508716.931069:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508716.931513:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509614848 00000100:00100000:1.0:1787508716.931524:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509614848 00000100:00100000:1.0:1787508716.931596:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94103 00000100:00100000:1.0:1787508716.931607:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:341177:x1874324509614848:12345-192.168.201.30@tcp:101:truncate.0 00010000:00010000:1.0:1787508716.931626:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508716.931644:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f3558a lrc: 2/0,0 mode: --/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae8bd expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.931667:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f3558a lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8bd expref: 13 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.931688:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f3558a lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8bd expref: 13 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.931702:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d9:0x0].0x0 (ffff9090d1b2bb00) 00010000:00010000:1.0:1787508716.931710:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787508716.931715:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a600, rc 0) 00000100:00100000:1.0:1787508716.931921:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:341177:x1874324509614848:12345-192.168.201.30@tcp:101:truncate.0 Request processed in 314us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508716.931928:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94103 00000100:00100000:3.0:1787508716.934875:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508716.934977:0:225835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509614976 00000100:00100000:1.0:1787508716.934988:0:225835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509614976 00000100:00100000:1.0:1787508716.935044:0:225835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15072 00000100:00100000:1.0:1787508716.935054:0:225835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:341177:x1874324509614976:12345-192.168.201.30@tcp:101:truncate.0 00010000:00010000:1.0:1787508716.935071:0:225835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508716.935092:0:225835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac8d89c8/0xb126349c40f35591 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xe0c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae8c4 expref: -99 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787508716.935117:0:225835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xe0c:0x0] initial LVB size: 2097152, mtime: 0x6a8b37ed, atime: 0x0, ctime: 0x6a8b37ed, blocks: 0x800 00010000:00010000:1.0:1787508716.935140:0:225835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xe0c:0x0].0x0 since=13687s v=(0 0) 00010000:00010000:1.0:1787508716.935144:0:225835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xe0c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787508716.935154:0:225835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac8d89c8/0xb126349c40f35591 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xe0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8c4 expref: 6 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.935172:0:225835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ac8d89c8/0xb126349c40f35591 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xe0c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8c4 expref: 6 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508716.935186:0:225835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ba00, rc 0) 00000100:00100000:1.0:1787508716.935364:0:225835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:341177:x1874324509614976:12345-192.168.201.30@tcp:101:truncate.0 Request processed in 311us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508716.935372:0:225835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15072 00000100:00100000:3.0:1787508716.941124:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508716.941173:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508716.941282:0:205407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509615232 00000100:00100000:1.0:1787508716.941291:0:205407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509615232 00002000:00010000:1.0:1787508716.941334:0:205407:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/3596 (0->18446744073709551615) 00002000:00100000:1.0:1787508716.941339:0:205407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090c6b54700 with x1874324509615232 ext(0->18446744073709551615) 00002000:00010000:1.0:1787508716.941351:0:205407:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9090c6b54700. 00000100:00100000:1.0:1787508716.941393:0:205407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:1.0:1787508716.941404:0:205407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509615232:12345-192.168.201.30@tcp:10:truncate.0 00002000:00010000:0.0:1787508716.942598:0:205407:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0xe0c:0x0] updating lvb size from disk: 2097152 -> 0 00002000:00010000:0.0:1787508716.942605:0:205407:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0xe0c:0x0] updating lvb mtime from disk: 1787508717 -> 1787508717 00002000:00010000:0.0:1787508716.942608:0:205407:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0xe0c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787508716.942609:0:205407:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0xe0c:0x0] updating lvb ctime from disk: 1787508717 -> 1787508717 00002000:00010000:0.0:1787508716.942612:0:205407:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0xe0c:0x0] updating lvb blocks from disk: 2048 -> 0 00000100:00100000:0.0:1787508716.942693:0:205407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2400:x1874324509615232:12345-192.168.201.30@tcp:10:truncate.0 Request processed in 1287us (1514us total) trans 8589940562 rc 0/0 00000100:00100000:0.0:1787508716.942703:0:205407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 50 00002000:00010000:0.0:1787508716.942707:0:205407:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/3596 (0->18446744073709551615) 00002000:00100000:0.0:1787508716.942710:0:205407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090c6b54700 with x1874324509615232 ext(0->18446744073709551615) 00002000:00010000:0.0:1787508716.942715:0:205407:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9090c6b54700. 00000100:00100000:2.0:1787508716.942925:0:230113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509615104 00000100:00100000:2.0:1787508716.942933:0:230113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509615104 00002000:00010000:2.0:1787508716.942995:0:230113:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0001: refresh DOM lock for [0x240000bd0:0x13d9:0x0] 00002000:00100000:2.0:1787508716.943001:0:230113:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9090c6b56680 with x1874324509615104 00000100:00100000:2.0:1787508716.943029:0:230113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7754 00000100:00100000:2.0:1787508716.943036:0:230113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2400:x1874324509615104:12345-192.168.201.30@tcp:10:truncate.0 00000004:00010000:2.0:1787508716.945736:0:230113:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb size from disk: 1048576 -> 4096 00000004:00010000:2.0:1787508716.945747:0:230113:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb mtime from disk: 1787508717 -> 1787508717 00000004:00010000:2.0:1787508716.945750:0:230113:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb atime from disk: 1787508717 -> 1787508717 00000004:00010000:2.0:1787508716.945753:0:230113:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb ctime from disk: 1787508717 -> 1787508717 00000004:00010000:2.0:1787508716.945756:0:230113:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000bd0:0x13d9:0x0] updating lvb blocks from disk: 2048 -> 8 00000100:00100000:2.0:1787508716.946096:0:230113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2400:x1874324509615104:12345-192.168.201.30@tcp:10:truncate.0 Request processed in 3054us (4977us total) trans 8589962060 rc 0/0 00000100:00100000:2.0:1787508716.946108:0:230113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7754 00002000:00010000:2.0:1787508716.946113:0:230113:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0001: refresh DOM lock for [0x240000bd0:0x13d9:0x0] 00002000:00100000:2.0:1787508716.946116:0:230113:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9090c6b56680 with x1874324509615104 00000100:00100000:3.0:1787508716.959986:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508716.960080:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509615360 00000100:00100000:0.0:1787508716.960089:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509615360 00000100:00100000:0.0:1787508716.960162:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94104 00000100:00100000:0.0:1787508716.960173:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:341178:x1874324509615360:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:0.0:1787508716.960197:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508716.960218:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5000/0xb126349c40f35598 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae8cb expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.960281:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f3559f lrc: 3/1,0 mode: --/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.960295:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f3559f lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.960307:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f3559f lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.960323:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f355a6 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.960330:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f355a6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.960337:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f355a6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.960411:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f355ad lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.960435:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 2/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 13 pid: 202227 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.960445:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f355ad lrc: 4/1,0 mode: --/PR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.960476:0:202228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 13 pid: 202227 timeout: 13787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.960492:0:202228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 4/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 13 pid: 202227 timeout: 13788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508716.960515:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:202228:1874324480196480:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508716.960606:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cdd730c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787508716.964053:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:202228:1874324480196480:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508716.964084:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f355ad lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508716.965268:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508716.965440:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509615488 00000100:00100000:2.0:1787508716.965450:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509615488 00010000:00010000:2.0:1787508716.965494:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 4/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 14 pid: 202227 timeout: 13788 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508716.965615:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27939 00000100:00100000:2.0:1787508716.965628:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2402:x1874324509615488:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508716.965643:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508716.965651:0:229383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 4/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 14 pid: 202227 timeout: 13788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.965665:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 14 pid: 202227 timeout: 13788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.965702:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f3554b lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a8 expref: 14 pid: 202227 timeout: 13788 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.965719:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d9:0x0].0x0 (ffff9090d1b2bb00) 00010000:00010000:2.0:1787508716.965724:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f355ad lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.965735:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f355ad lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.965742:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f355ad lrc: 4/1,0 mode: PR/PR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.965774:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508716.966123:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2402:x1874324509615488:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 224us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508716.966132:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27939 00010000:00010000:0.0:1787508716.966379:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f355ad lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.966388:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f355ad lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508716.966452:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13d9:0x0]: returning size 4096 00000004:00200000:0.0:1787508716.966459:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508716.966481:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f355ad lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.966499:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f3559f lrc: 4/1,0 mode: CR/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.966506:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f3559f lrc: 4/1,0 mode: CR/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.966513:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f3559f lrc: 3/0,0 mode: CR/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.966519:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f3559f lrc: 4/0,0 mode: CR/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.966525:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508716.966529:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f3559f lrc: 4/0,0 mode: CR/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.966536:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f3559f lrc: 5/0,0 mode: CR/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.966547:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d8:0x0].0x0 (ffff9090ca4e2f00) 00010000:00010000:0.0:1787508716.966550:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508716.966553:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f3559f lrc: 3/0,0 mode: --/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.966559:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4200/0xb126349c40f3559f lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.966571:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f355a6 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.966582:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f355a6 lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.966589:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f355a6 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.966594:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508716.966597:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f355a6 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.966603:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f355a6 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.966610:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d8:0x0].0xfe058dd8 (ffff9090d1b2b300) 00010000:00010000:0.0:1787508716.966612:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508716.966615:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f355a6 lrc: 2/0,0 mode: --/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.966621:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5200/0xb126349c40f355a6 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d8:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.966660:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5000/0xb126349c40f35598 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8cb expref: 11 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.966686:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f355ad lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8cb expref: 10 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.966693:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d9:0x0].0x0 (ffff9090d1b2bb00) 00010000:00010000:0.0:1787508716.966695:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787508716.966699:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5600, rc 0) 00000100:00100000:0.0:1787508716.966750:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:341178:x1874324509615360:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 6578us (6812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508716.966758:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94104 00000100:00100000:1.0:1787508716.972429:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508716.972474:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508716.972541:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509615616 00000100:00100000:0.0:1787508716.972556:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509615616 00000100:00100000:0.0:1787508716.972618:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94105 00000100:00100000:0.0:1787508716.972629:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2401:x1874324509615616:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:0.0:1787508716.972647:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508716.972669:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f355b4 lrc: 2/0,0 mode: --/PR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae8d2 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.972715:0:205405:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f3558a lrc: 3/0,0 mode: PW/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8bd expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508716.972755:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:205405:1874324480196608:192.168.201.30@tcp:106: 00000100:00100000:0.0:1787508716.972834:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cdd730c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508716.973436:0:225838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509615744 00000100:00100000:3.0:1787508716.973442:0:225838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509615744 00000100:00100000:3.0:1787508716.973502:0:225838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15073 00000100:00100000:3.0:1787508716.973510:0:225838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2401:x1874324509615744:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:3.0:1787508716.973521:0:225838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508716.973534:0:225838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031ca7b1a/0xb126349c40f355bb lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xe0c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae8d9 expref: -99 pid: 225838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508716.973573:0:225838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b55180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:225838:1874324480196736:192.168.201.30@tcp:106: 00000100:00080000:0.0:1787508716.974872:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787508716.975170:0:225838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d00cb300 going to sleep for 11 seconds 00002000:00010000:2.0:1787508716.977196:0:225838:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000400:0xe0c:0x0] updating lvb atime: 0 -> 1787508717 00000100:00100000:2.0:1787508716.977226:0:225838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b55180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:225838:1874324480196736:192.168.201.30@tcp:106: 00010000:00010000:2.0:1787508716.977263:0:225838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000031ca7b1a/0xb126349c40f355bb lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0xe0c:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8d9 expref: 8 pid: 225838 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.977299:0:225838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031ca7b1a/0xb126349c40f355bb lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xe0c:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8d9 expref: 8 pid: 225838 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508716.977317:0:225838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e600, rc 0) 00000100:00100000:2.0:1787508716.977372:0:225838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2401:x1874324509615744:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 3862us (4896us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508716.977381:0:225838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15073 00000100:00100000:0.0:1787508716.978302:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:205405:1874324480196608:192.168.201.30@tcp:106: 00002000:00010000:0.0:1787508716.978322:0:205405:0:(mdt_io.c:1552:mdt_lvb2reply()) size 4096 00010000:00010000:0.0:1787508716.978339:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f355b4 lrc: 1/0,0 mode: --/PR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8d2 expref: 11 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.978354:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d9:0x0].0x0 (ffff9090d1b2bb00) 00010000:00010000:0.0:1787508716.978357:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787508716.978362:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f355b4 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8d2 expref: 11 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508716.978380:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4400, rc 0) 00000100:00100000:0.0:1787508716.978562:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2401:x1874324509615616:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 5933us (6153us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508716.978570:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94105 00010000:00010000:0.0:1787508717.116996:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508717.682589:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508717.682636:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508717.682673:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509615872 00000100:00100000:1.0:1787508717.682683:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509615872 00000100:00100000:1.0:1787508717.682735:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1018 00000100:00100000:1.0:1787508717.682747:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fccc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509615872:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508717.682827:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fccc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509615872:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 81us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508717.683505:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1018 00000100:00100000:1.0:1787508717.683652:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508717.683696:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509616128 00000100:00100000:1.0:1787508717.683702:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509616128 00000100:00100000:1.0:1787508717.683749:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2416 00000100:00100000:1.0:1787508717.683758:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509616128:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508717.683798:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509616128:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 42us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508717.683805:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2416 00000100:00080000:0.0:1787508717.684035:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787508717.685099:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509616000 00000100:00100000:2.0:1787508717.685109:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509616000 00000100:00100000:2.0:1787508717.685165:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3051 00000100:00100000:2.0:1787508717.685174:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:2402:x1874324509616000:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508717.685228:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:2402:x1874324509616000:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 56us (2657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508717.685235:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3051 00000100:00100000:1.0:1787508717.695236:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508717.695324:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509616256 00000100:00100000:0.0:1787508717.695333:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509616256 00000100:00100000:0.0:1787508717.695426:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2417 00000100:00100000:0.0:1787508717.695437:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509616256:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508717.695515:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509616256:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 80us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508717.695524:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2417 00000100:00080000:1.0:1787508717.695994:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787508718.146067:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508718.273758:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480196864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508718.273838:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508718.273899:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480196864 00000100:00100000:1.0:1787508718.273906:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480196864 00000100:00100000:1.0:1787508718.273996:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1705 00000100:00100000:1.0:1787508718.274007:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480196864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787508718.274038:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 131576384 pending 0 free 3881955328 avail 3650433024 00000100:00100000:1.0:1787508718.274085:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480196864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508718.274107:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1705 00000100:00080000:1.0:1787508718.274128:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508718.274162:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480196864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508718.274883:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d021b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480196992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787508718.274919:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508718.275022:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480196992 00000100:00100000:2.0:1787508718.275028:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480196992 00000100:00100000:2.0:1787508718.275065:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1706 00000100:00100000:2.0:1787508718.275071:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480196992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787508718.275085:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 131576384 pending 0 free 3881955328 avail 3650433024 00000100:00100000:2.0:1787508718.275116:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480196992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508718.275123:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1706 00000100:00080000:1.0:1787508718.275169:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508718.275191:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d021b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480196992:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787508719.162148:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508719.805829:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480197120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787508719.805908:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508719.806015:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787508719.806022:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480197248:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787508719.806049:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508719.806081:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480197120 00000100:00100000:1.0:1787508719.806090:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480197120 00000100:00100000:1.0:1787508719.806146:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480197248 00000100:00100000:1.0:1787508719.806150:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480197248 00000100:00100000:1.0:1787508719.806168:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1707 00000100:00100000:1.0:1787508719.806176:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480197120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787508719.806206:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 41194048 pending 0 free 3909767168 avail 3678244864 00000100:00100000:1.0:1787508719.806248:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480197120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508719.806256:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1707 00000100:00100000:1.0:1787508719.806271:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1708 00000100:00100000:1.0:1787508719.806277:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480197248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787508719.806287:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 41194048 pending 0 free 3909767168 avail 3678244864 00000100:00100000:1.0:1787508719.808713:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480197248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2427us (2653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508719.808726:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1708 00000100:00080000:1.0:1787508719.808764:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508719.808814:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480197248:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787508719.808831:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480197120:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787508720.186289:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508720.826255:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787508720.826288:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480197376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787508720.826374:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508720.826473:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480197376 00000100:00100000:0.0:1787508720.826481:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480197376 00000100:00100000:0.0:1787508720.826540:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29885 00000100:00100000:0.0:1787508720.826550:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480197376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787508720.826586:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 5316608 pending 0 free 1440706560 avail 1294467072 00000100:00100000:0.0:1787508720.826659:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480197376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508720.826667:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29885 00000100:00100000:0.0:1787508720.826715:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480197376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787508720.828670:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787508720.828692:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480197504:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787508720.828761:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508720.829133:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480197504 00000100:00100000:1.0:1787508720.829142:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480197504 00000100:00100000:1.0:1787508720.829218:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29886 00000100:00100000:1.0:1787508720.829227:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480197504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787508720.829268:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442766848 avail 1296527360 00000100:00100000:1.0:1787508720.829341:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480197504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508720.829359:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29886 00000100:00100000:1.0:1787508720.829405:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480197504:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787508721.210233:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508721.340917:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480197888:0@lo:400:kworker.0 00000100:00100000:3.0:1787508721.341017:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508721.341068:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d4855500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480198400:0@lo:400:kworker.0 00000100:00100000:3.0:1787508721.341091:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508721.341113:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480198912:0@lo:400:kworker.0 00000100:00100000:3.0:1787508721.341138:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508721.341162:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787508721.341167:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480198016:0@lo:400:kworker.0 00000100:00100000:3.0:1787508721.341183:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508721.341193:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d4854e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480198528:0@lo:400:kworker.0 00000100:00100000:3.0:1787508721.341205:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508721.341216:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480199040:0@lo:400:kworker.0 00000100:00100000:3.0:1787508721.341228:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508721.341248:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480198912 00000100:00100000:3.0:1787508721.341254:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480198912 00000100:00100000:3.0:1787508721.341296:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480199040 00000100:00100000:3.0:1787508721.341298:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480199040 00000100:00100000:3.0:1787508721.341313:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3052 00000100:00100000:3.0:1787508721.341320:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480198912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508721.341374:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480198912:12345-0@lo:400:kworker.0 Request processed in 55us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508721.341379:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3052 00000100:00100000:3.0:1787508721.341394:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3053 00000100:00100000:3.0:1787508721.341398:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480199040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508721.341413:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480199040:12345-0@lo:400:kworker.0 Request processed in 15us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508721.341416:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3053 00000100:00080000:3.0:1787508721.341427:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787508721.341430:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787508721.341452:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480199040:0@lo:400:kworker.0 00000100:00100000:3.0:1787508721.341459:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480198912:0@lo:400:kworker.0 00000100:00100000:0.0:1787508721.342063:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480197632:0@lo:400:kworker.0 00000100:00100000:0.0:1787508721.342108:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508721.342145:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480198144:0@lo:400:kworker.0 00000100:00100000:0.0:1787508721.342168:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508721.342188:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480198656:0@lo:400:kworker.0 00000100:00100000:0.0:1787508721.342208:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508721.342226:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480199168:0@lo:400:kworker.0 00000100:00100000:0.0:1787508721.342247:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508721.342267:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787508721.342273:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480197760:0@lo:400:kworker.0 00000100:00100000:0.0:1787508721.342296:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508721.342314:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091d4857100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480198272:0@lo:400:kworker.0 00000100:00100000:0.0:1787508721.342335:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508721.342368:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874324480198784:0@lo:400:kworker.0 00000100:00100000:0.0:1787508721.342389:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508721.342422:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480198144 00000100:00100000:0.0:1787508721.342427:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480198144 00000100:00100000:0.0:1787508721.342459:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480198656 00000100:00100000:0.0:1787508721.342462:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480198656 00000100:00100000:0.0:1787508721.342474:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480199168 00000100:00100000:0.0:1787508721.342477:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480199168 00000100:00100000:0.0:1787508721.342496:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480198784 00000100:00100000:0.0:1787508721.342499:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480198784 00000100:00100000:0.0:1787508721.342514:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3054 00000100:00100000:0.0:1787508721.342521:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480198144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508721.342574:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480198144:12345-0@lo:400:kworker.0 Request processed in 52us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508721.342580:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3054 00000100:00100000:0.0:1787508721.342595:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3055 00000100:00100000:0.0:1787508721.342611:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480198656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508721.342639:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480198656:12345-0@lo:400:kworker.0 Request processed in 38us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508721.342644:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3055 00000100:00100000:0.0:1787508721.342657:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3056 00000100:00100000:0.0:1787508721.342663:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480199168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508721.342690:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480199168:12345-0@lo:400:kworker.0 Request processed in 28us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508721.342695:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3056 00000100:00100000:0.0:1787508721.342707:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3057 00000100:00100000:0.0:1787508721.342713:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874324480198784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508721.342740:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874324480198784:12345-0@lo:400:kworker.0 Request processed in 28us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508721.342747:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3057 00000100:00100000:0.0:1787508721.342798:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480197760 00000100:00100000:0.0:1787508721.342802:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480197760 00000100:00100000:0.0:1787508721.342824:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480198272 00000100:00100000:0.0:1787508721.342826:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480198272 00000100:00100000:0.0:1787508721.342842:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29887 00000100:00100000:0.0:1787508721.342848:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480197760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508721.343123:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480197760:12345-0@lo:400:kworker.0 Request processed in 273us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508721.343130:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29887 00000100:00100000:0.0:1787508721.343143:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29888 00000100:00100000:0.0:1787508721.343150:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480198272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508721.343174:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480198272:12345-0@lo:400:kworker.0 Request processed in 25us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508721.343180:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29888 00000100:00080000:0.0:1787508721.343209:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787508721.343212:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787508721.343242:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480197760:0@lo:400:kworker.0 00000100:00100000:0.0:1787508721.343253:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d4857100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480198272:0@lo:400:kworker.0 00000100:00100000:0.0:1787508721.343263:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874324480198784:0@lo:400:kworker.0 00000100:00100000:0.0:1787508721.343272:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480198144:0@lo:400:kworker.0 00000100:00100000:0.0:1787508721.343280:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480198656:0@lo:400:kworker.0 00000100:00100000:0.0:1787508721.343288:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480199168:0@lo:400:kworker.0 00000100:00100000:3.0:1787508721.344472:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480197632 00000100:00100000:3.0:1787508721.344484:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480197632 00000100:00100000:3.0:1787508721.344535:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:3.0:1787508721.344545:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fccc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480197632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508721.344616:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fccc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480197632:12345-0@lo:400:kworker.0 Request processed in 74us (2507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508721.344623:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00100000:1.0:1787508721.345172:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480197888 00000100:00100000:1.0:1787508721.345179:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480197888 00000100:00100000:1.0:1787508721.345220:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480198400 00000100:00100000:1.0:1787508721.345223:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480198400 00000100:00100000:1.0:1787508721.345242:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2418 00000100:00100000:1.0:1787508721.345250:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480197888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508721.345301:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480197888:12345-0@lo:400:kworker.0 Request processed in 52us (4285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508721.345308:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2418 00000100:00100000:1.0:1787508721.345319:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480198016 00000100:00100000:1.0:1787508721.345323:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480198016 00000100:00100000:1.0:1787508721.345356:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480198528 00000100:00100000:1.0:1787508721.345360:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480198528 00000100:00100000:1.0:1787508721.345380:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2419 00000100:00100000:1.0:1787508721.345387:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480198400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508721.345416:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480198400:12345-0@lo:400:kworker.0 Request processed in 30us (4325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508721.345423:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2419 00000100:00100000:1.0:1787508721.345432:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2420 00000100:00100000:1.0:1787508721.345438:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480198016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508721.345463:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480198016:12345-0@lo:400:kworker.0 Request processed in 26us (4279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508721.345469:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2420 00000100:00100000:1.0:1787508721.345478:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2421 00000100:00100000:1.0:1787508721.345484:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480198528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508721.345507:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480198528:12345-0@lo:400:kworker.0 Request processed in 25us (4301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508721.345513:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2421 00000100:00100000:1.0:1787508721.345581:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480198016:0@lo:400:kworker.0 00000100:00100000:1.0:1787508721.345592:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d4854e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480198528:0@lo:400:kworker.0 00000100:00100000:1.0:1787508721.345613:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480197888:0@lo:400:kworker.0 00000100:00100000:1.0:1787508721.345625:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091d4855500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480198400:0@lo:400:kworker.0 00000100:00080000:0.0:1787508721.346550:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787508721.346558:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787508721.346585:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480197632:0@lo:400:kworker.0 00010000:00010000:0.0:1787508722.235413:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508722.791106:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508722.791163:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508722.791203:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508722.791220:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508722.791236:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508722.791252:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508722.791269:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508722.791285:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508722.791304:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508722.791550:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509616640 00000100:00100000:2.0:1787508722.791562:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509616640 00000100:00100000:2.0:1787508722.791642:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509617152 00000100:00100000:2.0:1787508722.791646:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509617152 00000100:00100000:2.0:1787508722.791664:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509616512 00000100:00100000:2.0:1787508722.791667:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509616512 00000100:00100000:2.0:1787508722.791683:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509617024 00000100:00100000:2.0:1787508722.791686:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509617024 00000100:00100000:2.0:1787508722.791702:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3058 00000100:00100000:2.0:1787508722.791712:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2403:x1874324509616640:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508722.791803:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2403:x1874324509616640:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 92us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508722.791811:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3058 00000100:00100000:2.0:1787508722.791829:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3059 00000100:00100000:2.0:1787508722.791835:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2403:x1874324509617152:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508722.791864:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2403:x1874324509617152:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 29us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508722.791870:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3059 00000100:00100000:2.0:1787508722.791882:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3060 00000100:00100000:2.0:1787508722.791888:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:2403:x1874324509616512:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508722.791911:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:2403:x1874324509616512:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508722.791918:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3060 00000100:00100000:2.0:1787508722.791929:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3061 00000100:00100000:2.0:1787508722.791936:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2403:x1874324509617024:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508722.791986:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2403:x1874324509617024:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 50us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508722.791992:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3061 00000100:00080000:1.0:1787508722.792232:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787508722.792236:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787508722.792935:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509616384 00000100:00100000:0.0:1787508722.792976:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509616384 00000100:00100000:0.0:1787508722.793018:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1020 00000100:00100000:0.0:1787508722.793025:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fccc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509616384:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508722.793068:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fccc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509616384:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 43us (1972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508722.793075:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1020 00000100:00100000:0.0:1787508722.793106:0:225833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509616896 00000100:00100000:0.0:1787508722.793109:0:225833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509616896 00000100:00100000:0.0:1787508722.793147:0:225833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509617408 00000100:00100000:0.0:1787508722.793150:0:225833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509617408 00000100:00100000:0.0:1787508722.793165:0:225833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509616768 00000100:00100000:0.0:1787508722.793168:0:225833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509616768 00000100:00100000:0.0:1787508722.793181:0:225833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509617280 00000100:00100000:0.0:1787508722.793184:0:225833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509617280 00000100:00100000:0.0:1787508722.793199:0:225833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2422 00000100:00100000:0.0:1787508722.793204:0:225833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2403:x1874324509616896:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508722.793231:0:225833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2403:x1874324509616896:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 27us (2029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508722.793238:0:225833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2422 00000100:00100000:0.0:1787508722.793247:0:225833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2423 00000100:00100000:0.0:1787508722.793252:0:225833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2403:x1874324509617408:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508722.793268:0:225833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2403:x1874324509617408:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 16us (2031us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508722.793273:0:225833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2423 00000100:00100000:0.0:1787508722.793281:0:225833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2424 00000100:00100000:0.0:1787508722.793286:0:225833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509616768:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508722.793302:0:225833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509616768:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 16us (2032us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508722.793307:0:225833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2424 00000100:00100000:0.0:1787508722.793327:0:225833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2425 00000100:00100000:0.0:1787508722.793333:0:225833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2403:x1874324509617280:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508722.793351:0:225833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2403:x1874324509617280:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 18us (2046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508722.793356:0:225833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2425 00000100:00080000:2.0:1787508722.794466:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787508722.794473:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787508722.876353:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589962060 is committed 00000020:00080000:3.0:1787508722.876389:0:202955:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 4294998390 batchid updated 00010000:00010000:2.0:1787508722.877216:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f3557c lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508722.877236:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f3557c lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508722.877245:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f3557c lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508722.877252:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247be00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508722.877259:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f3557c lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508722.877269:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f3557c lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508722.877296:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d9:0x0].0x0 (ffff9090d1b2bb00) 00010000:00010000:2.0:1787508722.877301:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508722.877308:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f3557c lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508722.877316:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247be00/0xb126349c40f3557c lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787508722.882755:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998390 00000004:00080000:1.0:1787508722.882821:0:202975:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090c966e9c0 with version 13626 00000020:00080000:1.0:1787508722.882841:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294998390 cancel update log [0x2000013a2:0x5:0x0].599: rc = 0 00000020:00080000:1.0:1787508722.884120:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294998390 cancel update log [0x240000bd1:0xf:0x0].55: rc = 0 00000020:00080000:1.0:1787508722.884134:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998390 00000004:00080000:1.0:1787508722.884151:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13626 rpc_version 13626 00000020:00100000:1.0:1787508722.884188:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787508722.884199:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091ffc0c380 x1874324480199424/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787508722.884221:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0c380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480199424:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508722.884295:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508722.887815:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c966e840 going to sleep for 11 seconds 00000100:00100000:1.0:1787508722.887867:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480199424 00000100:00100000:1.0:1787508722.887876:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480199424 00000100:00100000:1.0:1787508722.887972:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29889 00000100:00100000:1.0:1787508722.887984:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:202961:x1874324480199424:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508722.888193:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:202961:x1874324480199424:12345-0@lo:1000:osp_up0-1.0 Request processed in 212us (3897us total) trans 12884944177 rc 0/0 00000100:00100000:1.0:1787508722.888205:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29889 00000100:00100000:3.0:1787508722.888254:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0c380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480199424:0@lo:1000:osp_up0-1.0 00000001:00080000:3.0:1787508722.888605:0:204539:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589940562 is committed 00010000:00010000:2.0:1787508723.261498:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508723.386327:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787508723.386354:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480199552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508723.386427:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508723.386496:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480199552 00000100:00100000:1.0:1787508723.386504:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480199552 00000100:00100000:1.0:1787508723.386560:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1709 00000100:00100000:1.0:1787508723.386582:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480199552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787508723.386613:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 131576384 pending 0 free 3881955328 avail 3650433024 00000100:00100000:1.0:1787508723.386659:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480199552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508723.386667:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1709 00000100:00080000:1.0:1787508723.386688:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508723.386735:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480199552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787508723.387388:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787508723.387400:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d021b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480199680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787508723.387439:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508723.387467:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480199680 00000100:00100000:2.0:1787508723.387471:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480199680 00000100:00100000:2.0:1787508723.387520:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1710 00000100:00100000:2.0:1787508723.387527:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480199680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787508723.387540:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 131576384 pending 0 free 3881955328 avail 3650433024 00000100:00100000:2.0:1787508723.387584:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480199680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508723.387591:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1710 00000100:00100000:2.0:1787508723.387623:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d021b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480199680:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787508723.390009:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:0.0:1787508723.578406:0:233693:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 100e: DoM: read on open and file size ==== 14:12:02 (1787508722) 00000100:00100000:3.0:1787508723.730851:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508723.731004:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509617664 00000100:00100000:2.0:1787508723.731016:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509617664 00000100:00100000:2.0:1787508723.731081:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94106 00000100:00100000:2.0:1787508723.731091:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:341753:x1874324509617664:12345-192.168.201.30@tcp:36:mkdir.0 00010000:00010000:2.0:1787508723.731153:0:202228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508723.731181:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f35480 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae869 expref: 11 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.731202:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508723.731207:0:202228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508723.731280:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f355c2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.731296:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f35505 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae893 expref: 8 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.731305:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f355c2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.731339:0:202228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f35505 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae893 expref: 8 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.731353:0:202228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f35505 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae893 expref: 8 pid: 203348 timeout: 13794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508723.731366:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480199808:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508723.731443:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d4534a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787508723.738332:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508723.738370:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509617792 00000100:00100000:2.0:1787508723.738380:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509617792 00010000:00010000:2.0:1787508723.738421:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f35505 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae893 expref: 9 pid: 203348 timeout: 13794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508723.738458:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27940 00000100:00100000:2.0:1787508723.738468:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9f1b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2402:x1874324509617792:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508723.738482:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508723.738489:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f35505 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae893 expref: 9 pid: 203348 timeout: 13794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.738504:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f35505 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae893 expref: 9 pid: 203348 timeout: 13794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.738526:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508723.738532:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f355c2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.738547:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f355c2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.738554:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f355c2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.738591:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508723.738652:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9f1b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2402:x1874324509617792:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 185us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508723.738660:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27940 00010000:00010000:3.0:1787508723.739411:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f35505 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae893 expref: 8 pid: 203348 timeout: 13794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508723.739435:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480199808:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508723.739457:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f355c2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.739465:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f355c2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.739693:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f355c2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.739717:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f355c9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.739727:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f355c9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.739735:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f355c9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.740961:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f355d0 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1267:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.740976:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f355d0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.740985:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f355d0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508723.741007:0:202228:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007aeb0aab reply state 00000000beace725 transno 12884944178 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f355d0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.741023:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f355d0 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.741030:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1267:0x0].0x0 (ffff9090cc088900) 00010000:00010000:3.0:1787508723.741033:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508723.741037:0:202228:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787508723.741043:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1267:0x0]: returning size 4096 00010000:00010000:3.0:1787508723.741052:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f355c2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.741058:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f355c2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.741064:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f355c2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.741070:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f355c2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.741077:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508723.741081:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f355c2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.741089:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f355c2 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.741099:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508723.741101:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508723.741104:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f355c2 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.741114:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f355c2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508723.741124:0:202228:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007aeb0aab reply state 00000000beace725 transno 12884944178 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f355c9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.741131:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f355c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.741137:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe6771fd0 (ffff9090cc088700) 00010000:00010000:3.0:1787508723.741140:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508723.741141:0:202228:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787508723.741233:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:341753:x1874324509617664:12345-192.168.201.30@tcp:36:mkdir.0 Request processed in 10139us (10390us total) trans 12884944178 rc 0/0 00000100:00100000:3.0:1787508723.741242:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94106 00000100:00100000:2.0:1787508723.781811:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508723.782013:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509617920 00000100:00100000:3.0:1787508723.782023:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509617920 00000100:00100000:3.0:1787508723.782086:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94107 00000100:00100000:3.0:1787508723.782097:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:341756:x1874324509617920:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508723.782127:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508723.782152:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f355d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae8e0 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.782221:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f355de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.782236:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f355de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.782252:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f355de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508723.782311:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508723.782316:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508723.782336:0:205405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f355de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.782362:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f355d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8e0 expref: 14 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.782379:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f355de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8e0 expref: 13 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.782389:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508723.782391:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508723.782395:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fe00, rc 0) 00000100:00100000:3.0:1787508723.782464:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:341756:x1874324509617920:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 368us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508723.782471:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94107 00000100:00100000:0.0:1787508723.793203:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508723.793282:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509618048 00000100:00100000:2.0:1787508723.793301:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509618048 00000100:00100000:2.0:1787508723.793361:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94108 00000100:00100000:2.0:1787508723.793372:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:341756:x1874324509618048:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508723.793393:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508723.793415:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f355e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae8e7 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.793484:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f355ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.793498:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f355ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.793509:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f355ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.793521:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f355f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.793528:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f355f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.793534:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f355f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.793645:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f355fa lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.793654:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f355fa lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.793662:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f355fa lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508723.793703:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1267:0x0]: returning size 4096 00000004:00200000:2.0:1787508723.793707:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508723.793726:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f355fa lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.793738:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f355ec lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.793745:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f355ec lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.793751:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f355ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.793757:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f355ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.793767:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508723.793771:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f355ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.793778:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f355ec lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.793791:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508723.793794:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508723.793799:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f355ec lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.793805:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f355ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.793817:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f355f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.793823:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f355f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.793830:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f355f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.793835:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508723.793838:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f355f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.793844:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f355f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.793854:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe6771fd0 (ffff9090cc088700) 00010000:00010000:2.0:1787508723.793857:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508723.793859:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f355f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.793865:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f355f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.793890:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f355e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8e7 expref: 15 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.793903:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f355fa lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8e7 expref: 14 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.793910:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1267:0x0].0x0 (ffff9090cc088900) 00010000:00010000:2.0:1787508723.793913:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508723.793915:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab800, rc 0) 00000100:00100000:2.0:1787508723.794017:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:341756:x1874324509618048:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 647us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508723.794024:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94108 00000100:00100000:3.0:1787508723.797487:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508723.797525:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509618304 00000100:00100000:3.0:1787508723.797533:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509618304 00000100:00100000:3.0:1787508723.797887:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94109 00000100:00100000:3.0:1787508723.797897:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:341756:x1874324509618304:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508723.797918:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508723.797962:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f35601 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae8ee expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508723.798060:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1267:0x0]: returning size 4096 00010000:00010000:3.0:1787508723.798165:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f35601 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8ee expref: 16 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.798185:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508723.798188:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508723.798193:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f35601 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8ee expref: 16 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.798203:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ec00, rc 0) 00000100:00100000:3.0:1787508723.798262:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:341756:x1874324509618304:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 367us (796us total) trans 12884944179 rc 301/301 00000100:00100000:3.0:1787508723.798269:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94109 00000100:00100000:3.0:1787508723.806743:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508723.809576:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509618560 00000100:00100000:2.0:1787508723.809593:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509618560 00000100:00100000:2.0:1787508723.809669:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94110 00000100:00100000:2.0:1787508723.809679:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:341756:x1874324509618560:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:2.0:1787508723.809750:0:202228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508723.809779:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f355fa lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8e7 expref: 15 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.809809:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1267:0x0].0x0 (ffff9090cc088900) 00010000:00010000:2.0:1787508723.809815:0:202228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508723.809839:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3560f lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1267:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.809852:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3560f lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1267:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.809861:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3560f lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1267:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508723.810034:0:202228:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000774807be reply state 000000000f95dceb transno 12884944180 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3560f lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1267:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.810048:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3560f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1267:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.810054:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1267:0x0].0x0 (ffff9090cc088900) 00010000:00010000:2.0:1787508723.810057:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:2.0:1787508723.810059:0:202228:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787508723.810067:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1267:0x0]: returning size 4096 00000100:00100000:2.0:1787508723.810156:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:341756:x1874324509618560:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 477us (3425us total) trans 12884944180 rc 0/0 00000100:00100000:2.0:1787508723.810163:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94110 00000100:00100000:0.0:1787508723.812697:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508723.812800:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509618816 00000100:00100000:3.0:1787508723.812811:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509618816 00000100:00100000:3.0:1787508723.812877:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15454 00000100:00100000:3.0:1787508723.812887:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:341756:x1874324509618816:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1787508723.813111:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:341756:x1874324509618816:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 225us (423us total) trans 12884944181 rc 0/0 00000100:00100000:3.0:1787508723.813118:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15454 00000100:00100000:3.0:1787508723.857767:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508723.857814:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509618944 00000100:00100000:3.0:1787508723.857824:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509618944 00000100:00100000:3.0:1787508723.858022:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9811 00000100:00100000:3.0:1787508723.858034:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:288263:x1874324509618944:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508723.858051:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787508723.858076:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35521 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae89a expref: 8 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.858092:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d8:0x0].0x0 (ffff9090d1b2bf00) 00010000:00010000:3.0:1787508723.858102:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3541e lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1266:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae854 expref: 7 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.858110:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1266:0x0].0x0 (ffff9090ca4e2800) 00010000:00010000:3.0:1787508723.858117:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f353e6 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae846 expref: 6 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.858125:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1265:0x0].0x0 (ffff9090cc088f00) 00010000:00010000:3.0:1787508723.858128:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508723.858176:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:288263:x1874324509618944:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 145us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508723.858182:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9811 00000100:00100000:2.0:1787508723.862582:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508723.864101:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508723.864146:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509619072 00000100:00100000:2.0:1787508723.864155:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509619072 00000100:00100000:2.0:1787508723.864211:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509619200 00000100:00100000:2.0:1787508723.864214:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509619200 00000100:00100000:2.0:1787508723.864236:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9812 00000100:00100000:2.0:1787508723.864246:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:287589:x1874324509619072:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508723.864262:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00000100:00100000:3.0:1787508723.864272:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9813 00000100:00100000:3.0:1787508723.864282:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:288110:x1874324509619200:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508723.864302:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:2.0:1787508723.864308:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f3558a lrc: 0/0,0 mode: --/PW res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8bd expref: 8 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.864313:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f355de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8e0 expref: 17 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.864336:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508723.864339:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa800/0xb126349c40f35583 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8b6 expref: 7 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.864347:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3549c lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae870 expref: 16 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.864348:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d9:0x0].0x0 (ffff9090d1b2bb00) 00010000:00010000:3.0:1787508723.864357:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d8:0x0].0x0 (ffff9090d1b2bf00) 00010000:00010000:2.0:1787508723.864357:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f3552f lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8a1 expref: 6 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.864364:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d8:0x0].0x0 (ffff9090ca4e2f00) 00010000:00010000:2.0:1787508723.864367:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508723.864381:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35448 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1266:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae85b expref: 15 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.864390:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1266:0x0].0x0 (ffff9090ca4e2800) 00010000:00010000:3.0:1787508723.864400:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f3536f lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1265:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae823 expref: 14 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508723.864408:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1265:0x0].0x0 (ffff9090cc088f00) 00000100:00100000:2.0:1787508723.864416:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:287589:x1874324509619072:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 172us (1845us total) trans 0 rc 0/0 00010000:00010000:3.0:1787508723.864420:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35306 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae807 expref: 13 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508723.864424:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9812 00010000:00010000:3.0:1787508723.864428:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d6:0x0].0x0 (ffff9090cc088e00) 00010000:00010000:3.0:1787508723.864432:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508723.864450:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:288110:x1874324509619200:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 172us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508723.864457:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9813 00000100:00100000:3.0:1787508723.868232:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508723.869926:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509619328 00000100:00100000:0.0:1787508723.869951:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509619328 00000100:00100000:0.0:1787508723.870018:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9814 00000100:00100000:0.0:1787508723.870030:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:288292:x1874324509619328:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508723.870046:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1787508723.870090:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e000/0xb126349c40f35330 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae815 expref: 10 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.870107:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d7:0x0].0x0 (ffff9090ca4e2900) 00010000:00010000:0.0:1787508723.870124:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5600/0xb126349c40f355ad lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8cb expref: 9 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.870135:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d9:0x0].0x0 (ffff9090d1b2bb00) 00010000:00010000:0.0:1787508723.870148:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5a00/0xb126349c40f354aa lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae877 expref: 8 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.870158:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d8:0x0].0x0 (ffff9090ca4e2f00) 00010000:00010000:0.0:1787508723.870168:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4e00/0xb126349c40f35314 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13d6:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae80e expref: 7 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.870183:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13d6:0x0].0x0 (ffff9090d36fd100) 00010000:00010000:0.0:1787508723.870189:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508723.870246:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:288292:x1874324509619328:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 218us (2022us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508723.870254:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9814 00000100:00100000:0.0:1787508723.943212:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508723.943425:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509619456 00000100:00100000:2.0:1787508723.943436:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509619456 00000100:00100000:2.0:1787508723.943535:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94111 00000100:00100000:2.0:1787508723.943546:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:341770:x1874324509619456:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:2.0:1787508723.943585:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508723.943606:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35616 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae8f5 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.943682:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3561d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.943695:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3561d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.943715:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3561d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508723.943764:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508723.943767:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508723.943796:0:209004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3561d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.943818:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35616 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8f5 expref: 14 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.943835:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3561d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8f5 expref: 13 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.943845:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508723.943847:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508723.943851:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa800, rc 0) 00000100:00100000:2.0:1787508723.943914:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:341770:x1874324509619456:12345-192.168.201.30@tcp:101:dd.0 Request processed in 370us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508723.944233:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94111 00000100:00100000:3.0:1787508723.948828:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508723.949062:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509619584 00000100:00100000:0.0:1787508723.949076:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509619584 00000100:00100000:0.0:1787508723.949146:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94112 00000100:00100000:0.0:1787508723.949156:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:341770:x1874324509619584:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1787508723.949176:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508723.949197:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35624 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae8fc expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.949260:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f3562b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.949274:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f3562b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.949285:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f3562b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.949415:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35632 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.949423:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35632 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.949431:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35632 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.949537:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f35639 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.949546:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f35639 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.949567:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f35639 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508723.949607:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1267:0x0]: returning size 4096 00000004:00200000:0.0:1787508723.949611:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508723.949721:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f35639 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.949735:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f3562b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.949741:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f3562b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.949747:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f3562b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.949753:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f3562b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.949759:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5a00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508723.949763:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f3562b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.949771:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f3562b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.949851:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508723.949855:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508723.949861:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f3562b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.949867:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f3562b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.949882:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35632 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.949888:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35632 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.949894:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35632 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.949899:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508723.949902:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35632 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.949908:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35632 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.949916:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe6771fd0 (ffff9090cc088700) 00010000:00010000:0.0:1787508723.949918:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508723.949921:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35632 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.949929:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35632 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.950050:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35624 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8fc expref: 15 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.950065:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f35639 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8fc expref: 14 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.950072:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1267:0x0].0x0 (ffff9090cc088900) 00010000:00010000:0.0:1787508723.950074:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787508723.950077:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5000, rc 0) 00000100:00100000:0.0:1787508723.950151:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:341770:x1874324509619584:12345-192.168.201.30@tcp:101:dd.0 Request processed in 996us (1341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508723.950159:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94112 00000100:00100000:3.0:1787508723.952847:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508723.952992:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509619840 00000100:00100000:0.0:1787508723.953006:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509619840 00000100:00100000:0.0:1787508723.953087:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94113 00000100:00100000:0.0:1787508723.953097:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:341770:x1874324509619840:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1787508723.953117:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508723.953138:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35640 lrc: 2/0,0 mode: --/CW res: [0x2000013a4:0x1267:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae903 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.953245:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f35647 lrc: 3/0,1 mode: --/CW res: [0x2000013a4:0x1267:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.953260:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f35647 lrc: 3/0,1 mode: CW/CW res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.953272:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f35647 lrc: 3/0,1 mode: CW/CW res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.953469:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3564e lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.953478:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3564e lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.953485:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3564e lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.954456:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35655 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.954470:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35655 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.954479:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35655 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508723.954524:0:203348:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1787508723.954528:0:203348:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb mtime from disk: 0 -> 1787508724 00000004:00010000:0.0:1787508723.954530:0:203348:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb atime from disk: 0 -> 1787508724 00000004:00010000:0.0:1787508723.954533:0:203348:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb ctime from disk: 0 -> 1787508724 00000004:00010000:0.0:1787508723.954535:0:203348:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:0.0:1787508723.954538:0:203348:0:(mdt_io.c:1552:mdt_lvb2reply()) size 0 00010000:00010000:0.0:1787508723.954544:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f35647 lrc: 4/0,1 mode: CW/CW res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.954565:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f35647 lrc: 4/0,1 mode: CW/CW res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.954571:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f35647 lrc: 3/0,0 mode: CW/CW res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.954577:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f35647 lrc: 4/0,0 mode: CW/CW res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.954582:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508723.954586:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f35647 lrc: 4/0,0 mode: CW/CW res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.954594:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f35647 lrc: 5/0,0 mode: CW/CW res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.954605:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1267:0x0].0x0 (ffff9090cc088900) 00010000:00010000:0.0:1787508723.954608:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508723.954611:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f35647 lrc: 3/0,0 mode: --/CW res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.955490:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f35647 lrc: 0/0,0 mode: --/CW res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508723.955509:0:203348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000190886ec reply state 00000000ddb0cb74 transno 12884944182 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3564e lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.955525:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3564e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.955532:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1267:0x0].0xfe058dd8 (ffff9090d1b2bb00) 00010000:00010000:0.0:1787508723.955536:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787508723.955540:0:203348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787508723.955597:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35640 lrc: 0/0,0 mode: --/CW res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae903 expref: 17 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.955688:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35655 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae903 expref: 16 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508723.955696:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1268:0x0].0x0 (ffff9090d1b2b500) 00010000:00010000:0.0:1787508723.955767:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:0.0:1787508723.955770:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5600, rc 0) 00000100:00100000:0.0:1787508723.955971:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:341770:x1874324509619840:12345-192.168.201.30@tcp:101:dd.0 Request processed in 2874us (3140us total) trans 12884944182 rc 0/0 00000100:00100000:0.0:1787508723.955980:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94113 00000100:00100000:2.0:1787508723.965174:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508723.965280:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509620096 00000100:00100000:3.0:1787508723.965425:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509620096 00000100:00100000:3.0:1787508723.965533:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15455 00000100:00100000:3.0:1787508723.965544:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde33050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:341770:x1874324509620096:12345-192.168.201.30@tcp:35:dd.0 00000100:00100000:3.0:1787508723.965961:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde33050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+18:341770:x1874324509620096:12345-192.168.201.30@tcp:35:dd.0 Request processed in 397us (776us total) trans 12884944183 rc 0/0 00000100:00100000:3.0:1787508723.965969:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15455 00000100:00100000:0.0:1787508723.989770:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508723.989898:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509620224 00000100:00100000:2.0:1787508723.989910:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509620224 00000100:00100000:2.0:1787508723.989999:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94114 00000100:00100000:2.0:1787508723.990011:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:341771:x1874324509620224:12345-192.168.201.30@tcp:101:truncate.0 00010000:00010000:2.0:1787508723.990032:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508723.990053:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35663 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae90a expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.990122:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3566a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.990136:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3566a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.990148:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3566a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508723.990190:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508723.990193:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508723.990233:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3566a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.990258:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35663 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae90a expref: 7 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.990275:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3566a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae90a expref: 6 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.990285:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508723.990300:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508723.990305:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa400, rc 0) 00000100:00100000:2.0:1787508723.990381:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:341771:x1874324509620224:12345-192.168.201.30@tcp:101:truncate.0 Request processed in 373us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508723.990388:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94114 00000100:00100000:0.0:1787508723.996494:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508723.996716:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509620352 00000100:00100000:2.0:1787508723.996726:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509620352 00000100:00100000:2.0:1787508723.996782:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94115 00000100:00100000:2.0:1787508723.996792:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:341771:x1874324509620352:12345-192.168.201.30@tcp:101:truncate.0 00010000:00010000:2.0:1787508723.996812:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508723.996831:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35671 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae911 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.996897:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35678 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.996912:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35678 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.996923:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35678 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.996934:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f3567f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.997017:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f3567f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.997024:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f3567f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.997118:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35686 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.997127:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35686 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.997134:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35686 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508723.997168:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1267:0x0]: returning size 4096 00000004:00200000:2.0:1787508723.997172:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508723.997191:0:209004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35686 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.997204:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35678 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.997211:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35678 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.997216:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35678 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.997223:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35678 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.997229:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508723.997232:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35678 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.997239:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35678 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.997251:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508723.997254:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508723.997258:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35678 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.997264:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35678 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.997276:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f3567f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.997282:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f3567f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.997300:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f3567f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.997305:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508723.997308:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f3567f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.997313:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f3567f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.997460:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe6771fd0 (ffff9090cc088700) 00010000:00010000:2.0:1787508723.997462:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508723.997528:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f3567f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.997536:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f3567f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.997578:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35671 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae911 expref: 8 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.997591:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35686 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae911 expref: 7 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508723.997598:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1267:0x0].0x0 (ffff9090cc088900) 00010000:00010000:2.0:1787508723.997600:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787508723.997602:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa000, rc 0) 00000100:00100000:2.0:1787508723.997795:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:341771:x1874324509620352:12345-192.168.201.30@tcp:101:truncate.0 Request processed in 1003us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508723.997804:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94115 00000100:00100000:0.0:1787508724.004310:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508724.004411:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509620480 00000100:00100000:2.0:1787508724.004422:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509620480 00000100:00100000:2.0:1787508724.004516:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94116 00000100:00100000:2.0:1787508724.004529:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:341771:x1874324509620480:12345-192.168.201.30@tcp:101:truncate.0 00010000:00010000:2.0:1787508724.004566:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508724.004596:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f3568d lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae918 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.004876:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f35694 lrc: 3/1,0 mode: --/CR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.004892:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f35694 lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.004902:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f35694 lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.004911:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3569b lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.004916:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3569b lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.004920:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3569b lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.005049:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f356a2 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1268:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.005058:0:202226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35655 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae903 expref: 17 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.005064:0:202226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f356a2 lrc: 4/1,0 mode: --/PR res: [0x2000013a4:0x1268:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.005101:0:202226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35655 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae903 expref: 17 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.005115:0:202226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35655 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae903 expref: 17 pid: 203348 timeout: 13795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508724.005128:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480199936:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508724.005214:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d45343c0 going to sleep for 11 seconds 00000100:00080000:1.0:1787508724.005276:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787508724.011300:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508724.012818:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509620608 00000100:00100000:1.0:1787508724.012841:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509620608 00010000:00010000:1.0:1787508724.012961:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35655 lrc: 5/0,0 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae903 expref: 18 pid: 203348 timeout: 13795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508724.013011:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27941 00000100:00100000:1.0:1787508724.013022:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+18:2401:x1874324509620608:12345-192.168.201.30@tcp:102:ldlm_bl.0 00010000:00010000:1.0:1787508724.013042:0:229383:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35655 lrc: 5/0,0 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae903 expref: 18 pid: 203348 timeout: 13795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508724.013056:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35655 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae903 expref: 18 pid: 203348 timeout: 13795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508724.013070:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35655 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x48/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae903 expref: 18 pid: 203348 timeout: 13795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508724.013079:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1268:0x0].0x0 (ffff9090d1b2b500) 00010000:00010000:1.0:1787508724.013082:0:229383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:1.0:1787508724.013086:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f356a2 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1268:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508724.013097:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f356a2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1268:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508724.013104:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f356a2 lrc: 4/1,0 mode: PR/PR res: [0x2000013a4:0x1268:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508724.013134:0:229383:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35655 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x48/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae903 expref: 18 pid: 203348 timeout: 13795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508724.013219:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+18:2401:x1874324509620608:12345-192.168.201.30@tcp:102:ldlm_bl.0 Request processed in 198us (1934us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508724.013227:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27941 00000100:00080000:3.0:1787508724.014159:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508724.018066:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480199936:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508724.018121:0:202226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f356a2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1268:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.018139:0:202226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f356a2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1268:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.018147:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f356a2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1268:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508724.018227:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508724.018260:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f356a2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1268:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.018611:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f35694 lrc: 4/1,0 mode: CR/CR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.018621:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f35694 lrc: 4/1,0 mode: CR/CR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.018628:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f35694 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.018636:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f35694 lrc: 4/0,0 mode: CR/CR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.018643:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508724.018648:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f35694 lrc: 4/0,0 mode: CR/CR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.018657:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f35694 lrc: 5/0,0 mode: CR/CR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.018678:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1267:0x0].0x0 (ffff9090cc088900) 00010000:00010000:2.0:1787508724.018682:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508724.018689:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f35694 lrc: 3/0,0 mode: --/CR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.018700:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f35694 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.018718:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3569b lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.018724:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3569b lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.018730:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3569b lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.018735:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508724.018738:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3569b lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.018743:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3569b lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.018752:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1267:0x0].0xfe058dd8 (ffff9090d1b2bb00) 00010000:00010000:2.0:1787508724.018755:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508724.018758:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3569b lrc: 2/0,0 mode: --/PR res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.018764:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3569b lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.018807:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f3568d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae918 expref: 9 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.018830:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f356a2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1268:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae918 expref: 8 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.018838:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1268:0x0].0x0 (ffff9090d1b2b500) 00010000:00010000:2.0:1787508724.018840:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508724.018843:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa600, rc 0) 00000100:00100000:2.0:1787508724.019064:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:341771:x1874324509620480:12345-192.168.201.30@tcp:101:truncate.0 Request processed in 14536us (14766us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508724.019075:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94116 00000100:00100000:0.0:1787508724.029066:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508724.029210:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509620864 00000100:00100000:3.0:1787508724.029224:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509620864 00000100:00100000:3.0:1787508724.029342:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94117 00000100:00100000:3.0:1787508724.029355:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:341771:x1874324509620864:12345-192.168.201.30@tcp:36:truncate.0 00010000:00010000:3.0:1787508724.029425:0:203348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508724.029458:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f356a2 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1268:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae918 expref: 8 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.029492:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1268:0x0].0x0 (ffff9090d1b2b500) 00010000:00010000:3.0:1787508724.029498:0:203348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508724.029597:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f356a9 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.029615:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f356a9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.029624:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f356a9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508724.029766:0:203348:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:3.0:1787508724.029770:0:203348:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb mtime from disk: 1787508724 -> 1787508724 00000004:00010000:3.0:1787508724.029772:0:203348:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb atime from disk: 1787508724 -> 1787508724 00000004:00010000:3.0:1787508724.029775:0:203348:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb ctime from disk: 1787508724 -> 1787508724 00000004:00010000:3.0:1787508724.029788:0:203348:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:3.0:1787508724.029797:0:203348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed384a24 reply state 000000002c716ed4 transno 12884944184 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f356a9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.029812:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f356a9 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1268:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.029818:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1268:0x0].0x0 (ffff9090d1b2b500) 00010000:00010000:3.0:1787508724.029821:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508724.029824:0:203348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787508724.029988:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:341771:x1874324509620864:12345-192.168.201.30@tcp:36:truncate.0 Request processed in 635us (936us total) trans 12884944184 rc 0/0 00000100:00100000:3.0:1787508724.029996:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94117 00000100:00100000:0.0:1787508724.032695:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508724.032813:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509620992 00000100:00100000:2.0:1787508724.032824:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509620992 00000100:00100000:2.0:1787508724.032912:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94118 00000100:00100000:2.0:1787508724.032924:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:341771:x1874324509620992:12345-192.168.201.30@tcp:101:truncate.0 00010000:00010000:2.0:1787508724.032978:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508724.033001:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f356b0 lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x1268:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae91f expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.033077:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f356b0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x1268:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae91f expref: 10 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.033092:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f356b0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x1268:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae91f expref: 10 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.033113:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1268:0x0].0x0 (ffff9090d1b2b500) 00010000:00010000:2.0:1787508724.033117:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787508724.033123:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab400, rc 0) 00000100:00100000:2.0:1787508724.033191:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:341771:x1874324509620992:12345-192.168.201.30@tcp:101:truncate.0 Request processed in 269us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508724.033199:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94118 00000100:00100000:1.0:1787508724.036064:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508724.036208:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509621120 00000100:00100000:2.0:1787508724.036222:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509621120 00000100:00100000:2.0:1787508724.036303:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94119 00000100:00100000:2.0:1787508724.036316:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:341771:x1874324509621120:12345-192.168.201.30@tcp:101:truncate.0 00010000:00010000:2.0:1787508724.036344:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508724.036375:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f356b7 lrc: 2/0,0 mode: --/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae926 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.036413:0:209004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35655 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x48/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae903 expref: 17 pid: 203348 timeout: 13795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.036426:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f356b7 lrc: 4/0,0 mode: --/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae926 expref: 11 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.036578:0:209004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35655 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x48/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae903 expref: 17 pid: 203348 timeout: 13795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.036598:0:209004:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35655 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x48/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae903 expref: 17 pid: 203348 timeout: 13795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508724.036616:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999e300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480200064:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508724.036764:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d45343c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787508724.049282:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508724.049364:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999e300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480200064:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508724.049424:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f356b7 lrc: 3/0,0 mode: --/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae926 expref: 11 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.049451:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1268:0x0].0x0 (ffff9090d1b2b500) 00010000:00010000:2.0:1787508724.049455:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787508724.049461:0:209004:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 6 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f356b7 lrc: 3/0,0 mode: --/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae926 expref: 11 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.049489:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab200, rc 0) 00000100:00100000:2.0:1787508724.049591:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:341771:x1874324509621120:12345-192.168.201.30@tcp:101:truncate.0 Request processed in 13276us (13539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508724.049602:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94119 00000100:00100000:3.0:1787508724.050336:0:202239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509621248 00000100:00100000:3.0:1787508724.050350:0:202239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509621248 00002000:00100000:3.0:1787508724.050418:0:202239:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x2000013a4:0x1268:0x0] req@ffff9090d2d3fb80 x1874324509621248/t0(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:334/0 lens 12488/0 e 0 to 0 dl 1787508889 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787508724.050430:0:202239:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9090d2d3fb80 with x1874324509621248 00010000:00010000:3.0:1787508724.050439:0:202239:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 205s. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35655 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x48/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae903 expref: 18 pid: 203348 timeout: 13795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.050456:0:202239:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 205s ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35655 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x48/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae903 expref: 18 pid: 203348 timeout: 13900 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787508724.050477:0:202239:0:(mdt_io.c:157:mdt_rw_hpreq_check()) lustre-MDT0000: refreshed 1 locks timeout for req ffff9090d2d3fb80 00000100:00100000:3.0:1787508724.050517:0:202239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:3.0:1787508724.050529:0:202239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+18:2400:x1874324509621248:12345-192.168.201.30@tcp:4:dd.0 00000004:00010000:0.0:1787508724.056042:0:202239:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb size from disk: 0 -> 12000 00000004:00010000:0.0:1787508724.056054:0:202239:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb mtime from disk: 1787508724 -> 1787508724 00000004:00010000:0.0:1787508724.056056:0:202239:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb atime from disk: 1787508724 -> 1787508724 00000004:00010000:0.0:1787508724.056058:0:202239:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb ctime from disk: 1787508724 -> 1787508724 00000004:00010000:0.0:1787508724.056060:0:202239:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb blocks from disk: 0 -> 24 00000100:00100000:0.0:1787508724.056133:0:202239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:2400:x1874324509621248:12345-192.168.201.30@tcp:4:dd.0 Request processed in 5600us (6858us total) trans 12884944185 rc 0/0 00000100:00100000:0.0:1787508724.056146:0:202239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00002000:00100000:0.0:1787508724.056159:0:202239:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_000: refresh rw locks for [0x2000013a4:0x1268:0x0] req@ffff9090d2d3fb80 x1874324509621248/t12884944185(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:334/0 lens 12488/448 e 0 to 0 dl 1787508889 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787508724.056170:0:202239:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9090d2d3fb80 with x1874324509621248 00010000:00010000:0.0:1787508724.056179:0:202239:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 205s. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35655 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x48/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae903 expref: 20 pid: 203348 timeout: 13900 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508724.056277:0:202239:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 205s ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35655 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x48/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae903 expref: 20 pid: 203348 timeout: 13900 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787508724.056286:0:202239:0:(mdt_io.c:157:mdt_rw_hpreq_check()) lustre-MDT0000: refreshed 1 locks timeout for req ffff9090d2d3fb80 00000100:00100000:0.0:1787508724.068381:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508724.068521:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509621376 00000100:00100000:2.0:1787508724.068535:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509621376 00010000:00010000:2.0:1787508724.068601:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35655 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x48/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae903 expref: 20 pid: 203348 timeout: 13900 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508724.071442:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27942 00000100:00100000:2.0:1787508724.071826:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:2402:x1874324509621376:12345-192.168.201.30@tcp:102:ldlm_bl.0 00010000:00010000:2.0:1787508724.071865:0:205406:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35655 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x48/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae903 expref: 20 pid: 203348 timeout: 13900 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.071886:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35655 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x48/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae903 expref: 20 pid: 203348 timeout: 13900 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.071901:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35655 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae903 expref: 20 pid: 203348 timeout: 13900 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.071917:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1268:0x0].0x0 (ffff9090d1b2b500) 00010000:00010000:2.0:1787508724.071920:0:205406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 48 00010000:00010000:2.0:1787508724.071926:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 6 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f356b7 lrc: 2/0,0 mode: --/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae926 expref: 10 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.071937:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f356b7 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae926 expref: 10 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.071972:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f356b7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae926 expref: 10 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.072024:0:205406:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f356b7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae926 expref: 10 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508724.072041:0:205406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:205406:1874324480200192:192.168.201.30@tcp:105: 00000100:00100000:2.0:1787508724.072149:0:205406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d45343c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787508724.075931:0:205406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:205406:1874324480200192:192.168.201.30@tcp:105: 00010000:00010000:2.0:1787508724.076019:0:205406:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35655 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae903 expref: 20 pid: 203348 timeout: 13900 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508724.076098:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:2402:x1874324509621376:12345-192.168.201.30@tcp:102:ldlm_bl.0 Request processed in 4640us (7731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508724.076113:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27942 00000100:00100000:0.0:1787508724.080182:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508724.080360:0:202240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509621504 00000100:00100000:1.0:1787508724.080374:0:202240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509621504 00002000:00010000:1.0:1787508724.080435:0:202240:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x2000013a4:0x1268:0x0] 00002000:00100000:1.0:1787508724.080442:0:202240:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9090d2d3d500 with x1874324509621504 00000100:00100000:1.0:1787508724.080735:0:202240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7755 00000100:00100000:1.0:1787508724.080749:0:202240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2401:x1874324509621504:12345-192.168.201.30@tcp:10:truncate.0 00000004:00010000:1.0:1787508724.082782:0:202240:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb size from disk: 12000 -> 6000 00000004:00010000:1.0:1787508724.082793:0:202240:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb mtime from disk: 1787508724 -> 1787508724 00000004:00010000:1.0:1787508724.082796:0:202240:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb atime from disk: 1787508724 -> 1787508724 00000004:00010000:1.0:1787508724.082799:0:202240:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb ctime from disk: 1787508724 -> 1787508724 00000004:00010000:1.0:1787508724.082801:0:202240:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb blocks from disk: 24 -> 16 00000100:00100000:1.0:1787508724.082898:0:202240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2401:x1874324509621504:12345-192.168.201.30@tcp:10:truncate.0 Request processed in 2147us (2726us total) trans 12884944186 rc 0/0 00000100:00100000:1.0:1787508724.082908:0:202240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7755 00002000:00010000:1.0:1787508724.082914:0:202240:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x2000013a4:0x1268:0x0] 00002000:00100000:1.0:1787508724.082917:0:202240:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9090d2d3d500 with x1874324509621504 00000100:00100000:0.0:1787508724.115261:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508724.115423:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509621632 00000100:00100000:3.0:1787508724.115434:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509621632 00000100:00100000:3.0:1787508724.115516:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9815 00000100:00100000:3.0:1787508724.115528:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9f1b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:288263:x1874324509621632:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508724.115544:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787508724.115583:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35655 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae903 expref: 20 pid: 203348 timeout: 13900 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.115604:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1268:0x0].0x0 (ffff9090d1b2b500) 00010000:00010000:3.0:1787508724.115614:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f35639 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8fc expref: 19 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.115631:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1267:0x0].0x0 (ffff9090cc088900) 00010000:00010000:3.0:1787508724.115640:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3561d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8f5 expref: 18 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.115648:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508724.115651:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508724.115709:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9f1b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:288263:x1874324509621632:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 183us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508724.115717:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9815 00000100:00100000:0.0:1787508724.117282:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508724.117451:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509621760 00000100:00100000:1.0:1787508724.117459:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509621760 00000100:00100000:1.0:1787508724.117647:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9816 00000100:00100000:1.0:1787508724.117658:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:288110:x1874324509621760:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508724.117672:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1787508724.117715:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f356b7 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae926 expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508724.117737:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f356b0 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1268:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae91f expref: 11 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508724.117748:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1268:0x0].0x0 (ffff9090d1b2b500) 00010000:00010000:1.0:1787508724.117758:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35686 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae911 expref: 10 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508724.117767:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1267:0x0].0x0 (ffff9090cc088900) 00010000:00010000:1.0:1787508724.117776:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3566a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae90a expref: 9 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508724.117784:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508724.117788:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508724.117843:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:288110:x1874324509621760:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 187us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508724.117850:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9816 00000100:00100000:0.0:1787508724.226934:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508724.227498:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509621888 00000100:00100000:2.0:1787508724.227518:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509621888 00000100:00100000:2.0:1787508724.227595:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94120 00000100:00100000:2.0:1787508724.227606:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4855500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:341780:x1874324509621888:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1787508724.227642:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508724.227664:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f356be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae92d expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.227728:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f356c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.227742:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f356c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.227753:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f356c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508724.227799:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508724.227803:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508724.227825:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f356c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.227849:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f356be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae92d expref: 19 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.227867:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f356c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae92d expref: 18 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.227877:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508724.227880:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508724.227884:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aba00, rc 0) 00000100:00100000:2.0:1787508724.227969:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4855500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+18:341780:x1874324509621888:12345-192.168.201.30@tcp:101:bash.0 Request processed in 335us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508724.227977:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94120 00000100:00100000:0.0:1787508724.231993:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508724.232130:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509622016 00000100:00100000:3.0:1787508724.232140:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509622016 00000100:00100000:3.0:1787508724.232220:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94121 00000100:00100000:3.0:1787508724.232231:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+18:341780:x1874324509622016:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1787508724.232251:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508724.232272:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f356cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae934 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.232444:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f356d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.232458:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f356d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.232481:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f356d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.232493:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f356da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.232500:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f356da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.232507:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f356da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.232608:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f356e1 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.232616:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f356e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.232693:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f356e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508724.232727:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1267:0x0]: returning size 4096 00000004:00200000:3.0:1787508724.232731:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508724.232751:0:203348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f356e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.232766:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f356d3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.232773:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f356d3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.232779:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f356d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.232786:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f356d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.232792:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508724.232796:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f356d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.232803:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f356d3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.232815:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508724.232818:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508724.232823:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f356d3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.232830:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f356d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.232841:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f356da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.232847:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f356da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.232853:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f356da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.232857:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fa00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508724.232860:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f356da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.232867:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f356da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.232874:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe6771fd0 (ffff9090cc088700) 00010000:00010000:3.0:1787508724.232876:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508724.232878:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f356da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.232884:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f356da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.232909:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f356cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae934 expref: 20 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.232922:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f356e1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae934 expref: 19 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508724.232929:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1267:0x0].0x0 (ffff9090cc088900) 00010000:00010000:3.0:1787508724.232931:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787508724.232933:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ea00, rc 0) 00000100:00100000:3.0:1787508724.233712:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+19:341780:x1874324509622016:12345-192.168.201.30@tcp:101:bash.0 Request processed in 1478us (1723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508724.233724:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94121 00000100:00100000:1.0:1787508724.237145:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508724.237473:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509622272 00000100:00100000:2.0:1787508724.237485:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509622272 00000100:00100000:2.0:1787508724.237638:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94122 00000100:00100000:2.0:1787508724.237649:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+19:341780:x1874324509622272:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1787508724.237669:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508724.237689:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f356e8 lrc: 2/0,0 mode: --/CW res: [0x2000013a4:0x1267:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae93b expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.237822:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f356ef lrc: 3/1,0 mode: --/CR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.237837:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f356ef lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.237848:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f356ef lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.237860:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f356f6 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.237868:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f356f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.237874:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f356f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.237932:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f356fd lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.237978:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f356fd lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.237985:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f356fd lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508724.238078:0:230618:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb size from disk: 6000 -> 6000 00000004:00010000:2.0:1787508724.238082:0:230618:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb mtime from disk: 1787508724 -> 1787508724 00000004:00010000:2.0:1787508724.238085:0:230618:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb atime from disk: 1787508724 -> 1787508724 00000004:00010000:2.0:1787508724.238087:0:230618:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb ctime from disk: 1787508724 -> 1787508724 00000004:00010000:2.0:1787508724.238089:0:230618:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb blocks from disk: 16 -> 16 00002000:00010000:2.0:1787508724.238092:0:230618:0:(mdt_io.c:1552:mdt_lvb2reply()) size 6000 00010000:00010000:2.0:1787508724.238099:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f356ef lrc: 4/1,0 mode: CR/CR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.238105:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f356ef lrc: 4/1,0 mode: CR/CR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.238111:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f356ef lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.238117:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f356ef lrc: 4/0,0 mode: CR/CR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.238123:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508724.238128:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f356ef lrc: 4/0,0 mode: CR/CR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.238135:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f356ef lrc: 5/0,0 mode: CR/CR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.238151:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1267:0x0].0x0 (ffff9090cc088900) 00010000:00010000:2.0:1787508724.238154:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508724.238158:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f356ef lrc: 3/0,0 mode: --/CR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.238164:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f356ef lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.238176:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f356f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.238182:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f356f6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.238187:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f356f6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.238193:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508724.238195:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f356f6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.238201:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f356f6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.238209:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1267:0x0].0xfe058dd8 (ffff9090d1b2bb00) 00010000:00010000:2.0:1787508724.238211:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508724.238215:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f356f6 lrc: 2/0,0 mode: --/PR res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.238221:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f356f6 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.238302:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f356e8 lrc: 0/0,0 mode: --/CW res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae93b expref: 22 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.238316:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f356fd lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae93b expref: 21 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.238323:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1268:0x0].0x0 (ffff9090d1b2b500) 00010000:00010000:2.0:1787508724.238326:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:2.0:1787508724.238328:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aae00, rc 0) 00000100:00100000:2.0:1787508724.238396:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+21:341780:x1874324509622272:12345-192.168.201.30@tcp:101:bash.0 Request processed in 737us (1248us total) trans 12884944187 rc 0/0 00000100:00100000:2.0:1787508724.238404:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94122 00000100:00100000:0.0:1787508724.265925:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508724.266176:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509622400 00000100:00100000:2.0:1787508724.266188:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509622400 00000100:00100000:2.0:1787508724.266252:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94123 00000100:00100000:2.0:1787508724.266263:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+21:341780:x1874324509622400:12345-192.168.201.30@tcp:101:cat.0 00010000:00010000:2.0:1787508724.266288:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508724.266310:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f3570b lrc: 2/0,0 mode: --/PR res: [0x2000013a4:0x1268:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae942 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.266346:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f35712 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1268:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.266362:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f35712 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1268:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.266373:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f35712 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1268:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.266785:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f3570b lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1268:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae942 expref: 23 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.266805:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f35712 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1268:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae942 expref: 22 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508724.266814:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1268:0x0].0x0 (ffff9090d1b2b500) 00010000:00010000:2.0:1787508724.266816:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787508724.266821:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abc00, rc 0) 00000100:00100000:2.0:1787508724.266892:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+22:341780:x1874324509622400:12345-192.168.201.30@tcp:101:cat.0 Request processed in 631us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508724.266900:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94123 00010000:00010000:1.0:1787508724.285800:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508724.295268:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508724.295350:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509622656 00000100:00100000:3.0:1787508724.295362:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509622656 00000100:00100000:3.0:1787508724.295435:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15456 00000100:00100000:3.0:1787508724.295446:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+22:341780:x1874324509622656:12345-192.168.201.30@tcp:35:cat.0 00000100:00100000:3.0:1787508724.295722:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+23:341780:x1874324509622656:12345-192.168.201.30@tcp:35:cat.0 Request processed in 277us (462us total) trans 12884944188 rc 0/0 00000100:00100000:3.0:1787508724.295730:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15456 00000100:00100000:0.0:1787508724.923824:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787508724.923848:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480200320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787508724.923923:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508724.924836:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787508724.924852:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480200448:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787508724.924894:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508724.925142:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480200320 00000100:00100000:2.0:1787508724.925151:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480200320 00000100:00100000:2.0:1787508724.925211:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480200448 00000100:00100000:2.0:1787508724.925214:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480200448 00000100:00100000:2.0:1787508724.925236:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1711 00000100:00100000:2.0:1787508724.925245:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480200320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787508724.925285:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 41194048 pending 0 free 3909767168 avail 3678244864 00000100:00080000:3.0:1787508724.925442:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508724.925875:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1712 00000100:00100000:1.0:1787508724.925888:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480200448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787508724.925903:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 41194048 pending 0 free 3909767168 avail 3678244864 00000100:00100000:1.0:1787508724.926074:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480200448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 190us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508724.926081:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1712 00000100:00100000:2.0:1787508724.930255:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480200320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1063us (2384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508724.930274:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1711 00000100:00100000:1.0:1787508724.930466:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480200320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787508724.931100:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480200448:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787508725.306203:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508725.947266:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480200576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787508725.947374:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508725.948302:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480200704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787508725.948363:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508725.948482:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480200576 00000100:00100000:0.0:1787508725.948493:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480200576 00000100:00100000:0.0:1787508725.948569:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480200704 00000100:00100000:0.0:1787508725.948573:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480200704 00000100:00100000:0.0:1787508725.948601:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29890 00000100:00100000:0.0:1787508725.948611:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:3619:x1874324480200576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787508725.948659:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7462912 pending 36864 free 1440694272 avail 1294454784 00000100:00100000:0.0:1787508725.948723:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:3619:x1874324480200576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (1349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508725.948730:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29890 00000100:00100000:0.0:1787508725.948749:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29891 00000100:00100000:0.0:1787508725.948756:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480200704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787508725.948775:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442766848 avail 1296527360 00000100:00100000:0.0:1787508725.948807:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480200704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508725.948813:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29891 00000100:00100000:1.0:1787508725.948917:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480200704:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787508725.949063:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480200576:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787508726.330348:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508726.460473:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480200960:0@lo:400:kworker.0 00000100:00100000:3.0:1787508726.460584:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508726.460634:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480201472:0@lo:400:kworker.0 00000100:00100000:3.0:1787508726.460656:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508726.460671:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874324480201984:0@lo:400:kworker.0 00000100:00100000:2.0:1787508726.460868:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79de3f65-4bad-42d0-a46f-842a654b33a0:3617:1874324480200832:0@lo:400:kworker.0 00000100:00100000:3.0:1787508726.461012:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508726.461049:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787508726.461056:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480201088:0@lo:400:kworker.0 00000100:00100000:3.0:1787508726.461083:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508726.461154:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508726.461190:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480201216:0@lo:400:kworker.0 00000100:00100000:1.0:1787508726.461235:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508726.461262:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874324480201344:0@lo:400:kworker.0 00000100:00100000:1.0:1787508726.461279:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480201728:0@lo:400:kworker.0 00000100:00100000:1.0:1787508726.461316:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508726.461343:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480202240:0@lo:400:kworker.0 00000100:00100000:2.0:1787508726.461351:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508726.461392:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480201856:0@lo:400:kworker.0 00000100:00100000:1.0:1787508726.461394:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508726.461441:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508726.461465:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480200960 00000100:00100000:1.0:1787508726.461478:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480200960 00000100:00100000:2.0:1787508726.461493:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480202368:0@lo:400:kworker.0 00000100:00100000:2.0:1787508726.461537:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508726.461561:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480201472 00000100:00100000:1.0:1787508726.461567:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480201472 00000100:00100000:1.0:1787508726.461604:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29892 00000100:00100000:2.0:1787508726.461614:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480200832 00000100:00100000:1.0:1787508726.461617:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480200960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508726.461626:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480200832 00000100:00100000:2.0:1787508726.461693:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1787508726.461706:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fccc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3617:x1874324480200832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508726.461716:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480200960:12345-0@lo:400:kworker.0 Request processed in 98us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508726.461725:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29892 00000100:00100000:1.0:1787508726.461752:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29893 00000100:00100000:1.0:1787508726.461764:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3618:x1874324480201472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508726.461785:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fccc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3617:x1874324480200832:12345-0@lo:400:kworker.0 Request processed in 81us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508726.461810:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:1.0:1787508726.461817:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3618:x1874324480201472:12345-0@lo:400:kworker.0 Request processed in 54us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508726.461826:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29893 00000100:00100000:1.0:1787508726.461854:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480201088 00000100:00100000:1.0:1787508726.461858:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480201088 00000100:00100000:2.0:1787508726.461865:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480201984 00000100:00100000:2.0:1787508726.461872:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480201984 00000100:00100000:1.0:1787508726.461917:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480201216 00000100:00100000:1.0:1787508726.461923:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480201216 00000100:00100000:2.0:1787508726.461972:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480201344 00000100:00100000:2.0:1787508726.461979:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480201344 00000100:00100000:1.0:1787508726.461987:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480201728 00000100:00100000:1.0:1787508726.461994:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480201728 00000100:00100000:2.0:1787508726.462017:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480202240 00000100:00100000:2.0:1787508726.462023:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480202240 00000100:00100000:1.0:1787508726.462033:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2426 00000100:00100000:1.0:1787508726.462045:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480201088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508726.462053:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480201856 00000100:00100000:2.0:1787508726.462060:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480201856 00000100:00100000:2.0:1787508726.462087:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480202368 00000100:00100000:2.0:1787508726.462091:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480202368 00000100:00100000:1.0:1787508726.462096:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480201088:12345-0@lo:400:kworker.0 Request processed in 54us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508726.462106:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2426 00000100:00100000:2.0:1787508726.462120:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3062 00000100:00100000:1.0:1787508726.462127:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2427 00000100:00100000:2.0:1787508726.462133:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874324480201984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508726.462143:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480201216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508726.462218:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874324480201984:12345-0@lo:400:kworker.0 Request processed in 88us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508726.462226:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3062 00000100:00100000:2.0:1787508726.462245:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3063 00000100:00100000:2.0:1787508726.462253:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874324480201344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508726.462291:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874324480201344:12345-0@lo:400:kworker.0 Request processed in 40us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508726.462297:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3063 00000100:00100000:2.0:1787508726.462308:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3064 00000100:00100000:2.0:1787508726.462315:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480202240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508726.462343:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480202240:12345-0@lo:400:kworker.0 Request processed in 29us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508726.462349:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3064 00000100:00100000:2.0:1787508726.462361:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3065 00000100:00100000:1.0:1787508726.462372:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480201216:12345-0@lo:400:kworker.0 Request processed in 232us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508726.462373:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480201856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508726.462397:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2427 00000100:00100000:1.0:1787508726.462418:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2428 00000100:00100000:2.0:1787508726.462438:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480201856:12345-0@lo:400:kworker.0 Request processed in 60us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508726.462438:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480201728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508726.462456:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3065 00000100:00100000:2.0:1787508726.462477:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3066 00000100:00100000:2.0:1787508726.462488:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480202368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508726.462498:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480201728:12345-0@lo:400:kworker.0 Request processed in 70us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508726.462508:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2428 00000100:00100000:2.0:1787508726.462548:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480202368:12345-0@lo:400:kworker.0 Request processed in 61us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508726.462558:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3066 00000100:00100000:1.0:1787508726.462615:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480201216:0@lo:400:kworker.0 00000100:00100000:1.0:1787508726.462642:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480201728:0@lo:400:kworker.0 00000100:00100000:2.0:1787508726.462649:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79de3f65-4bad-42d0-a46f-842a654b33a0:3617:1874324480200832:0@lo:400:kworker.0 00000100:00100000:1.0:1787508726.462663:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480202240:0@lo:400:kworker.0 00000100:00100000:2.0:1787508726.462675:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874324480201344:0@lo:400:kworker.0 00000100:00100000:2.0:1787508726.462692:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480201856:0@lo:400:kworker.0 00000100:00100000:2.0:1787508726.462701:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480202368:0@lo:400:kworker.0 00000100:00080000:2.0:1787508726.462776:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787508726.462780:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787508726.462783:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787508726.462785:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787508726.464931:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480201600:0@lo:400:kworker.0 00000100:00100000:3.0:1787508726.465053:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508726.468017:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874324480202112:0@lo:400:kworker.0 00000100:00100000:3.0:1787508726.468113:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508726.468191:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480200960:0@lo:400:kworker.0 00000100:00100000:3.0:1787508726.468209:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480201472:0@lo:400:kworker.0 00000100:00100000:3.0:1787508726.468225:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874324480201984:0@lo:400:kworker.0 00000100:00100000:3.0:1787508726.468288:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480201088:0@lo:400:kworker.0 00000100:00100000:2.0:1787508726.468529:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480202112 00000100:00100000:2.0:1787508726.468539:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480202112 00000100:00100000:2.0:1787508726.468642:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3067 00000100:00100000:2.0:1787508726.468653:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874324480202112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508726.468737:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874324480202112:12345-0@lo:400:kworker.0 Request processed in 86us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508726.468746:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3067 00000100:00080000:3.0:1787508726.470617:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787508726.470703:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874324480202112:0@lo:400:kworker.0 00000100:00100000:1.0:1787508726.475084:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480201600 00000100:00100000:1.0:1787508726.475111:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480201600 00000100:00100000:1.0:1787508726.476935:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2429 00000100:00100000:1.0:1787508726.476979:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480201600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508726.477113:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480201600:12345-0@lo:400:kworker.0 Request processed in 140us (12062us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508726.477121:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2429 00000100:00100000:2.0:1787508726.478912:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480201600:0@lo:400:kworker.0 00000100:00080000:3.0:1787508726.479961:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787508727.354193:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508727.912281:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508727.912373:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509622784 00000100:00100000:3.0:1787508727.912378:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508727.912388:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509622784 00000100:00100000:1.0:1787508727.912470:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1022 00000100:00100000:1.0:1787508727.912483:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fccc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509622784:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508727.912532:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508727.912590:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fccc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509622784:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 108us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508727.912599:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1022 00000100:00100000:1.0:1787508727.912659:0:208927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509623296 00000100:00100000:1.0:1787508727.912663:0:208927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509623296 00000100:00100000:1.0:1787508727.912718:0:208927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2430 00000100:00100000:1.0:1787508727.912726:0:208927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2402:x1874324509623296:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508727.913316:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509623040 00000100:00100000:2.0:1787508727.913326:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509623040 00000100:00100000:2.0:1787508727.913372:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3068 00000100:00100000:2.0:1787508727.913382:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509623040:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508727.914180:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508727.914855:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508727.914888:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508727.915085:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508727.915107:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508727.915128:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508727.919049:0:208927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2402:x1874324509623296:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 6304us (6514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508727.919071:0:208927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2430 00000100:00100000:3.0:1787508727.919076:0:225833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509623808 00000100:00100000:3.0:1787508727.919091:0:225833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509623808 00000100:00100000:1.0:1787508727.919108:0:208927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509623168 00000100:00100000:1.0:1787508727.919114:0:208927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509623168 00000100:00100000:1.0:1787508727.919160:0:208927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509623680 00000100:00100000:1.0:1787508727.919164:0:208927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509623680 00000100:00100000:3.0:1787508727.919183:0:225833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2431 00000100:00100000:3.0:1787508727.919195:0:225833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509623168:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508727.919264:0:225833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509623168:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 72us (4180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508727.919271:0:225833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2431 00000100:00100000:3.0:1787508727.919286:0:225833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2432 00000100:00100000:3.0:1787508727.919292:0:225833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509623808:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508727.919320:0:225833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509623808:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 29us (4469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508727.919326:0:225833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2432 00000100:00100000:3.0:1787508727.923144:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509623552 00000100:00100000:3.0:1787508727.923170:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509623552 00000100:00100000:3.0:1787508727.923314:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509622912 00000100:00100000:3.0:1787508727.923319:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509622912 00000100:00100000:3.0:1787508727.923345:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509623424 00000100:00100000:3.0:1787508727.923348:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509623424 00000100:00100000:3.0:1787508727.923379:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3069 00000100:00100000:3.0:1787508727.923393:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509623552:12345-192.168.201.30@tcp:400:kworker.0 00000100:00080000:1.0:1787508727.923398:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787508727.923406:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787508727.923411:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787508727.923415:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508727.923597:0:208927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2433 00000100:00100000:1.0:1787508727.923609:0:208927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509623680:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508727.923796:0:208927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509623680:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 188us (8664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508727.923805:0:208927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2433 00000100:00100000:1.0:1787508727.924106:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3070 00000100:00100000:1.0:1787508727.924116:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+23:2402:x1874324509622912:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508727.924168:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+23:2402:x1874324509622912:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 53us (9278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508727.924242:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3070 00000100:00100000:1.0:1787508727.924267:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3071 00000100:00100000:1.0:1787508727.924275:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2402:x1874324509623424:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508727.924307:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2402:x1874324509623424:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 34us (9200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508727.924313:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3071 00000100:00100000:2.0:1787508727.926525:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509623040:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 13130us (14169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508727.926543:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3068 00000100:00100000:2.0:1787508727.937673:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509623552:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 14265us (23482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508727.937702:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3069 00010000:00010000:1.0:1787508728.392652:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508728.509676:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480202496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787508728.509754:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508728.509816:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480202496 00000100:00100000:2.0:1787508728.509824:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480202496 00000100:00100000:2.0:1787508728.509876:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1713 00000100:00100000:2.0:1787508728.509886:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480202496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787508728.509915:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 131576384 pending 0 free 3881955328 avail 3650433024 00000100:00100000:2.0:1787508728.509977:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480202496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508728.509984:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1713 00000100:00080000:2.0:1787508728.510005:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787508728.510040:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480202496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787508728.518012:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480202624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787508728.518096:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508728.526338:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480202624 00000100:00100000:3.0:1787508728.526355:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480202624 00000100:00100000:3.0:1787508728.526445:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1714 00000100:00100000:3.0:1787508728.526454:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480202624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787508728.526492:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 131576384 pending 0 free 3881955328 avail 3650433024 00000100:00100000:3.0:1787508728.526579:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480202624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (8483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508728.526588:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1714 00000100:00100000:3.0:1787508728.526644:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480202624:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787508728.526971:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1787508729.020056:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944188 is committed 00000001:00080000:2.0:1787508729.020086:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944186 is committed 00010000:00010000:3.0:1787508729.020088:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f355c9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508729.020101:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f355c9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787508729.020106:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944177 is committed 00010000:00010000:3.0:1787508729.020109:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f355c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508729.020115:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508729.020120:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f355c9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508729.020129:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f355c9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508729.020149:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe6771fd0 (ffff9090cc088700) 00010000:00010000:0.0:1787508729.020151:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f356a9 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1268:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508729.020152:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508729.020157:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f355c9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508729.020158:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f356a9 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x1268:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508729.020164:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f355c9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe6771fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508729.020164:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f356a9 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1268:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508729.020170:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ec00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508729.020173:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f356a9 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1268:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508729.020178:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f356a9 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x1268:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508729.020185:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f355d0 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508729.020190:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f355d0 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508729.020192:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1268:0x0].0x0 (ffff9090d1b2b500) 00010000:00010000:0.0:1787508729.020194:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508729.020197:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f355d0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508729.020198:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f356a9 lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x1268:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508729.020202:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ee00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508729.020204:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f356a9 lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x1268:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508729.020205:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f355d0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508729.020211:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f355d0 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508729.020216:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1267:0x0].0x0 (ffff9090cc088900) 00010000:00010000:3.0:1787508729.020218:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508729.020221:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f355d0 lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508729.020226:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f355d0 lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x1267:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508729.020237:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3560f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1267:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508729.020241:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3560f lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x1267:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508729.020245:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3560f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1267:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508729.020248:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508729.020249:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3560f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1267:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508729.020256:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3560f lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x1267:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508729.020261:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1267:0x0].0x0 (ffff9090cc088900) 00010000:00010000:3.0:1787508729.020262:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787508729.020264:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3560f lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x1267:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508729.020267:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3560f lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x1267:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508729.020273:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3564e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508729.020277:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3564e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508729.020281:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3564e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508729.020283:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508729.020285:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3564e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508729.020288:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3564e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508729.020291:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1267:0x0].0xfe058dd8 (ffff9090d1b2bb00) 00010000:00010000:3.0:1787508729.020293:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508729.020294:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3564e lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508729.020298:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3564e lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x1267:0x0].0xfe058dd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508729.402240:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508729.452071:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508729.452183:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508729.452574:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509624064 00000100:00100000:1.0:1787508729.452597:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509624064 00000100:00100000:1.0:1787508729.452675:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94124 00000100:00100000:1.0:1787508729.452688:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2403:x1874324509624064:12345-192.168.201.30@tcp:16:kworker.0 00000100:00100000:1.0:1787508729.452808:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2403:x1874324509624064:12345-192.168.201.30@tcp:16:kworker.0 Request processed in 123us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508729.452817:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94124 00000100:00080000:0.0:1787508729.453019:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508729.454540:0:228420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509623936 00000100:00100000:2.0:1787508729.454555:0:228420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509623936 00002000:00100000:2.0:1787508729.458690:0:228420:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_003: refresh rw locks for [0x2000013a4:0x1268:0x0] req@ffff9091f9a9a300 x1874324509623936/t0(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:185/0 lens 2552/0 e 0 to 0 dl 1787508740 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787508729.458704:0:228420:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9091f9a9a300 with x1874324509623936 00000100:00100000:2.0:1787508729.458753:0:228420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7756 00000100:00100000:2.0:1787508729.458771:0:228420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2403:x1874324509623936:12345-192.168.201.30@tcp:4:cat.0 00000004:00010000:3.0:1787508729.464620:0:228420:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb size from disk: 6000 -> 6158 00000004:00010000:3.0:1787508729.464632:0:228420:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb mtime from disk: 1787508724 -> 1787508724 00000004:00010000:3.0:1787508729.464635:0:228420:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb atime from disk: 1787508724 -> 1787508724 00000004:00010000:3.0:1787508729.464637:0:228420:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb ctime from disk: 1787508724 -> 1787508724 00000004:00010000:3.0:1787508729.464639:0:228420:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x1268:0x0] updating lvb blocks from disk: 16 -> 16 00000100:00100000:3.0:1787508729.464738:0:228420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:2403:x1874324509623936:12345-192.168.201.30@tcp:4:cat.0 Request processed in 5970us (12669us total) trans 12884944189 rc 0/0 00000100:00100000:3.0:1787508729.464751:0:228420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7756 00002000:00100000:3.0:1787508729.464763:0:228420:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_003: refresh rw locks for [0x2000013a4:0x1268:0x0] req@ffff9091f9a9a300 x1874324509623936/t12884944189(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:185/0 lens 2552/448 e 0 to 0 dl 1787508740 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787508729.464772:0:228420:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9091f9a9a300 with x1874324509623936 00000100:00100000:2.0:1787508730.044574:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787508730.044597:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480202752:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787508730.044664:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508730.044729:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480202752 00000100:00100000:2.0:1787508730.044737:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480202752 00000100:00100000:2.0:1787508730.044802:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1715 00000100:00100000:2.0:1787508730.044812:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480202752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787508730.044843:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 41194048 pending 0 free 3909767168 avail 3678244864 00000100:00100000:2.0:1787508730.044886:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480202752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508730.044893:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1715 00000100:00080000:2.0:1787508730.044913:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787508730.044967:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480202752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787508730.051378:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787508730.051400:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480202880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787508730.051503:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508730.051554:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480202880 00000100:00100000:3.0:1787508730.051562:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480202880 00000100:00100000:3.0:1787508730.051618:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1716 00000100:00100000:3.0:1787508730.051627:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480202880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787508730.051649:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 41194048 pending 0 free 3909767168 avail 3678244864 00000100:00100000:3.0:1787508730.051690:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480202880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508730.051697:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1716 00000100:00100000:3.0:1787508730.051748:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480202880:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787508730.051771:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787508730.426700:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508731.067442:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787508731.067466:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480203008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787508731.067535:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508731.067604:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480203136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787508731.067612:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480203008 00000100:00100000:1.0:1787508731.067620:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480203008 00000100:00100000:3.0:1787508731.067627:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508731.067663:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480203136 00000100:00100000:1.0:1787508731.067666:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480203136 00000100:00100000:1.0:1787508731.067684:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29894 00000100:00100000:1.0:1787508731.067694:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480203008:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787508731.067726:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29895 00000004:00000024:1.0:1787508731.067729:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442766848 avail 1296527360 00000100:00100000:3.0:1787508731.067734:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480203136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787508731.067750:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9572352 pending 28672 free 1440694272 avail 1294454784 00000100:00100000:1.0:1787508731.067777:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480203008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508731.067784:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29894 00000100:00100000:3.0:1787508731.067789:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480203136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 45us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508731.067794:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29895 00000100:00100000:3.0:1787508731.067822:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944177 gen 2 00000004:00080000:3.0:1787508731.067828:0:3619:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944177 committed transno 12884944177 00000100:00100000:3.0:1787508731.067855:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480203136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787508731.067870:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480203008:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787508731.452443:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508731.578342:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480203648:0@lo:400:kworker.0 00000100:00100000:3.0:1787508731.578417:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508731.578483:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e61d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480204160:0@lo:400:kworker.0 00000100:00100000:3.0:1787508731.578506:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508731.578530:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787508731.578536:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480203520:0@lo:400:kworker.0 00000100:00100000:3.0:1787508731.578562:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508731.578634:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480203392:0@lo:400:kworker.0 00000100:00100000:1.0:1787508731.578672:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480203648 00000100:00100000:1.0:1787508731.578679:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480203648 00000100:00100000:1.0:1787508731.578722:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480204160 00000100:00100000:1.0:1787508731.578724:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480204160 00000100:00100000:1.0:1787508731.578754:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3072 00000100:00100000:1.0:1787508731.578762:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e61d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480203648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508731.578814:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e61d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480203648:12345-0@lo:400:kworker.0 Request processed in 53us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508731.578822:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3072 00000100:00100000:1.0:1787508731.578837:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3073 00000100:00100000:1.0:1787508731.578843:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e61d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480204160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508731.578868:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e61d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480204160:12345-0@lo:400:kworker.0 Request processed in 25us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508731.578873:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3073 00000100:00080000:1.0:1787508731.578891:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508731.579631:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480203264:0@lo:400:kworker.0 00000100:00100000:2.0:1787508731.579676:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508731.579716:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480203776:0@lo:400:kworker.0 00000100:00100000:0.0:1787508731.579717:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480203264 00000100:00100000:0.0:1787508731.579724:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480203264 00000100:00100000:0.0:1787508731.579808:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:0.0:1787508731.579817:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fccc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480203264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508731.579867:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fccc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480203264:12345-0@lo:400:kworker.0 Request processed in 52us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508731.579874:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00100000:3.0:1787508731.580018:0:208928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480203520 00000100:00100000:3.0:1787508731.580023:0:208928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480203520 00000100:00100000:3.0:1787508731.580061:0:208928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2434 00000100:00100000:3.0:1787508731.580069:0:208928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e61d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480203520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508731.580104:0:208928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e61d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480203520:12345-0@lo:400:kworker.0 Request processed in 37us (1541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508731.580111:0:208928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2434 00000100:00100000:3.0:1787508731.580136:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508731.580158:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e61d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480204288:0@lo:400:kworker.0 00000100:00100000:3.0:1787508731.580181:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508731.580228:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480203264:0@lo:400:kworker.0 00000100:00100000:3.0:1787508731.580257:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480204288 00000100:00100000:3.0:1787508731.580260:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480204288 00000100:00100000:3.0:1787508731.580287:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3074 00000100:00100000:3.0:1787508731.580293:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e61d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480204288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508731.580328:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e61d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480204288:12345-0@lo:400:kworker.0 Request processed in 34us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508731.580334:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3074 00000100:00100000:3.0:1787508731.580360:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e61d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480204288:0@lo:400:kworker.0 00000100:00100000:3.0:1787508731.580387:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480203776 00000100:00100000:3.0:1787508731.580390:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480203776 00000100:00100000:3.0:1787508731.580410:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2435 00000100:00100000:3.0:1787508731.580415:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e61d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480203776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508731.580459:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e61d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480203776:12345-0@lo:400:kworker.0 Request processed in 42us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508731.580465:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2435 00000100:00100000:3.0:1787508731.580492:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480203776:0@lo:400:kworker.0 00000100:00100000:1.0:1787508731.580611:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508731.580652:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480203904:0@lo:400:kworker.0 00000100:00100000:1.0:1787508731.580677:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508731.580694:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e61d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480204416:0@lo:400:kworker.0 00000100:00100000:1.0:1787508731.580713:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787508731.580737:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787508731.580742:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508731.580750:0:230130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480203392 00000100:00100000:1.0:1787508731.580753:0:230130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480203392 00000100:00100000:1.0:1787508731.580777:0:230130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480203904 00000100:00100000:1.0:1787508731.580779:0:230130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480203904 00000100:00100000:1.0:1787508731.580799:0:230130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2436 00000100:00100000:1.0:1787508731.580805:0:230130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480203392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508731.580834:0:230130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480203392:12345-0@lo:400:kworker.0 Request processed in 30us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508731.580840:0:230130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2436 00000100:00100000:1.0:1787508731.580850:0:230130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2437 00000100:00100000:1.0:1787508731.580855:0:230130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480203904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508731.580874:0:230130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480203904:12345-0@lo:400:kworker.0 Request processed in 19us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508731.580879:0:230130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2437 00000100:00080000:1.0:1787508731.580891:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508731.580907:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480203392:0@lo:400:kworker.0 00000100:00100000:1.0:1787508731.580916:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480203904:0@lo:400:kworker.0 00000100:00100000:3.0:1787508731.581046:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480204416 00000100:00100000:3.0:1787508731.581050:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480204416 00000100:00100000:3.0:1787508731.581074:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3075 00000100:00100000:3.0:1787508731.581080:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480204416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508731.581113:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480204416:12345-0@lo:400:kworker.0 Request processed in 33us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508731.581119:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3075 00000100:00080000:1.0:1787508731.581178:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787508731.581196:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e61d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480204416:0@lo:400:kworker.0 00000100:00100000:0.0:1787508731.581298:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480203520:0@lo:400:kworker.0 00000100:00100000:0.0:1787508731.581306:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874324480204032:0@lo:400:kworker.0 00000100:00100000:0.0:1787508731.581329:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508731.581355:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e61d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874324480204544:0@lo:400:kworker.0 00000100:00100000:0.0:1787508731.581374:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508731.581394:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480203648:0@lo:400:kworker.0 00000100:00100000:0.0:1787508731.581405:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e61d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480204160:0@lo:400:kworker.0 00000100:00100000:0.0:1787508731.581439:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480204032 00000100:00100000:0.0:1787508731.581442:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480204032 00000100:00100000:0.0:1787508731.581464:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480204544 00000100:00100000:0.0:1787508731.581467:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480204544 00000100:00100000:0.0:1787508731.581490:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3076 00000100:00100000:0.0:1787508731.581495:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874324480204032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508731.581531:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874324480204032:12345-0@lo:400:kworker.0 Request processed in 35us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508731.581537:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3076 00000100:00100000:0.0:1787508731.581550:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3077 00000100:00100000:0.0:1787508731.581555:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6391500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874324480204544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508731.581578:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6391500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874324480204544:12345-0@lo:400:kworker.0 Request processed in 23us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508731.581583:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3077 00000100:00080000:0.0:1787508731.581596:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787508731.581612:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874324480204032:0@lo:400:kworker.0 00000100:00100000:0.0:1787508731.581620:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e61d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874324480204544:0@lo:400:kworker.0 00000001:02000400:2.0:1787508732.348291:0:233888:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 101a: Discard DoM data on unlink ========= 14:12:11 (1787508731) 00000100:00100000:3.0:1787508732.462158:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508732.462197:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509624192 00000100:00100000:3.0:1787508732.462206:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509624192 00000100:00100000:3.0:1787508732.462262:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94125 00000100:00100000:3.0:1787508732.462273:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e61d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:342362:x1874324509624192:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508732.462295:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508732.462315:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f35719 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae949 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.462376:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35720 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.462390:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35720 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.462402:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35720 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.462431:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35727 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.462439:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35727 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.462445:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35727 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.462500:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35720 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.462507:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35720 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.462513:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35720 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.462519:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35720 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.462525:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00000100:00080000:0.0:1787508732.462528:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787508732.462529:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35720 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.462536:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35720 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.462548:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508732.462551:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508732.462555:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35720 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.462561:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35720 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.462572:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35727 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.462578:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35727 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.462583:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35727 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.462588:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508732.462590:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35727 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.462596:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35727 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.462603:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24502e87 (ffff9090cc088700) 00010000:00010000:3.0:1787508732.462605:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508732.462607:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35727 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.462613:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35727 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.462645:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f35719 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae949 expref: 13 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.462656:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508732.462658:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508732.462662:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f35719 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae949 expref: 13 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.462670:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ee00, rc 0) 00000100:00100000:3.0:1787508732.462735:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e61d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:342362:x1874324509624192:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 463us (585us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508732.462742:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94125 00000100:00100000:3.0:1787508732.476567:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508732.476656:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509624448 00000100:00100000:3.0:1787508732.476665:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509624448 00000100:00100000:3.0:1787508732.476719:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94126 00000100:00100000:3.0:1787508732.476728:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e61d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:342362:x1874324509624448:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508732.476747:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508732.476751:0:202228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787508732.476776:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f356c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae92d expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.476792:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508732.476796:0:202228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508732.476808:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3572e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae950 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.476914:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35735 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.476926:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35735 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.476936:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35735 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.476971:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f3573c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24502e87 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.476978:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f3573c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.476985:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f3573c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.477331:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35743 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.478450:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35743 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.478462:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35743 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508732.478476:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x126a:0x0]: returning size 0 00010000:00010000:3.0:1787508732.478515:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35735 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.478522:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35735 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.478528:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35735 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.478534:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35735 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.478540:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508732.478546:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35735 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.478553:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35735 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.478565:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508732.478568:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508732.478572:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35735 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.478578:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35735 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508732.478807:0:202228:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2017178 reply state 0000000028468de4 transno 12884944190 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f3573c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.478820:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f3573c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.478827:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24502e87 (ffff9090cc088e00) 00010000:00010000:3.0:1787508732.478829:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508732.478832:0:202228:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787508732.478874:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f3572e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae950 expref: 14 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.478903:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35743 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae950 expref: 13 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.478911:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126a:0x0].0x0 (ffff9090cc088f00) 00010000:00010000:3.0:1787508732.478914:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787508732.478916:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fc00, rc 0) 00000100:00100000:3.0:1787508732.479005:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e61d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:342362:x1874324509624448:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 2277us (2445us total) trans 12884944190 rc 0/0 00000100:00100000:3.0:1787508732.479015:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94126 00010000:00010000:2.0:1787508732.480354:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508732.498996:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508732.499317:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509624704 00000100:00100000:1.0:1787508732.499328:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509624704 00000100:00100000:1.0:1787508732.499392:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94127 00000100:00100000:1.0:1787508732.499403:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e61d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:342362:x1874324509624704:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508732.499437:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508732.499534:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35751 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae957 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508732.499740:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35758 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x126a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508732.499758:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35743 lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae950 expref: 15 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508732.499767:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35758 lrc: 4/0,1 mode: --/EX res: [0x2000013a4:0x126a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508732.499797:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35743 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae950 expref: 15 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508732.499810:0:230618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35743 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae950 expref: 15 pid: 202228 timeout: 13803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508732.499822:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce782d80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480204672:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508732.499894:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c966e540 going to sleep for 11 seconds 00000100:00100000:3.0:1787508732.507881:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508732.507989:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce782d80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480204672:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508732.508019:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35758 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x126a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508732.508105:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509624832 00000100:00100000:2.0:1787508732.508114:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509624832 00010000:00010000:2.0:1787508732.508153:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35743 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae950 expref: 16 pid: 202228 timeout: 13803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508732.508193:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27943 00000100:00100000:2.0:1787508732.508203:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e61d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:2403:x1874324509624832:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508732.508218:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508732.508225:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35743 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae950 expref: 16 pid: 202228 timeout: 13803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508732.508239:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35743 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae950 expref: 16 pid: 202228 timeout: 13803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508732.508263:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35743 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae950 expref: 16 pid: 202228 timeout: 13803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508732.508279:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126a:0x0].0x0 (ffff9090cc088f00) 00010000:00010000:2.0:1787508732.508284:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35758 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x126a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508732.508293:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35758 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508732.508299:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35758 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x126a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508732.508317:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508732.508444:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35758 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.508452:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35758 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508732.508471:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x126a:0x0]: returning size 0 00010000:00010000:0.0:1787508732.509582:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35758 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508732.509743:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e61d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:2403:x1874324509624832:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1535us (1860us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508732.509756:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27943 00010000:00010000:0.0:1787508732.510476:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35758 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x126a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.510484:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35758 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x126a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.510491:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508732.510495:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35758 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x126a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.510503:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35758 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x126a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.510518:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126a:0x0].0x0 (ffff9090cc088f00) 00010000:00010000:0.0:1787508732.510521:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787508732.510526:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35758 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x126a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.510533:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35758 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x126a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.510711:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35751 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae957 expref: 15 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.510723:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508732.510726:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508732.510731:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35751 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae957 expref: 15 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.510742:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a000, rc 0) 00000100:00100000:0.0:1787508732.510810:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e61d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:342362:x1874324509624704:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 11408us (11819us total) trans 12884944191 rc 301/301 00000100:00100000:0.0:1787508732.510818:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94127 00000100:00100000:3.0:1787508732.516043:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508732.516083:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509625088 00000100:00100000:3.0:1787508732.516093:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509625088 00000100:00100000:3.0:1787508732.516149:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15457 00000100:00100000:3.0:1787508732.516158:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e61d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:342362:x1874324509625088:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1787508732.516682:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e61d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:342362:x1874324509625088:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 523us (648us total) trans 12884944192 rc 0/0 00000100:00100000:3.0:1787508732.516691:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15457 00000100:00100000:2.0:1787508732.520467:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508732.520530:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509625344 00000100:00100000:0.0:1787508732.520540:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509625344 00000100:00100000:0.0:1787508732.520670:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15458 00000100:00100000:0.0:1787508732.520681:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:342362:x1874324509625344:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1787508732.520904:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:342362:x1874324509625344:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 223us (445us total) trans 12884944193 rc 0/0 00000100:00100000:0.0:1787508732.520912:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15458 00000100:00100000:2.0:1787508732.541268:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508732.541364:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509625472 00000100:00100000:3.0:1787508732.541375:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509625472 00000100:00100000:3.0:1787508732.541454:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94128 00000100:00100000:3.0:1787508732.541465:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:342363:x1874324509625472:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:3.0:1787508732.541490:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508732.541512:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f35766 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae95e expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.541599:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f3576d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.541613:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f3576d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.541627:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f3576d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508732.541672:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508732.541676:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508732.541702:0:205405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f3576d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.541729:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f35766 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae95e expref: 18 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.541750:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f3576d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae95e expref: 17 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.541759:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508732.541762:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508732.541766:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fe00, rc 0) 00000100:00100000:3.0:1787508732.541828:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:342363:x1874324509625472:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 366us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508732.541836:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94128 00000100:00100000:3.0:1787508732.546649:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508732.546768:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509625600 00000100:00100000:0.0:1787508732.546789:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509625600 00000100:00100000:0.0:1787508732.546862:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94129 00000100:00100000:0.0:1787508732.546873:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e61d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:342363:x1874324509625600:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:0.0:1787508732.546894:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508732.546914:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35774 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae965 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.547029:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f3577b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.547045:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f3577b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.547062:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f3577b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.547073:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35782 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.547080:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35782 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.547086:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35782 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.547196:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35789 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.547206:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35789 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.547213:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35789 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508732.547253:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508732.547274:0:203348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35789 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508732.547297:0:203348:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126a:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1787508732.547300:0:203348:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126a:0x0] updating lvb mtime from disk: 0 -> 1787508733 00000004:00010000:0.0:1787508732.547303:0:203348:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126a:0x0] updating lvb atime from disk: 0 -> 1787508733 00000004:00010000:0.0:1787508732.547305:0:203348:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126a:0x0] updating lvb ctime from disk: 0 -> 1787508733 00000004:00010000:0.0:1787508732.547308:0:203348:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126a:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:0.0:1787508732.547313:0:203348:0:(mdt_io.c:1552:mdt_lvb2reply()) size 0 00010000:00010000:0.0:1787508732.547331:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f3577b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.547339:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f3577b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.547346:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f3577b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.547353:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f3577b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.547359:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508732.547364:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f3577b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.547373:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f3577b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.547385:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508732.547388:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508732.547393:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f3577b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.547399:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f3577b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.547422:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35782 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.547429:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35782 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.547440:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35782 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.547446:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508732.547449:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35782 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.547455:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35782 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.547463:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24502e87 (ffff9090cc088e00) 00010000:00010000:0.0:1787508732.547465:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508732.547468:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35782 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.547475:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35782 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.547500:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35774 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae965 expref: 19 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.547513:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35789 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae965 expref: 18 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.547522:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126a:0x0].0x0 (ffff9090d1b2b600) 00010000:00010000:0.0:1787508732.547524:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:0.0:1787508732.547527:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4e00, rc 0) 00000100:00100000:0.0:1787508732.547593:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e61d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+18:342363:x1874324509625600:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 721us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508732.547605:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94129 00000100:00100000:2.0:1787508732.632288:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508732.632388:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509625856 00000100:00100000:3.0:1787508732.632399:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509625856 00000100:00100000:3.0:1787508732.632480:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94130 00000100:00100000:3.0:1787508732.632491:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+18:342366:x1874324509625856:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:2.0:1787508732.633420:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508732.633425:0:202226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787508732.633460:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f3576d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae95e expref: 18 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508732.633481:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508732.633487:0:202226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508732.633504:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f35790 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae96c expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508732.638286:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f35797 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508732.638304:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f35797 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508732.638313:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f35797 lrc: 2/0,0 mode: --/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508732.638320:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f35797 lrc: 3/0,0 mode: --/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508732.638328:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508732.638332:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f35797 lrc: 3/0,0 mode: --/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508732.638340:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f35797 lrc: 4/0,0 mode: --/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508732.638351:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126a:0x0].0x0 (ffff9090d1b2b600) 00010000:00010000:2.0:1787508732.638358:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f35797 lrc: 2/0,0 mode: --/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508732.638364:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f35797 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508732.638516:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f35790 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae96c expref: 19 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508732.638535:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508732.638538:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508732.638542:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f35790 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae96c expref: 19 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508732.638551:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab000, rc 0) 00000100:00100000:2.0:1787508732.638629:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+18:342366:x1874324509625856:12345-192.168.201.30@tcp:101:dd.0 Request processed in 6138us (6350us total) trans 12884944194 rc 301/301 00000100:00100000:2.0:1787508732.638639:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94130 00000100:00100000:2.0:1787508732.643547:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508732.643636:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509625984 00000100:00100000:0.0:1787508732.643649:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509625984 00000100:00100000:0.0:1787508732.643716:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94131 00000100:00100000:0.0:1787508732.643727:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+18:342366:x1874324509625984:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1787508732.643753:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508732.643775:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f357a5 lrc: 2/0,0 mode: --/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae973 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.643812:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f357ac lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.643825:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f357ac lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.643836:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f357ac lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.644003:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f357a5 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae973 expref: 20 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.644021:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f357ac lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae973 expref: 19 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.644031:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126a:0x0].0x0 (ffff9090d1b2b600) 00010000:00010000:0.0:1787508732.644033:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787508732.644037:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4400, rc 0) 00000100:00100000:0.0:1787508732.644106:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+19:342366:x1874324509625984:12345-192.168.201.30@tcp:101:dd.0 Request processed in 368us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508732.644115:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94131 00000100:00100000:3.0:1787508732.651303:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508732.652584:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509626240 00000100:00100000:0.0:1787508732.652597:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509626240 00000100:00100000:0.0:1787508732.652663:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94132 00000100:00100000:0.0:1787508732.652673:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e61d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+19:342366:x1874324509626240:12345-192.168.201.30@tcp:36:dd.0 00010000:00010000:0.0:1787508732.652795:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f357b3 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.652813:0:202227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35789 lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae965 expref: 19 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.652823:0:202227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f357b3 lrc: 4/0,1 mode: --/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.652867:0:202227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35789 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae965 expref: 19 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.652883:0:202227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35789 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae965 expref: 19 pid: 203348 timeout: 13803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508732.652897:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6392680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:202227:1874324480204800:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508732.653003:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3455a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787508732.663272:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508732.669182:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509626368 00000100:00100000:3.0:1787508732.669198:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509626368 00010000:00010000:3.0:1787508732.669255:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35789 lrc: 5/0,0 mode: PR/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae965 expref: 20 pid: 203348 timeout: 13803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508732.669309:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27944 00000100:00100000:3.0:1787508732.669319:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:2400:x1874324509626368:12345-192.168.201.30@tcp:102:ldlm_bl.0 00010000:00010000:3.0:1787508732.669342:0:225839:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35789 lrc: 5/0,0 mode: PR/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae965 expref: 20 pid: 203348 timeout: 13803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.669356:0:225839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35789 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae965 expref: 20 pid: 203348 timeout: 13803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.669368:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35789 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae965 expref: 20 pid: 203348 timeout: 13803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.669377:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126a:0x0].0x0 (ffff9090d1b2b600) 00010000:00010000:3.0:1787508732.669380:0:225839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:3.0:1787508732.669384:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f357b3 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.669393:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f357b3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.669399:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f357b3 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.669433:0:225839:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35789 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae965 expref: 20 pid: 203348 timeout: 13803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508732.669521:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:2400:x1874324509626368:12345-192.168.201.30@tcp:102:ldlm_bl.0 Request processed in 202us (6257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508732.669529:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27944 00000100:00100000:0.0:1787508732.670814:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6392680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:202227:1874324480204800:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508732.670843:0:202227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f357b3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.670854:0:202227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f357b3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.670861:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f357b3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508732.671007:0:202227:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126a:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1787508732.671011:0:202227:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126a:0x0] updating lvb mtime from disk: 1787508733 -> 1787508733 00000004:00010000:0.0:1787508732.671014:0:202227:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126a:0x0] updating lvb atime from disk: 1787508733 -> 1787508733 00000004:00010000:0.0:1787508732.671016:0:202227:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126a:0x0] updating lvb ctime from disk: 1787508733 -> 1787508733 00000004:00010000:0.0:1787508732.671018:0:202227:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126a:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:0.0:1787508732.671026:0:202227:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000013aa3067 reply state 000000001ce82937 transno 12884944195 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f357b3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.671041:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f357b3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x126a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.671049:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126a:0x0].0x0 (ffff9090d1b2b600) 00010000:00010000:0.0:1787508732.671052:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787508732.671055:0:202227:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787508732.671154:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e61d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+21:342366:x1874324509626240:12345-192.168.201.30@tcp:36:dd.0 Request processed in 18481us (19860us total) trans 12884944195 rc 0/0 00000100:00100000:0.0:1787508732.671162:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94132 00000100:00100000:2.0:1787508732.675276:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508732.675544:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509626496 00000100:00100000:3.0:1787508732.675555:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509626496 00000100:00100000:3.0:1787508732.675624:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94133 00000100:00100000:3.0:1787508732.675636:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+21:342366:x1874324509626496:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:3.0:1787508732.675661:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508732.675665:0:202228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787508732.675718:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35789 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x59/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae965 expref: 21 pid: 203348 timeout: 13803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.675738:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126a:0x0].0x0 (ffff9090d1b2b600) 00010000:00010000:3.0:1787508732.675744:0:202228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508732.675758:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f357ba lrc: 2/0,0 mode: --/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae97a expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.675785:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f357ba lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae97a expref: 21 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.675797:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f357ba lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae97a expref: 21 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.675807:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126a:0x0].0x0 (ffff9090d1b2b600) 00010000:00010000:3.0:1787508732.675810:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787508732.675813:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fa00, rc 0) 00000100:00100000:3.0:1787508732.675888:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+21:342366:x1874324509626496:12345-192.168.201.30@tcp:101:dd.0 Request processed in 255us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508732.675895:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94133 00000100:00100000:2.0:1787508732.678183:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508732.678270:0:202239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509626624 00000100:00100000:0.0:1787508732.678279:0:202239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509626624 00002000:00010000:0.0:1787508732.678315:0:202239:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x2000013a4:0x126a:0x0] 00002000:00100000:0.0:1787508732.678320:0:202239:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9090c6bf0000 with x1874324509626624 00000100:00100000:0.0:1787508732.678354:0:202239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7757 00000100:00100000:0.0:1787508732.678365:0:202239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+21:2403:x1874324509626624:12345-192.168.201.30@tcp:10:dd.0 00000004:00010000:0.0:1787508732.678543:0:202239:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126a:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1787508732.678548:0:202239:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126a:0x0] updating lvb mtime from disk: 1787508733 -> 1787508733 00000004:00010000:0.0:1787508732.678550:0:202239:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126a:0x0] updating lvb atime from disk: 1787508733 -> 1787508733 00000004:00010000:0.0:1787508732.678553:0:202239:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126a:0x0] updating lvb ctime from disk: 1787508733 -> 1787508733 00000004:00010000:0.0:1787508732.678555:0:202239:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787508732.678625:0:202239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+22:2403:x1874324509626624:12345-192.168.201.30@tcp:10:dd.0 Request processed in 261us (449us total) trans 12884944196 rc 0/0 00000100:00100000:0.0:1787508732.678633:0:202239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7757 00002000:00010000:0.0:1787508732.678637:0:202239:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x2000013a4:0x126a:0x0] 00002000:00100000:0.0:1787508732.678640:0:202239:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9090c6bf0000 with x1874324509626624 00000100:00100000:1.0:1787508732.682990:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508732.683088:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509626752 00000100:00100000:2.0:1787508732.683099:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509626752 00000100:00100000:2.0:1787508732.683169:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94134 00000100:00100000:2.0:1787508732.683180:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+22:342366:x1874324509626752:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:2.0:1787508732.683206:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508732.683228:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f357c1 lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae981 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508732.683289:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f357c1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae981 expref: 23 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508732.683304:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f357c1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae981 expref: 23 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508732.683340:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126a:0x0].0x0 (ffff9090d1b2b600) 00010000:00010000:2.0:1787508732.683344:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787508732.683350:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab400, rc 0) 00000100:00100000:2.0:1787508732.683413:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+23:342366:x1874324509626752:12345-192.168.201.30@tcp:101:dd.0 Request processed in 224us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508732.683420:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94134 00000100:00100000:3.0:1787508732.694817:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508732.694983:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509627008 00000100:00100000:0.0:1787508732.694994:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509627008 00000100:00100000:0.0:1787508732.695074:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15459 00000100:00100000:0.0:1787508732.695084:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e61d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+23:342366:x1874324509627008:12345-192.168.201.30@tcp:35:dd.0 00000100:00100000:0.0:1787508732.695304:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e61d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+24:342366:x1874324509627008:12345-192.168.201.30@tcp:35:dd.0 Request processed in 221us (498us total) trans 12884944197 rc 0/0 00000100:00100000:0.0:1787508732.695314:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15459 00000100:00100000:2.0:1787508732.773048:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508732.777138:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509627136 00000100:00100000:0.0:1787508732.777228:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509627136 00000100:00100000:1.0:1787508732.780146:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94135 00000100:00100000:1.0:1787508732.780173:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:342368:x1874324509627136:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1787508732.780197:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508732.780219:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f357c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae988 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508732.780284:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f357cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508732.780299:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f357cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508732.780309:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f357cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508732.780369:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508732.780372:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508732.780393:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f357cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508732.780431:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f357c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae988 expref: 7 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508732.780450:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f357cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae988 expref: 6 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508732.780460:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508732.780463:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508732.780467:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a400, rc 0) 00000100:00100000:1.0:1787508732.780540:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:342368:x1874324509627136:12345-192.168.201.30@tcp:101:rm.0 Request processed in 370us (7501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508732.780547:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94135 00000100:00100000:1.0:1787508732.786772:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508732.787034:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509627264 00000100:00100000:3.0:1787508732.787045:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509627264 00000100:00100000:3.0:1787508732.787104:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94136 00000100:00100000:3.0:1787508732.787114:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:342368:x1874324509627264:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:3.0:1787508732.787134:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508732.787167:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f357d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae98f expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.787232:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f357dd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.787247:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f357dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.787257:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f357dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.787269:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f357e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.787276:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f357e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.787282:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f357e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.787383:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f357eb lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.787394:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f357eb lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.787399:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f357eb lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508732.787451:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508732.787471:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f357eb lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.787485:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f357dd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.787491:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f357dd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.787497:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f357dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.787503:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f357dd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.787509:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508732.787513:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f357dd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.787520:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f357dd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.787536:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508732.787538:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508732.787543:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f357dd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.787548:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f357dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.787561:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f357e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.787567:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f357e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.787573:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f357e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.787577:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508732.787580:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f357e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.787586:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f357e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.787593:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24502e87 (ffff9090cc088e00) 00010000:00010000:3.0:1787508732.787596:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508732.787598:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f357e4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.787604:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f357e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.787634:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f357d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae98f expref: 8 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.787647:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f357eb lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae98f expref: 7 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.787653:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126a:0x0].0x0 (ffff9090d1b2b600) 00010000:00010000:3.0:1787508732.787656:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787508732.787658:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f200, rc 0) 00000100:00100000:3.0:1787508732.787727:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:342368:x1874324509627264:12345-192.168.201.30@tcp:101:rm.0 Request processed in 614us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508732.787734:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94136 00000100:00080000:0.0:1787508732.792391:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787508732.793741:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508732.793908:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509627392 00000100:00100000:0.0:1787508732.793919:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509627392 00000100:00100000:2.0:1787508732.795081:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94137 00000100:00100000:2.0:1787508732.795096:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e61d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2403:x1874324509627392:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508732.795118:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508732.795139:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f357f2 lrc: 2/0,0 mode: --/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae996 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508732.795187:0:202226:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f357ba lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x40/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae97a expref: 23 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508732.795230:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480204928:192.168.201.30@tcp:106: 00000100:00100000:2.0:1787508732.795360:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090e6fc3b40 going to sleep for 11 seconds 00000004:00010000:3.0:1787508732.806822:0:202226:0:(mdt_lvb.c:177:mdt_dom_lvbo_update()) res: [0x2000013a4:0x126a:0x0] updating lvb size: 0 -> 4096 00000004:00010000:3.0:1787508732.806833:0:202226:0:(mdt_lvb.c:201:mdt_dom_lvbo_update()) res: [0x2000013a4:0x126a:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:3.0:1787508732.806861:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480204928:192.168.201.30@tcp:106: 00002000:00010000:3.0:1787508732.806891:0:202226:0:(mdt_io.c:1552:mdt_lvb2reply()) size 4096 00010000:00010000:3.0:1787508732.806910:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f357f2 lrc: 1/0,0 mode: --/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x40/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae996 expref: 8 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.806932:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126a:0x0].0x0 (ffff9090d1b2b600) 00010000:00010000:3.0:1787508732.806936:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787508732.806960:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f357f2 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x40/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae996 expref: 8 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.806974:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa200, rc 0) 00000100:00100000:3.0:1787508732.807031:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e61d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2403:x1874324509627392:12345-192.168.201.30@tcp:101:rm.0 Request processed in 11939us (13297us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508732.807039:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94137 00000100:00100000:1.0:1787508732.816025:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508732.816151:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509627648 00000100:00100000:3.0:1787508732.816172:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509627648 00000100:00100000:3.0:1787508732.816233:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94138 00000100:00100000:3.0:1787508732.816244:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:342368:x1874324509627648:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:3.0:1787508732.816297:0:205405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787508732.816335:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f357eb lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae98f expref: 7 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.816355:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126a:0x0].0x0 (ffff9090d1b2b600) 00010000:00010000:3.0:1787508732.816367:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f357cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae988 expref: 6 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.816376:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508732.816380:0:205405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508732.816413:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f357f9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.816426:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f357f9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.816435:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f357f9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.816446:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35800 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x24502e87 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.816456:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35800 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.816462:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35800 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.816550:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35807 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x126a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.816560:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35807 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126a:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.816567:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35807 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126a:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.816752:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3580e lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.816764:0:205405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f357ba lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x40/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae97a expref: 23 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.816772:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3580e lrc: 4/0,1 mode: --/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x40/0x0 rrc: 7 type: IBT flags: 0x50010080000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.817344:0:205405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f357ba lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x40/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000080010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae97a expref: 23 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.817364:0:205405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f357ba lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x40/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000480010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae97a expref: 23 pid: 202228 timeout: 13803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508732.817385:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480205056:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508732.817489:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c6b58300 going to sleep for 11 seconds 00000100:00100000:0.0:1787508732.820524:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508732.820667:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509627776 00000100:00100000:1.0:1787508732.820676:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509627776 00010000:00010000:1.0:1787508732.820716:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f357ba lrc: 5/0,0 mode: PW/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x40/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000480010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae97a expref: 24 pid: 202228 timeout: 13803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508732.820760:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27945 00000100:00100000:1.0:1787508732.820770:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6392680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+24:2401:x1874324509627776:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508732.820786:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508732.820791:0:229383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f357ba lrc: 5/0,0 mode: PW/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x40/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000480010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae97a expref: 24 pid: 202228 timeout: 13803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508732.820804:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f357ba lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x40/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000480010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae97a expref: 24 pid: 202228 timeout: 13803 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508732.820837:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126a:0x0].0x0 (ffff9090d1b2b600) 00010000:00010000:1.0:1787508732.820842:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 6 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3580e lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x40/0x0 rrc: 8 type: IBT flags: 0x50010080000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508732.820851:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3580e lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x40/0x0 rrc: 8 type: IBT flags: 0x50090080000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508732.820857:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3580e lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x40/0x0 rrc: 8 type: IBT flags: 0x50090080000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508732.820875:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508732.820927:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6392680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+24:2401:x1874324509627776:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 158us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508732.820962:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27945 00010000:00010000:3.0:1787508732.821624:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f357ba lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x40/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801480010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae97a expref: 23 pid: 202228 timeout: 13803 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508732.821641:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480205056:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508732.821661:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3580e lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT flags: 0x40010080000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.821671:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3580e lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT flags: 0x40010080000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.821678:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3580e lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT flags: 0x50010480000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.821684:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3580e lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT flags: 0x50010480000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.821697:0:205405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787508732.821720:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35807 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126a:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.821727:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35807 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x126a:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.821733:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35807 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x126a:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.821738:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508732.821744:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35807 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x126a:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.821751:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35807 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x126a:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.821763:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126a:0x0].0x0 (ffff9090d1b2b600) 00010000:00010000:3.0:1787508732.821765:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787508732.821770:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35807 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x126a:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.821776:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35807 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x126a:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.821797:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f357f9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.821803:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f357f9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.821819:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f357f9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.821825:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f357f9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.821830:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ee00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508732.821833:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f357f9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.821838:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f357f9 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.821850:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508732.821852:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508732.821855:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f357f9 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.821860:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f357f9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508732.821870:0:205405:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034ee2b3a reply state 000000000d796315 transno 12884944198 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35800 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.821882:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35800 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508732.821888:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24502e87 (ffff9090cc088e00) 00010000:00010000:3.0:1787508732.821890:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508732.821893:0:205405:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787508732.821990:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:342368:x1874324509627648:12345-192.168.201.30@tcp:36:rm.0 Request processed in 5747us (5974us total) trans 12884944198 rc 0/0 00000100:00100000:3.0:1787508732.821997:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94138 00010000:00010000:0.0:1787508732.822283:0:226765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508732.822290:0:226765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3580e lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.822297:0:226765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f800 already unused, calling callback (ffffffffc0d0a230) 00010000:00010000:0.0:1787508732.822301:0:226765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3580e lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.822307:0:226765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3580e lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.822327:0:226765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126a:0x0].0x0 (ffff9090d1b2b600) 00010000:00010000:0.0:1787508732.822330:0:226765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787508732.822333:0:226765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3580e lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.822339:0:226765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f3580e lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x126a:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508732.822348:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508732.822350:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508732.822352:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508733.040911:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508733.041007:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508733.041039:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508733.041048:0:225832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509628160 00000100:00100000:2.0:1787508733.041057:0:225832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509628160 00000100:00100000:0.0:1787508733.041069:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508733.041088:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508733.041114:0:225832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2438 00000100:00100000:0.0:1787508733.041116:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508733.041125:0:225832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6390700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509628160:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508733.041139:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508733.041170:0:203728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509628672 00000100:00100000:0.0:1787508733.041174:0:203728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509628672 00000100:00100000:0.0:1787508733.041199:0:203728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509628288 00000100:00100000:0.0:1787508733.041202:0:203728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509628288 00000100:00100000:2.0:1787508733.041209:0:225832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6390700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509628160:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 86us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508733.041219:0:203728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509628544 00000100:00100000:2.0:1787508733.041220:0:225832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2438 00000100:00100000:0.0:1787508733.041222:0:203728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509628544 00000100:00100000:2.0:1787508733.041235:0:225832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2439 00000100:00100000:0.0:1787508733.041241:0:203728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2440 00000100:00100000:2.0:1787508733.041242:0:225832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6392a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509628672:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508733.041246:0:203728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6391f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2402:x1874324509628288:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508733.041268:0:225832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6392a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509628672:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 27us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508733.041268:0:203728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6391f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2402:x1874324509628288:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508733.041275:0:225832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2439 00000100:00100000:1.0:1787508733.041328:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509627904 00000100:00100000:1.0:1787508733.041332:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509627904 00000100:00100000:1.0:1787508733.041367:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1024 00000100:00100000:1.0:1787508733.041374:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed598c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509627904:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508733.041412:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed598c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509627904:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 38us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508733.041419:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1024 00000100:00100000:0.0:1787508733.041468:0:203728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2440 00000100:00100000:0.0:1787508733.041483:0:203728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2441 00000100:00100000:0.0:1787508733.041490:0:203728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6391880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509628544:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508733.041517:0:203728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6391880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509628544:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 28us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508733.041523:0:203728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2441 00000100:00080000:0.0:1787508733.041671:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787508733.041675:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787508733.041708:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509628416 00000100:00100000:0.0:1787508733.041713:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509628416 00000100:00100000:0.0:1787508733.041742:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509628032 00000100:00100000:0.0:1787508733.041744:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509628032 00000100:00100000:0.0:1787508733.041763:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3078 00000100:00100000:0.0:1787508733.041769:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6390e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509628416:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508733.041803:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6390e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509628416:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 34us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508733.041810:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3078 00000100:00100000:0.0:1787508733.041823:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3079 00000100:00100000:0.0:1787508733.041829:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6393480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509628032:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508733.041853:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6393480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509628032:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508733.041859:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3079 00000100:00080000:0.0:1787508733.041877:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787508733.501387:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508733.626191:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480205184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787508733.626267:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508733.626363:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480205184 00000100:00100000:2.0:1787508733.626373:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480205184 00000100:00100000:2.0:1787508733.626458:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1717 00000100:00100000:2.0:1787508733.626468:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6393800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480205184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787508733.626500:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 131576384 pending 0 free 3881955328 avail 3650433024 00000100:00100000:3.0:1787508733.626643:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480205312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787508733.626674:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508733.626709:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480205312 00000100:00100000:3.0:1787508733.626714:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480205312 00000100:00100000:3.0:1787508733.626739:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1718 00000100:00100000:3.0:1787508733.626746:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480205312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787508733.626756:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 131576384 pending 0 free 3881955328 avail 3650433024 00000100:00100000:3.0:1787508733.626789:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480205312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508733.628027:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1718 00000100:00100000:3.0:1787508733.628102:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480205312:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787508733.628132:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787508733.639311:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6393800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480205184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 12822us (13022us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508733.639327:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1717 00000100:00100000:0.0:1787508733.645477:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480205184:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787508734.522155:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508735.162642:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787508735.162663:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480205440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787508735.162736:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508735.162783:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480205440 00000100:00100000:3.0:1787508735.162791:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480205440 00000100:00100000:3.0:1787508735.162846:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1719 00000100:00100000:3.0:1787508735.162868:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480205440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787508735.162898:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 41194048 pending 0 free 3909767168 avail 3678244864 00000100:00100000:3.0:1787508735.162956:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480205440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508735.162963:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1719 00000100:00080000:3.0:1787508735.162988:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787508735.163024:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480205440:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1787508735.167972:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944198 is committed 00000001:00080000:0.0:1787508735.167996:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944197 is committed 00010000:00010000:0.0:1787508735.168034:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f3573c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508735.168048:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f3573c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508735.168056:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f3573c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508735.168063:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508735.168067:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f3573c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508735.168074:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f3573c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508735.168093:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24502e87 (ffff9090cc088e00) 00010000:00010000:0.0:1787508735.168096:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508735.168101:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f3573c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508735.168108:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f3573c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508735.168126:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f357b3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x126a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508735.168133:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f357b3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x126a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508735.168139:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f357b3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x126a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508735.168144:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5a00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508735.168147:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f357b3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x126a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508735.168153:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f357b3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x126a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508735.168161:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126a:0x0].0x0 (ffff9090d1b2b600) 00010000:00010000:0.0:1787508735.168164:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508735.168167:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f357b3 lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x126a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508735.168173:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f357b3 lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x126a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508735.168371:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35800 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508735.168380:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35800 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508735.168386:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35800 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508735.168392:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508735.168395:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35800 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508735.168401:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35800 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508735.168410:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x24502e87 (ffff9090cc088e00) 00010000:00010000:3.0:1787508735.168413:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508735.168415:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35800 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508735.168421:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35800 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x24502e87 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508735.169541:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787508735.169559:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480205568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787508735.169629:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508735.169758:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480205568 00000100:00100000:1.0:1787508735.169768:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480205568 00000100:00100000:1.0:1787508735.169836:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1720 00000100:00100000:1.0:1787508735.169847:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480205568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787508735.169878:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 41194048 pending 0 free 3909767168 avail 3678244864 00000100:00100000:1.0:1787508735.169932:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480205568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508735.169965:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1720 00000100:00100000:0.0:1787508735.169985:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480205568:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787508735.172722:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787508735.547037:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508736.186335:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787508736.186389:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480205824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787508736.186459:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508736.186505:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480205824 00000100:00100000:1.0:1787508736.186512:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480205824 00000100:00100000:1.0:1787508736.186561:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29896 00000100:00100000:1.0:1787508736.186569:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480205824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787508736.186596:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440694272 avail 1294454784 00000100:00100000:1.0:1787508736.186631:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480205824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508736.186636:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29896 00000100:00100000:1.0:1787508736.186670:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480205824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787508736.186783:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480205696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787508736.186813:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508736.186922:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480205696 00000100:00100000:3.0:1787508736.186926:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480205696 00000100:00100000:3.0:1787508736.186974:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29897 00000100:00100000:3.0:1787508736.186980:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6390000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480205696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787508736.186996:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442766848 avail 1296527360 00000100:00100000:3.0:1787508736.187024:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6390000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480205696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 44us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508736.187027:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29897 00000100:00100000:0.0:1787508736.187114:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480205696:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787508736.573910:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508736.699547:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480206080:0@lo:400:kworker.0 00000100:00100000:1.0:1787508736.699626:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508736.699690:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480206592:0@lo:400:kworker.0 00000100:00100000:1.0:1787508736.699725:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508736.699750:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c993ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480207104:0@lo:400:kworker.0 00000100:00100000:1.0:1787508736.699775:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508736.699797:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787508736.699803:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480206208:0@lo:400:kworker.0 00000100:00100000:2.0:1787508736.700061:0:203996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480206080 00000100:00100000:2.0:1787508736.700068:0:203996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480206080 00000100:00100000:2.0:1787508736.700112:0:203996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480206592 00000100:00100000:2.0:1787508736.700115:0:203996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480206592 00000100:00100000:2.0:1787508736.700144:0:203996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2442 00000100:00100000:2.0:1787508736.700153:0:203996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480206080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508736.700222:0:203996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480206080:12345-0@lo:400:kworker.0 Request processed in 70us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508736.700230:0:203996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2442 00000100:00100000:2.0:1787508736.700248:0:203996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2443 00000100:00100000:2.0:1787508736.700255:0:203996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480206592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508736.700285:0:203996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480206592:12345-0@lo:400:kworker.0 Request processed in 30us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508736.700291:0:203996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2443 00000100:00100000:0.0:1787508736.700453:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874324480206336:0@lo:400:kworker.0 00000100:00100000:0.0:1787508736.700483:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508736.700510:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874324480206848:0@lo:400:kworker.0 00000100:00100000:0.0:1787508736.700529:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508736.700547:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787508736.700553:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480205952:0@lo:400:kworker.0 00000100:00100000:0.0:1787508736.700579:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508736.700596:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480206464:0@lo:400:kworker.0 00000100:00100000:0.0:1787508736.700616:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480205952 00000100:00100000:0.0:1787508736.700619:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480205952 00000100:00100000:0.0:1787508736.700640:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:0.0:1787508736.700644:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed599850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480205952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508736.700667:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed599850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480205952:12345-0@lo:400:kworker.0 Request processed in 23us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508736.700671:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00100000:3.0:1787508736.700785:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480207104 00000100:00100000:3.0:1787508736.700789:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480207104 00000100:00100000:3.0:1787508736.700819:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480206336 00000100:00100000:3.0:1787508736.700821:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480206336 00000100:00100000:3.0:1787508736.700841:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480206848 00000100:00100000:3.0:1787508736.700844:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480206848 00000100:00100000:3.0:1787508736.700856:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3080 00000100:00100000:3.0:1787508736.700861:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480207104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508736.700888:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480207104:12345-0@lo:400:kworker.0 Request processed in 28us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508736.700891:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3080 00000100:00100000:3.0:1787508736.700902:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3081 00000100:00100000:3.0:1787508736.700905:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6391180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874324480206336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508736.700922:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6391180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874324480206336:12345-0@lo:400:kworker.0 Request processed in 17us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508736.700926:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3081 00000100:00100000:3.0:1787508736.700932:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3082 00000100:00100000:3.0:1787508736.700935:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6392300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874324480206848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508736.700966:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6392300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874324480206848:12345-0@lo:400:kworker.0 Request processed in 30us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508736.700969:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3082 00000100:00080000:3.0:1787508736.700979:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787508736.700983:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508736.702502:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508736.703034:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480206720:0@lo:400:kworker.0 00000100:00100000:1.0:1787508736.703089:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508736.703120:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c993e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480207232:0@lo:400:kworker.0 00000100:00100000:1.0:1787508736.703143:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508736.703179:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480206080:0@lo:400:kworker.0 00000100:00100000:1.0:1787508736.703193:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480206592:0@lo:400:kworker.0 00000100:00100000:1.0:1787508736.703216:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c993ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480207104:0@lo:400:kworker.0 00000100:00100000:2.0:1787508736.705065:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480206720 00000100:00100000:2.0:1787508736.705079:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480206720 00000100:00100000:2.0:1787508736.705161:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480207232 00000100:00100000:2.0:1787508736.705165:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480207232 00000100:00100000:2.0:1787508736.705197:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3083 00000100:00100000:2.0:1787508736.705218:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480206720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508736.705305:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480206720:12345-0@lo:400:kworker.0 Request processed in 89us (2215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508736.705313:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3083 00000100:00100000:2.0:1787508736.705330:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3084 00000100:00100000:2.0:1787508736.705349:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480207232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508736.705385:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480207232:12345-0@lo:400:kworker.0 Request processed in 51us (2242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508736.705391:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3084 00000100:00100000:0.0:1787508736.705726:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508736.705779:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c993c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480206976:0@lo:400:kworker.0 00000100:00100000:0.0:1787508736.705823:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508736.705858:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874324480206336:0@lo:400:kworker.0 00000100:00100000:0.0:1787508736.705871:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874324480206848:0@lo:400:kworker.0 00000100:00100000:0.0:1787508736.705894:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480205952:0@lo:400:kworker.0 00000100:00100000:0.0:1787508736.705917:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480206976 00000100:00100000:0.0:1787508736.705921:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480206976 00000100:00100000:0.0:1787508736.705999:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3085 00000100:00100000:0.0:1787508736.706007:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6392d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480206976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508736.706047:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6392d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480206976:12345-0@lo:400:kworker.0 Request processed in 42us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508736.706053:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3085 00000100:00100000:0.0:1787508736.706125:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c993c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480206976:0@lo:400:kworker.0 00000100:00100000:3.0:1787508736.706423:0:208928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480206208 00000100:00100000:3.0:1787508736.706428:0:208928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480206208 00000100:00100000:3.0:1787508736.706470:0:208928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480206464 00000100:00100000:3.0:1787508736.706474:0:208928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480206464 00000100:00100000:3.0:1787508736.706505:0:208928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2444 00000100:00100000:3.0:1787508736.706521:0:208928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480206208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508736.706561:0:208928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480206208:12345-0@lo:400:kworker.0 Request processed in 49us (4074us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508736.706567:0:208928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2444 00000100:00100000:3.0:1787508736.706584:0:208928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2445 00000100:00100000:3.0:1787508736.706590:0:208928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6393100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480206464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508736.706621:0:208928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6393100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480206464:12345-0@lo:400:kworker.0 Request processed in 31us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508736.706626:0:208928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2445 00000100:00080000:3.0:1787508736.706656:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787508736.706661:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787508736.706994:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480206464:0@lo:400:kworker.0 00000100:00100000:1.0:1787508736.711928:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480206720:0@lo:400:kworker.0 00000100:00100000:1.0:1787508736.711984:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c993e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480207232:0@lo:400:kworker.0 00000100:00100000:1.0:1787508736.712013:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480206208:0@lo:400:kworker.0 00010000:00010000:0.0:1787508737.595384:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508738.159406:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508738.159465:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508738.159506:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508738.159527:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508738.159591:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508738.159619:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508738.159638:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508738.159653:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508738.159670:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508738.159698:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509628928 00000100:00100000:0.0:1787508738.159707:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509628928 00000100:00100000:0.0:1787508738.159766:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509629440 00000100:00100000:0.0:1787508738.159769:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509629440 00000100:00100000:0.0:1787508738.159790:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509629056 00000100:00100000:0.0:1787508738.159792:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509629056 00000100:00100000:0.0:1787508738.159808:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509629568 00000100:00100000:0.0:1787508738.159811:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509629568 00000100:00100000:0.0:1787508738.159828:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3086 00000100:00100000:0.0:1787508738.159838:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6390380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:2402:x1874324509628928:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508738.159916:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6390380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:2402:x1874324509628928:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 78us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508738.159926:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3086 00000100:00100000:0.0:1787508738.159968:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3087 00000100:00100000:0.0:1787508738.159975:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509629440:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508738.159998:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509629440:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508738.160004:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3087 00000100:00100000:0.0:1787508738.160013:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3088 00000100:00100000:0.0:1787508738.160019:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509629056:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508738.160041:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509629056:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508738.160047:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3088 00000100:00100000:0.0:1787508738.160058:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3089 00000100:00100000:0.0:1787508738.160064:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509629568:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508738.160086:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509629568:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508738.160092:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3089 00000100:00100000:0.0:1787508738.160111:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509628800 00000100:00100000:0.0:1787508738.160115:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509628800 00000100:00100000:0.0:1787508738.160140:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1026 00000100:00100000:0.0:1787508738.160146:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed599c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509628800:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508738.160169:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed599c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509628800:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508738.160175:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1026 00000100:00100000:0.0:1787508738.160207:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509629184 00000100:00100000:0.0:1787508738.160211:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509629184 00000100:00100000:0.0:1787508738.160248:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509629696 00000100:00100000:0.0:1787508738.160251:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509629696 00000100:00100000:0.0:1787508738.160269:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509629312 00000100:00100000:0.0:1787508738.160272:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509629312 00000100:00100000:0.0:1787508738.160286:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509629824 00000100:00100000:0.0:1787508738.160289:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509629824 00000100:00100000:0.0:1787508738.160307:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2446 00000100:00100000:0.0:1787508738.160323:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6390a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509629184:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508738.160351:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6390a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509629184:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 29us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508738.160358:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2446 00000100:00100000:0.0:1787508738.160369:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2447 00000100:00100000:0.0:1787508738.160376:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509629696:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508738.160396:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509629696:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508738.160401:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2447 00000100:00100000:0.0:1787508738.160411:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2448 00000100:00100000:0.0:1787508738.160416:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2402:x1874324509629312:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508738.160435:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2402:x1874324509629312:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 19us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508738.160440:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2448 00000100:00100000:0.0:1787508738.160449:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2449 00000100:00100000:0.0:1787508738.160455:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc620000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509629824:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508738.160470:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc620000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509629824:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 16us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508738.160475:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2449 00000100:00080000:0.0:1787508738.160497:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787508738.160501:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787508738.160503:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508738.160505:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787508738.618133:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508738.746523:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787508738.746546:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480207360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787508738.746615:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508738.746663:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480207360 00000100:00100000:3.0:1787508738.746670:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480207360 00000100:00080000:0.0:1787508738.746702:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508738.746725:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1721 00000100:00100000:3.0:1787508738.746733:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480207360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787508738.746761:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 131576384 pending 0 free 3881955328 avail 3650433024 00000100:00100000:3.0:1787508738.746816:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480207360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508738.746823:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1721 00000100:00100000:0.0:1787508738.746999:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480207360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787508738.747394:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c993e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480207488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787508738.747426:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508738.748157:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480207488 00000100:00100000:3.0:1787508738.748164:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480207488 00000100:00100000:1.0:1787508738.748275:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1722 00000100:00100000:1.0:1787508738.748290:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc621c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480207488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787508738.748317:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 131576384 pending 0 free 3881955328 avail 3650433024 00000100:00100000:1.0:1787508738.748375:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc621c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480207488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508738.748441:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c993e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480207488:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787508738.749434:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508738.754797:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1722 00010000:00010000:2.0:1787508739.642143:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787508739.713857:0:234083:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 101b: Discard DoM data on rename ========= 14:12:18 (1787508738) 00000100:00100000:0.0:1787508739.977727:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508739.977848:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509629952 00000100:00100000:2.0:1787508739.977859:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509629952 00000100:00100000:2.0:1787508739.977923:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94139 00000100:00100000:2.0:1787508739.977934:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:342943:x1874324509629952:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508739.978003:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508739.978026:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f35815 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae99d expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.978096:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f3581c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.978111:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f3581c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.978124:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f3581c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508739.978172:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508739.978176:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508739.978195:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f3581c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.978220:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f35815 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae99d expref: 13 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.978238:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f3581c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae99d expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.978245:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508739.978248:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508739.978252:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa200, rc 0) 00000100:00100000:2.0:1787508739.978333:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:342943:x1874324509629952:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 401us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508739.978341:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94139 00000100:00100000:0.0:1787508739.980604:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508739.980699:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509630080 00000100:00100000:2.0:1787508739.980710:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509630080 00000100:00100000:2.0:1787508739.980788:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94140 00000100:00100000:2.0:1787508739.980802:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:342943:x1874324509630080:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508739.980824:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508739.980844:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f35823 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae9a4 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.980903:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3582a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.980916:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3582a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.980926:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3582a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.980965:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35831 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.980973:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35831 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.980980:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35831 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.981067:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3582a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.981074:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3582a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.981085:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3582a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.981092:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3582a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.981097:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508739.981102:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3582a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.981109:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3582a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.981121:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508739.981124:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508739.981129:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3582a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.981135:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3582a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.981147:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35831 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.981152:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35831 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.981158:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35831 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.981162:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508739.981166:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35831 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.981171:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35831 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.981177:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x144b74e0 (ffff9090d36fd700) 00010000:00010000:2.0:1787508739.981180:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508739.981182:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35831 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.981187:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35831 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.981214:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f35823 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9a4 expref: 13 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.981223:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508739.981226:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508739.981230:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f35823 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9a4 expref: 13 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508739.981239:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa400, rc 0) 00000100:00100000:2.0:1787508739.981451:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:342943:x1874324509630080:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 651us (856us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508739.981459:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94140 00000100:00100000:3.0:1787508739.988492:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508739.988636:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509630336 00000100:00100000:0.0:1787508739.988647:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509630336 00000100:00100000:0.0:1787508739.988748:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94141 00000100:00100000:0.0:1787508739.988760:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:342943:x1874324509630336:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508739.988782:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508739.988785:0:209004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787508739.988814:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f3581c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae99d expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508739.988835:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508739.988847:0:209004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508739.988863:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f35838 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae9ab expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508739.989556:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f3583f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508739.989572:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f3583f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508739.989585:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f3583f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508739.989601:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f35846 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508739.989608:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f35846 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508739.989615:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f35846 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508739.991698:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f3584d lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508739.991720:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f3584d lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508739.991731:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f3584d lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508739.991745:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x126b:0x0]: returning size 0 00010000:00010000:1.0:1787508739.991778:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f3583f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508739.991785:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f3583f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508739.991791:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f3583f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508739.991798:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f3583f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508739.991804:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247aa00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508739.991808:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f3583f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508739.991814:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f3583f lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508739.991827:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508739.991831:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508739.991835:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f3583f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508739.992299:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f3583f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508739.992321:0:209004:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c386d05 reply state 00000000f42e2a38 transno 12884944199 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f35846 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508739.992339:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f35846 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508739.992345:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x144b74e0 (ffff9090d02ada00) 00010000:00010000:1.0:1787508739.992348:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787508739.992351:0:209004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787508739.992397:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f35838 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9ab expref: 14 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508739.992414:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f3584d lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9ab expref: 13 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508739.992422:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126b:0x0].0x0 (ffff9090d02ad300) 00010000:00010000:1.0:1787508739.992424:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787508739.992427:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b400, rc 0) 00000100:00100000:1.0:1787508739.992562:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:342943:x1874324509630336:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 3803us (4080us total) trans 12884944199 rc 0/0 00000100:00100000:1.0:1787508739.992573:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94141 00000100:00100000:0.0:1787508739.996785:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508739.996877:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509630592 00000100:00100000:3.0:1787508739.996889:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509630592 00000100:00100000:3.0:1787508739.996988:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94142 00000100:00100000:3.0:1787508739.996999:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:342943:x1874324509630592:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508739.997038:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508739.997061:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3585b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae9b2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508739.997195:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35862 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x126b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508739.997393:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f3584d lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9ab expref: 15 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508739.997403:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35862 lrc: 4/0,1 mode: --/EX res: [0x2000013a4:0x126b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508739.997438:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f3584d lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9ab expref: 15 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508739.997453:0:230618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f3584d lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9ab expref: 15 pid: 209004 timeout: 13811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508739.997469:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480207616:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508739.997555:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9091c9dd0240 going to sleep for 11 seconds 00000100:00100000:3.0:1787508740.005183:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480207616:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508740.005226:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35862 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x126b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508740.007856:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508740.008047:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509630720 00000100:00100000:2.0:1787508740.008057:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509630720 00010000:00010000:2.0:1787508740.008109:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f3584d lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9ab expref: 16 pid: 209004 timeout: 13811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508740.008147:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27946 00000100:00100000:2.0:1787508740.008157:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:2401:x1874324509630720:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508740.008172:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508740.008178:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f3584d lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9ab expref: 16 pid: 209004 timeout: 13811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.008203:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f3584d lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9ab expref: 16 pid: 209004 timeout: 13811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.008223:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f3584d lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9ab expref: 16 pid: 209004 timeout: 13811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.008240:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126b:0x0].0x0 (ffff9090d02ad300) 00010000:00010000:2.0:1787508740.008245:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35862 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x126b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.008253:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35862 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.008261:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35862 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x126b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.008304:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508740.008350:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:2401:x1874324509630720:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 195us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508740.008358:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27946 00010000:00010000:1.0:1787508740.008629:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35862 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.008638:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35862 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508740.008657:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x126b:0x0]: returning size 0 00010000:00010000:1.0:1787508740.008843:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35862 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.008851:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35862 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x126b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.008859:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35862 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x126b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.008865:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508740.008869:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35862 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x126b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.008876:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35862 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x126b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.008886:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126b:0x0].0x0 (ffff9090d02ad300) 00010000:00010000:1.0:1787508740.008889:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787508740.008892:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35862 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x126b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.008898:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35862 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x126b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.008998:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3585b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9b2 expref: 15 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.009008:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508740.009010:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508740.009014:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3585b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9b2 expref: 15 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.009031:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ee00, rc 0) 00000100:00100000:1.0:1787508740.009059:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:342943:x1874324509630592:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 12062us (12284us total) trans 12884944200 rc 301/301 00000100:00100000:1.0:1787508740.009069:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94142 00000100:00080000:0.0:1787508740.009300:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787508740.014757:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508740.014932:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509630976 00000100:00100000:2.0:1787508740.015003:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509630976 00000100:00100000:2.0:1787508740.018130:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15460 00000100:00100000:2.0:1787508740.018157:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:342943:x1874324509630976:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1787508740.018688:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:342943:x1874324509630976:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 543us (3939us total) trans 12884944201 rc 0/0 00000100:00100000:2.0:1787508740.018773:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15460 00000100:00100000:0.0:1787508740.022234:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508740.022581:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509631232 00000100:00100000:3.0:1787508740.022593:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509631232 00000100:00100000:3.0:1787508740.022658:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15461 00000100:00100000:3.0:1787508740.022669:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde30c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:342943:x1874324509631232:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1787508740.023072:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde30c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:342943:x1874324509631232:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 402us (845us total) trans 12884944202 rc 0/0 00000100:00100000:3.0:1787508740.023082:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15461 00000100:00100000:1.0:1787508740.036082:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508740.036312:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509631360 00000100:00100000:0.0:1787508740.036324:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509631360 00000100:00100000:0.0:1787508740.036401:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94143 00000100:00100000:0.0:1787508740.036411:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:342947:x1874324509631360:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:0.0:1787508740.036435:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508740.036457:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f35870 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae9b9 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.036524:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35877 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.036539:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35877 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.036551:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35877 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508740.036598:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787508740.036603:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508740.036625:0:205405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35877 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.036647:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f35870 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9b9 expref: 18 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.036666:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35877 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9b9 expref: 17 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.036674:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508740.036677:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508740.036680:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4000, rc 0) 00000100:00100000:0.0:1787508740.036745:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:342947:x1874324509631360:12345-192.168.201.30@tcp:101:touch.0 Request processed in 335us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508740.036752:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94143 00000100:00100000:1.0:1787508740.043116:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508740.043318:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509631616 00000100:00100000:2.0:1787508740.043330:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509631616 00000100:00100000:2.0:1787508740.043398:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94144 00000100:00100000:2.0:1787508740.043410:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:342947:x1874324509631616:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:2.0:1787508740.043430:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508740.043433:0:203348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787508740.043461:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35877 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9b9 expref: 17 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.043479:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508740.043484:0:203348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508740.043520:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3587e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae9c0 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.043636:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35885 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.043651:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35885 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.043661:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35885 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.043676:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3588c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.043684:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3588c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.043690:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3588c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787508740.045473:0:203348:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x158c:0x0], index 1: 0 00010000:00010000:2.0:1787508740.045672:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f35893 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x126c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.045685:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f35893 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.045695:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f35893 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.045729:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35885 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.045737:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35885 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.045743:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35885 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.045750:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35885 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.045760:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508740.045765:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35885 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.045772:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35885 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.045784:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508740.045788:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508740.045793:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35885 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.045799:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35885 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508740.045813:0:203348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1d9c466 reply state 000000000605c1e3 transno 12884944203 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3588c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.045823:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3588c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.045830:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb0d9dfe0 (ffff9090d36fd700) 00010000:00010000:2.0:1787508740.045833:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787508740.045835:0:203348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787508740.045872:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3587e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9c0 expref: 19 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.045887:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f35893 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9c0 expref: 18 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.045900:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126c:0x0].0x0 (ffff9090d36fd500) 00010000:00010000:2.0:1787508740.045902:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787508740.045904:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab600, rc 0) 00000100:00100000:2.0:1787508740.046016:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+19:342947:x1874324509631616:12345-192.168.201.30@tcp:101:touch.0 Request processed in 2608us (2911us total) trans 12884944203 rc 0/0 00000100:00100000:2.0:1787508740.046025:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94144 00000100:00100000:1.0:1787508740.051976:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508740.053480:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509631872 00000100:00100000:3.0:1787508740.053494:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509631872 00000100:00100000:2.0:1787508740.053624:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94145 00000100:00100000:2.0:1787508740.053635:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+19:342947:x1874324509631872:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:2.0:1787508740.053687:0:209004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508740.053710:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f35893 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x126c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9c0 expref: 19 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.053728:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126c:0x0].0x0 (ffff9090d36fd500) 00010000:00010000:2.0:1787508740.053739:0:209004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508740.053805:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f358a1 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x126c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.053819:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f358a1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x126c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.053829:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f358a1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x126c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508740.053993:0:209004:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5da08f4 reply state 000000000af70b6b transno 12884944204 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f358a1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x126c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.054005:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f358a1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x126c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.054012:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126c:0x0].0x0 (ffff9090d36fdf00) 00010000:00010000:2.0:1787508740.054015:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787508740.054018:0:209004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787508740.054235:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:342947:x1874324509631872:12345-192.168.201.30@tcp:36:touch.0 Request processed in 600us (2305us total) trans 12884944204 rc 0/0 00000100:00100000:2.0:1787508740.054243:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94145 00000100:00100000:1.0:1787508740.065805:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508740.065901:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509632000 00000100:00100000:3.0:1787508740.065913:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509632000 00000100:00100000:3.0:1787508740.066012:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94146 00000100:00100000:3.0:1787508740.066034:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:342947:x1874324509632000:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:3.0:1787508740.066061:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508740.066082:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f358a8 lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x126c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae9c7 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508740.066141:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f358a8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x126c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9c7 expref: 21 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508740.066155:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f358a8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x126c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9c7 expref: 21 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508740.066175:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126c:0x0].0x0 (ffff9090d36fdf00) 00010000:00010000:3.0:1787508740.066179:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787508740.066182:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f600, rc 0) 00000100:00100000:3.0:1787508740.066426:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+21:342947:x1874324509632000:12345-192.168.201.30@tcp:101:touch.0 Request processed in 403us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508740.066433:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94146 00000100:00100000:1.0:1787508740.069545:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508740.069655:0:225843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509632128 00000100:00100000:0.0:1787508740.069666:0:225843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509632128 00000100:00100000:0.0:1787508740.069746:0:225843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15074 00000100:00100000:0.0:1787508740.069758:0:225843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2400:x1874324509632128:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:0.0:1787508740.070038:0:225843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2400:x1874324509632128:12345-192.168.201.30@tcp:2:touch.0 Request processed in 281us (501us total) trans 8589940563 rc 0/0 00000100:00100000:0.0:1787508740.070046:0:225843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15074 00000100:00080000:3.0:1787508740.070980:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508740.074072:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508740.074179:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509632384 00000100:00100000:2.0:1787508740.074200:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509632384 00000100:00100000:2.0:1787508740.074266:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15462 00000100:00100000:2.0:1787508740.074287:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+21:342947:x1874324509632384:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:2.0:1787508740.074617:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+22:342947:x1874324509632384:12345-192.168.201.30@tcp:35:touch.0 Request processed in 341us (553us total) trans 12884944205 rc 0/0 00000100:00100000:2.0:1787508740.074624:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15462 00000100:00100000:2.0:1787508740.083720:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508740.083857:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509632512 00000100:00100000:0.0:1787508740.083867:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509632512 00000100:00100000:0.0:1787508740.084003:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94147 00000100:00100000:0.0:1787508740.084015:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+22:342951:x1874324509632512:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:0.0:1787508740.084055:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508740.084074:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f358af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae9ce expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.084136:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f358b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.084150:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f358b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.084162:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f358b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508740.084220:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787508740.084224:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508740.084246:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f358b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.084271:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f358af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9ce expref: 24 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.084299:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f358b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9ce expref: 23 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.084307:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508740.084310:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508740.084314:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4e00, rc 0) 00000100:00100000:0.0:1787508740.084369:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+23:342951:x1874324509632512:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 356us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508740.084376:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94147 00000100:00100000:1.0:1787508740.089572:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508740.089708:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509632640 00000100:00100000:0.0:1787508740.089717:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509632640 00000100:00100000:0.0:1787508740.089774:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94148 00000100:00100000:0.0:1787508740.089792:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+23:342951:x1874324509632640:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:0.0:1787508740.089813:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508740.089832:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f358bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae9d5 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.089900:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f358c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.089913:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f358c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.089923:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f358c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.089933:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f358cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.089956:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f358cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.089964:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f358cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.090074:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f358d2 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.090082:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f358d2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.090089:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f358d2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508740.090128:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508740.090149:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f358d2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508740.090172:0:202227:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126b:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1787508740.090175:0:202227:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126b:0x0] updating lvb mtime from disk: 0 -> 1787508740 00000004:00010000:0.0:1787508740.090178:0:202227:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126b:0x0] updating lvb atime from disk: 0 -> 1787508740 00000004:00010000:0.0:1787508740.090180:0:202227:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126b:0x0] updating lvb ctime from disk: 0 -> 1787508740 00000004:00010000:0.0:1787508740.090182:0:202227:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126b:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:0.0:1787508740.090561:0:202227:0:(mdt_io.c:1552:mdt_lvb2reply()) size 0 00010000:00010000:0.0:1787508740.090570:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f358c4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.090577:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f358c4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.090584:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f358c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.090591:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f358c4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.090597:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508740.090601:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f358c4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.090608:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f358c4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.090620:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508740.090624:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508740.090628:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f358c4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.090639:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f358c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.090652:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f358cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.090658:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f358cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.090663:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f358cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.090668:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508740.090670:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f358cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.090676:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f358cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.090683:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x144b74e0 (ffff9090d02ada00) 00010000:00010000:0.0:1787508740.090686:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508740.090690:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f358cb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.090695:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f358cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.090721:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f358bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9d5 expref: 25 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.090740:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f358d2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9d5 expref: 24 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.090748:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126b:0x0].0x0 (ffff9090d1b2b300) 00010000:00010000:0.0:1787508740.090750:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:0.0:1787508740.090752:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5600, rc 0) 00000100:00100000:0.0:1787508740.090826:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+24:342951:x1874324509632640:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 1036us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508740.090834:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94148 00000100:00100000:1.0:1787508740.159130:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508740.159228:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509632896 00000100:00100000:2.0:1787508740.159240:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509632896 00000100:00100000:2.0:1787508740.159310:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94149 00000100:00100000:2.0:1787508740.159322:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+24:342956:x1874324509632896:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:2.0:1787508740.159344:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508740.159347:0:209004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787508740.159374:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f358b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9ce expref: 24 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.159392:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508740.159397:0:209004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508740.159411:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f358d9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae9dc expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.159521:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f358e0 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.159536:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f358e0 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.159542:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f358e0 lrc: 2/0,0 mode: --/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.159548:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f358e0 lrc: 3/0,0 mode: --/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.159554:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508740.159558:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f358e0 lrc: 3/0,0 mode: --/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.159564:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f358e0 lrc: 4/0,0 mode: --/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.159572:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126b:0x0].0x0 (ffff9090d1b2b300) 00010000:00010000:2.0:1787508740.159576:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f358e0 lrc: 2/0,0 mode: --/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.159581:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f358e0 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.159690:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f358d9 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9dc expref: 25 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.159705:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508740.159708:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508740.159712:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f358d9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9dc expref: 25 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.159722:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa400, rc 0) 00000100:00100000:2.0:1787508740.160097:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+24:342956:x1874324509632896:12345-192.168.201.30@tcp:101:dd.0 Request processed in 776us (975us total) trans 12884944206 rc 301/301 00000100:00100000:2.0:1787508740.160105:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94149 00000100:00100000:1.0:1787508740.163773:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508740.164421:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509633024 00000100:00100000:3.0:1787508740.164431:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509633024 00000100:00100000:3.0:1787508740.164534:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94150 00000100:00100000:3.0:1787508740.164546:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+24:342956:x1874324509633024:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:3.0:1787508740.164572:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508740.164595:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f358ee lrc: 2/0,0 mode: --/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae9e3 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508740.164629:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f358f5 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508740.164641:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f358f5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508740.164652:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f358f5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508740.164764:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f358ee lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9e3 expref: 26 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508740.164796:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f358f5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9e3 expref: 25 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508740.164805:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126b:0x0].0x0 (ffff9090d1b2b300) 00010000:00010000:3.0:1787508740.164809:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787508740.164813:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f200, rc 0) 00000100:00100000:3.0:1787508740.164879:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+25:342956:x1874324509633024:12345-192.168.201.30@tcp:101:dd.0 Request processed in 335us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508740.164887:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94150 00000100:00100000:1.0:1787508740.168612:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508740.168712:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509633280 00000100:00100000:0.0:1787508740.168722:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509633280 00000100:00100000:0.0:1787508740.168986:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94151 00000100:00100000:0.0:1787508740.168998:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+25:342956:x1874324509633280:12345-192.168.201.30@tcp:36:dd.0 00010000:00010000:0.0:1787508740.169266:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f358fc lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.169297:0:202227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f358d2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9d5 expref: 25 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.169306:0:202227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f358fc lrc: 4/0,1 mode: --/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.169342:0:202227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f358d2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9d5 expref: 25 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.169357:0:202227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f358d2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9d5 expref: 25 pid: 202227 timeout: 13811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508740.169372:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4c87480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:202227:1874324480207744:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508740.169456:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c966ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508740.172337:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508740.172549:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509633408 00000100:00100000:2.0:1787508740.172558:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509633408 00010000:00010000:2.0:1787508740.172595:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f358d2 lrc: 5/0,0 mode: PR/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9d5 expref: 26 pid: 202227 timeout: 13811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508740.172637:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27947 00000100:00100000:2.0:1787508740.172647:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+26:2400:x1874324509633408:12345-192.168.201.30@tcp:102:ldlm_bl.0 00010000:00010000:2.0:1787508740.172663:0:202213:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f358d2 lrc: 5/0,0 mode: PR/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9d5 expref: 26 pid: 202227 timeout: 13811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.172674:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f358d2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9d5 expref: 26 pid: 202227 timeout: 13811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.172685:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f358d2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9d5 expref: 26 pid: 202227 timeout: 13811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.172699:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126b:0x0].0x0 (ffff9090d1b2b300) 00010000:00010000:2.0:1787508740.172702:0:202213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:2.0:1787508740.172706:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f358fc lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.172716:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f358fc lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.172722:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f358fc lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.172744:0:202213:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f358d2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9d5 expref: 26 pid: 202227 timeout: 13811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508740.172815:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+26:2400:x1874324509633408:12345-192.168.201.30@tcp:102:ldlm_bl.0 Request processed in 168us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508740.172823:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27947 00000100:00100000:0.0:1787508740.173146:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4c87480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:202227:1874324480207744:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508740.173168:0:202227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f358fc lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.173177:0:202227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f358fc lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.173183:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f358fc lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508740.174041:0:202227:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126b:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1787508740.174046:0:202227:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126b:0x0] updating lvb mtime from disk: 1787508740 -> 1787508740 00000004:00010000:0.0:1787508740.174049:0:202227:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126b:0x0] updating lvb atime from disk: 1787508740 -> 1787508740 00000004:00010000:0.0:1787508740.174051:0:202227:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126b:0x0] updating lvb ctime from disk: 1787508740 -> 1787508740 00000004:00010000:0.0:1787508740.174053:0:202227:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126b:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:0.0:1787508740.174060:0:202227:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096f4b85d reply state 000000004f23a2af transno 12884944207 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f358fc lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.174074:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f358fc lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x126b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.174081:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126b:0x0].0x0 (ffff9090d1b2b300) 00010000:00010000:0.0:1787508740.174084:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787508740.174087:0:202227:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787508740.174172:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+27:342956:x1874324509633280:12345-192.168.201.30@tcp:36:dd.0 Request processed in 5176us (5568us total) trans 12884944207 rc 0/0 00000100:00100000:0.0:1787508740.174180:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94151 00000100:00100000:1.0:1787508740.177602:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508740.177700:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509633536 00000100:00100000:2.0:1787508740.177710:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509633536 00000100:00100000:2.0:1787508740.177899:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94152 00000100:00100000:2.0:1787508740.177911:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+27:342956:x1874324509633536:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:2.0:1787508740.177936:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508740.177972:0:203348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787508740.178014:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f358d2 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x59/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9d5 expref: 27 pid: 202227 timeout: 13811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.178032:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126b:0x0].0x0 (ffff9090d1b2b300) 00010000:00010000:2.0:1787508740.178037:0:203348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508740.178051:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f35903 lrc: 2/0,0 mode: --/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae9ea expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.178074:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f35903 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9ea expref: 27 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.178086:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f35903 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9ea expref: 27 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.178096:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126b:0x0].0x0 (ffff9090d1b2b300) 00010000:00010000:2.0:1787508740.178099:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787508740.178102:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa400, rc 0) 00000100:00100000:2.0:1787508740.178151:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+27:342956:x1874324509633536:12345-192.168.201.30@tcp:101:dd.0 Request processed in 243us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508740.178158:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94152 00000100:00100000:3.0:1787508740.180640:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508740.180733:0:202241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509633664 00000100:00100000:0.0:1787508740.180743:0:202241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509633664 00002000:00010000:0.0:1787508740.180792:0:202241:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x2000013a4:0x126b:0x0] 00002000:00100000:0.0:1787508740.180798:0:202241:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9090cf9cbb80 with x1874324509633664 00000100:00100000:0.0:1787508740.180869:0:202241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7758 00000100:00100000:0.0:1787508740.180879:0:202241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+27:2400:x1874324509633664:12345-192.168.201.30@tcp:10:dd.0 00000004:00010000:0.0:1787508740.181097:0:202241:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126b:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1787508740.181101:0:202241:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126b:0x0] updating lvb mtime from disk: 1787508740 -> 1787508740 00000004:00010000:0.0:1787508740.181104:0:202241:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126b:0x0] updating lvb atime from disk: 1787508740 -> 1787508740 00000004:00010000:0.0:1787508740.181106:0:202241:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126b:0x0] updating lvb ctime from disk: 1787508740 -> 1787508740 00000004:00010000:0.0:1787508740.181108:0:202241:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787508740.181166:0:202241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+28:2400:x1874324509633664:12345-192.168.201.30@tcp:10:dd.0 Request processed in 288us (533us total) trans 12884944208 rc 0/0 00000100:00100000:0.0:1787508740.181174:0:202241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7758 00002000:00010000:0.0:1787508740.181177:0:202241:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x2000013a4:0x126b:0x0] 00002000:00100000:0.0:1787508740.181180:0:202241:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9090cf9cbb80 with x1874324509633664 00000100:00100000:1.0:1787508740.184652:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508740.184744:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509633792 00000100:00100000:2.0:1787508740.184754:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509633792 00000100:00100000:2.0:1787508740.184823:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94153 00000100:00100000:2.0:1787508740.184833:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+28:342956:x1874324509633792:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:2.0:1787508740.184857:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508740.184878:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f3590a lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae9f1 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.184935:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f3590a lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9f1 expref: 29 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.184979:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f3590a lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9f1 expref: 29 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.184999:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126b:0x0].0x0 (ffff9090d1b2b300) 00010000:00010000:2.0:1787508740.185002:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787508740.185006:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa000, rc 0) 00000100:00100000:2.0:1787508740.185075:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+29:342956:x1874324509633792:12345-192.168.201.30@tcp:101:dd.0 Request processed in 243us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508740.185082:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94153 00000100:00100000:1.0:1787508740.191473:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508740.191606:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509634048 00000100:00100000:3.0:1787508740.191617:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509634048 00000100:00100000:3.0:1787508740.191684:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15463 00000100:00100000:3.0:1787508740.191695:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+29:342956:x1874324509634048:12345-192.168.201.30@tcp:35:dd.0 00000100:00100000:3.0:1787508740.191992:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+30:342956:x1874324509634048:12345-192.168.201.30@tcp:35:dd.0 Request processed in 298us (528us total) trans 12884944209 rc 0/0 00000100:00100000:3.0:1787508740.192000:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15463 00000100:00100000:3.0:1787508740.216794:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508740.216894:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509634176 00000100:00100000:1.0:1787508740.216904:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509634176 00000100:00100000:1.0:1787508740.217032:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94154 00000100:00100000:1.0:1787508740.217044:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:342958:x1874324509634176:12345-192.168.201.30@tcp:101:mv.0 00010000:00010000:1.0:1787508740.217065:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508740.217086:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35911 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae9f8 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.217153:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f35918 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.217167:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f35918 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.217179:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f35918 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787508740.217390:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1787508740.217469:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508740.217473:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508740.217528:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f35918 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.217553:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35911 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9f8 expref: 7 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.217568:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f35918 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9f8 expref: 6 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.217576:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508740.217578:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508740.217582:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a400, rc 0) 00000100:00100000:1.0:1787508740.217647:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:342958:x1874324509634176:12345-192.168.201.30@tcp:101:mv.0 Request processed in 605us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508740.217655:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94154 00000100:00100000:1.0:1787508740.221032:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508740.221151:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509634304 00000100:00100000:0.0:1787508740.221160:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509634304 00000100:00100000:0.0:1787508740.221233:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94155 00000100:00100000:0.0:1787508740.221245:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:342958:x1874324509634304:12345-192.168.201.30@tcp:101:mv.0 00010000:00010000:0.0:1787508740.221263:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508740.221296:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f3591f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaae9ff expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.221367:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35926 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.221380:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35926 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.221390:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35926 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.221401:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3592d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.221409:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3592d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.221415:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3592d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.221497:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f35934 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x126c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.221506:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f35934 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.221513:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f35934 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508740.221552:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x126c:0x0]: returning size 0 00000004:00200000:0.0:1787508740.221557:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508740.221581:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f35934 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.221597:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f35934 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.221607:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35926 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.221613:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35926 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.221619:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35926 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.221626:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35926 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.221632:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508740.221636:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35926 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.221644:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35926 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.221656:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508740.221659:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508740.221663:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35926 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.221669:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35926 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.221682:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3592d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.221688:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3592d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.221693:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3592d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.221697:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508740.221700:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3592d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.221705:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3592d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.221711:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb0d9dfe0 (ffff9090d36fd700) 00010000:00010000:0.0:1787508740.221714:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508740.221716:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3592d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.221721:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3592d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.221747:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f3591f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9ff expref: 8 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.221759:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f35934 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9ff expref: 7 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.221766:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126c:0x0].0x0 (ffff9090d36fdf00) 00010000:00010000:0.0:1787508740.221768:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787508740.221771:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5400, rc 0) 00000100:00100000:0.0:1787508740.222058:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:342958:x1874324509634304:12345-192.168.201.30@tcp:101:mv.0 Request processed in 814us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508740.222065:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94155 00000100:00100000:3.0:1787508740.226365:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508740.226524:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509634432 00000100:00100000:2.0:1787508740.226533:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509634432 00000100:00100000:2.0:1787508740.226587:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94156 00000100:00100000:2.0:1787508740.226596:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:342958:x1874324509634432:12345-192.168.201.30@tcp:101:mv.0 00010000:00010000:2.0:1787508740.226616:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508740.226634:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3593b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaea06 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.226694:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35942 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.226707:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35942 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.226718:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35942 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.226728:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35949 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.226735:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35949 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.226742:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35949 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.226825:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f35950 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.226834:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f35950 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.226842:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f35950 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508740.226876:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508740.226896:0:203348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f35950 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.226910:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35942 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.226917:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35942 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.226924:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35942 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.226931:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35942 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.226936:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508740.226957:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35942 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.226969:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35942 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.226981:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508740.226984:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508740.226988:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35942 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.226994:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35942 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.227007:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35949 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.227012:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35949 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.227019:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35949 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.227023:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508740.227035:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35949 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.227041:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35949 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.227047:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x144b74e0 (ffff9090d02ada00) 00010000:00010000:2.0:1787508740.227050:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508740.227053:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35949 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.227059:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35949 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.227081:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3593b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea06 expref: 9 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.227093:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f35950 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea06 expref: 8 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.227100:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126b:0x0].0x0 (ffff9090d1b2b300) 00010000:00010000:2.0:1787508740.227102:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787508740.227105:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aac00, rc 0) 00000100:00100000:2.0:1787508740.227156:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:342958:x1874324509634432:12345-192.168.201.30@tcp:101:mv.0 Request processed in 561us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508740.227163:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94156 00000100:00100000:3.0:1787508740.230645:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508740.230758:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509634560 00000100:00100000:0.0:1787508740.230768:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509634560 00000100:00100000:0.0:1787508740.230840:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94157 00000100:00100000:0.0:1787508740.230851:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e61d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2401:x1874324509634560:12345-192.168.201.30@tcp:101:mv.0 00010000:00010000:0.0:1787508740.230872:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508740.230892:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35957 lrc: 2/0,0 mode: --/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaea0d expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.230926:0:202226:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f35903 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x40/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9ea expref: 29 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508740.231004:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4c87480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480207872:192.168.201.30@tcp:106: 00000100:00100000:0.0:1787508740.231085:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c966ec00 going to sleep for 11 seconds 00000004:00010000:0.0:1787508740.234381:0:202226:0:(mdt_lvb.c:177:mdt_dom_lvbo_update()) res: [0x2000013a4:0x126b:0x0] updating lvb size: 0 -> 4096 00000004:00010000:0.0:1787508740.234391:0:202226:0:(mdt_lvb.c:201:mdt_dom_lvbo_update()) res: [0x2000013a4:0x126b:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:0.0:1787508740.234418:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4c87480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480207872:192.168.201.30@tcp:106: 00002000:00010000:0.0:1787508740.234445:0:202226:0:(mdt_io.c:1552:mdt_lvb2reply()) size 4096 00010000:00010000:0.0:1787508740.234467:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35957 lrc: 1/0,0 mode: --/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x40/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea0d expref: 9 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.234489:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126b:0x0].0x0 (ffff9090d1b2b300) 00010000:00010000:0.0:1787508740.234492:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787508740.234498:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35957 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x40/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea0d expref: 9 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508740.234512:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5200, rc 0) 00000100:00100000:0.0:1787508740.234577:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e61d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2401:x1874324509634560:12345-192.168.201.30@tcp:101:mv.0 Request processed in 3727us (3941us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508740.234588:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94157 00000100:00100000:3.0:1787508740.238103:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508740.238307:0:225832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509634688 00000100:00100000:2.0:1787508740.238317:0:225832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509634688 00000100:00100000:2.0:1787508740.238393:0:225832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15075 00000100:00100000:2.0:1787508740.238403:0:225832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e61d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509634688:12345-192.168.201.30@tcp:101:mv.0 00010000:00010000:2.0:1787508740.238422:0:225832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508740.238447:0:225832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa96315d/0xb126349c40f3595e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x158c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaea14 expref: -99 pid: 225832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787508740.238472:0:225832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x158c:0x0] initial LVB size: 0, mtime: 0x6a8b3804, atime: 0x6a8b3804, ctime: 0x6a8b3804, blocks: 0x0 00010000:00010000:2.0:1787508740.238493:0:225832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x158c:0x0].0x0 since=13711s v=(0 0) 00010000:00010000:2.0:1787508740.238497:0:225832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x158c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787508740.238508:0:225832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa96315d/0xb126349c40f3595e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x158c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea14 expref: 7 pid: 225832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.238529:0:225832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fa96315d/0xb126349c40f3595e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x158c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea14 expref: 7 pid: 225832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.238543:0:225832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa800, rc 0) 00000100:00100000:2.0:1787508740.238611:0:225832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e61d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2400:x1874324509634688:12345-192.168.201.30@tcp:101:mv.0 Request processed in 209us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508740.238619:0:225832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15075 00000100:00080000:3.0:1787508740.238730:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508740.242099:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508740.242392:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509634816 00000100:00100000:2.0:1787508740.242403:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509634816 00000100:00100000:2.0:1787508740.242464:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94158 00000100:00100000:2.0:1787508740.242475:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2401:x1874324509634816:12345-192.168.201.30@tcp:101:mv.0 00010000:00010000:2.0:1787508740.242496:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508740.242517:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35965 lrc: 2/0,0 mode: --/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaea1b expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.242554:0:202228:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f35903 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x40/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9ea expref: 29 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508740.242598:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480208000:192.168.201.30@tcp:106: 00000100:00100000:2.0:1787508740.242696:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090e6fc3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787508740.245084:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480208000:192.168.201.30@tcp:106: 00002000:00010000:2.0:1787508740.245115:0:202228:0:(mdt_io.c:1552:mdt_lvb2reply()) size 4096 00010000:00010000:2.0:1787508740.245137:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35965 lrc: 1/0,0 mode: --/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x40/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea1b expref: 9 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.245158:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126b:0x0].0x0 (ffff9090d1b2b300) 00010000:00010000:2.0:1787508740.245161:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787508740.245166:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35965 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x40/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea1b expref: 9 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508740.245180:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abe00, rc 0) 00000100:00100000:2.0:1787508740.245364:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2401:x1874324509634816:12345-192.168.201.30@tcp:101:mv.0 Request processed in 2890us (3274us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508740.245372:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94158 00000100:00100000:3.0:1787508740.248724:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508740.248851:0:202239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509635072 00000100:00100000:1.0:1787508740.248859:0:202239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509635072 00000100:00100000:1.0:1787508740.248921:0:202239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7759 00000100:00100000:1.0:1787508740.248931:0:202239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:342958:x1874324509635072:12345-192.168.201.30@tcp:36:mv.0 00010000:00010000:1.0:1787508740.249045:0:202239:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787508740.249077:0:202239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f35950 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea06 expref: 8 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249102:0:202239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126b:0x0].0x0 (ffff9090d1b2b300) 00010000:00010000:1.0:1787508740.249115:0:202239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f35934 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x126c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9ff expref: 7 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249127:0:202239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126c:0x0].0x0 (ffff9090d36fdf00) 00010000:00010000:1.0:1787508740.249135:0:202239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f35918 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9f8 expref: 6 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249144:0:202239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508740.249147:0:202239:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787508740.249178:0:202239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3596c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249204:0:202239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3596c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249213:0:202239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3596c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249224:0:202239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f35973 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249230:0:202239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f35973 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249235:0:202239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f35973 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249244:0:202239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3597a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249251:0:202239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3597a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249257:0:202239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3597a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249384:0:202239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35981 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x126b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249393:0:202239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35981 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126b:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249401:0:202239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35981 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126b:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249412:0:202239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35988 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x126c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249419:0:202239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35988 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249425:0:202239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35988 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249745:0:202239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35981 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126b:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249754:0:202239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35981 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x126b:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249761:0:202239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35981 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x126b:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249768:0:202239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508740.249773:0:202239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35981 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x126b:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249780:0:202239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35981 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x126b:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249789:0:202239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126b:0x0].0x0 (ffff9090d1b2b300) 00010000:00010000:1.0:1787508740.249791:0:202239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787508740.249796:0:202239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35981 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x126b:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249802:0:202239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35981 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x126b:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508740.249813:0:202239:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bfc68564 reply state 00000000afc27d05 transno 12884944210 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35988 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249824:0:202239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35988 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x126c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249830:0:202239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126c:0x0].0x0 (ffff9090d36fdf00) 00010000:00010000:1.0:1787508740.249832:0:202239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00000100:00100000:1.0:1787508740.249835:0:202239:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787508740.249842:0:202239:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3596c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249849:0:202239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3596c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249854:0:202239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3596c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249860:0:202239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3596c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249864:0:202239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508740.249867:0:202239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3596c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249872:0:202239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3596c lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249879:0:202239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508740.249881:0:202239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508740.249884:0:202239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3596c lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249889:0:202239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3596c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508740.249897:0:202239:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bfc68564 reply state 00000000afc27d05 transno 12884944210 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f35973 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249904:0:202239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f35973 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249909:0:202239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x144b74e0 (ffff9090d02ada00) 00010000:00010000:1.0:1787508740.249911:0:202239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787508740.249913:0:202239:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00010000:1.0:1787508740.249915:0:202239:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bfc68564 reply state 00000000afc27d05 transno 12884944210 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3597a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249922:0:202239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3597a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249928:0:202239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb0d9dfe0 (ffff9090d36fd700) 00010000:00010000:1.0:1787508740.249930:0:202239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787508740.249931:0:202239:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00010000:00010000:1.0:1787508740.249969:0:202239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f3598f lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249980:0:202239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f35903 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9ea expref: 29 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.249988:0:202239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f3598f lrc: 4/0,1 mode: --/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT flags: 0x50010080000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.250024:0:202239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f35903 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000080010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9ea expref: 29 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.250041:0:202239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f35903 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000480010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9ea expref: 29 pid: 203348 timeout: 13811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508740.250055:0:202239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb60000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:202239:1874324480208128:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508740.250138:0:202239:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1e756c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508740.252684:0:202239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb60000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:202239:1874324480208128:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508740.252719:0:202239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f3598f lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT flags: 0x40010080000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508740.252825:0:202239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:342958:x1874324509635072:12345-192.168.201.30@tcp:36:mv.0 Request processed in 3894us (4109us total) trans 12884944210 rc 0/0 00000100:00100000:1.0:1787508740.252834:0:202239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7759 00000100:00100000:3.0:1787508740.254797:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508740.254877:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509635200 00000100:00100000:1.0:1787508740.254889:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509635200 00010000:00010000:1.0:1787508740.254931:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f35903 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000480010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9ea expref: 30 pid: 203348 timeout: 13811 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508740.255006:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27948 00000100:00100000:1.0:1787508740.255015:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9f1a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+30:2400:x1874324509635200:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508740.255040:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508740.255047:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f35903 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x40/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000480010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9ea expref: 30 pid: 203348 timeout: 13811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.255061:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f35903 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x40/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000480010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9ea expref: 30 pid: 203348 timeout: 13811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.255084:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f35903 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x40/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801480010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9ea expref: 30 pid: 203348 timeout: 13811 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.255102:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126b:0x0].0x0 (ffff9090d1b2b300) 00010000:00010000:1.0:1787508740.255107:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 6 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f3598f lrc: 2/0,1 mode: --/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT flags: 0x40010080000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.255117:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f3598f lrc: 2/0,1 mode: PW/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT flags: 0x40090080000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.255124:0:202212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f3598f lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT flags: 0x40090080000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.255140:0:202212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f3598f lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT flags: 0x50010080000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.255153:0:202212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f3598f lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT flags: 0x50010480000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508740.255167:0:202212:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787508740.255181:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508740.255237:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9f1a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+29:2400:x1874324509635200:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 222us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508740.255244:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27948 00010000:00010000:3.0:1787508740.255490:0:226765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787508740.255497:0:226765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f3598f lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508740.255503:0:226765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b400 already unused, calling callback (ffffffffc0d0a230) 00010000:00010000:3.0:1787508740.255508:0:226765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f3598f lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508740.255515:0:226765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f3598f lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508740.255524:0:226765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126b:0x0].0x0 (ffff9090d1b2b300) 00010000:00010000:3.0:1787508740.255526:0:226765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787508740.255530:0:226765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f3598f lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508740.255535:0:226765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f3598f lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x126b:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508740.255547:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508740.255548:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508740.255550:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508740.282587:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480208256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787508740.282660:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508740.282922:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480208384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787508740.282982:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508740.283125:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480208256 00000100:00100000:1.0:1787508740.283133:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480208256 00000100:00100000:1.0:1787508740.283201:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480208384 00000100:00100000:1.0:1787508740.283205:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480208384 00000100:00100000:1.0:1787508740.283227:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1723 00000100:00100000:1.0:1787508740.283235:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480208256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787508740.283265:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 41194048 pending 0 free 3909767168 avail 3678244864 00000100:00100000:1.0:1787508740.283318:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480208256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508740.283325:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1723 00000100:00100000:1.0:1787508740.283342:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1724 00000100:00100000:1.0:1787508740.283348:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f2ad9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480208384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787508740.283358:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 41194048 pending 0 free 3909767168 avail 3678244864 00000100:00100000:1.0:1787508740.283387:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f2ad9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480208384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508740.283394:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1724 00000100:00100000:1.0:1787508740.283658:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480208384:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787508740.283826:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480208256:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787508740.283892:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787508740.666277:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508741.307140:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787508741.307168:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480208512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787508741.307244:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508741.307312:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480208512 00000100:00100000:1.0:1787508741.307320:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480208512 00000100:00100000:1.0:1787508741.307374:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29898 00000100:00100000:1.0:1787508741.307384:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480208512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787508741.307422:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440694272 avail 1294454784 00000100:00100000:1.0:1787508741.307475:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480208512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508741.307482:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29898 00000100:00100000:1.0:1787508741.307533:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480208512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787508741.307871:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787508741.307883:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480208640:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787508741.307917:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508741.307973:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480208640 00000100:00100000:3.0:1787508741.307977:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480208640 00000100:00100000:3.0:1787508741.308006:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29899 00000100:00100000:3.0:1787508741.308012:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480208640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787508741.308032:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442766848 avail 1296527360 00000100:00100000:3.0:1787508741.308068:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480208640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508741.308074:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29899 00000100:00100000:3.0:1787508741.308110:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480208640:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787508741.695151:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508741.819327:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480208768:0@lo:400:kworker.0 00000100:00100000:2.0:1787508741.819403:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508741.819448:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480209280:0@lo:400:kworker.0 00000100:00100000:2.0:1787508741.819475:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508741.819496:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874324480209792:0@lo:400:kworker.0 00000100:00100000:2.0:1787508741.819519:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508741.819545:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787508741.819551:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480208896:0@lo:400:kworker.0 00000100:00100000:2.0:1787508741.819573:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508741.819590:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480209408:0@lo:400:kworker.0 00000100:00100000:2.0:1787508741.819611:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508741.819625:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480209920:0@lo:400:kworker.0 00000100:00100000:2.0:1787508741.819643:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508741.819671:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480209024:0@lo:400:kworker.0 00000100:00100000:2.0:1787508741.819695:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508741.819712:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874324480209536:0@lo:400:kworker.0 00000100:00100000:2.0:1787508741.819734:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508741.819752:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874324480210048:0@lo:400:kworker.0 00000100:00100000:2.0:1787508741.819773:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508741.819791:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787508741.819797:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874324480209152:0@lo:400:kworker.0 00000100:00100000:2.0:1787508741.819819:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508741.819836:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874324480209664:0@lo:400:kworker.0 00000100:00100000:2.0:1787508741.819855:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508741.819858:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480208768 00000100:00100000:0.0:1787508741.819866:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480208768 00000100:00100000:2.0:1787508741.819882:0:203996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480209280 00000100:00100000:2.0:1787508741.819885:0:203996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480209280 00000100:00100000:2.0:1787508741.819907:0:203996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480208896 00000100:00100000:2.0:1787508741.819910:0:203996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480208896 00000100:00100000:0.0:1787508741.819911:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:0.0:1787508741.819918:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed598450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480208768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508741.819925:0:203996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480209408 00000100:00100000:2.0:1787508741.819927:0:203996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480209408 00000100:00100000:2.0:1787508741.819970:0:203996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480209024 00000100:00100000:2.0:1787508741.819974:0:203996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480209024 00000100:00100000:0.0:1787508741.819992:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed598450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480208768:12345-0@lo:400:kworker.0 Request processed in 74us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508741.819999:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:2.0:1787508741.820005:0:203996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2450 00000100:00100000:2.0:1787508741.820011:0:203996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480209280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508741.820034:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480209792 00000100:00100000:0.0:1787508741.820038:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480209792 00000100:00100000:2.0:1787508741.820042:0:203996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480209280:12345-0@lo:400:kworker.0 Request processed in 33us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508741.820048:0:203996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2450 00000100:00100000:2.0:1787508741.820061:0:203996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2451 00000100:00100000:0.0:1787508741.820062:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480209920 00000100:00100000:0.0:1787508741.820064:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480209920 00000100:00100000:2.0:1787508741.820067:0:203996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480208896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508741.820075:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480209536 00000100:00100000:0.0:1787508741.820077:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480209536 00000100:00100000:0.0:1787508741.820086:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480210048 00000100:00100000:0.0:1787508741.820089:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480210048 00000100:00100000:2.0:1787508741.820091:0:203996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480208896:12345-0@lo:400:kworker.0 Request processed in 25us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508741.820097:0:203996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2451 00000100:00100000:0.0:1787508741.820099:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480209152 00000100:00100000:0.0:1787508741.820101:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480209152 00000100:00100000:2.0:1787508741.820106:0:203996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2452 00000100:00100000:0.0:1787508741.820110:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480209664 00000100:00100000:2.0:1787508741.820111:0:203996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480209408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508741.820113:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480209664 00000100:00100000:0.0:1787508741.820127:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3090 00000100:00100000:0.0:1787508741.820133:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874324480209792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508741.820134:0:203996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480209408:12345-0@lo:400:kworker.0 Request processed in 23us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508741.820139:0:203996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2452 00000100:00100000:2.0:1787508741.820150:0:203996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2453 00000100:00100000:2.0:1787508741.820156:0:203996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480209024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508741.820159:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874324480209792:12345-0@lo:400:kworker.0 Request processed in 26us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508741.820164:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3090 00000100:00100000:0.0:1787508741.820176:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3091 00000100:00100000:0.0:1787508741.820182:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480209920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508741.820184:0:203996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480209024:12345-0@lo:400:kworker.0 Request processed in 29us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508741.820189:0:203996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2453 00000100:00100000:2.0:1787508741.820207:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3092 00000100:00100000:0.0:1787508741.820207:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480209920:12345-0@lo:400:kworker.0 Request processed in 26us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508741.820212:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3091 00000100:00100000:2.0:1787508741.820213:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874324480209536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508741.820223:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3093 00000100:00100000:0.0:1787508741.820228:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874324480210048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508741.820238:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874324480209536:12345-0@lo:400:kworker.0 Request processed in 26us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508741.820243:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3092 00000100:00100000:0.0:1787508741.820263:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874324480210048:12345-0@lo:400:kworker.0 Request processed in 35us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508741.820269:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3093 00000100:00100000:2.0:1787508741.820417:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3094 00000100:00100000:2.0:1787508741.820426:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874324480209152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508741.820455:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874324480209152:12345-0@lo:400:kworker.0 Request processed in 33us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508741.820461:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3094 00000100:00100000:2.0:1787508741.820474:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3095 00000100:00100000:2.0:1787508741.820480:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874324480209664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508741.820504:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874324480209664:12345-0@lo:400:kworker.0 Request processed in 25us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508741.820510:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3095 00000100:00100000:2.0:1787508741.820581:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874324480209152:0@lo:400:kworker.0 00000100:00100000:2.0:1787508741.820591:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874324480209664:0@lo:400:kworker.0 00000100:00100000:2.0:1787508741.820602:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480209024:0@lo:400:kworker.0 00000100:00100000:2.0:1787508741.820610:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874324480209536:0@lo:400:kworker.0 00000100:00100000:2.0:1787508741.820618:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874324480210048:0@lo:400:kworker.0 00000100:00080000:0.0:1787508741.829482:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787508741.829493:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508741.829497:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508741.829563:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480208896:0@lo:400:kworker.0 00000100:00100000:0.0:1787508741.829580:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480209408:0@lo:400:kworker.0 00000100:00100000:0.0:1787508741.829592:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480209920:0@lo:400:kworker.0 00000100:00100000:0.0:1787508741.829604:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480208768:0@lo:400:kworker.0 00000100:00100000:0.0:1787508741.829616:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480209280:0@lo:400:kworker.0 00000100:00100000:0.0:1787508741.829632:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874324480209792:0@lo:400:kworker.0 00010000:00010000:2.0:1787508742.715179:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508743.276288:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508743.276335:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508743.276768:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509635328 00000100:00100000:0.0:1787508743.276778:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509635328 00000100:00100000:0.0:1787508743.276843:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1028 00000100:00100000:0.0:1787508743.276854:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed59ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509635328:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508743.276923:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed59ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509635328:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 71us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508743.276932:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1028 00000100:00100000:3.0:1787508743.277185:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508743.277215:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508743.277259:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509635840 00000100:00100000:0.0:1787508743.277264:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509635840 00000100:00100000:0.0:1787508743.277302:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2454 00000100:00100000:0.0:1787508743.277310:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2402:x1874324509635840:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508743.277347:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2402:x1874324509635840:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 38us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508743.277354:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2454 00000100:00080000:0.0:1787508743.277377:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508743.278210:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508743.278243:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508743.278283:0:203728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509636352 00000100:00100000:1.0:1787508743.278289:0:203728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509636352 00000100:00100000:1.0:1787508743.278326:0:203728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2455 00000100:00100000:1.0:1787508743.278334:0:203728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2402:x1874324509636352:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508743.278373:0:203728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2402:x1874324509636352:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 41us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508743.278379:0:203728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2455 00000100:00100000:2.0:1787508743.278819:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509635584 00000100:00100000:2.0:1787508743.278825:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509635584 00000100:00100000:3.0:1787508743.279905:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508743.279932:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508743.280290:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509636096 00000100:00100000:0.0:1787508743.280297:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509636096 00000100:00100000:0.0:1787508743.280341:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509635456 00000100:00100000:0.0:1787508743.280344:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509635456 00000100:00100000:0.0:1787508743.280365:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3096 00000100:00100000:0.0:1787508743.280375:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509635584:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508743.280432:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509635584:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 58us (4096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508743.280440:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3096 00000100:00100000:0.0:1787508743.280457:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3097 00000100:00100000:0.0:1787508743.280462:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509636096:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508743.280485:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509636096:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (3270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508743.280492:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3097 00000100:00100000:0.0:1787508743.280506:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3098 00000100:00100000:0.0:1787508743.280513:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+29:2402:x1874324509635456:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508743.280733:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+29:2402:x1874324509635456:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 40us (2308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508743.280741:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3098 00000100:00100000:0.0:1787508743.280770:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509635712 00000100:00100000:0.0:1787508743.280845:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509635712 00000100:00100000:0.0:1787508743.280877:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2456 00000100:00100000:0.0:1787508743.280884:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509635712:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508743.280911:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509635712:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 28us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508743.280918:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2456 00000100:00080000:0.0:1787508743.280964:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787508743.280968:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787508743.280971:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508743.280972:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508743.283055:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509635968 00000100:00100000:0.0:1787508743.283069:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509635968 00000100:00100000:0.0:1787508743.283389:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3099 00000100:00100000:0.0:1787508743.283399:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2402:x1874324509635968:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508743.283480:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2402:x1874324509635968:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 83us (3547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508743.283487:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3099 00000100:00100000:0.0:1787508743.283699:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508743.284242:0:230130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509636224 00000100:00100000:0.0:1787508743.284248:0:230130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509636224 00000100:00080000:1.0:1787508743.284566:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787508743.284571:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787508743.285002:0:230130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2457 00000100:00100000:0.0:1787508743.285011:0:230130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509636224:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508743.285081:0:230130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509636224:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 72us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508743.285089:0:230130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2457 00010000:00010000:3.0:1787508743.742023:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508743.866638:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787508743.866662:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480210176:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787508743.866753:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508743.866962:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480210176 00000100:00100000:3.0:1787508743.866971:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480210176 00000100:00100000:3.0:1787508743.867029:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1725 00000100:00100000:3.0:1787508743.867039:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480210176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787508743.867068:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 131576384 pending 0 free 3881955328 avail 3650433024 00000100:00100000:3.0:1787508743.867113:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480210176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508743.867120:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1725 00000100:00100000:0.0:1787508743.867309:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480210176:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787508743.868342:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508743.868358:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787508743.868373:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480210304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508743.868421:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508743.868461:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480210304 00000100:00100000:1.0:1787508743.868468:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480210304 00000100:00100000:1.0:1787508743.868509:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1726 00000100:00100000:1.0:1787508743.868517:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480210304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787508743.868535:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 131576384 pending 0 free 3881955328 avail 3650433024 00000100:00100000:1.0:1787508743.868572:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480210304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508743.868579:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1726 00000100:00080000:1.0:1787508743.868595:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508743.868622:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480210304:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787508744.762447:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508745.402567:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787508745.402704:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787508745.402726:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480210560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787508745.402801:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508745.402960:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480210560 00000100:00100000:3.0:1787508745.402967:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480210560 00000100:00100000:3.0:1787508745.403017:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1727 00000100:00100000:3.0:1787508745.403027:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480210560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787508745.403056:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 41194048 pending 0 free 3909767168 avail 3678244864 00000100:00080000:1.0:1787508745.403210:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787508745.403481:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480210560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 455us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508745.403490:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1727 00000100:00100000:3.0:1787508745.403541:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480210560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787508745.406990:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480210432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787508745.407070:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508745.407371:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480210432 00000100:00100000:1.0:1787508745.407380:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480210432 00000100:00100000:1.0:1787508745.407526:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1728 00000100:00100000:1.0:1787508745.407536:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480210432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787508745.407560:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 41194048 pending 0 free 3909767168 avail 3678244864 00000100:00100000:1.0:1787508745.407627:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480210432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508745.407635:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1728 00000100:00100000:0.0:1787508745.407835:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480210432:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787508745.414542:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787508745.787005:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787508745.921754:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944210 is committed 00000001:00080000:0.0:1787508745.921791:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944209 is committed 00010000:00010000:1.0:1787508745.921894:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f35846 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508745.921907:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f35846 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508745.921924:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f35846 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508745.921931:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508745.921937:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f35846 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508745.921971:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f35846 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508745.921990:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x144b74e0 (ffff9090d02ada00) 00010000:00010000:1.0:1787508745.921994:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508745.921999:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f35846 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508745.922005:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f35846 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508745.922026:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3588c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508745.922032:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3588c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508745.922037:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3588c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508745.922053:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508745.922056:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3588c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508745.922063:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3588c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508745.922072:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb0d9dfe0 (ffff9090d36fd700) 00010000:00010000:1.0:1787508745.922074:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508745.922077:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3588c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508745.922082:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f3588c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508745.922107:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f358a1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x126c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508745.922123:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f358a1 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x126c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508745.922129:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f358a1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x126c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508745.922134:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508745.922137:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f358a1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x126c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508745.922143:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f358a1 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x126c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508745.922150:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126c:0x0].0x0 (ffff9090d36fdf00) 00010000:00010000:1.0:1787508745.922152:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508745.922155:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f358a1 lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x126c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508745.922160:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f358a1 lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x126c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508745.922171:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f358fc lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x126b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508745.922192:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f358fc lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x126b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508745.922197:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f358fc lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x126b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508745.922203:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508745.922206:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f358fc lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x126b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508745.922212:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f358fc lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x126b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508745.922219:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126b:0x0].0x0 (ffff9090d1b2b300) 00010000:00010000:1.0:1787508745.922221:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508745.922224:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f358fc lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x126b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508745.922230:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f358fc lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x126b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508745.922559:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3597a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508745.922567:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3597a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508745.922573:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3597a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508745.922579:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508745.922582:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3597a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508745.922588:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3597a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508745.922597:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb0d9dfe0 (ffff9090d36fd700) 00010000:00010000:3.0:1787508745.922600:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508745.922603:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3597a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508745.922608:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f3597a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb0d9dfe0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508745.922625:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f35973 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508745.922631:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f35973 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508745.922637:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f35973 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508745.922641:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508745.922644:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f35973 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508745.922650:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f35973 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508745.922662:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x144b74e0 (ffff9090d02ada00) 00010000:00010000:3.0:1787508745.922665:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508745.922667:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f35973 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508745.922673:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f35973 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x144b74e0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508745.922683:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35988 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x126c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508745.922689:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35988 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x126c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508745.922694:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35988 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x126c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508745.922698:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508745.922701:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35988 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x126c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508745.922707:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35988 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x126c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508745.922713:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126c:0x0].0x0 (ffff9090d36fdf00) 00010000:00010000:3.0:1787508745.922716:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787508745.922718:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35988 lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x126c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508745.922723:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35988 lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x126c:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202239 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787508745.924663:0:204539:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589940563 is committed 00000100:00100000:2.0:1787508746.427165:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787508746.427210:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480210688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787508746.427324:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508746.427984:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480210688 00000100:00100000:1.0:1787508746.427998:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480210688 00000100:00100000:1.0:1787508746.428072:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29900 00000100:00100000:1.0:1787508746.428093:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480210688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787508746.428146:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440694272 avail 1294454784 00000100:00100000:1.0:1787508746.428243:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480210688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508746.428254:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29900 00000100:00100000:2.0:1787508746.428419:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480210688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787508746.428921:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787508746.428938:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480210816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787508746.429011:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508746.429211:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480210816 00000100:00100000:3.0:1787508746.429217:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480210816 00000100:00100000:3.0:1787508746.429266:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29901 00000100:00100000:3.0:1787508746.429274:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480210816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787508746.429306:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442766848 avail 1296527360 00000100:00100000:3.0:1787508746.429362:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480210816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508746.429369:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29901 00000100:00100000:1.0:1787508746.429489:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480210816:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787508746.813926:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508746.939500:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79de3f65-4bad-42d0-a46f-842a654b33a0:3619:1874324480210944:0@lo:400:kworker.0 00000100:00100000:1.0:1787508746.939605:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508746.939658:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480210944 00000100:00100000:0.0:1787508746.939669:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480210944 00000100:00100000:0.0:1787508746.939737:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:0.0:1787508746.939748:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed59a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3619:x1874324480210944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508746.939823:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79de3f65-4bad-42d0-a46f-842a654b33a0:3619:1874324480210944:0@lo:400:kworker.0 00000100:00100000:0.0:1787508746.942588:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed59a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3619:x1874324480210944:12345-0@lo:400:kworker.0 Request processed in 2824us (2965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508746.942611:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00100000:2.0:1787508746.948617:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480211072:0@lo:400:kworker.0 00000100:00100000:2.0:1787508746.948739:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508746.949024:0:225843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480211072 00000100:00100000:0.0:1787508746.949036:0:225843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480211072 00000100:00100000:0.0:1787508746.949216:0:225843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2458 00000100:00100000:0.0:1787508746.949227:0:225843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480211072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508746.949298:0:225843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480211072:12345-0@lo:400:kworker.0 Request processed in 73us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508746.949306:0:225843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2458 00000100:00100000:2.0:1787508746.949405:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480211072:0@lo:400:kworker.0 00000100:00100000:2.0:1787508746.959451:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787508746.959635:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787508746.959647:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480211328:0@lo:400:kworker.0 00000100:00100000:3.0:1787508746.959752:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508746.959821:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480211328 00000100:00100000:3.0:1787508746.959831:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480211328 00000100:00100000:3.0:1787508746.960011:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3100 00000100:00100000:3.0:1787508746.960022:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480211328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508746.960179:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480211328:12345-0@lo:400:kworker.0 Request processed in 157us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508746.960188:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3100 00000100:00100000:3.0:1787508746.960253:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480211328:0@lo:400:kworker.0 00000100:00100000:3.0:1787508746.960296:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480211456:0@lo:400:kworker.0 00000100:00100000:3.0:1787508746.960330:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508746.960375:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787508746.960383:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480211584:0@lo:400:kworker.0 00000100:00100000:3.0:1787508746.960408:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508746.960439:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480211456 00000100:00100000:3.0:1787508746.960444:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480211456 00000100:00100000:3.0:1787508746.960476:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480211584 00000100:00100000:3.0:1787508746.960479:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480211584 00000100:00100000:2.0:1787508746.960584:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480211200:0@lo:400:kworker.0 00000100:00100000:2.0:1787508746.960622:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508746.960654:0:225832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480211200 00000100:00100000:2.0:1787508746.960658:0:225832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480211200 00000100:00100000:3.0:1787508746.960709:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2459 00000100:00100000:3.0:1787508746.960717:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480211456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508746.960759:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480211456:12345-0@lo:400:kworker.0 Request processed in 44us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508746.960766:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2459 00000100:00100000:3.0:1787508746.960779:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2460 00000100:00080000:0.0:1787508746.963263:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787508746.964540:0:225832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2461 00000100:00100000:2.0:1787508746.964558:0:225832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480211200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508746.964694:0:225832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480211200:12345-0@lo:400:kworker.0 Request processed in 142us (4071us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508746.964703:0:225832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2461 00000100:00100000:2.0:1787508746.964785:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480211200:0@lo:400:kworker.0 00000100:00100000:2.0:1787508746.964888:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787508746.964901:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874324480211712:0@lo:400:kworker.0 00000100:00100000:2.0:1787508746.964977:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508746.965025:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480211712 00000100:00100000:2.0:1787508746.965033:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480211712 00000100:00100000:2.0:1787508746.965082:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3101 00000100:00100000:2.0:1787508746.965090:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874324480211712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508746.966687:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874324480211712:12345-0@lo:400:kworker.0 Request processed in 1584us (1696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508746.966703:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3101 00000100:00100000:2.0:1787508746.966796:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874324480211712:0@lo:400:kworker.0 00000100:00100000:2.0:1787508746.966920:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480212096:0@lo:400:kworker.0 00000100:00100000:2.0:1787508746.966988:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508746.967047:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787508746.967053:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874324480212224:0@lo:400:kworker.0 00000100:00100000:2.0:1787508746.967269:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508746.967308:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480212096 00000100:00100000:2.0:1787508746.967316:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480212096 00000100:00100000:2.0:1787508746.967369:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480212224 00000100:00100000:2.0:1787508746.967373:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480212224 00000100:00100000:2.0:1787508746.967397:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3102 00000100:00100000:2.0:1787508746.967407:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480212096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508746.967460:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480212096:12345-0@lo:400:kworker.0 Request processed in 55us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508746.967468:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3102 00000100:00100000:2.0:1787508746.967482:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3103 00000100:00100000:2.0:1787508746.967489:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874324480212224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508746.967604:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874324480212224:12345-0@lo:400:kworker.0 Request processed in 114us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508746.967611:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3103 00000100:00100000:2.0:1787508746.967642:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874324480212224:0@lo:400:kworker.0 00000100:00100000:2.0:1787508746.967652:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480212096:0@lo:400:kworker.0 00000100:00100000:2.0:1787508746.967735:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480211968:0@lo:400:kworker.0 00000100:00100000:2.0:1787508746.967766:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508746.967801:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480211456:0@lo:400:kworker.0 00000100:00100000:2.0:1787508746.967818:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787508746.967823:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480211840:0@lo:400:kworker.0 00000100:00100000:2.0:1787508746.967846:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508746.967870:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480211968 00000100:00100000:2.0:1787508746.968037:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480211968 00000100:00100000:2.0:1787508746.968085:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480211840 00000100:00100000:2.0:1787508746.968089:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480211840 00000100:00100000:2.0:1787508746.968109:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3104 00000100:00100000:2.0:1787508746.968198:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480211968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508746.968239:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480211968:12345-0@lo:400:kworker.0 Request processed in 45us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508746.968246:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3104 00000100:00100000:2.0:1787508746.968259:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3105 00000100:00100000:2.0:1787508746.968266:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480211840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508746.968294:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480211840:12345-0@lo:400:kworker.0 Request processed in 29us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508746.968300:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3105 00000100:00100000:2.0:1787508746.968333:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480211840:0@lo:400:kworker.0 00000100:00100000:2.0:1787508746.968343:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480211968:0@lo:400:kworker.0 00000100:00100000:3.0:1787508746.972024:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480211584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508746.972360:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480211584:12345-0@lo:400:kworker.0 Request processed in 11572us (11947us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508746.972374:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2460 00000100:00100000:2.0:1787508746.972527:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480211584:0@lo:400:kworker.0 00000100:00080000:0.0:1787508746.973601:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508746.973610:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1787508747.093131:0:234278:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 101c: Discard DoM data on close-unlink === 14:12:25 (1787508745) 00000100:00100000:3.0:1787508747.222107:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508747.222340:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509636480 00000100:00100000:2.0:1787508747.222353:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509636480 00000100:00100000:2.0:1787508747.222441:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94159 00000100:00100000:2.0:1787508747.222455:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:343542:x1874324509636480:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508747.222479:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508747.222502:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35996 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaea22 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.222569:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3599d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.222587:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3599d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.222599:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3599d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508747.222642:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508747.222646:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508747.222666:0:205405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3599d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.222690:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35996 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea22 expref: 16 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.222708:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3599d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea22 expref: 15 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.222716:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508747.222719:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508747.222723:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa600, rc 0) 00000100:00100000:2.0:1787508747.222785:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:343542:x1874324509636480:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 333us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508747.222792:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94159 00000100:00080000:3.0:1787508747.224396:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508747.235150:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508747.235258:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509636608 00000100:00100000:0.0:1787508747.235278:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509636608 00000100:00100000:0.0:1787508747.235377:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94160 00000100:00100000:0.0:1787508747.235394:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:343542:x1874324509636608:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508747.235430:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508747.235466:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f359a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaea29 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.235582:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f359ab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.235599:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f359ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.235619:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f359ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.235638:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.235646:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.235652:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.235748:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f359ab lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.235757:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f359ab lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.235763:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f359ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.235771:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f359ab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.235777:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508747.235782:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f359ab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.235791:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f359ab lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.235806:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508747.235810:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508747.235815:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f359ab lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.235821:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f359ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.235839:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.235846:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359b2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.235852:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.235857:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508747.235860:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.235867:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359b2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.235874:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf4d6d012 (ffff9090d1b2b100) 00010000:00010000:0.0:1787508747.235876:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508747.235879:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359b2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.235884:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.235928:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f359a4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea29 expref: 16 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.235982:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508747.235985:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508747.235990:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f359a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea29 expref: 16 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.236001:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4000, rc 0) 00000100:00100000:0.0:1787508747.236184:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:343542:x1874324509636608:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 795us (1047us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508747.236194:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94160 00000100:00100000:3.0:1787508747.238754:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508747.239225:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509636864 00000100:00100000:2.0:1787508747.239238:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509636864 00000100:00100000:2.0:1787508747.239317:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94161 00000100:00100000:2.0:1787508747.239329:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:343542:x1874324509636864:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508747.239351:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508747.239354:0:203348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787508747.239384:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f3599d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea22 expref: 15 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.239407:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508747.239414:0:203348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508747.239430:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f359b9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaea30 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.239565:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f359c0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.239581:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f359c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.239594:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f359c0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.239615:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f359c7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.239623:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f359c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.239630:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f359c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508747.245478:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f359ce lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508747.245502:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f359ce lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508747.245514:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f359ce lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508747.245527:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x126d:0x0]: returning size 0 00010000:00010000:3.0:1787508747.245555:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f359c0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508747.245563:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f359c0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508747.245570:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f359c0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508747.245577:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f359c0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508747.245583:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508747.245587:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f359c0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508747.245594:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f359c0 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508747.245607:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508747.245610:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508747.245614:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f359c0 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508747.245620:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f359c0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508747.245633:0:203348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b6d3d45 reply state 000000001d6a9d7e transno 12884944211 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f359c7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508747.245643:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f359c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508747.245649:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf4d6d012 (ffff9090d36fd200) 00010000:00010000:3.0:1787508747.245651:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508747.245653:0:203348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787508747.245687:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f359b9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea30 expref: 17 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508747.245701:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f359ce lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea30 expref: 16 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508747.245708:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126d:0x0].0x0 (ffff9090cc088d00) 00010000:00010000:3.0:1787508747.245711:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787508747.245714:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f400, rc 0) 00000100:00100000:3.0:1787508747.245910:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:343542:x1874324509636864:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 6574us (7159us total) trans 12884944211 rc 0/0 00000100:00100000:3.0:1787508747.245921:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94161 00000100:00100000:3.0:1787508747.257729:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508747.257820:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509637120 00000100:00100000:0.0:1787508747.257840:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509637120 00000100:00100000:0.0:1787508747.257935:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94162 00000100:00100000:0.0:1787508747.257988:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:343542:x1874324509637120:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508747.258023:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508747.258053:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f359dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaea37 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.258208:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359e3 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.258227:0:209004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f359ce lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea30 expref: 18 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.258237:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359e3 lrc: 4/0,1 mode: --/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.258282:0:209004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f359ce lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea30 expref: 18 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.258301:0:209004:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f359ce lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea30 expref: 18 pid: 203348 timeout: 13818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508747.258322:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4c86680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480212352:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508747.258461:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3455a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787508747.262430:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4c86680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480212352:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508747.262490:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359e3 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508747.269149:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508747.269746:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509637248 00000100:00100000:3.0:1787508747.269762:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509637248 00010000:00010000:3.0:1787508747.269821:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f359ce lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea30 expref: 19 pid: 203348 timeout: 13818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508747.269877:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27949 00000100:00100000:3.0:1787508747.269890:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+19:2400:x1874324509637248:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508747.269910:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508747.269919:0:225839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f359ce lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea30 expref: 19 pid: 203348 timeout: 13818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508747.269936:0:225839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f359ce lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea30 expref: 19 pid: 203348 timeout: 13818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508747.270000:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f359ce lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea30 expref: 19 pid: 203348 timeout: 13818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508747.270022:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126d:0x0].0x0 (ffff9090cc088d00) 00010000:00010000:3.0:1787508747.270029:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359e3 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508747.270042:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359e3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508747.270051:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359e3 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508747.270083:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508747.270179:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+18:2400:x1874324509637248:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 290us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508747.270190:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27949 00010000:00010000:0.0:1787508747.270505:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359e3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.270516:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359e3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508747.270553:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x126d:0x0]: returning size 0 00010000:00010000:0.0:1787508747.270850:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359e3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.270860:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359e3 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.270867:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359e3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.270873:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508747.270879:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359e3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.270888:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359e3 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.270901:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126d:0x0].0x0 (ffff9090cc088d00) 00010000:00010000:0.0:1787508747.270904:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787508747.270908:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359e3 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.270914:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359e3 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.271001:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f359dc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea37 expref: 18 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.271010:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508747.271013:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508747.271017:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f359dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea37 expref: 18 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.271026:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4000, rc 0) 00000100:00100000:0.0:1787508747.271081:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:343542:x1874324509637120:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 13095us (13362us total) trans 12884944212 rc 301/301 00000100:00100000:0.0:1787508747.271090:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94162 00000100:00100000:3.0:1787508747.277986:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508747.278098:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509637504 00000100:00100000:1.0:1787508747.278112:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509637504 00000100:00100000:1.0:1787508747.278198:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15464 00000100:00100000:1.0:1787508747.278212:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:343542:x1874324509637504:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:1.0:1787508747.279461:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+18:343542:x1874324509637504:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 1243us (1478us total) trans 12884944213 rc 0/0 00000100:00100000:1.0:1787508747.279474:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15464 00000100:00100000:2.0:1787508747.286313:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508747.299494:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509637760 00000100:00100000:0.0:1787508747.299511:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509637760 00000100:00100000:1.0:1787508747.299664:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15465 00000100:00100000:1.0:1787508747.299682:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+18:343542:x1874324509637760:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:1.0:1787508747.300038:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+19:343542:x1874324509637760:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 361us (13740us total) trans 12884944214 rc 0/0 00000100:00100000:1.0:1787508747.300045:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15465 00000100:00100000:3.0:1787508747.321431:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508747.325100:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509637888 00000100:00100000:0.0:1787508747.325116:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509637888 00000100:00100000:0.0:1787508747.325212:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94163 00000100:00100000:0.0:1787508747.325224:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+19:343543:x1874324509637888:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:0.0:1787508747.325253:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508747.325276:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f359f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaea3e expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.325342:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.325357:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.325369:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508747.325416:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787508747.325431:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508747.325453:0:205405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.325481:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f359f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea3e expref: 21 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.325499:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea3e expref: 20 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.325508:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508747.325511:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508747.325516:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5400, rc 0) 00000100:00100000:0.0:1787508747.325583:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:343543:x1874324509637888:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 362us (4167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508747.325594:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94163 00000100:00100000:2.0:1787508747.328863:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508747.329344:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509638016 00000100:00100000:0.0:1787508747.329361:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509638016 00000100:00100000:0.0:1787508747.329452:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94164 00000100:00100000:0.0:1787508747.329464:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:343543:x1874324509638016:12345-192.168.201.30@tcp:101:checkstat.0 00010000:00010000:0.0:1787508747.329489:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508747.329511:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f359ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaea45 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.329576:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35a06 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.329591:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35a06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.329602:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35a06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.329614:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35a0d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.329622:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35a0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.329628:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35a0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.329719:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35a14 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.329730:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35a14 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.329736:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35a14 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508747.329776:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508747.329800:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35a14 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508747.329825:0:202227:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126d:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1787508747.329828:0:202227:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126d:0x0] updating lvb mtime from disk: 0 -> 1787508747 00000004:00010000:0.0:1787508747.329830:0:202227:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126d:0x0] updating lvb atime from disk: 0 -> 1787508747 00000004:00010000:0.0:1787508747.329833:0:202227:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126d:0x0] updating lvb ctime from disk: 0 -> 1787508747 00000004:00010000:0.0:1787508747.329836:0:202227:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126d:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:0.0:1787508747.329841:0:202227:0:(mdt_io.c:1552:mdt_lvb2reply()) size 0 00010000:00010000:0.0:1787508747.329847:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35a06 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.329855:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35a06 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.329863:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35a06 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.329870:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35a06 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.329877:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508747.329882:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35a06 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.329891:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35a06 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.329920:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508747.329924:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508747.331092:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35a06 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.331107:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35a06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.331128:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35a0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.331136:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35a0d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.331143:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35a0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.331149:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508747.331163:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35a0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.331171:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35a0d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.331184:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf4d6d012 (ffff9090d36fd200) 00010000:00010000:0.0:1787508747.331189:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508747.331193:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35a0d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.331201:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35a0d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.331240:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f359ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea45 expref: 22 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.331254:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35a14 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea45 expref: 21 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.331262:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126d:0x0].0x0 (ffff9090d1b2b100) 00010000:00010000:0.0:1787508747.331265:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:0.0:1787508747.331268:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5200, rc 0) 00000100:00100000:0.0:1787508747.331345:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+21:343543:x1874324509638016:12345-192.168.201.30@tcp:101:checkstat.0 Request processed in 1882us (2497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508747.331354:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94164 00000100:00100000:0.0:1787508747.414587:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508747.414636:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509638272 00000100:00100000:3.0:1787508747.414649:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509638272 00000100:00100000:3.0:1787508747.414726:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94165 00000100:00100000:3.0:1787508747.414738:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+21:343546:x1874324509638272:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:3.0:1787508747.414766:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508747.414770:0:203348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787508747.414818:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f359f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea3e expref: 21 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508747.414840:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508747.414846:0:203348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508747.414866:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f35a1b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaea4c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.415344:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35a22 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.415365:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35a22 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.415373:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35a22 lrc: 2/0,0 mode: --/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.415379:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35a22 lrc: 3/0,0 mode: --/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.415386:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508747.415391:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35a22 lrc: 3/0,0 mode: --/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.415399:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35a22 lrc: 4/0,0 mode: --/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.415408:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126d:0x0].0x0 (ffff9090d1b2b100) 00010000:00010000:2.0:1787508747.415414:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35a22 lrc: 2/0,0 mode: --/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.415421:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35a22 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.415576:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f35a1b lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea4c expref: 22 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.415587:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508747.415590:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508747.415594:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f35a1b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea4c expref: 22 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.421350:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f400, rc 0) 00000100:00100000:2.0:1787508747.421491:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+21:343546:x1874324509638272:12345-192.168.201.30@tcp:101:dd.0 Request processed in 6745us (6908us total) trans 12884944215 rc 301/301 00000100:00100000:2.0:1787508747.421502:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94165 00000100:00100000:3.0:1787508747.425205:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508747.425299:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509638400 00000100:00100000:0.0:1787508747.425312:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509638400 00000100:00100000:0.0:1787508747.425400:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94166 00000100:00100000:0.0:1787508747.425413:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+21:343546:x1874324509638400:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1787508747.425454:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508747.425484:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f35a30 lrc: 2/0,0 mode: --/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaea53 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.425532:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35a37 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.425553:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35a37 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.425566:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35a37 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.425734:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f35a30 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea53 expref: 23 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.425760:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35a37 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea53 expref: 22 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.425771:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126d:0x0].0x0 (ffff9090d1b2b100) 00010000:00010000:0.0:1787508747.425774:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787508747.425779:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4e00, rc 0) 00000100:00100000:0.0:1787508747.425880:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+22:343546:x1874324509638400:12345-192.168.201.30@tcp:101:dd.0 Request processed in 468us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508747.425888:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94166 00000100:00100000:3.0:1787508747.428630:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508747.428825:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509638656 00000100:00100000:2.0:1787508747.428840:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509638656 00000100:00100000:2.0:1787508747.429010:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94167 00000100:00100000:2.0:1787508747.429023:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+22:343546:x1874324509638656:12345-192.168.201.30@tcp:36:dd.0 00010000:00010000:2.0:1787508747.429212:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35a3e lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.429235:0:202226:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35a14 lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea45 expref: 22 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.429245:0:202226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35a3e lrc: 4/0,1 mode: --/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.429298:0:202226:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35a14 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea45 expref: 22 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.429317:0:202226:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35a14 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea45 expref: 22 pid: 202227 timeout: 13818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508747.429335:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed432300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480212480:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508747.429446:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090e6fc3780 going to sleep for 11 seconds 00000100:00100000:2.0:1787508747.431593:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed432300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480212480:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508747.431629:0:202226:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35a3e lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508747.434482:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508747.434588:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509638784 00000100:00100000:1.0:1787508747.434601:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509638784 00010000:00010000:1.0:1787508747.434657:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35a14 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea45 expref: 23 pid: 202227 timeout: 13818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508747.434718:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27950 00000100:00100000:1.0:1787508747.434729:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+23:2401:x1874324509638784:12345-192.168.201.30@tcp:102:ldlm_bl.0 00010000:00010000:1.0:1787508747.434752:0:229383:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35a14 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea45 expref: 23 pid: 202227 timeout: 13818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508747.434767:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35a14 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea45 expref: 23 pid: 202227 timeout: 13818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508747.434782:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35a14 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea45 expref: 23 pid: 202227 timeout: 13818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508747.434793:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126d:0x0].0x0 (ffff9090d1b2b100) 00010000:00010000:1.0:1787508747.434796:0:229383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:1.0:1787508747.434801:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35a3e lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508747.434811:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35a3e lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508747.434818:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35a3e lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508747.434856:0:229383:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35a14 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea45 expref: 23 pid: 202227 timeout: 13818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508747.434932:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+23:2401:x1874324509638784:12345-192.168.201.30@tcp:102:ldlm_bl.0 Request processed in 203us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508747.434971:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27950 00010000:00010000:2.0:1787508747.435239:0:202226:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35a3e lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.435248:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35a3e lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508747.435417:0:202226:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126d:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:2.0:1787508747.435421:0:202226:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126d:0x0] updating lvb mtime from disk: 1787508747 -> 1787508748 00000004:00010000:2.0:1787508747.435423:0:202226:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126d:0x0] updating lvb atime from disk: 1787508747 -> 1787508747 00000004:00010000:2.0:1787508747.435426:0:202226:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126d:0x0] updating lvb ctime from disk: 1787508747 -> 1787508748 00000004:00010000:2.0:1787508747.435428:0:202226:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126d:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:2.0:1787508747.435436:0:202226:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7ce4a5e reply state 000000004829cccf transno 12884944216 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35a3e lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.435449:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35a3e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x126d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.435456:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126d:0x0].0x0 (ffff9090d1b2b100) 00010000:00010000:2.0:1787508747.435459:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787508747.435461:0:202226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787508747.435594:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+24:343546:x1874324509638656:12345-192.168.201.30@tcp:36:dd.0 Request processed in 6573us (6977us total) trans 12884944216 rc 0/0 00000100:00100000:2.0:1787508747.435602:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94167 00000100:00100000:3.0:1787508747.438447:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508747.438779:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509638912 00000100:00100000:0.0:1787508747.438793:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509638912 00000100:00100000:0.0:1787508747.438927:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94168 00000100:00100000:0.0:1787508747.438981:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+24:343546:x1874324509638912:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1787508747.439019:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508747.439023:0:202227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787508747.439097:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35a14 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x59/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea45 expref: 24 pid: 202227 timeout: 13818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.439127:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126d:0x0].0x0 (ffff9090d1b2b100) 00010000:00010000:0.0:1787508747.439133:0:202227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508747.439163:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f35a45 lrc: 2/0,0 mode: --/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaea5a expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.439195:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f35a45 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea5a expref: 24 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.439212:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f35a45 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea5a expref: 24 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508747.439224:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126d:0x0].0x0 (ffff9090d1b2b100) 00010000:00010000:0.0:1787508747.439228:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787508747.439231:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5e00, rc 0) 00000100:00100000:0.0:1787508747.439314:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+24:343546:x1874324509638912:12345-192.168.201.30@tcp:101:dd.0 Request processed in 376us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508747.439322:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94168 00000100:00100000:1.0:1787508747.445811:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508747.445919:0:202240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509639040 00000100:00100000:0.0:1787508747.445931:0:202240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509639040 00002000:00010000:0.0:1787508747.446009:0:202240:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x2000013a4:0x126d:0x0] 00002000:00100000:0.0:1787508747.446015:0:202240:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9091ffb61500 with x1874324509639040 00000100:00100000:0.0:1787508747.446054:0:202240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7760 00000100:00100000:0.0:1787508747.446063:0:202240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+24:2401:x1874324509639040:12345-192.168.201.30@tcp:10:dd.0 00000004:00010000:0.0:1787508747.446313:0:202240:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126d:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1787508747.446322:0:202240:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126d:0x0] updating lvb mtime from disk: 1787508748 -> 1787508748 00000004:00010000:0.0:1787508747.446326:0:202240:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126d:0x0] updating lvb atime from disk: 1787508747 -> 1787508747 00000004:00010000:0.0:1787508747.446329:0:202240:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126d:0x0] updating lvb ctime from disk: 1787508748 -> 1787508748 00000004:00010000:0.0:1787508747.446331:0:202240:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x2000013a4:0x126d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787508747.446425:0:202240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+25:2401:x1874324509639040:12345-192.168.201.30@tcp:10:dd.0 Request processed in 361us (629us total) trans 12884944217 rc 0/0 00000100:00100000:0.0:1787508747.446434:0:202240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7760 00002000:00010000:0.0:1787508747.446438:0:202240:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x2000013a4:0x126d:0x0] 00002000:00100000:0.0:1787508747.446440:0:202240:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9091ffb61500 with x1874324509639040 00000100:00100000:3.0:1787508747.449710:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508747.449831:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509639168 00000100:00100000:2.0:1787508747.449846:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509639168 00000100:00100000:2.0:1787508747.449937:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94169 00000100:00100000:2.0:1787508747.450028:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+25:343546:x1874324509639168:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:2.0:1787508747.450076:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508747.450105:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35a4c lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaea61 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.450198:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35a4c lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea61 expref: 26 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.450217:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35a4c lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea61 expref: 26 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.450243:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126d:0x0].0x0 (ffff9090d1b2b100) 00010000:00010000:2.0:1787508747.450246:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787508747.450252:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa600, rc 0) 00000100:00100000:2.0:1787508747.450326:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+26:343546:x1874324509639168:12345-192.168.201.30@tcp:101:dd.0 Request processed in 301us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508747.450333:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94169 00000100:00100000:2.0:1787508747.454353:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508747.454454:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509639424 00000100:00100000:3.0:1787508747.454470:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509639424 00000100:00100000:3.0:1787508747.454546:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15466 00000100:00100000:3.0:1787508747.454558:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+26:343546:x1874324509639424:12345-192.168.201.30@tcp:35:dd.0 00000100:00100000:3.0:1787508747.455377:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+27:343546:x1874324509639424:12345-192.168.201.30@tcp:35:dd.0 Request processed in 816us (1036us total) trans 12884944218 rc 0/0 00000100:00100000:3.0:1787508747.455386:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15466 00000100:00100000:1.0:1787508747.477495:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508747.477565:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509639552 00000100:00100000:2.0:1787508747.477580:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509639552 00000100:00100000:2.0:1787508747.477665:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94170 00000100:00100000:2.0:1787508747.477681:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+27:343547:x1874324509639552:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:2.0:1787508747.477719:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508747.477750:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35a53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaea68 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.478137:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35a5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.478166:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35a5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.478179:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35a5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508747.478243:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508747.478248:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508747.478274:0:205405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35a5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.478307:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35a53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea68 expref: 29 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.478330:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35a5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea68 expref: 28 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.478340:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508747.478343:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508747.478348:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abe00, rc 0) 00000100:00100000:2.0:1787508747.478493:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+28:343547:x1874324509639552:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 814us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508747.478501:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94170 00000100:00100000:0.0:1787508747.483714:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508747.483813:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509639808 00000100:00100000:2.0:1787508747.483827:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509639808 00000100:00100000:2.0:1787508747.483931:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94171 00000100:00100000:2.0:1787508747.483986:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+28:343547:x1874324509639808:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:2.0:1787508747.484019:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508747.484023:0:202226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787508747.484071:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35a5a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea68 expref: 28 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484096:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508747.484102:0:202226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508747.484119:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f35a61 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaea6f expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484335:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35a68 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484351:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35a68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484364:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35a68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484378:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f35a6f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484386:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f35a6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484392:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f35a6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484467:0:202226:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f35a45 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea5a expref: 28 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484485:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35a76 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484493:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35a76 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484500:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35a76 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484618:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35a68 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484626:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35a68 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484632:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35a68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484639:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35a68 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484646:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508747.484651:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35a68 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484660:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35a68 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484669:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508747.484672:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508747.484677:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35a68 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484683:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35a68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484695:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f35a6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484702:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f35a6f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484707:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f35a6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484712:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508747.484715:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f35a6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484721:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f35a6f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484728:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf4d6d012 (ffff9090d36fd200) 00010000:00010000:2.0:1787508747.484731:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508747.484733:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f35a6f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484739:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f35a6f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484779:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f35a61 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea6f expref: 30 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484801:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35a76 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea6f expref: 29 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508747.484809:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126d:0x0].0x0 (ffff9090d1b2b100) 00010000:00010000:2.0:1787508747.484811:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787508747.484814:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab800, rc 0) 00000100:00100000:2.0:1787508747.485513:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+29:343547:x1874324509639808:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 1566us (1815us total) trans 12884944219 rc 0/0 00000100:00100000:2.0:1787508747.485526:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94171 00010000:00010000:3.0:1787508747.835409:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508748.392625:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508748.392799:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509640064 00000100:00100000:2.0:1787508748.392814:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509640064 00000100:00100000:3.0:1787508748.392903:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508748.392903:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3106 00000100:00100000:2.0:1787508748.392916:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+29:2402:x1874324509640064:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508748.393206:0:208928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509640320 00000100:00100000:1.0:1787508748.393213:0:208928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509640320 00000100:00100000:1.0:1787508748.393273:0:208928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2462 00000100:00100000:1.0:1787508748.393283:0:208928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509640320:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508748.393360:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+29:2402:x1874324509640064:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 447us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508748.393370:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3106 00000100:00080000:0.0:1787508748.393557:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787508748.396536:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508748.396761:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508748.396805:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508748.396840:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508748.397230:0:208928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509640320:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 3945us (4322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508748.397247:0:208928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2462 00000100:00100000:1.0:1787508748.397293:0:208928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509640832 00000100:00100000:1.0:1787508748.397305:0:208928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509640832 00000100:00100000:1.0:1787508748.397374:0:208928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2463 00000100:00100000:1.0:1787508748.397385:0:208928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509640832:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508748.397439:0:208928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509640832:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 57us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508748.397446:0:208928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2463 00000100:00080000:1.0:1787508748.397470:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508748.397521:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509639936 00000100:00100000:1.0:1787508748.397526:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509639936 00000100:00100000:1.0:1787508748.397558:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1030 00000100:00100000:1.0:1787508748.397565:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed598850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509639936:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508748.397593:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed598850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509639936:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 29us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508748.397599:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1030 00000100:00100000:3.0:1787508748.403566:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508748.403612:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508748.403702:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509640448 00000100:00100000:1.0:1787508748.403721:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509640448 00000100:00100000:1.0:1787508748.403812:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2464 00000100:00100000:1.0:1787508748.403826:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2402:x1874324509640448:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508748.403924:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2402:x1874324509640448:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 102us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508748.403933:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2464 00000100:00080000:1.0:1787508748.403979:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508748.405845:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509640576 00000100:00100000:0.0:1787508748.405867:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509640576 00000100:00080000:1.0:1787508748.406089:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787508748.406121:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509640192 00000100:00100000:0.0:1787508748.406127:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509640192 00000100:00100000:1.0:1787508748.406152:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3107 00000100:00100000:1.0:1787508748.406167:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509640576:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508748.406172:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3108 00000100:00100000:0.0:1787508748.406179:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509640192:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508748.406528:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509640192:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 348us (9686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508748.406537:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3108 00000100:00080000:0.0:1787508748.406572:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787508748.408892:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509640576:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 2711us (12354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508748.408912:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3107 00000100:00100000:3.0:1787508748.414213:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508748.414344:0:203728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509640960 00000100:00100000:1.0:1787508748.414359:0:203728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509640960 00000100:00100000:1.0:1787508748.414466:0:203728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2465 00000100:00100000:1.0:1787508748.414480:0:203728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2402:x1874324509640960:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508748.414576:0:203728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2402:x1874324509640960:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 99us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508748.414584:0:203728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2465 00000100:00100000:1.0:1787508748.414618:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509640704 00000100:00100000:1.0:1787508748.414624:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509640704 00000100:00100000:1.0:1787508748.414676:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3109 00000100:00100000:1.0:1787508748.414684:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509640704:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508748.414717:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509640704:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 35us (11105us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508748.414724:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3109 00000100:00080000:3.0:1787508748.416918:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787508748.416932:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508748.512492:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508748.512684:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509641088 00000100:00100000:2.0:1787508748.512698:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509641088 00000100:00100000:2.0:1787508748.512837:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94172 00000100:00100000:2.0:1787508748.512852:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:343550:x1874324509641088:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508748.512891:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508748.512923:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35a84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaea76 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.513073:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35a8b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.513093:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35a8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.513109:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35a8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508748.513180:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508748.513185:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508748.513212:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35a8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.513253:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35a84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea76 expref: 7 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.513278:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35a8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea76 expref: 6 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.513288:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508748.513292:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508748.513296:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abe00, rc 0) 00000100:00100000:2.0:1787508748.513399:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:343550:x1874324509641088:12345-192.168.201.30@tcp:101:rm.0 Request processed in 549us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508748.513407:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94172 00000100:00100000:1.0:1787508748.516682:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508748.516761:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509641216 00000100:00100000:0.0:1787508748.516786:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509641216 00000100:00100000:0.0:1787508748.516867:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94173 00000100:00100000:0.0:1787508748.516897:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:343550:x1874324509641216:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508748.516925:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508748.517208:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35a92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaea7d expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.517307:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f35a99 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.517324:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f35a99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.517337:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f35a99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.517356:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f35aa0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.517467:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f35aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.517476:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f35aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.517585:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35aa7 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.517595:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35aa7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.517602:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35aa7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508748.517646:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508748.517857:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35aa7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.518303:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f35a99 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.518313:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f35a99 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.518320:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f35a99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.518327:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f35a99 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.518333:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508748.518338:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f35a99 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.518570:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f35a99 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.518589:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508748.518592:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508748.518597:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f35a99 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.518604:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f35a99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.518623:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f35aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.518630:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f35aa0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.518637:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f35aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.518643:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508748.518646:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f35aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.518651:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f35aa0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.518657:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf4d6d012 (ffff9090d36fd200) 00010000:00010000:0.0:1787508748.518659:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508748.518662:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f35aa0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.518808:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f35aa0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.518855:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35a92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea7d expref: 8 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.519121:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35aa7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea7d expref: 7 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.519142:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126d:0x0].0x0 (ffff9090d1b2b100) 00010000:00010000:0.0:1787508748.519145:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787508748.519149:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5a00, rc 0) 00000100:00100000:0.0:1787508748.519516:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:343550:x1874324509641216:12345-192.168.201.30@tcp:101:rm.0 Request processed in 2619us (2852us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508748.519530:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94173 00000100:00100000:1.0:1787508748.525360:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508748.528213:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509641344 00000100:00100000:2.0:1787508748.528303:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509641344 00000100:00100000:2.0:1787508748.528544:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94174 00000100:00100000:2.0:1787508748.528558:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2403:x1874324509641344:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1787508748.528585:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508748.528616:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35aae lrc: 2/0,0 mode: --/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaea84 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.528785:0:202226:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f35a45 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x40/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea5a expref: 28 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508748.528846:0:202226:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed431880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480212608:192.168.201.30@tcp:106: 00000100:00100000:2.0:1787508748.529139:0:202226:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090e6fc3900 going to sleep for 11 seconds 00000004:00010000:2.0:1787508748.532246:0:202226:0:(mdt_lvb.c:177:mdt_dom_lvbo_update()) res: [0x2000013a4:0x126d:0x0] updating lvb size: 0 -> 4096 00000004:00010000:2.0:1787508748.532259:0:202226:0:(mdt_lvb.c:201:mdt_dom_lvbo_update()) res: [0x2000013a4:0x126d:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:2.0:1787508748.532291:0:202226:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed431880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:202226:1874324480212608:192.168.201.30@tcp:106: 00002000:00010000:2.0:1787508748.532320:0:202226:0:(mdt_io.c:1552:mdt_lvb2reply()) size 4096 00010000:00010000:2.0:1787508748.532346:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35aae lrc: 1/0,0 mode: --/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x40/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea84 expref: 8 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.532373:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126d:0x0].0x0 (ffff9090d1b2b100) 00010000:00010000:2.0:1787508748.532377:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787508748.532384:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35aae lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x40/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea84 expref: 8 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.532403:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab200, rc 0) 00000100:00100000:2.0:1787508748.532525:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2403:x1874324509641344:12345-192.168.201.30@tcp:101:rm.0 Request processed in 3968us (7179us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508748.532537:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94174 00000100:00100000:1.0:1787508748.542306:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508748.542630:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509641600 00000100:00100000:2.0:1787508748.542643:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509641600 00000100:00100000:2.0:1787508748.542792:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94175 00000100:00100000:2.0:1787508748.542806:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:343550:x1874324509641600:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1787508748.542904:0:205405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787508748.542995:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35aa7 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea7d expref: 7 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.543022:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126d:0x0].0x0 (ffff9090d1b2b100) 00010000:00010000:2.0:1787508748.543037:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35a8b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea76 expref: 6 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.543202:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508748.543207:0:205405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508748.543238:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35ab5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.543254:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35ab5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.543265:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35ab5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.543277:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35abc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.543285:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35abc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.543293:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35abc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.543418:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35ac3 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.543436:0:205405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35a76 lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea6f expref: 28 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.543444:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35ac3 lrc: 4/0,1 mode: --/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.543488:0:205405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35a76 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea6f expref: 28 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.543507:0:205405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35a76 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea6f expref: 28 pid: 202226 timeout: 13819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508748.543524:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed431880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480212736:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508748.543693:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090e6fc3900 going to sleep for 11 seconds 00000100:00100000:1.0:1787508748.548469:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508748.548560:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509641728 00000100:00100000:3.0:1787508748.548571:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509641728 00010000:00010000:3.0:1787508748.548626:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35a76 lrc: 5/0,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea6f expref: 29 pid: 202226 timeout: 13819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508748.548678:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27951 00000100:00100000:3.0:1787508748.548691:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+29:2401:x1874324509641728:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508748.548709:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508748.548717:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35a76 lrc: 5/0,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea6f expref: 29 pid: 202226 timeout: 13819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508748.548735:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35a76 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea6f expref: 29 pid: 202226 timeout: 13819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508748.548763:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126d:0x0].0x0 (ffff9090d1b2b100) 00010000:00010000:3.0:1787508748.548769:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35ac3 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508748.548792:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35ac3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508748.548802:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35ac3 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508748.548825:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508748.548900:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+29:2401:x1874324509641728:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 212us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508748.548908:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27951 00010000:00010000:0.0:1787508748.550575:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35a76 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea6f expref: 28 pid: 202226 timeout: 13819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508748.550606:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed431880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480212736:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508748.550636:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35ac3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.550646:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35ac3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.550653:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35ac3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787508748.551112:0:205405:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x2000013a4:0x126d:0x0] is inserted into orphan list, open count = 1 00010000:00010000:0.0:1787508748.551522:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35ac3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.551534:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35ac3 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.551543:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35ac3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.551549:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aaa00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508748.551554:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35ac3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.551562:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35ac3 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.551581:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126d:0x0].0x0 (ffff9090d1b2b100) 00010000:00010000:0.0:1787508748.551584:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787508748.551590:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35ac3 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.551596:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35ac3 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x126d:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.551616:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35ab5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.551622:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35ab5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.551628:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35ab5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.551635:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35ab5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.551641:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508748.551643:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35ab5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.551649:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35ab5 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.551656:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508748.551658:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508748.551661:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35ab5 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.551670:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35ab5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508748.551681:0:205405:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006314677f reply state 000000000b14de59 transno 12884944220 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35abc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.551696:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35abc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.551704:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf4d6d012 (ffff9090d36fd200) 00010000:00010000:0.0:1787508748.551707:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787508748.551711:0:205405:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787508748.552265:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:343550:x1874324509641600:12345-192.168.201.30@tcp:36:rm.0 Request processed in 9454us (9969us total) trans 12884944220 rc 0/0 00000100:00100000:0.0:1787508748.552276:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94175 00000100:00100000:1.0:1787508748.557642:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508748.557749:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509641984 00000100:00100000:2.0:1787508748.557762:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509641984 00000100:00100000:2.0:1787508748.558199:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15467 00000100:00100000:2.0:1787508748.558213:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde33450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+28:343547:x1874324509641984:12345-192.168.201.30@tcp:35:multiop.0 00000004:00080000:2.0:1787508748.558492:0:202230:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a4:0x126d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1787508748.558600:0:202230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35aca lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.558624:0:202230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f35a45 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea5a expref: 29 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.558634:0:202230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35aca lrc: 4/0,1 mode: --/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT flags: 0x50010080000000 pid: 202230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.558682:0:202230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f35a45 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000080010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea5a expref: 29 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.558701:0:202230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f35a45 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000480010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea5a expref: 29 pid: 202227 timeout: 13819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508748.558719:0:202230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed431f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:202230:1874324480212864:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508748.559229:0:202230:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090e6fc3480 going to sleep for 11 seconds 00000100:00100000:2.0:1787508748.561815:0:202230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed431f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:202230:1874324480212864:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508748.561857:0:202230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35aca lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT flags: 0x40010080000000 pid: 202230 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508748.562033:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde33450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+29:343547:x1874324509641984:12345-192.168.201.30@tcp:35:multiop.0 Request processed in 3822us (4406us total) trans 12884944221 rc 0/0 00000100:00100000:2.0:1787508748.562055:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15467 00000100:00100000:3.0:1787508748.566756:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508748.567305:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509642112 00000100:00100000:2.0:1787508748.567320:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509642112 00010000:00010000:2.0:1787508748.567375:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f35a45 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000480010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea5a expref: 29 pid: 202227 timeout: 13819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508748.567428:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27952 00000100:00100000:2.0:1787508748.567440:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+29:2400:x1874324509642112:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508748.567460:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508748.567466:0:225839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f35a45 lrc: 4/0,0 mode: PW/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x40/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000480010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea5a expref: 29 pid: 202227 timeout: 13819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.567491:0:225839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f35a45 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x40/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000480010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea5a expref: 29 pid: 202227 timeout: 13819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.567517:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f35a45 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x40/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801480010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea5a expref: 29 pid: 202227 timeout: 13819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.567537:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126d:0x0].0x0 (ffff9090d1b2b100) 00010000:00010000:2.0:1787508748.567543:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 6 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35aca lrc: 2/0,1 mode: --/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT flags: 0x40010080000000 pid: 202230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.567555:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35aca lrc: 2/0,1 mode: PW/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT flags: 0x40090080000000 pid: 202230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.567563:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35aca lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT flags: 0x40090080000000 pid: 202230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.567582:0:225839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35aca lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT flags: 0x50010080000000 pid: 202230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.567590:0:225839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35aca lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x40/0x0 rrc: 6 type: IBT flags: 0x50010480000000 pid: 202230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508748.567646:0:225839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787508748.567665:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508748.567741:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+28:2400:x1874324509642112:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 303us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508748.567750:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27952 00010000:00010000:0.0:1787508748.574214:0:202214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508748.574242:0:202214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35aca lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 202230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.574257:0:202214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abe00 already unused, calling callback (ffffffffc0d0a230) 00010000:00010000:0.0:1787508748.574262:0:202214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35aca lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 202230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.574272:0:202214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35aca lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 202230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.574298:0:202214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126d:0x0].0x0 (ffff9090d1b2b100) 00010000:00010000:0.0:1787508748.574301:0:202214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787508748.574308:0:202214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35aca lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 202230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.574316:0:202214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35aca lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x126d:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 202230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508748.574335:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508748.574337:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508748.574339:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508748.860180:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508748.986371:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787508748.986402:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480212992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787508748.986500:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508748.991508:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480212992 00000100:00100000:3.0:1787508748.991530:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480212992 00000100:00100000:3.0:1787508748.991639:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1729 00000100:00100000:3.0:1787508748.991651:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480212992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787508748.991699:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 131576384 pending 0 free 3881955328 avail 3650433024 00000100:00100000:3.0:1787508748.991829:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480212992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 180us (5328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508748.991848:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1729 00000100:00100000:3.0:1787508748.991968:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480212992:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787508748.993320:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508748.997385:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787508749.004240:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480213120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787508749.004363:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508749.005080:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480213120 00000100:00100000:3.0:1787508749.005093:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480213120 00000100:00100000:3.0:1787508749.005207:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1730 00000100:00100000:3.0:1787508749.005220:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480213120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787508749.005260:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 131576384 pending 0 free 3881955328 avail 3650433024 00000100:00100000:3.0:1787508749.005357:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480213120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 138us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508749.005366:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1730 00000100:00100000:2.0:1787508749.005691:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480213120:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787508749.006707:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787508749.882713:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508750.031270:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480213248:0@lo:400:kworker.0 00000100:00100000:0.0:1787508750.031389:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508750.031417:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480213376:0@lo:400:kworker.0 00000100:00100000:0.0:1787508750.031458:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480213248 00000100:00100000:1.0:1787508750.031477:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508750.031507:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480213888:0@lo:400:kworker.0 00000100:00100000:0.0:1787508750.031523:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480213248 00000100:00100000:1.0:1787508750.031532:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508750.031551:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874324480214400:0@lo:400:kworker.0 00000100:00100000:1.0:1787508750.031580:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508750.031594:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:0.0:1787508750.031606:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed59b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480213248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508750.031611:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787508750.031619:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874324480213760:0@lo:400:kworker.0 00000100:00100000:1.0:1787508750.031645:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508750.031661:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480214272:0@lo:400:kworker.0 00000100:00100000:1.0:1787508750.031685:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508750.031702:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480214784:0@lo:400:kworker.0 00000100:00100000:1.0:1787508750.031725:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508750.031775:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480213376 00000100:00100000:1.0:1787508750.031779:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480213376 00000100:00100000:1.0:1787508750.031812:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480213888 00000100:00100000:1.0:1787508750.031815:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480213888 00000100:00100000:1.0:1787508750.031836:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29902 00000100:00100000:1.0:1787508750.031843:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480213376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508750.031892:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480213376:12345-0@lo:400:kworker.0 Request processed in 49us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508750.031900:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29902 00000100:00100000:1.0:1787508750.031919:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29903 00000100:00100000:1.0:1787508750.031927:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480213888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508750.031984:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480213888:12345-0@lo:400:kworker.0 Request processed in 57us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508750.031990:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29903 00000100:00100000:1.0:1787508750.032009:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480214400 00000100:00100000:1.0:1787508750.032013:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480214400 00000100:00100000:1.0:1787508750.032052:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480213760 00000100:00100000:1.0:1787508750.032055:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480213760 00000100:00100000:1.0:1787508750.032073:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480214272 00000100:00100000:1.0:1787508750.032076:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480214272 00000100:00100000:1.0:1787508750.032098:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480214784 00000100:00100000:1.0:1787508750.032102:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480214784 00000100:00100000:1.0:1787508750.032137:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3110 00000100:00100000:1.0:1787508750.032147:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874324480214400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508750.032161:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed59b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480213248:12345-0@lo:400:kworker.0 Request processed in 555us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508750.032170:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:1.0:1787508750.032190:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874324480214400:12345-0@lo:400:kworker.0 Request processed in 44us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508750.032199:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3110 00000100:00100000:1.0:1787508750.032217:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3111 00000100:00100000:0.0:1787508750.032226:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3112 00000100:00100000:1.0:1787508750.032227:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874324480213760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508750.032239:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480214272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508750.032264:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874324480213760:12345-0@lo:400:kworker.0 Request processed in 39us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508750.032272:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3111 00000100:00100000:0.0:1787508750.032288:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480214272:12345-0@lo:400:kworker.0 Request processed in 51us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508750.032289:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3113 00000100:00100000:0.0:1787508750.032301:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3112 00000100:00100000:1.0:1787508750.032303:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480214784:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787508750.032329:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508750.032336:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787508750.032345:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480214784:12345-0@lo:400:kworker.0 Request processed in 47us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508750.032353:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3113 00000100:00100000:0.0:1787508750.032379:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480213248:0@lo:400:kworker.0 00000100:00100000:1.0:1787508750.032400:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874324480213760:0@lo:400:kworker.0 00000100:00100000:1.0:1787508750.032415:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480214272:0@lo:400:kworker.0 00000100:00100000:1.0:1787508750.032425:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480214784:0@lo:400:kworker.0 00000100:00100000:1.0:1787508750.032434:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480213376:0@lo:400:kworker.0 00000100:00100000:1.0:1787508750.032444:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480213888:0@lo:400:kworker.0 00000100:00100000:1.0:1787508750.032452:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874324480214400:0@lo:400:kworker.0 00000100:00100000:1.0:1787508750.032521:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480213504:0@lo:400:kworker.0 00000100:00100000:1.0:1787508750.032553:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508750.032588:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480214016:0@lo:400:kworker.0 00000100:00100000:0.0:1787508750.032600:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480213504 00000100:00100000:0.0:1787508750.032607:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480213504 00000100:00100000:1.0:1787508750.032618:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508750.032642:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874324480214528:0@lo:400:kworker.0 00000100:00100000:0.0:1787508750.032649:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480214016 00000100:00100000:0.0:1787508750.032655:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480214016 00000100:00100000:1.0:1787508750.032668:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508750.032688:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2466 00000100:00100000:1.0:1787508750.032692:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787508750.032699:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480213504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508750.032702:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480213632:0@lo:400:kworker.0 00000100:00100000:1.0:1787508750.032735:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508750.032756:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480213504:12345-0@lo:400:kworker.0 Request processed in 59us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508750.032761:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480214144:0@lo:400:kworker.0 00000100:00100000:0.0:1787508750.032768:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2466 00000100:00100000:0.0:1787508750.032783:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480213632 00000100:00100000:0.0:1787508750.032787:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480213632 00000100:00100000:1.0:1787508750.032792:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508750.032889:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480214144 00000100:00100000:0.0:1787508750.032894:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480214144 00000100:00100000:1.0:1787508750.037225:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480214656:0@lo:400:kworker.0 00000100:00100000:1.0:1787508750.037401:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508750.037535:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480213504:0@lo:400:kworker.0 00000100:00100000:3.0:1787508750.038739:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480214528 00000100:00100000:3.0:1787508750.038752:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480214528 00000100:00100000:3.0:1787508750.039391:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480214656 00000100:00100000:3.0:1787508750.039397:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480214656 00000100:00100000:3.0:1787508750.039432:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3114 00000100:00100000:3.0:1787508750.039443:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4856a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874324480214528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508750.039671:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2467 00000100:00100000:0.0:1787508750.039686:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480214016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508750.039802:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480214016:12345-0@lo:400:kworker.0 Request processed in 121us (7183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508750.039810:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2467 00000100:00100000:3.0:1787508750.040117:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4856a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874324480214528:12345-0@lo:400:kworker.0 Request processed in 664us (7437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508750.040125:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3114 00000100:00100000:3.0:1787508750.040153:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3115 00000100:00100000:3.0:1787508750.040161:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480214656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508750.040198:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480214656:12345-0@lo:400:kworker.0 Request processed in 40us (2799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508750.040205:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3115 00000100:00100000:0.0:1787508750.041317:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2468 00000100:00100000:0.0:1787508750.041335:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480213632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508750.041408:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480213632:12345-0@lo:400:kworker.0 Request processed in 79us (8672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508750.041417:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2468 00000100:00100000:0.0:1787508750.041433:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2469 00000100:00100000:0.0:1787508750.041442:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480214144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508750.041479:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480214144:12345-0@lo:400:kworker.0 Request processed in 39us (8688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508750.041486:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2469 00000100:00080000:0.0:1787508750.041512:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787508750.041519:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508750.041523:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787508750.041527:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787508750.047402:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480213632:0@lo:400:kworker.0 00000100:00100000:0.0:1787508750.047424:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480214144:0@lo:400:kworker.0 00000100:00100000:0.0:1787508750.047439:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480214656:0@lo:400:kworker.0 00000100:00100000:0.0:1787508750.047453:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480214016:0@lo:400:kworker.0 00000100:00100000:0.0:1787508750.047467:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874324480214528:0@lo:400:kworker.0 00000100:00100000:3.0:1787508750.522641:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787508750.522675:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480214912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787508750.522776:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508750.522846:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480214912 00000100:00100000:3.0:1787508750.522856:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480214912 00000100:00100000:3.0:1787508750.522924:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1731 00000100:00100000:3.0:1787508750.522935:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480214912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787508750.522999:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 41194048 pending 0 free 3909767168 avail 3678244864 00000100:00100000:3.0:1787508750.523139:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480214912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 204us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508750.523147:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1731 00000100:00100000:3.0:1787508750.523216:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480214912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787508750.527783:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480215040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787508750.527890:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508750.531164:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480215040 00000100:00100000:0.0:1787508750.531187:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480215040 00000100:00100000:0.0:1787508750.531262:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1732 00000100:00100000:0.0:1787508750.531274:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480215040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787508750.531502:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 41194048 pending 0 free 3909767168 avail 3678244864 00000100:00100000:0.0:1787508750.532559:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480215040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1278us (4660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508750.532572:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1732 00000100:00100000:1.0:1787508750.532748:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480215040:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787508750.911122:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508751.547507:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787508751.547557:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480215168:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787508751.547680:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508751.547782:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480215168 00000100:00100000:2.0:1787508751.547795:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480215168 00000100:00100000:2.0:1787508751.547871:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29904 00000100:00100000:2.0:1787508751.547882:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480215168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787508751.547931:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440694272 avail 1294454784 00000100:00100000:2.0:1787508751.548031:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480215168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 148us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508751.548040:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29904 00000100:00100000:2.0:1787508751.548115:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480215168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787508751.551309:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480215296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787508751.551425:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508751.552114:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480215296 00000100:00100000:0.0:1787508751.552127:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480215296 00000100:00100000:0.0:1787508751.552205:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29905 00000100:00100000:0.0:1787508751.552217:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480215296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787508751.552270:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442766848 avail 1296527360 00000100:00100000:0.0:1787508751.552374:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480215296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 158us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508751.552381:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29905 00000100:00100000:1.0:1787508751.553205:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480215296:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787508751.935037:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508752.954166:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787508753.089377:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944221 is committed 00000001:00080000:0.0:1787508753.089406:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944220 is committed 00010000:00010000:1.0:1787508753.090081:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35abc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508753.090098:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35abc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508753.090108:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35abc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508753.090116:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508753.090122:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35abc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508753.090132:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35abc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508753.090157:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf4d6d012 (ffff9090d36fd200) 00010000:00010000:1.0:1787508753.090160:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508753.090166:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35abc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508753.090174:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35abc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508753.091788:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f359c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508753.091811:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f359c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508753.091819:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f359c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508753.091825:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508753.091830:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f359c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508753.091842:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f359c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508753.091871:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf4d6d012 (ffff9090d36fd200) 00010000:00010000:3.0:1787508753.091875:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508753.091880:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f359c7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508753.091888:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f359c7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf4d6d012 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508753.091924:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35a3e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x126d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508753.091931:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35a3e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x126d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508753.091959:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35a3e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x126d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508753.092117:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508753.092121:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35a3e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x126d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508753.092129:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35a3e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x126d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508753.092138:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126d:0x0].0x0 (ffff9090d1b2b100) 00010000:00010000:3.0:1787508753.092141:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508753.092144:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35a3e lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x126d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508753.092152:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f35a3e lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x126d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508753.513117:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508753.513165:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508753.513213:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508753.513254:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508753.513270:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508753.513300:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508753.513315:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508753.513331:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508753.513354:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508753.513384:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509642752 00000100:00100000:3.0:1787508753.513396:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509642752 00000100:00100000:3.0:1787508753.513459:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509643264 00000100:00100000:3.0:1787508753.513462:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509643264 00000100:00100000:3.0:1787508753.513652:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509642624 00000100:00100000:3.0:1787508753.513657:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509642624 00000100:00100000:3.0:1787508753.513677:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509643136 00000100:00100000:3.0:1787508753.513679:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509643136 00000100:00100000:3.0:1787508753.513700:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2470 00000100:00100000:3.0:1787508753.513712:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2403:x1874324509642752:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508753.513803:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2403:x1874324509642752:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 94us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508753.513811:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2470 00000100:00100000:3.0:1787508753.513833:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2471 00000100:00100000:3.0:1787508753.513839:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2403:x1874324509643264:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508753.513858:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2403:x1874324509643264:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 20us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508753.513864:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2471 00000100:00100000:3.0:1787508753.513875:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2472 00000100:00100000:3.0:1787508753.513880:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509642624:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508753.513899:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509642624:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 20us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508753.513905:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2472 00000100:00100000:3.0:1787508753.513913:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2473 00000100:00100000:3.0:1787508753.513918:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2403:x1874324509643136:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508753.513935:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2403:x1874324509643136:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 17us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508753.513992:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2473 00000100:00100000:3.0:1787508753.514011:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509642496 00000100:00100000:3.0:1787508753.514014:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509642496 00000100:00100000:3.0:1787508753.514041:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509643008 00000100:00100000:3.0:1787508753.514057:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509643008 00000100:00100000:3.0:1787508753.514076:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509642368 00000100:00100000:3.0:1787508753.514079:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509642368 00000100:00100000:3.0:1787508753.514098:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509642880 00000100:00100000:3.0:1787508753.514100:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509642880 00000100:00100000:3.0:1787508753.514114:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3116 00000100:00100000:3.0:1787508753.514120:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509642496:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508753.514153:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509642496:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 33us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508753.514162:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3116 00000100:00100000:3.0:1787508753.514174:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3117 00000100:00100000:3.0:1787508753.514179:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509643008:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508753.514204:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509643008:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508753.514210:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3117 00000100:00100000:3.0:1787508753.514221:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3118 00000100:00100000:3.0:1787508753.514227:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:2403:x1874324509642368:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508753.514260:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:2403:x1874324509642368:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 33us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508753.514266:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3118 00000100:00100000:3.0:1787508753.514276:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3119 00000100:00100000:1.0:1787508753.514409:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509642240 00000100:00100000:1.0:1787508753.514414:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509642240 00000100:00100000:1.0:1787508753.514450:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1032 00000100:00100000:1.0:1787508753.514458:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed599050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509642240:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508753.514501:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed599050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509642240:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 44us (1400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508753.514507:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1032 00000100:00100000:3.0:1787508753.515454:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509642880:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508753.515702:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509642880:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 1416us (2366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508753.515711:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3119 00000100:00080000:0.0:1787508753.517654:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787508753.517667:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508753.517671:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787508753.517675:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787508753.978251:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508754.107176:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787508754.107208:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480215424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508754.107305:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508754.108381:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480215424 00000100:00100000:3.0:1787508754.108395:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480215424 00000100:00100000:3.0:1787508754.108485:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1733 00000100:00100000:3.0:1787508754.108498:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480215424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787508754.108542:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 131576384 pending 0 free 3881955328 avail 3650433024 00000100:00100000:3.0:1787508754.108634:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480215424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508754.108645:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1733 00000100:00080000:3.0:1787508754.108681:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508754.108737:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480215424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508754.118813:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787508754.118846:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480215552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787508754.119229:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508754.119343:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480215552 00000100:00100000:2.0:1787508754.119354:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480215552 00000100:00100000:2.0:1787508754.119452:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1734 00000100:00100000:2.0:1787508754.119465:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480215552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787508754.119498:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 131576384 pending 0 free 3881955328 avail 3650433024 00000100:00100000:2.0:1787508754.119559:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480215552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508754.119567:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1734 00000100:00080000:1.0:1787508754.119626:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508754.119675:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480215552:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787508755.004434:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508755.130278:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79de3f65-4bad-42d0-a46f-842a654b33a0:3619:1874324480215680:0@lo:400:kworker.0 00000100:00100000:1.0:1787508755.130382:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508755.130638:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480216064:0@lo:400:kworker.0 00000100:00100000:2.0:1787508755.130676:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508755.130734:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480215808:0@lo:400:kworker.0 00000100:00100000:2.0:1787508755.130762:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508755.130781:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787508755.130786:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480215936:0@lo:400:kworker.0 00000100:00100000:2.0:1787508755.130807:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508755.130841:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480215808 00000100:00100000:2.0:1787508755.130849:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480215808 00000100:00100000:2.0:1787508755.130898:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29906 00000100:00100000:2.0:1787508755.130908:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480215808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508755.131048:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480215680 00000100:00100000:0.0:1787508755.131053:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480215680 00000100:00100000:0.0:1787508755.131088:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:0.0:1787508755.131096:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed598050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3619:x1874324480215680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508755.131841:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480215808:12345-0@lo:400:kworker.0 Request processed in 931us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508755.131852:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29906 00000100:00100000:2.0:1787508755.131885:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480216064 00000100:00100000:2.0:1787508755.131890:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480216064 00000100:00100000:2.0:1787508755.131920:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480215936 00000100:00100000:2.0:1787508755.131923:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480215936 00000100:00100000:2.0:1787508755.131978:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2474 00000100:00100000:2.0:1787508755.131985:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480216064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508755.132037:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480216064:12345-0@lo:400:kworker.0 Request processed in 53us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508755.132045:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2474 00000100:00100000:2.0:1787508755.132057:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2475 00000100:00100000:2.0:1787508755.132063:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480215936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508755.132093:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480215936:12345-0@lo:400:kworker.0 Request processed in 30us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508755.132099:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2475 00000100:00100000:2.0:1787508755.132142:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480215936:0@lo:400:kworker.0 00000100:00100000:2.0:1787508755.132154:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480215808:0@lo:400:kworker.0 00000100:00100000:2.0:1787508755.132189:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480216064:0@lo:400:kworker.0 00000100:00080000:2.0:1787508755.132229:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787508755.136504:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480216448:0@lo:400:kworker.0 00000100:00100000:3.0:1787508755.136581:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508755.136616:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9acc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874324480216960:0@lo:400:kworker.0 00000100:00100000:3.0:1787508755.136644:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508755.136670:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787508755.136675:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480216320:0@lo:400:kworker.0 00000100:00100000:3.0:1787508755.136700:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508755.136722:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9acdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874324480216832:0@lo:400:kworker.0 00000100:00100000:3.0:1787508755.136744:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508755.136775:0:225833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480216448 00000100:00100000:3.0:1787508755.136783:0:225833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480216448 00000100:00100000:3.0:1787508755.136844:0:225833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2476 00000100:00100000:3.0:1787508755.136853:0:225833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480216448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508755.136927:0:225833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480216448:12345-0@lo:400:kworker.0 Request processed in 76us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508755.136935:0:225833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2476 00000100:00100000:2.0:1787508755.137073:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480216576:0@lo:400:kworker.0 00000100:00100000:2.0:1787508755.137107:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508755.137127:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9acf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480217088:0@lo:400:kworker.0 00000100:00100000:2.0:1787508755.137148:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508755.137167:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787508755.137172:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480216192:0@lo:400:kworker.0 00000100:00100000:2.0:1787508755.137195:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508755.137211:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9acdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480216704:0@lo:400:kworker.0 00000100:00100000:2.0:1787508755.137230:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508755.137246:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9acce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480217216:0@lo:400:kworker.0 00000100:00100000:2.0:1787508755.137264:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508755.137289:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480216960 00000100:00100000:2.0:1787508755.137294:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480216960 00000100:00100000:2.0:1787508755.137322:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480216832 00000100:00100000:2.0:1787508755.137326:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480216832 00000100:00100000:2.0:1787508755.137339:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480217088 00000100:00100000:2.0:1787508755.137341:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480217088 00000100:00100000:2.0:1787508755.137354:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480216192 00000100:00100000:2.0:1787508755.137357:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480216192 00000100:00100000:2.0:1787508755.137366:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480216704 00000100:00100000:2.0:1787508755.137369:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480216704 00000100:00100000:2.0:1787508755.137378:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480217216 00000100:00100000:2.0:1787508755.137379:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480217216 00000100:00100000:2.0:1787508755.137393:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3120 00000100:00100000:2.0:1787508755.137398:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874324480216960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508755.137433:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874324480216960:12345-0@lo:400:kworker.0 Request processed in 34us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508755.137439:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3120 00000100:00100000:2.0:1787508755.137451:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3121 00000100:00100000:2.0:1787508755.137457:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874324480216832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508755.137480:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874324480216832:12345-0@lo:400:kworker.0 Request processed in 24us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508755.137485:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3121 00000100:00100000:2.0:1787508755.137494:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3122 00000100:00100000:2.0:1787508755.137499:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480217088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508755.138102:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3123 00000100:00100000:3.0:1787508755.138113:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091d4862850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480216192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508755.138180:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480217088:12345-0@lo:400:kworker.0 Request processed in 679us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508755.138188:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3122 00000100:00100000:2.0:1787508755.138204:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3124 00000100:00100000:2.0:1787508755.138211:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480216704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508755.138541:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79de3f65-4bad-42d0-a46f-842a654b33a0:3619:1874324480215680:0@lo:400:kworker.0 00000100:00100000:1.0:1787508755.138579:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3125 00000100:00100000:1.0:1787508755.138588:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480217216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508755.141386:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed598050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3619:x1874324480215680:12345-0@lo:400:kworker.0 Request processed in 10280us (10992us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508755.141404:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:0.0:1787508755.141483:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480216320 00000100:00100000:0.0:1787508755.141492:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480216320 00000100:00100000:0.0:1787508755.141739:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29907 00000100:00100000:0.0:1787508755.141751:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9aced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480216320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508755.141833:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9aced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480216320:12345-0@lo:400:kworker.0 Request processed in 86us (5132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508755.141840:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29907 00000100:00100000:3.0:1787508755.141848:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091d4862850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480216192:12345-0@lo:400:kworker.0 Request processed in 3737us (4651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508755.141858:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3123 00000100:00100000:0.0:1787508755.141860:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480216576 00000100:00100000:0.0:1787508755.141864:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480216576 00000100:00100000:0.0:1787508755.141889:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2477 00000100:00100000:0.0:1787508755.141895:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480216576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508755.141952:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480216576:12345-0@lo:400:kworker.0 Request processed in 32us (4820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508755.141959:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2477 00000100:00080000:0.0:1787508755.142062:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787508755.142068:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508755.142071:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787508755.142116:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480216192:0@lo:400:kworker.0 00000100:00100000:0.0:1787508755.142130:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480216576:0@lo:400:kworker.0 00000100:00100000:0.0:1787508755.142140:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9acf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480217088:0@lo:400:kworker.0 00000100:00100000:0.0:1787508755.144505:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480216320:0@lo:400:kworker.0 00000100:00100000:0.0:1787508755.144522:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9acdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874324480216832:0@lo:400:kworker.0 00000100:00100000:0.0:1787508755.144535:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480216448:0@lo:400:kworker.0 00000100:00100000:0.0:1787508755.144546:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9acc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874324480216960:0@lo:400:kworker.0 00000100:00100000:2.0:1787508755.148311:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480216704:12345-0@lo:400:kworker.0 Request processed in 10089us (11068us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508755.148328:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3124 00000100:00100000:1.0:1787508755.150183:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480217216:12345-0@lo:400:kworker.0 Request processed in 11584us (12904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508755.150199:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3125 00000100:00100000:0.0:1787508755.152885:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9acdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480216704:0@lo:400:kworker.0 00000100:00100000:0.0:1787508755.152911:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9acce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480217216:0@lo:400:kworker.0 00000100:00100000:3.0:1787508755.642331:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787508755.642355:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480217344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787508755.642432:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508755.642621:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480217472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787508755.642650:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508755.642731:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480217344 00000100:00100000:0.0:1787508755.642740:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480217344 00000100:00100000:0.0:1787508755.642792:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480217472 00000100:00100000:0.0:1787508755.642795:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480217472 00000100:00100000:0.0:1787508755.642810:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1735 00000100:00100000:0.0:1787508755.642819:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480217344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787508755.642849:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 41194048 pending 0 free 3909767168 avail 3678244864 00000100:00100000:3.0:1787508755.643067:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1736 00000100:00100000:3.0:1787508755.643078:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480217472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787508755.643089:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 41194048 pending 0 free 3909767168 avail 3678244864 00000100:00100000:3.0:1787508755.643132:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480217472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508755.643139:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1736 00000100:00100000:3.0:1787508755.643183:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480217472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787508755.643362:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480217344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 543us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508755.643370:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1735 00000100:00100000:3.0:1787508755.643555:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480217344:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787508756.029353:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787508756.565456:0:234474:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 102: Test open by handle of unlinked file ========================================================== 14:12:35 (1787508755) 00000100:00100000:1.0:1787508756.675631:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787508756.675657:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480217600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787508756.675731:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508756.675889:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9acfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480217728:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787508756.676016:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480217600 00000100:00100000:3.0:1787508756.676024:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480217600 00000100:00100000:3.0:1787508756.676073:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29908 00000100:00100000:3.0:1787508756.676082:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480217600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787508756.676117:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440694272 avail 1294454784 00000100:00100000:3.0:1787508756.676170:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480217600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508756.676178:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29908 00000100:00100000:1.0:1787508756.676254:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508756.676303:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ace680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480217600:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787508756.676750:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480217728 00000100:00100000:3.0:1787508756.676755:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480217728 00000100:00100000:3.0:1787508756.676789:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29909 00000100:00100000:3.0:1787508756.676798:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480217728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787508756.676821:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442766848 avail 1296527360 00000100:00100000:3.0:1787508756.676864:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480217728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508756.676870:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29909 00000100:00100000:3.0:1787508756.676914:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9acfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480217728:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787508756.783686:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508756.783841:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509643392 00000100:00100000:0.0:1787508756.783852:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509643392 00000100:00100000:0.0:1787508756.783935:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94176 00000100:00100000:0.0:1787508756.783997:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:343986:x1874324509643392:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1787508756.784018:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508756.784040:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4800/0xb126349c40f35ad1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaea8b expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508756.784170:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35ad8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787508756.784183:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787508756.784185:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508756.784196:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508756.784242:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508756.784245:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508756.784268:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508756.784295:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4800/0xb126349c40f35ad1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea8b expref: 18 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508756.784313:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea8b expref: 17 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508756.784323:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508756.784325:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508756.784329:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e800, rc 0) 00000100:00100000:3.0:1787508756.784395:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:343986:x1874324509643392:12345-192.168.201.30@tcp:101:bash.0 Request processed in 412us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508756.784403:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94176 00000100:00100000:1.0:1787508756.790893:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508756.791568:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509643648 00000100:00100000:0.0:1787508756.791581:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509643648 00000100:00100000:0.0:1787508756.791661:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94177 00000100:00100000:0.0:1787508756.791672:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:343986:x1874324509643648:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1787508756.791693:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508756.791697:0:202227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787508756.791732:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35ad8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea8b expref: 17 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508756.791751:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508756.791756:0:202227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508756.791769:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35adf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaea92 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508756.791888:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f35ae6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508756.791905:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f35ae6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508756.791914:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f35ae6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508756.791927:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f35aed lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf852b649 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508756.791935:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f35aed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf852b649 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508756.792001:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f35aed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf852b649 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787508756.796527:0:202227:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x152f:0x0], index 0: 0 00010000:00010000:2.0:1787508756.797636:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35af4 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508756.797654:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35af4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508756.797665:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35af4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508756.797700:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f35ae6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508756.797708:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f35ae6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508756.797715:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f35ae6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508756.797722:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f35ae6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508756.797729:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508756.797733:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f35ae6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508756.797740:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f35ae6 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508756.797753:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508756.797756:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508756.797760:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f35ae6 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508756.797770:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f35ae6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508756.797963:0:202227:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7e29169 reply state 000000003e861629 transno 12884944222 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f35aed lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf852b649 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508756.797976:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f35aed lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf852b649 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508756.797982:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf852b649 (ffff9090ca4e2900) 00010000:00010000:2.0:1787508756.797985:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787508756.797997:0:202227:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787508756.798034:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35adf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea92 expref: 19 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508756.798050:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35af4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea92 expref: 18 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508756.798058:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126f:0x0].0x0 (ffff9090d36fd800) 00010000:00010000:2.0:1787508756.798060:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787508756.798063:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab800, rc 0) 00000100:00100000:2.0:1787508756.798142:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+19:343986:x1874324509643648:12345-192.168.201.30@tcp:101:bash.0 Request processed in 6471us (7259us total) trans 12884944222 rc 0/0 00000100:00100000:2.0:1787508756.798152:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94177 00000100:00100000:1.0:1787508756.803586:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508756.803687:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509643776 00000100:00100000:0.0:1787508756.803697:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509643776 00000100:00080000:2.0:1787508756.803773:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787508756.804115:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15076 00000100:00100000:0.0:1787508756.804128:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:343986:x1874324509643776:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1787508756.804335:0:203726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508756.804361:0:203726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014fe1493/0xb126349c40f35b02 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x152f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaea99 expref: -99 pid: 203726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787508756.804391:0:203726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x152f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787508756.804416:0:203726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x152f:0x0].0x0 since=13727s v=(0 0) 00010000:00010000:0.0:1787508756.804421:0:203726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x152f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787508756.804432:0:203726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014fe1493/0xb126349c40f35b02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x152f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea99 expref: 7 pid: 203726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508756.804454:0:203726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000014fe1493/0xb126349c40f35b02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x152f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea99 expref: 7 pid: 203726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508756.804468:0:203726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5000, rc 0) 00000100:00100000:0.0:1787508756.804581:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:343986:x1874324509643776:12345-192.168.201.30@tcp:101:bash.0 Request processed in 456us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508756.804588:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15076 00000100:00100000:3.0:1787508756.807708:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508756.808299:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509644032 00000100:00100000:0.0:1787508756.808309:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509644032 00000100:00100000:0.0:1787508756.808426:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15468 00000100:00100000:0.0:1787508756.808438:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+19:343986:x1874324509644032:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:0.0:1787508756.808767:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:343986:x1874324509644032:12345-192.168.201.30@tcp:35:bash.0 Request processed in 330us (1068us total) trans 12884944223 rc 0/0 00000100:00100000:0.0:1787508756.808776:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15468 00000100:00100000:1.0:1787508756.854691:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508756.854790:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509644160 00000100:00100000:3.0:1787508756.854801:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509644160 00000100:00100000:3.0:1787508756.854865:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94178 00000100:00100000:3.0:1787508756.854875:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:344127:x1874324509644160:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:3.0:1787508756.854912:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508756.854934:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f35b09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeaa0 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508756.855046:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f35b10 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508756.855061:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f35b10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508756.855072:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f35b10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508756.855116:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508756.855120:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508756.855163:0:209004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f35b10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508756.855189:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f35b09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeaa0 expref: 22 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508756.855207:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f35b10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeaa0 expref: 21 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508756.855216:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508756.855218:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508756.855222:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ee00, rc 0) 00000100:00100000:3.0:1787508756.855283:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+21:344127:x1874324509644160:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 409us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508756.855290:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94178 00000100:00100000:3.0:1787508756.859893:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508756.860189:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509644416 00000100:00100000:1.0:1787508756.860199:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509644416 00000100:00100000:1.0:1787508756.860283:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94179 00000100:00100000:1.0:1787508756.860295:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+21:344127:x1874324509644416:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:1.0:1787508756.860323:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508756.860348:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35b17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeaa7 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508756.860471:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f35b1e lrc: 3/1,0 mode: --/CR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508756.860487:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f35b1e lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x126f:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508756.860499:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f35b1e lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x126f:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508756.860513:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x126f:0x0]: returning size 26 00010000:00010000:1.0:1787508756.860630:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35b17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeaa7 expref: 24 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508756.860649:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f35b1e lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x126f:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeaa7 expref: 23 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508756.860658:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126f:0x0].0x0 (ffff9090d36fd800) 00010000:00010000:1.0:1787508756.860661:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787508756.860666:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a800, rc 0) 00000100:00100000:1.0:1787508756.860746:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+23:344127:x1874324509644416:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 453us (864us total) trans 12884944224 rc 0/0 00000100:00100000:1.0:1787508756.860754:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94179 00000100:00100000:1.0:1787508756.940173:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508756.940455:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509644544 00000100:00100000:3.0:1787508756.940466:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509644544 00000100:00100000:3.0:1787508756.940543:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94180 00000100:00100000:3.0:1787508756.940554:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:344127:x1874324509644544:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:3.0:1787508756.940574:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508756.940593:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f35b2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeaae expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508756.940658:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f35b33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508756.940671:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f35b33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508756.940682:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f35b33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508756.940727:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508756.940731:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508756.940755:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f35b33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508756.940794:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f35b2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeaae expref: 7 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508756.940814:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f35b33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeaae expref: 6 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508756.940823:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508756.940825:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508756.940829:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fa00, rc 0) 00000100:00080000:2.0:1787508756.941020:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787508756.941219:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:344127:x1874324509644544:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 665us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508756.941228:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94180 00000100:00100000:3.0:1787508756.997778:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508756.997905:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509644672 00000100:00100000:2.0:1787508756.997916:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509644672 00000100:00100000:2.0:1787508756.998019:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15469 00000100:00100000:2.0:1787508756.998029:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:344127:x1874324509644672:12345-192.168.201.30@tcp:33:check_fhandle_s.0 00000004:00200000:2.0:1787508756.998108:0:202230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x126f:0x0]: returning size 26 00000004:00200000:2.0:1787508756.998112:0:202230:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1787508756.998189:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:344127:x1874324509644672:12345-192.168.201.30@tcp:33:check_fhandle_s.0 Request processed in 161us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508756.998197:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15469 00000100:00100000:0.0:1787508757.001265:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508757.001360:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509644928 00000100:00100000:2.0:1787508757.001370:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509644928 00000100:00100000:2.0:1787508757.001425:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94181 00000100:00100000:2.0:1787508757.001434:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:344127:x1874324509644928:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:2.0:1787508757.001455:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508757.001476:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35b3a lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeab5 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.001571:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35b41 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.001584:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35b41 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.001596:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35b41 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508757.001606:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x126f:0x0]: returning size 26 00010000:00010000:2.0:1787508757.001700:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35b3a lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeab5 expref: 9 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.001720:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35b41 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeab5 expref: 8 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.001729:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126f:0x0].0x0 (ffff9090d36fd800) 00010000:00010000:2.0:1787508757.001731:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787508757.001735:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab200, rc 0) 00000100:00100000:2.0:1787508757.001795:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:344127:x1874324509644928:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 361us (539us total) trans 12884944225 rc 0/0 00000100:00100000:2.0:1787508757.001802:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94181 00000100:00100000:3.0:1787508757.028225:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508757.034072:0:225832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509645056 00000100:00100000:0.0:1787508757.034088:0:225832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509645056 00000100:00100000:0.0:1787508757.034185:0:225832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15077 00000100:00100000:0.0:1787508757.034195:0:225832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509645056:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:0.0:1787508757.034211:0:225832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508757.034228:0:225832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8508683/0xb126349c40f35b4f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x152f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeabc expref: -99 pid: 225832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508757.034277:0:225832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b27b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:225832:1874324480217856:192.168.201.30@tcp:106: 00000100:00100000:0.0:1787508757.034417:0:225832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3455a80 going to sleep for 11 seconds 00000100:00080000:2.0:1787508757.035403:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1787508757.043486:0:225832:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000401:0x152f:0x0] updating lvb size: 0 -> 26 00002000:00010000:0.0:1787508757.043494:0:225832:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000401:0x152f:0x0] updating lvb mtime: 0 -> 1787508757 00002000:00010000:0.0:1787508757.043495:0:225832:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0x152f:0x0] updating lvb atime: 0 -> 1787508757 00002000:00010000:0.0:1787508757.043497:0:225832:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000401:0x152f:0x0] updating lvb ctime: 0 -> 1787508757 00002000:00010000:0.0:1787508757.043499:0:225832:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x280000401:0x152f:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:0.0:1787508757.043519:0:225832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b27b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:225832:1874324480217856:192.168.201.30@tcp:106: 00010000:00010000:0.0:1787508757.043551:0:225832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b8508683/0xb126349c40f35b4f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x152f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeabc expref: 7 pid: 225832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.043569:0:225832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8508683/0xb126349c40f35b4f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x152f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeabc expref: 7 pid: 225832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.043579:0:225832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4000, rc 0) 00000100:00100000:0.0:1787508757.043629:0:225832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509645056:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 9436us (15416us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508757.043636:0:225832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15077 00010000:00010000:0.0:1787508757.051177:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508757.057318:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508757.057396:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509645184 00000100:00100000:3.0:1787508757.057405:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509645184 00000100:00100000:3.0:1787508757.057457:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15078 00000100:00100000:3.0:1787508757.057466:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:344127:x1874324509645184:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:3.0:1787508757.057482:0:225840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508757.057498:0:225840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2673ad9/0xb126349c40f35b56 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x152f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeac3 expref: -99 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.057526:0:225840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000014fe1493/0xb126349c40f35b02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x152f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea99 expref: 6 pid: 203726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.057533:0:225840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x152f:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787508757.057538:0:225840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x152f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787508757.057543:0:225840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2673ad9/0xb126349c40f35b56 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x152f:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeac3 expref: 7 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.057572:0:225840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000014fe1493/0xb126349c40f35b02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x152f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea99 expref: 6 pid: 203726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.057585:0:225840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000014fe1493/0xb126349c40f35b02 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x152f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea99 expref: 6 pid: 203726 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508757.057597:0:225840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9acd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:225840:1874324480217984:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508757.057749:0:225840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d46c60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508757.060427:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508757.060606:0:203732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509645312 00000100:00100000:2.0:1787508757.060617:0:203732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509645312 00002000:00100000:2.0:1787508757.060668:0:203732:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x152f:0x0] (0->25) req@ffff9091f9ace300 x1874324509645312/t0(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:213/0 lens 520/0 e 0 to 0 dl 1787508768 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787508757.060679:0:203732:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091f9ace300 with x1874324509645312 ext(0->25) 00010000:00010000:2.0:1787508757.060689:0:203732:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000014fe1493/0xb126349c40f35b02 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x152f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea99 expref: 7 pid: 203726 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.060707:0:203732:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000014fe1493/0xb126349c40f35b02 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x152f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea99 expref: 7 pid: 203726 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787508757.060716:0:203732:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9091f9ace300 00000100:00100000:2.0:1787508757.060751:0:203732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:2.0:1787508757.060760:0:203732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ace300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2401:x1874324509645312:12345-192.168.201.30@tcp:4:bash.0 00000100:00100000:2.0:1787508757.065777:0:203732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ace300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:2401:x1874324509645312:12345-192.168.201.30@tcp:4:bash.0 Request processed in 5004us (5345us total) trans 8589941254 rc 0/0 00000100:00100000:2.0:1787508757.065795:0:203732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00002000:00100000:2.0:1787508757.065812:0:203732:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x152f:0x0] (0->25) req@ffff9091f9ace300 x1874324509645312/t8589941254(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:213/0 lens 520/448 e 0 to 0 dl 1787508768 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787508757.065823:0:203732:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091f9ace300 with x1874324509645312 ext(0->25) 00010000:00010000:2.0:1787508757.065835:0:203732:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000014fe1493/0xb126349c40f35b02 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x152f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea99 expref: 9 pid: 203726 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.065858:0:203732:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000014fe1493/0xb126349c40f35b02 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x152f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea99 expref: 9 pid: 203726 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787508757.065866:0:203732:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9091f9ace300 00000100:00100000:0.0:1787508757.066814:0:225840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9acd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:225840:1874324480217984:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508757.066847:0:225840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a2673ad9/0xb126349c40f35b56 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x152f:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeac3 expref: 7 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.066865:0:225840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f800, rc 0) 00000100:00100000:0.0:1787508757.066912:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:344127:x1874324509645184:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 9446us (9603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508757.066923:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15078 00000100:00100000:3.0:1787508757.068258:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508757.072586:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509645440 00000100:00100000:0.0:1787508757.072600:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509645440 00010000:00010000:0.0:1787508757.072662:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000014fe1493/0xb126349c40f35b02 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x152f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea99 expref: 9 pid: 203726 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508757.072716:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27953 00000100:00100000:0.0:1787508757.072727:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:2401:x1874324509645440:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508757.072745:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787508757.072764:0:202212:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x152f:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:0.0:1787508757.072772:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000014fe1493/0xb126349c40f35b02 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x152f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea99 expref: 9 pid: 203726 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.072788:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000014fe1493/0xb126349c40f35b02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x152f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea99 expref: 9 pid: 203726 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.072810:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014fe1493/0xb126349c40f35b02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x152f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea99 expref: 9 pid: 203726 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.072827:0:202212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x152f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787508757.072831:0:202212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x152f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787508757.072839:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2673ad9/0xb126349c40f35b56 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x152f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeac3 expref: 6 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.072850:0:202212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2673ad9/0xb126349c40f35b56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x152f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeac3 expref: 6 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.072890:0:202212:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a2673ad9/0xb126349c40f35b56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x152f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeac3 expref: 6 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508757.072916:0:202212:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b27b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:202212:1874324480218112:192.168.201.30@tcp:105: 00000100:00100000:0.0:1787508757.073123:0:202212:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3455a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787508757.075734:0:202212:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b27b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:202212:1874324480218112:192.168.201.30@tcp:105: 00010000:00010000:0.0:1787508757.075763:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508757.075820:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2401:x1874324509645440:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 3094us (7566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508757.075832:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27953 00000100:00100000:1.0:1787508757.077866:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508757.085172:0:203733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509645568 00000100:00100000:2.0:1787508757.085189:0:203733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509645568 00002000:00100000:2.0:1787508757.085254:0:203733:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x152f:0x0] (0->4095) req@ffff9090e4ba0000 x1874324509645568/t0(0) o3->eb35f31c-097f-45a3-8275-bc75f97f89ee@192.168.201.30@tcp:213/0 lens 488/0 e 0 to 0 dl 1787508768 ref 1 fl New:/600/ffffffff rc 0/-1 job:'check_fhandle_s.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787508757.085264:0:203733:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090e4ba0000 with x1874324509645568 ext(0->4095) 00002000:00010000:2.0:1787508757.085269:0:203733:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9090e4ba0000 00000100:00100000:2.0:1787508757.086275:0:203733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:2.0:1787508757.086289:0:203733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2401:x1874324509645568:12345-192.168.201.30@tcp:3:check_fhandle_s.0 00000100:00100000:2.0:1787508757.086476:0:203733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2401:x1874324509645568:12345-192.168.201.30@tcp:3:check_fhandle_s.0 Request processed in 191us (8619us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787508757.086481:0:203733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 51 00002000:00100000:2.0:1787508757.086487:0:203733:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x152f:0x0] (0->4095) req@ffff9090e4ba0000 x1874324509645568/t0(0) o3->eb35f31c-097f-45a3-8275-bc75f97f89ee@192.168.201.30@tcp:213/0 lens 488/4536 e 0 to 0 dl 1787508768 ref 1 fl Complete:/600/0 rc 4096/4096 job:'check_fhandle_s.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787508757.086494:0:203733:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090e4ba0000 with x1874324509645568 ext(0->4095) 00002000:00010000:2.0:1787508757.086498:0:203733:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9090e4ba0000 00000100:00100000:3.0:1787508757.092928:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508757.093085:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509645824 00000100:00100000:1.0:1787508757.093096:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509645824 00000100:00100000:1.0:1787508757.093146:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15470 00000100:00100000:1.0:1787508757.093157:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:344127:x1874324509645824:12345-192.168.201.30@tcp:35:check_fhandle_s.0 00000100:00100000:1.0:1787508757.093437:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:344127:x1874324509645824:12345-192.168.201.30@tcp:35:check_fhandle_s.0 Request processed in 281us (518us total) trans 12884944226 rc 0/0 00000100:00100000:1.0:1787508757.093446:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15470 00000100:00100000:1.0:1787508757.104091:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508757.107175:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509646080 00000100:00100000:2.0:1787508757.107188:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509646080 00000100:00100000:2.0:1787508757.107255:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94182 00000100:00100000:2.0:1787508757.107262:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+23:344127:x1874324509646080:12345-192.168.201.30@tcp:36:check_fhandle_s.0 00010000:00010000:2.0:1787508757.107315:0:203348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787508757.107339:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f35b1e lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x126f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeaa7 expref: 23 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.107357:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35af4 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea92 expref: 22 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.107367:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126f:0x0].0x0 (ffff9090d36fd800) 00010000:00010000:2.0:1787508757.107374:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f35b10 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeaa0 expref: 21 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.107379:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508757.107382:0:203348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508757.107399:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35b5d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.107408:0:203348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f35b33 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeaae expref: 8 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.107413:0:203348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35b5d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.107436:0:203348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f35b33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeaae expref: 8 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.107446:0:203348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f35b33 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeaae expref: 8 pid: 230618 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508757.107456:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed431500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:203348:1874324480218240:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508757.107530:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1e759c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508757.110337:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508757.110426:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed431500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:203348:1874324480218240:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508757.110454:0:203348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35b5d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508757.110517:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509646208 00000100:00100000:1.0:1787508757.110523:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509646208 00010000:00010000:1.0:1787508757.110559:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f35b33 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeaae expref: 9 pid: 230618 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508757.110593:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27954 00000100:00100000:1.0:1787508757.110601:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ace680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2401:x1874324509646208:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508757.110617:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508757.110623:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f35b33 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeaae expref: 9 pid: 230618 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.110635:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f35b33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeaae expref: 9 pid: 230618 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.110653:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f35b33 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeaae expref: 9 pid: 230618 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.110668:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508757.110672:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35b5d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.110682:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35b5d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.110689:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35b5d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.110720:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508757.110778:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ace680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2401:x1874324509646208:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 177us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508757.110786:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27954 00010000:00010000:3.0:1787508757.111318:0:203348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35b5d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.111327:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35b5d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.111345:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35b64 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf852b649 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.111353:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35b64 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf852b649 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.111361:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35b64 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf852b649 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.111459:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35b6b lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x126f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.111469:0:203348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35b41 lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeab5 expref: 7 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.111476:0:203348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35b6b lrc: 4/0,1 mode: --/EX res: [0x2000013a4:0x126f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.111502:0:203348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35b41 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeab5 expref: 7 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.111514:0:203348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35b41 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeab5 expref: 7 pid: 202227 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508757.111527:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9acce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:203348:1874324480218368:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508757.111589:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d46c6840 going to sleep for 11 seconds 00000100:00100000:3.0:1787508757.113848:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508757.114009:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509646336 00000100:00100000:1.0:1787508757.114020:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509646336 00010000:00010000:1.0:1787508757.114061:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35b41 lrc: 5/0,0 mode: PR/PR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeab5 expref: 8 pid: 202227 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508757.114113:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27955 00000100:00100000:1.0:1787508757.114124:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9f1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2400:x1874324509646336:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508757.114140:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508757.114147:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35b41 lrc: 5/0,0 mode: PR/PR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeab5 expref: 8 pid: 202227 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.114163:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35b41 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeab5 expref: 8 pid: 202227 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.114185:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126f:0x0].0x0 (ffff9090d36fd800) 00010000:00010000:1.0:1787508757.114190:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35b6b lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x126f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.114199:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35b6b lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.114205:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35b6b lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x126f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.114224:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508757.114280:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9f1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2400:x1874324509646336:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 157us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508757.114287:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27955 00010000:00010000:2.0:1787508757.115176:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35b41 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeab5 expref: 7 pid: 202227 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508757.115196:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9acce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:203348:1874324480218368:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508757.115217:0:203348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35b6b lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.115226:0:203348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35b6b lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.115231:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35b6b lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787508757.115474:0:203348:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x2000013a4:0x126f:0x0] is inserted into orphan list, open count = 1 00010000:00010000:2.0:1787508757.115547:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35b6b lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x126f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.115555:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35b6b lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x126f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.115561:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35b6b lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x126f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.115568:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508757.115571:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35b6b lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x126f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.115579:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35b6b lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x126f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.115590:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126f:0x0].0x0 (ffff9090d36fd800) 00010000:00010000:2.0:1787508757.115593:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787508757.115596:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35b6b lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x126f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.115601:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35b6b lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x126f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.115619:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35b5d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.115625:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35b5d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.115630:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35b5d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.115635:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35b5d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.115639:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aaa00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508757.115642:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35b5d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.115647:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35b5d lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.115654:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508757.115657:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508757.115659:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35b5d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.115666:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35b5d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508757.115675:0:203348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003e383af reply state 00000000bad29a23 transno 12884944227 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35b64 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf852b649 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.115686:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35b64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf852b649 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.115693:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf852b649 (ffff9090ca4e2900) 00010000:00010000:2.0:1787508757.115696:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787508757.115698:0:203348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787508757.117097:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+22:344127:x1874324509646080:12345-192.168.201.30@tcp:36:check_fhandle_s.0 Request processed in 9825us (13006us total) trans 12884944227 rc 0/0 00000100:00100000:2.0:1787508757.117110:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94182 00000100:00100000:3.0:1787508757.132177:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508757.134158:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509646592 00000100:00100000:0.0:1787508757.134172:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509646592 00000100:00100000:0.0:1787508757.134252:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94183 00000100:00100000:0.0:1787508757.134263:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:344127:x1874324509646592:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:0.0:1787508757.134291:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508757.134316:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35b72 lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeaca expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.134421:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35b79 lrc: 3/1,0 mode: --/CR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.134436:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35b79 lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x126f:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.134447:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35b79 lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x126f:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508757.134459:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x126f:0x0]: returning size 26 00010000:00010000:0.0:1787508757.134568:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35b72 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeaca expref: 10 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.134588:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35b79 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x126f:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeaca expref: 9 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.134596:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126f:0x0].0x0 (ffff9090ca4e2000) 00010000:00010000:0.0:1787508757.134599:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787508757.134603:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5600, rc 0) 00000100:00100000:0.0:1787508757.134667:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:344127:x1874324509646592:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 406us (2498us total) trans 12884944228 rc 0/0 00000100:00100000:0.0:1787508757.134674:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94183 00000100:00100000:1.0:1787508757.173546:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508757.174192:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509646720 00000100:00100000:0.0:1787508757.174202:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509646720 00000100:00100000:1.0:1787508757.174418:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94184 00000100:00100000:1.0:1787508757.174430:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:344127:x1874324509646720:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:1.0:1787508757.174458:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508757.174478:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f35b87 lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaead1 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.174546:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f35b8e lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.174560:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f35b8e lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.174571:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f35b8e lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508757.174613:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x126f:0x0]: returning size 26 00000004:00200000:1.0:1787508757.174617:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508757.174636:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f35b8e lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.174662:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f35b87 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaead1 expref: 11 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.174679:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f35b8e lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaead1 expref: 10 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.174686:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126f:0x0].0x0 (ffff9090ca4e2000) 00010000:00010000:1.0:1787508757.174689:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787508757.174693:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b600, rc 0) 00000100:00100000:1.0:1787508757.174768:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:344127:x1874324509646720:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 340us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508757.174882:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94184 00000100:00100000:1.0:1787508757.189842:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508757.189937:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509646976 00000100:00100000:2.0:1787508757.189996:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509646976 00000100:00100000:2.0:1787508757.190049:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15471 00000100:00100000:2.0:1787508757.190058:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:344127:x1874324509646976:12345-192.168.201.30@tcp:35:check_fhandle_s.0 00000100:00100000:2.0:1787508757.190260:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:344127:x1874324509646976:12345-192.168.201.30@tcp:35:check_fhandle_s.0 Request processed in 202us (426us total) trans 12884944229 rc 0/0 00000100:00100000:2.0:1787508757.190268:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15471 00000100:00100000:3.0:1787508757.196651:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508757.196765:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509647232 00000100:00100000:1.0:1787508757.196775:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509647232 00000100:00100000:1.0:1787508757.196842:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15472 00000100:00100000:1.0:1787508757.196852:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+22:344127:x1874324509647232:12345-192.168.201.30@tcp:35:check_fhandle_s.0 00000004:00080000:1.0:1787508757.197120:0:227154:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a4:0x126f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787508757.197242:0:227154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2340, 64 off157952 00000004:00080000:1.0:1787508757.197255:0:227154:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 13728242313805ns, next at 13729242311341ns, rc = 0 00010000:00010000:1.0:1787508757.197313:0:227154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f35b95 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x126f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 227154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.197330:0:227154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f35b95 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x126f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 227154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.197341:0:227154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f35b95 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x126f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 227154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.197350:0:227154:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f35b95 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x126f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 227154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.197357:0:227154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f35b95 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x126f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 227154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.197363:0:227154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f35b95 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x126f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 227154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.197377:0:227154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787508757.197481:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+23:344127:x1874324509647232:12345-192.168.201.30@tcp:35:check_fhandle_s.0 Request processed in 629us (838us total) trans 12884944230 rc 0/0 00000100:00100000:1.0:1787508757.197490:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15472 00010000:00010000:2.0:1787508757.198074:0:202215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787508757.198083:0:202215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f35b95 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x126f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 227154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.198092:0:202215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247be00 already unused, calling callback (ffffffffc0d0a230) 00010000:00010000:2.0:1787508757.198097:0:202215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f35b95 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x126f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 227154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.198105:0:202215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f35b95 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x126f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 227154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.198119:0:202215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126f:0x0].0x0 (ffff9090ca4e2000) 00010000:00010000:2.0:1787508757.198122:0:202215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787508757.198127:0:202215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f35b95 lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x126f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 227154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.198132:0:202215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f35b95 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x126f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 227154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.198146:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508757.198148:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508757.198150:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508757.249495:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508757.249607:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509647360 00000100:00100000:0.0:1787508757.249617:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509647360 00000100:00100000:0.0:1787508757.249684:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94185 00000100:00100000:0.0:1787508757.249695:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+23:344169:x1874324509647360:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508757.249718:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508757.249750:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35b9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaead8 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.249825:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35ba3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.249840:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.249852:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508757.249909:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787508757.249913:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508757.249934:0:209004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.250153:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35b9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaead8 expref: 25 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.250171:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaead8 expref: 24 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.250178:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508757.250181:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508757.250185:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5200, rc 0) 00000100:00100000:0.0:1787508757.250246:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+24:344169:x1874324509647360:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 553us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508757.250254:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94185 00000100:00100000:3.0:1787508757.253095:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508757.253202:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509647488 00000100:00100000:2.0:1787508757.253212:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509647488 00000100:00100000:2.0:1787508757.253270:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94186 00000100:00100000:2.0:1787508757.253279:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+24:344169:x1874324509647488:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508757.253301:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508757.253323:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35baa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeadf expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.253384:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35bb1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.253397:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35bb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.253408:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35bb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.253485:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35bb8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.253493:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.253500:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.253559:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35bb1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.253567:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35bb1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.253573:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35bb1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.253580:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35bb1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.253587:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508757.253592:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35bb1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.253599:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35bb1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.253612:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508757.253614:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508757.253619:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35bb1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.253625:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35bb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.253641:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.253647:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35bb8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.253652:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.253658:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508757.253661:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.253667:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35bb8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.253679:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb0d038d2 (ffff9090d36fd800) 00010000:00010000:2.0:1787508757.253682:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508757.253685:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35bb8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.253691:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35bb8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.253723:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35baa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeadf expref: 25 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.253747:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508757.253750:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508757.253754:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35baa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeadf expref: 25 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.253765:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aaa00, rc 0) 00000100:00100000:2.0:1787508757.253845:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+24:344169:x1874324509647488:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 566us (760us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508757.253852:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94186 00000100:00100000:3.0:1787508757.258693:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508757.260413:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509647744 00000100:00100000:0.0:1787508757.260429:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509647744 00000100:00100000:0.0:1787508757.260524:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94187 00000100:00100000:0.0:1787508757.260538:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:344169:x1874324509647744:12345-192.168.201.30@tcp:36:lfs.0 00000100:00100000:0.0:1787508757.260655:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b27b80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480218496:0@lo:1000:mdt00_006.0 00000100:00100000:0.0:1787508757.260717:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508757.260766:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d34556c0 going to sleep for 11 seconds 00000100:00080000:2.0:1787508757.261102:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787508757.261180:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480218496 00000100:00100000:3.0:1787508757.261185:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480218496 00000100:00100000:3.0:1787508757.261219:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29910 00000100:00100000:3.0:1787508757.261227:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:230618:x1874324480218496:12345-0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1787508757.261310:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:230618:x1874324480218496:12345-0@lo:1000:mdt00_006.0 Request processed in 84us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508757.261318:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29910 00000100:00100000:1.0:1787508757.261406:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b27b80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480218496:0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1787508757.261457:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba3100 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480218624:0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1787508757.261486:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508757.261513:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d4534180 going to sleep for 11 seconds 00000100:00100000:3.0:1787508757.262050:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480218624 00000100:00100000:3.0:1787508757.262055:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480218624 00000100:00100000:3.0:1787508757.262091:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29911 00000100:00100000:3.0:1787508757.262098:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:230618:x1874324480218624:12345-0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1787508757.262197:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:230618:x1874324480218624:12345-0@lo:1000:mdt00_006.0 Request processed in 99us (710us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787508757.262204:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29911 00000100:00100000:2.0:1787508757.262282:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba3100 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480218624:0@lo:1000:mdt00_006.0 00010000:00010000:2.0:1787508757.262340:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f35bbf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.262350:0:230618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f35bbf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.262365:0:230618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f35bbf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508757.262378:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed431500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480218752:0@lo:101:mdt00_006.0 00000100:00100000:2.0:1787508757.262402:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508757.262425:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1e75600 going to sleep for 11 seconds 00000100:00100000:1.0:1787508757.262479:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480218752 00000100:00100000:1.0:1787508757.262483:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480218752 00000100:00100000:1.0:1787508757.262517:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29912 00000100:00100000:1.0:1787508757.262523:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:230618:x1874324480218752:12345-0@lo:101:mdt00_006.0 00010000:00010000:1.0:1787508757.262532:0:203182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508757.262545:0:203182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f35bc6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f35bbf expref: -99 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.262567:0:203182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35ba3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaead8 expref: 23 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.262577:0:203182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f35bc6 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f35bbf expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.262597:0:203182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaead8 expref: 23 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.262609:0:203182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35ba3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaead8 expref: 23 pid: 209004 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508757.262619:0:203182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba3100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480218880:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508757.262677:0:203182:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d45346c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508757.266462:0:203182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba3100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480218880:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508757.266505:0:203182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f35bc6 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f35bbf expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.266519:0:203182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508757.266523:0:203182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508757.266527:0:203182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f35bc6 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f35bbf expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.266539:0:203182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247aa00, rc 0) 00000100:00100000:1.0:1787508757.266606:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:230618:x1874324480218752:12345-0@lo:101:mdt00_006.0 Request processed in 4081us (4201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508757.266614:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29912 00000100:00100000:2.0:1787508757.266712:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed431500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480218752:0@lo:101:mdt00_006.0 00010000:00010000:2.0:1787508757.266731:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f35bbf lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f35bc6 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.266753:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f35bbf lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f35bc6 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508757.268582:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508757.268777:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509647872 00000100:00100000:2.0:1787508757.268786:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509647872 00010000:00010000:2.0:1787508757.268828:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35ba3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaead8 expref: 24 pid: 209004 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508757.268869:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27956 00000100:00100000:2.0:1787508757.268878:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+24:2400:x1874324509647872:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508757.268904:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508757.268911:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35ba3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaead8 expref: 24 pid: 209004 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.268923:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaead8 expref: 24 pid: 209004 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.268991:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35ba3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaead8 expref: 24 pid: 209004 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.269008:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508757.269232:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f35bc6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f35bbf expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.269246:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f35bc6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f35bbf expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.269255:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f35bc6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f35bbf expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.269293:0:202211:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f35bc6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f35bbf expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508757.269306:0:202211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed430380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:202211:1874324480219008:0@lo:105: 00000100:00100000:2.0:1787508757.269353:0:202211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508757.269389:0:202211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1e75600 going to sleep for 11 seconds 00000100:00100000:3.0:1787508757.269615:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480219008 00000100:00100000:3.0:1787508757.269620:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480219008 00000100:00100000:3.0:1787508757.269661:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18201 00000100:00100000:3.0:1787508757.269670:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed430000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:202211:x1874324480219008:12345-0@lo:105: 00010000:00010000:3.0:1787508757.269681:0:202209:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f35bbf lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f35bc6 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.269690:0:202209:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f35bbf lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f35bc6 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.269698:0:202209:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f35bbf lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f35bc6 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.269704:0:202209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f35bbf lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f35bc6 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.269715:0:202209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f35bbf lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f35bc6 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.269722:0:202209:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f35bbf lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f35bc6 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.269746:0:202209:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090cd2aaa00) 00000100:00100000:3.0:1787508757.269795:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed430000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:202211:x1874324480219008:12345-0@lo:105: Request processed in 126us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508757.269803:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18201 00000100:00100000:0.0:1787508757.269901:0:202211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed430380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:202211:1874324480219008:0@lo:105: 00010000:00010000:0.0:1787508757.269918:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508757.269999:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+23:2400:x1874324509647872:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1122us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508757.270006:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27956 00010000:00010000:2.0:1787508757.271054:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f35bbf lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f35bc6 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.271067:0:230618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f35bbf lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f35bc6 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787508757.271091:0:230618:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787508757.271132:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f35bcd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.271140:0:230618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f35bcd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.271149:0:230618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f35bcd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508757.271167:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed431500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480219136:0@lo:101:mdt00_006.0 00000100:00100000:2.0:1787508757.271210:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508757.271237:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1e75540 going to sleep for 11 seconds 00000100:00100000:0.0:1787508757.272058:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480219136 00000100:00100000:0.0:1787508757.272067:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480219136 00000100:00100000:0.0:1787508757.272127:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29913 00000100:00100000:0.0:1787508757.272138:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:230618:x1874324480219136:12345-0@lo:101:mdt00_006.0 00010000:00010000:0.0:1787508757.272155:0:225829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508757.272174:0:225829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35bd4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f35bcd expref: -99 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.272200:0:225829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35bd4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f35bcd expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.272213:0:225829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35bd4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f35bcd expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.272222:0:225829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb0d038d2 (ffff9090ca4e2e00) 00010000:00010000:0.0:1787508757.272225:0:225829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508757.272229:0:225829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5a00, rc 0) 00000100:00100000:0.0:1787508757.272283:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:230618:x1874324480219136:12345-0@lo:101:mdt00_006.0 Request processed in 147us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508757.272290:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29913 00000100:00100000:2.0:1787508757.273250:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed431500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480219136:0@lo:101:mdt00_006.0 00010000:00010000:2.0:1787508757.273272:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f35bcd lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f35bd4 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.273284:0:230618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f35bcd lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f35bd4 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787508757.273307:0:230618:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1787508757.273354:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed431500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480219264:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1787508757.273403:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508757.273434:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1e750c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508757.273497:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480219264 00000100:00100000:3.0:1787508757.273503:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480219264 00000100:00100000:3.0:1787508757.273551:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29914 00000100:00100000:3.0:1787508757.273560:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:230618:x1874324480219264:12345-0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1787508757.273638:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:230618:x1874324480219264:12345-0@lo:1000:mdt00_006.0 Request processed in 80us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508757.273646:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29914 00000100:00100000:2.0:1787508757.274022:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed431500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480219264:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1787508757.274070:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed431500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480219392:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1787508757.274097:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508757.274120:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1e750c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787508757.274274:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480219392 00000100:00100000:0.0:1787508757.274279:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480219392 00000100:00100000:0.0:1787508757.274317:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29915 00000100:00100000:0.0:1787508757.274326:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:230618:x1874324480219392:12345-0@lo:1000:mdt00_006.0 00000100:00100000:0.0:1787508757.274423:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:230618:x1874324480219392:12345-0@lo:1000:mdt00_006.0 Request processed in 98us (325us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787508757.274430:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29915 00000100:00100000:2.0:1787508757.274493:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed431500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480219392:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1787508757.274560:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed431500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480219520:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1787508757.274584:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508757.274610:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1e750c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508757.274662:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480219520 00000100:00100000:3.0:1787508757.274667:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480219520 00000100:00100000:3.0:1787508757.274698:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29916 00000100:00100000:3.0:1787508757.274704:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:230618:x1874324480219520:12345-0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1787508757.274790:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:230618:x1874324480219520:12345-0@lo:1000:mdt00_006.0 Request processed in 86us (205us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787508757.274797:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29916 00000100:00100000:2.0:1787508757.275101:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed431500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480219520:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1787508757.275151:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed431500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480219648:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1787508757.275174:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508757.275200:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1e750c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508757.275246:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480219648 00000100:00100000:1.0:1787508757.275251:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480219648 00000100:00100000:1.0:1787508757.275281:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29917 00000100:00100000:1.0:1787508757.275287:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:230618:x1874324480219648:12345-0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1787508757.275351:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:230618:x1874324480219648:12345-0@lo:1000:mdt00_006.0 Request processed in 64us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508757.275357:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29917 00000100:00100000:2.0:1787508757.275514:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed431500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480219648:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1787508757.275553:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed431500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480219776:0@lo:1000:mdt00_006.0 00000100:00100000:2.0:1787508757.275576:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508757.275598:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1e750c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508757.275642:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480219776 00000100:00100000:1.0:1787508757.275646:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480219776 00000100:00100000:1.0:1787508757.275677:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29918 00000100:00100000:1.0:1787508757.275683:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:230618:x1874324480219776:12345-0@lo:1000:mdt00_006.0 00000100:00100000:1.0:1787508757.275762:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:230618:x1874324480219776:12345-0@lo:1000:mdt00_006.0 Request processed in 79us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508757.275769:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29918 00000100:00100000:3.0:1787508757.276100:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed431500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480219776:0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1787508757.276143:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ace680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480219904:0@lo:1000:mdt00_006.0 00000100:00100000:3.0:1787508757.276172:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508757.276197:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d46c6240 going to sleep for 11 seconds 00000100:00100000:0.0:1787508757.276246:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480219904 00000100:00100000:0.0:1787508757.276250:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480219904 00000100:00100000:0.0:1787508757.276281:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29919 00000100:00100000:0.0:1787508757.276288:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:230618:x1874324480219904:12345-0@lo:1000:mdt00_006.0 00000100:00100000:0.0:1787508757.276345:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:230618:x1874324480219904:12345-0@lo:1000:mdt00_006.0 Request processed in 57us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508757.276352:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29919 00000100:00100000:3.0:1787508757.277108:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ace680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-mdtlov_UUID:230618:1874324480219904:0@lo:1000:mdt00_006.0 00000040:00080000:3.0:1787508757.277619:0:230618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xf:0x0].56, 1112 off91208 00000040:00080000:3.0:1787508757.277679:0:230618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x5:0x0].600, 1256 off761088 00000004:00080000:3.0:1787508757.277686:0:230618:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d46c6f00 with version 13627 00000004:00080000:0.0:1787508757.278317:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13627 rpc_version 13627 00000020:00100000:0.0:1787508757.278351:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787508757.278360:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091f9b27100 x1874324480220160/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2544/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787508757.278380:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b27100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480220160:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787508757.278440:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508757.278474:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3455780 going to sleep for 11 seconds 00000100:00100000:2.0:1787508757.278530:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480220160 00000100:00100000:2.0:1787508757.278537:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480220160 00000100:00100000:2.0:1787508757.278584:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29920 00000100:00100000:2.0:1787508757.278593:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf199c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202961:x1874324480220160:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508757.279240:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf199c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:202961:x1874324480220160:12345-0@lo:1000:osp_up0-1.0 Request processed in 646us (798us total) trans 12884944231 rc 0/0 00000100:00100000:2.0:1787508757.279249:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29920 00000100:00100000:0.0:1787508757.279571:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b27100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480220160:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1787508757.279869:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e000/0xb126349c40f35bdb lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13da:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.279887:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e000/0xb126349c40f35bdb lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.279911:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e000/0xb126349c40f35bdb lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508757.279929:0:230618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001941712e reply state 00000000629e5793 transno 8589962061 ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e000/0xb126349c40f35bdb lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.280139:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e000/0xb126349c40f35bdb lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.280148:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090cc088a00) 00010000:00010000:3.0:1787508757.280152:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508757.280155:0:230618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787508757.280161:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13da:0x0]: returning size 4096 00000004:00080000:3.0:1787508757.280171:0:230618:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1787508757.280182:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f35bbf lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f35bc6 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.280194:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f35bbf lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f35bc6 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.280202:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f35bbf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f35bc6 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.280221:0:230618:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1787508757.280226:0:230618:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1787508757.280231:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f35bcd lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f35bd4 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.280238:0:230618:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f35bcd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f35bd4 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508757.280324:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:344169:x1874324509647744:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 19789us (21640us total) trans 8589962061 rc 0/0 00000100:00100000:3.0:1787508757.280332:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94187 00010000:00010000:2.0:1787508757.283089:0:226765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787508757.283102:0:226765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f35bbf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xb126349c40f35bc6 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.283114:0:226765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aaa00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:2.0:1787508757.283121:0:226765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f35bbf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xb126349c40f35bc6 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508757.283131:0:226765:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f35bbf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xb126349c40f35bc6 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.283176:0:226765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f35bbf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f35bc6 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.283184:0:226765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787508757.283216:0:226765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f35bbf lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f35bc6 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.283224:0:226765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2aaa00/0xb126349c40f35bbf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f35bc6 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.283237:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508757.283239:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508757.283241:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508757.283312:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480220288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508757.283379:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508757.283487:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480220288 00000100:00100000:1.0:1787508757.283494:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480220288 00000100:00100000:1.0:1787508757.283544:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9817 00000100:00100000:1.0:1787508757.283553:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3616:x1874324480220288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508757.283565:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508757.283582:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f35bc6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f35bbf expref: 9 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.283595:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508757.283600:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508757.283640:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3616:x1874324480220288:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508757.283648:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9817 00000100:00100000:0.0:1787508757.283712:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480220288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787508757.312688:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508757.312736:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508757.313150:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509648000 00000100:00100000:1.0:1787508757.313161:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509648000 00000100:00100000:1.0:1787508757.313232:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509648128 00000100:00100000:1.0:1787508757.313236:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509648128 00000100:00100000:1.0:1787508757.313265:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9818 00000100:00100000:1.0:1787508757.313275:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:287589:x1874324509648000:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508757.313292:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787508757.313319:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35b79 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x126f:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeaca expref: 11 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.313343:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f35b8e lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x126f:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaead1 expref: 10 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.313359:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126f:0x0].0x0 (ffff9090ca4e2000) 00010000:00010000:1.0:1787508757.313370:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508757.313422:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:287589:x1874324509648000:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 148us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508757.313429:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9818 00000100:00100000:1.0:1787508757.313447:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9819 00000100:00100000:1.0:1787508757.313454:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+23:288263:x1874324509648128:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508757.313462:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 10 locks, starting at 0 00010000:00010000:1.0:1787508757.313473:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35a4c lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea61 expref: 23 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.313486:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35a37 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x126d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea53 expref: 22 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.313494:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126d:0x0].0x0 (ffff9090d1b2b100) 00010000:00010000:1.0:1787508757.313509:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f3590a lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9f1 expref: 21 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.313520:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f358f5 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x126b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9e3 expref: 20 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.313528:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126b:0x0].0x0 (ffff9090d1b2b300) 00010000:00010000:1.0:1787508757.313538:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f358a8 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x126c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae9c7 expref: 19 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.313552:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126c:0x0].0x0 (ffff9090d36fdf00) 00010000:00010000:1.0:1787508757.313562:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f357c1 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae981 expref: 18 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.313575:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f357ac lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x126a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae973 expref: 17 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.313582:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x126a:0x0].0x0 (ffff9090d1b2b600) 00010000:00010000:1.0:1787508757.313612:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f356fd lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x1268:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae93b expref: 16 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.313625:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f35712 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1268:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae942 expref: 15 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.313634:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1268:0x0].0x0 (ffff9090d1b2b500) 00010000:00010000:1.0:1787508757.313644:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f356e1 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1267:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae934 expref: 14 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.313653:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1267:0x0].0x0 (ffff9090cc088900) 00010000:00010000:1.0:1787508757.313658:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508757.313679:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:288263:x1874324509648128:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 225us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508757.313685:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9819 00000100:00100000:3.0:1787508757.366159:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508757.366273:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509648256 00000100:00100000:0.0:1787508757.366283:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509648256 00000100:00100000:0.0:1787508757.366353:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94188 00000100:00100000:0.0:1787508757.366365:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:344177:x1874324509648256:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:0.0:1787508757.366387:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508757.366410:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f35be2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeae6 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.366480:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35be9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.366494:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35be9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.366505:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35be9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508757.366548:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787508757.366552:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508757.366574:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35be9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.366600:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f35be2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeae6 expref: 15 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.366618:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35be9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeae6 expref: 14 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.366627:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508757.366629:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508757.366633:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4400, rc 0) 00000100:00100000:0.0:1787508757.366697:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:344177:x1874324509648256:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 333us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508757.366707:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94188 00000100:00100000:1.0:1787508757.369390:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508757.369459:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509648512 00000100:00100000:0.0:1787508757.369468:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509648512 00000100:00100000:0.0:1787508757.369522:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94189 00000100:00100000:0.0:1787508757.369532:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:344177:x1874324509648512:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:0.0:1787508757.369549:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508757.369566:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35bf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeaed expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.369631:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35bf7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.369644:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35bf7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.369654:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35bf7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.369664:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35bfe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.369674:0:209004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35bd4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f35bcd expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.369683:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35bfe lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.369712:0:209004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35bd4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f35bcd expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508757.369743:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b24700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480220416:0@lo:104: 00000100:00100000:0.0:1787508757.369792:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508757.369830:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3455780 going to sleep for 11 seconds 00000100:00100000:3.0:1787508757.369878:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480220416 00000100:00100000:3.0:1787508757.369883:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480220416 00000100:00100000:3.0:1787508757.369920:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18202 00000100:00100000:3.0:1787508757.369927:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:209004:x1874324480220416:12345-0@lo:104: 00010000:00010000:3.0:1787508757.369962:0:229363:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f35bcd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f35bd4 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.370025:0:229363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787508757.370031:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b25880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:209004:x1874324480220416:12345-0@lo:104: Request processed in 104us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508757.370038:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18202 00010000:00010000:0.0:1787508757.370129:0:202214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508757.370135:0:202214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f35bcd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f35bd4 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.370144:0:202214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab800 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:0.0:1787508757.370150:0:202214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f35bcd lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f35bd4 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508757.370159:0:202214:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f35bcd lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f35bd4 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.370183:0:202214:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f35bcd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f35bd4 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.370189:0:202214:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787508757.370234:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1787508757.370340:0:202214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f35bcd lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f35bd4 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.370348:0:202214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2ab800/0xb126349c40f35bcd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f35bd4 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.370366:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508757.370368:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508757.370369:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508757.370392:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b24700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480220416:0@lo:104: 00010000:00010000:0.0:1787508757.370409:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35bfe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508757.371129:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480220544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508757.371176:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508757.371280:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480220544 00000100:00100000:0.0:1787508757.371285:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480220544 00010000:00010000:0.0:1787508757.371311:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35bd4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f35bcd expref: 8 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508757.371379:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27957 00000100:00100000:0.0:1787508757.371387:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3616:x1874324480220544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508757.371400:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1787508757.374178:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944231 is committed 00000001:00080000:0.0:1787508757.374207:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944230 is committed 00000004:00080000:0.0:1787508757.374212:0:202206:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 276 committed 00000001:00080000:0.0:1787508757.374226:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944229 is committed 00010000:00010000:0.0:1787508757.374307:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f35bd4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f35bcd expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.374326:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb0d038d2 (ffff9090ca4e2e00) 00010000:00010000:0.0:1787508757.374332:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35bfe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.374342:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35bfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.374349:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35bfe lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.374374:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508757.374447:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480220544:12345-0@lo:103:ldlm_bl.0 Request processed in 3059us (3270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508757.374457:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27957 00000100:00100000:1.0:1787508757.374585:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480220672:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787508757.374624:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508757.374664:0:225835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480220672 00000100:00100000:1.0:1787508757.374670:0:225835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480220672 00000100:00100000:1.0:1787508757.374719:0:225835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15079 00000100:00100000:1.0:1787508757.374738:0:225835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480220672:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787508757.374762:0:225835:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5423 count 1 00010000:00010000:1.0:1787508757.374798:0:225835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ae8bacb/0xb126349c40f35c05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x152f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.374817:0:225835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2673ad9/0xb126349c40f35b56 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x152f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeac3 expref: 6 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.374826:0:225835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x152f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787508757.374830:0:225835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x152f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787508757.374835:0:225835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ae8bacb/0xb126349c40f35c05 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x152f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.374856:0:225835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a2673ad9/0xb126349c40f35b56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x152f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000030020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeac3 expref: 6 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.374870:0:225835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a2673ad9/0xb126349c40f35b56 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x152f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400030020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeac3 expref: 6 pid: 225840 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508757.374883:0:225835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:225835:1874324480220800:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508757.374971:0:225835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d45346c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787508757.375095:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f35aed lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf852b649 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.375104:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f35aed lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf852b649 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.375112:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f35aed lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf852b649 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.375118:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508757.375123:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f35aed lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf852b649 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.375130:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f35aed lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf852b649 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.375142:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf852b649 (ffff9090ca4e2900) 00010000:00010000:3.0:1787508757.375144:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508757.375148:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f35aed lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf852b649 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.375153:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f35aed lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf852b649 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.375166:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35b64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf852b649 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.375173:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35b64 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf852b649 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.375179:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35b64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf852b649 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.375184:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508757.375187:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35b64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf852b649 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.375193:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35b64 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf852b649 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.375201:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf852b649 (ffff9090ca4e2900) 00010000:00010000:3.0:1787508757.375203:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508757.375205:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35b64 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf852b649 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.375210:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35b64 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf852b649 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787508757.376085:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787508757.378821:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508757.378911:0:225835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:225835:1874324480220800:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508757.378959:0:225835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007ae8bacb/0xb126349c40f35c05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x152f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508757.379757:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509648640 00000100:00100000:2.0:1787508757.379766:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509648640 00010000:00010000:2.0:1787508757.379898:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a2673ad9/0xb126349c40f35b56 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x152f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400030020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeac3 expref: 7 pid: 225840 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508757.379936:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27958 00000100:00100000:2.0:1787508757.379964:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2401:x1874324509648640:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508757.379988:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508757.379994:0:225839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a2673ad9/0xb126349c40f35b56 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x152f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400030020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeac3 expref: 7 pid: 225840 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.380008:0:225839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a2673ad9/0xb126349c40f35b56 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x152f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400030020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeac3 expref: 7 pid: 225840 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.380036:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2673ad9/0xb126349c40f35b56 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x152f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400030020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeac3 expref: 7 pid: 225840 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.380052:0:225839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x152f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787508757.380056:0:225839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x152f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787508757.380061:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007ae8bacb/0xb126349c40f35c05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x152f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.380072:0:225839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ae8bacb/0xb126349c40f35c05 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x152f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.380096:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508757.380113:0:225835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007ae8bacb/0xb126349c40f35c05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x152f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.380121:0:225835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ae8bacb/0xb126349c40f35c05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x152f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.380130:0:225835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ae8bacb/0xb126349c40f35c05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x152f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.380137:0:225835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ae8bacb/0xb126349c40f35c05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x152f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.380168:0:225835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787508757.380337:0:225835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3618:x1874324480220672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5609us (5710us total) trans 8589941255 rc 0/0 00000100:00100000:2.0:1787508757.380346:0:225835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15079 00000004:00080000:2.0:1787508757.380387:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9090e4ba1500/2, rc 0, transno 8589941255 00000100:00100000:2.0:1787508757.380393:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480220672:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787508757.380516:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2401:x1874324509648640:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 552us (1702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508757.380523:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27958 00000100:00100000:2.0:1787508757.380574:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480220544:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508757.380598:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35bfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.380605:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35bfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508757.380715:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed433800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:209004:1874324480220928:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787508757.381055:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508757.381081:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1e75d80 going to sleep for 11 seconds 00010000:00010000:2.0:1787508757.381106:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787508757.381113:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ae8bacb/0xb126349c40f35c05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x152f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.381122:0:204785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc0d0a230) 00010000:00010000:2.0:1787508757.381126:0:204785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ae8bacb/0xb126349c40f35c05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x152f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.381135:0:204785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ae8bacb/0xb126349c40f35c05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x152f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.381149:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ae8bacb/0xb126349c40f35c05 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x152f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.381156:0:204785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ae8bacb/0xb126349c40f35c05 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x152f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.381175:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508757.381177:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508757.381178:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508757.381191:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480220928 00000100:00100000:2.0:1787508757.381195:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480220928 00000100:00100000:2.0:1787508757.381232:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29921 00000100:00100000:2.0:1787508757.381239:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:209004:x1874324480220928:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787508757.381303:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:209004:x1874324480220928:12345-0@lo:1000:mdt00_005.0 Request processed in 65us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508757.381310:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29921 00000100:00100000:2.0:1787508757.381335:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed433800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:209004:1874324480220928:0@lo:1000:mdt00_005.0 00010000:00010000:2.0:1787508757.381379:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35c0c lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.381390:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35c0c lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.381399:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35c0c lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.381411:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35bf7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.381418:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35bf7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.381423:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35bf7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.381429:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35bf7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.381434:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508757.381437:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35bf7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.381443:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35bf7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.381452:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508757.381455:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508757.381458:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35bf7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.381465:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f35bf7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.381475:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35bfe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.381481:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35bfe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.381486:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35bfe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.381491:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508757.381494:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35bfe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.381499:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35bfe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.381506:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb0d038d2 (ffff9090ca4e2e00) 00010000:00010000:2.0:1787508757.381509:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508757.381513:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35bfe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.381519:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f35bfe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.381562:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f35bf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeaed expref: 9 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.381577:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35c0c lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeaed expref: 8 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.381584:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090d36fd900) 00010000:00010000:2.0:1787508757.381587:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508757.381589:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aaa00, rc 0) 00000100:00100000:2.0:1787508757.381615:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:344177:x1874324509648512:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 12085us (12233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508757.381622:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94189 00000100:00100000:3.0:1787508757.384315:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508757.384655:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509648896 00000100:00100000:2.0:1787508757.384666:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509648896 00000100:00100000:2.0:1787508757.384767:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94190 00000100:00100000:2.0:1787508757.384788:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:344177:x1874324509648896:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:2.0:1787508757.384813:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508757.384833:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f35c13 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeaf4 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508757.384968:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13da:0x0]: returning size 4096 00010000:00010000:2.0:1787508757.385108:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f35c13 lrc: 1/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeaf4 expref: 10 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.385123:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090cc088a00) 00010000:00010000:2.0:1787508757.385126:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508757.385131:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f35c13 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeaf4 expref: 10 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.385142:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab200, rc 0) 00000100:00100000:2.0:1787508757.385196:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:344177:x1874324509648896:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 420us (891us total) trans 8589962062 rc 301/301 00000100:00100000:2.0:1787508757.385203:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94190 00000100:00100000:3.0:1787508757.413125:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508757.413288:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509649024 00000100:00100000:2.0:1787508757.413299:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509649024 00000100:00100000:2.0:1787508757.413363:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94191 00000100:00100000:2.0:1787508757.413373:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:344177:x1874324509649024:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:2.0:1787508757.413398:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508757.413478:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f35c21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeafb expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.413549:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f35c28 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.413563:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f35c28 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.413575:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f35c28 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508757.413620:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13da:0x0]: returning size 4096 00000004:00200000:2.0:1787508757.413623:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508757.413644:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f35c28 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.413671:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f35c21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeafb expref: 11 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.413696:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f35c28 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeafb expref: 10 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.413704:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090cc088a00) 00010000:00010000:2.0:1787508757.413707:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508757.413710:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abe00, rc 0) 00000100:00100000:2.0:1787508757.413779:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:344177:x1874324509649024:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 406us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508757.413790:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94191 00000100:00100000:3.0:1787508757.448456:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508757.448577:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509649152 00000100:00100000:2.0:1787508757.448588:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509649152 00000100:00100000:2.0:1787508757.448657:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94192 00000100:00100000:2.0:1787508757.448668:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:344177:x1874324509649152:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:2.0:1787508757.448694:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508757.448716:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35c2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeb02 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.448798:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35c36 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.448812:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35c36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.448823:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35c36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508757.448869:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508757.448873:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508757.448904:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35c36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.448929:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35c2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb02 expref: 7 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.449238:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35c36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb02 expref: 6 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.449247:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508757.449250:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508757.449253:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab800, rc 0) 00000100:00100000:0.0:1787508757.449380:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:344177:x1874324509649152:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 713us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508757.449388:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94192 00000100:00100000:3.0:1787508757.503711:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508757.503840:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509649280 00000100:00100000:2.0:1787508757.503851:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509649280 00000100:00100000:2.0:1787508757.503986:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15473 00000100:00100000:2.0:1787508757.503998:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fdb9e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:344177:x1874324509649280:12345-192.168.201.30@tcp:33:check_fhandle_s.0 00000004:00200000:2.0:1787508757.504095:0:202230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13da:0x0]: returning size 4096 00000004:00200000:2.0:1787508757.504099:0:202230:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1787508757.504177:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fdb9e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:344177:x1874324509649280:12345-192.168.201.30@tcp:33:check_fhandle_s.0 Request processed in 182us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508757.504185:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15473 00000100:00080000:3.0:1787508757.504419:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787508757.508822:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508757.509107:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509649408 00000100:00100000:2.0:1787508757.509117:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509649408 00000100:00100000:2.0:1787508757.509180:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94193 00000100:00100000:2.0:1787508757.509190:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:344177:x1874324509649408:12345-192.168.201.30@tcp:34:check_fhandle_s.0 00000004:00080000:2.0:1787508757.509311:0:209004:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1787508757.509368:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed433800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480221056:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787508757.509429:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508757.509516:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1e750c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787508757.510160:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480221056 00000100:00100000:0.0:1787508757.510167:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480221056 00000100:00100000:0.0:1787508757.510214:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29922 00000100:00100000:0.0:1787508757.510223:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:209004:x1874324480221056:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787508757.510389:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:209004:x1874324480221056:12345-0@lo:1000:mdt00_005.0 Request processed in 167us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508757.510397:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29922 00000100:00100000:1.0:1787508757.510501:0:209004:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944231 gen 2 00000004:00080000:1.0:1787508757.510506:0:209004:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944231 committed transno 12884944231 00000100:00100000:1.0:1787508757.510532:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed433800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:209004:1874324480221056:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787508757.510666:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:344177:x1874324509649408:12345-192.168.201.30@tcp:34:check_fhandle_s.0 Request processed in 1476us (1854us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508757.510674:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94193 00000100:00100000:3.0:1787508757.513670:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508757.513758:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509649536 00000100:00100000:1.0:1787508757.513769:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509649536 00000100:00100000:1.0:1787508757.513850:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15474 00000100:00100000:1.0:1787508757.513862:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:344177:x1874324509649536:12345-192.168.201.30@tcp:37:check_fhandle_s.0 00000100:00100000:1.0:1787508757.520427:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:344177:x1874324509649536:12345-192.168.201.30@tcp:37:check_fhandle_s.0 Request processed in 6556us (6755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508757.520442:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15474 00000100:00100000:0.0:1787508757.524260:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508757.524354:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509649664 00000100:00100000:2.0:1787508757.524363:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509649664 00000100:00100000:2.0:1787508757.524427:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94194 00000100:00100000:2.0:1787508757.524438:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:344177:x1874324509649664:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:2.0:1787508757.524472:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508757.524496:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f35c3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeb09 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.524560:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35c44 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.524578:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35c44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.524588:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35c44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.524602:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f35c4b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.524608:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f35c4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.524614:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f35c4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.524681:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35c52 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.524690:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35c52 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.524697:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35c52 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508757.524719:0:205405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35c52 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.524750:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35c44 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.524757:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35c44 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.524769:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35c44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.524786:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35c44 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.524794:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508757.524799:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35c44 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.524807:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35c44 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.524819:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508757.524822:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508757.524827:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35c44 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.524835:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35c44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.524852:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f35c4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.524858:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f35c4b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.524864:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f35c4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.524869:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508757.524872:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f35c4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.524878:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f35c4b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.525265:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb0d038d2 (ffff9090d36fd000) 00010000:00010000:2.0:1787508757.525270:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508757.525274:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f35c4b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.525281:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f35c4b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.525318:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f35c3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb09 expref: 8 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.525333:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35c52 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb09 expref: 7 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.525341:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090d36fd900) 00010000:00010000:2.0:1787508757.525344:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508757.525346:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa000, rc 0) 00000100:00100000:2.0:1787508757.525414:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:344177:x1874324509649664:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 977us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508757.525421:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94194 00000100:00100000:2.0:1787508757.529735:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508757.529923:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509649792 00000100:00100000:0.0:1787508757.529933:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509649792 00000100:00100000:0.0:1787508757.530042:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94195 00000100:00100000:0.0:1787508757.530053:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:344177:x1874324509649792:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:0.0:1787508757.530075:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508757.530096:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5000/0xb126349c40f35c59 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeb10 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.530154:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4000/0xb126349c40f35c60 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.530168:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4000/0xb126349c40f35c60 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.530182:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4000/0xb126349c40f35c60 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508757.530230:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13da:0x0]: returning size 4096 00000004:00200000:0.0:1787508757.530235:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1787508757.530276:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5000/0xb126349c40f35c59 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb10 expref: 7 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.530294:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4000/0xb126349c40f35c60 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb10 expref: 6 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.530302:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090cc088a00) 00010000:00010000:0.0:1787508757.530304:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508757.530308:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4000, rc 0) 00000100:00100000:0.0:1787508757.530365:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:344177:x1874324509649792:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 313us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508757.530371:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94195 00000100:00100000:0.0:1787508757.533816:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508757.533962:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509650048 00000100:00100000:1.0:1787508757.533981:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509650048 00000100:00100000:1.0:1787508757.534044:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94196 00000100:00100000:1.0:1787508757.534056:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:344177:x1874324509650048:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:1.0:1787508757.534078:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508757.534101:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f35c67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeb17 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508757.534211:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13da:0x0]: returning size 4096 00010000:00010000:1.0:1787508757.534324:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f35c67 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb17 expref: 8 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.534339:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d171f600) 00010000:00010000:1.0:1787508757.534341:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508757.534346:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f35c67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb17 expref: 8 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.534364:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a600, rc 0) 00000100:00100000:1.0:1787508757.534420:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:344177:x1874324509650048:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 366us (610us total) trans 8589962063 rc 301/301 00000100:00100000:1.0:1787508757.534427:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94196 00000100:00100000:1.0:1787508757.574580:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508757.575327:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509650304 00000100:00100000:2.0:1787508757.575338:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509650304 00000100:00100000:2.0:1787508757.575400:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15475 00000100:00100000:2.0:1787508757.575411:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:344177:x1874324509650304:12345-192.168.201.30@tcp:35:check_fhandle_s.0 00000100:00100000:2.0:1787508757.575653:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:344177:x1874324509650304:12345-192.168.201.30@tcp:35:check_fhandle_s.0 Request processed in 243us (1085us total) trans 8589962064 rc 0/0 00000100:00100000:2.0:1787508757.575662:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15475 00000100:00100000:2.0:1787508757.578315:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508757.578453:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509650560 00000100:00100000:0.0:1787508757.578463:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509650560 00000100:00100000:0.0:1787508757.578563:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15476 00000100:00100000:0.0:1787508757.578575:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:344177:x1874324509650560:12345-192.168.201.30@tcp:35:check_fhandle_s.0 00000100:00100000:0.0:1787508757.578839:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:344177:x1874324509650560:12345-192.168.201.30@tcp:35:check_fhandle_s.0 Request processed in 265us (532us total) trans 8589962065 rc 0/0 00000100:00100000:0.0:1787508757.578848:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15476 00000100:00100000:0.0:1787508757.594432:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508757.594530:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509650688 00000100:00100000:1.0:1787508757.594543:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509650688 00000100:00100000:1.0:1787508757.594612:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94197 00000100:00100000:1.0:1787508757.594624:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:344202:x1874324509650688:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508757.594648:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508757.594668:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f35c75 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeb1e expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.594736:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f35c7c lrc: 3/1,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.594751:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f35c7c lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.594762:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f35c7c lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.595152:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f35c83 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.595163:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f35c83 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.595170:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f35c83 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.595220:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f35c7c lrc: 4/1,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.595227:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f35c7c lrc: 4/1,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.595233:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f35c7c lrc: 3/0,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.595239:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f35c7c lrc: 4/0,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.595245:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508757.595250:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f35c7c lrc: 4/0,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.595256:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f35c7c lrc: 5/0,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.595271:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090cc088a00) 00010000:00010000:1.0:1787508757.595274:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508757.595279:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f35c7c lrc: 3/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.595286:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f35c7c lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.595298:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f35c83 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.595304:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f35c83 lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.595309:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f35c83 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.595314:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508757.595317:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f35c83 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.595323:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f35c83 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.595329:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x27c99889 (ffff9090d171f600) 00010000:00010000:1.0:1787508757.595332:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508757.595334:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f35c83 lrc: 2/0,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.595340:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f35c83 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.595372:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f35c75 lrc: 1/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb1e expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.595381:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090cc088a00) 00010000:00010000:1.0:1787508757.595383:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508757.595387:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a600/0xb126349c40f35c75 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb1e expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.595394:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a600, rc 0) 00000100:00100000:1.0:1787508757.595460:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:344202:x1874324509650688:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 838us (1038us total) trans 0 rc 301/301 00000100:00100000:1.0:1787508757.595468:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94197 00000100:00100000:2.0:1787508757.604549:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508757.604633:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509650944 00000100:00100000:3.0:1787508757.604644:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509650944 00000100:00100000:3.0:1787508757.604707:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94198 00000100:00100000:3.0:1787508757.604719:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:344202:x1874324509650944:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508757.604751:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508757.604788:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ec00/0xb126349c40f35c8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeb25 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.605152:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fe00/0xb126349c40f35c91 lrc: 3/1,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.605173:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fe00/0xb126349c40f35c91 lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.605186:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fe00/0xb126349c40f35c91 lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508757.605199:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13da:0x0]: returning size 4096 00010000:00010000:3.0:1787508757.605307:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ec00/0xb126349c40f35c8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb25 expref: 14 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.605330:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fe00/0xb126349c40f35c91 lrc: 3/0,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb25 expref: 13 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.605340:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090cc088a00) 00010000:00010000:3.0:1787508757.605343:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787508757.605346:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fe00, rc 0) 00000100:00100000:3.0:1787508757.605447:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:344202:x1874324509650944:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 729us (907us total) trans 8589962066 rc 0/0 00000100:00100000:3.0:1787508757.605458:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94198 00000100:00100000:2.0:1787508757.610031:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508757.610335:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509651200 00000100:00100000:3.0:1787508757.610345:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509651200 00000100:00100000:3.0:1787508757.610402:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94199 00000100:00100000:3.0:1787508757.610413:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:344202:x1874324509651200:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:3.0:1787508757.610473:0:203348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508757.610501:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abe00/0xb126349c40f35c28 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeafb expref: 13 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.610521:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090cc088a00) 00010000:00010000:3.0:1787508757.610525:0:203348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508757.610583:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ec00/0xb126349c40f35c9f lrc: 3/0,1 mode: --/CW res: [0x240000bd0:0x13da:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.610598:0:203348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4000/0xb126349c40f35c60 lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb10 expref: 7 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.610606:0:203348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ec00/0xb126349c40f35c9f lrc: 4/0,1 mode: --/CW res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.610638:0:203348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4000/0xb126349c40f35c60 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb10 expref: 7 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.610652:0:203348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4000/0xb126349c40f35c60 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb10 expref: 7 pid: 202228 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508757.610667:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:203348:1874324480221184:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508757.610760:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d46c6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787508757.613821:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508757.614350:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:203348:1874324480221184:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508757.614377:0:203348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ec00/0xb126349c40f35c9f lrc: 3/0,1 mode: --/CW res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508757.615676:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509651328 00000100:00100000:2.0:1787508757.615690:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509651328 00010000:00010000:2.0:1787508757.615751:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4000/0xb126349c40f35c60 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb10 expref: 8 pid: 202228 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508757.615807:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27959 00000100:00100000:2.0:1787508757.615818:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9f1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2400:x1874324509651328:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508757.615833:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508757.615840:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4000/0xb126349c40f35c60 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb10 expref: 8 pid: 202228 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.615855:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4000/0xb126349c40f35c60 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb10 expref: 8 pid: 202228 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.615876:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4000/0xb126349c40f35c60 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb10 expref: 8 pid: 202228 timeout: 13828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.615905:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090cc088a00) 00010000:00010000:2.0:1787508757.615911:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ec00/0xb126349c40f35c9f lrc: 3/0,1 mode: --/CW res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.615921:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ec00/0xb126349c40f35c9f lrc: 3/0,1 mode: CW/CW res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.615928:0:202212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ec00/0xb126349c40f35c9f lrc: 4/0,1 mode: CW/CW res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.616244:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508757.616303:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9f1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2400:x1874324509651328:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 486us (2493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508757.616311:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27959 00010000:00010000:3.0:1787508757.616399:0:203348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ec00/0xb126349c40f35c9f lrc: 3/0,1 mode: CW/CW res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.616408:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ec00/0xb126349c40f35c9f lrc: 3/0,1 mode: CW/CW res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.616432:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f35ca6 lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.616441:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f35ca6 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.616450:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f35ca6 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787508757.617692:0:203348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xf:0x0].57, 2312 off93520 00000040:00080000:3.0:1787508757.617798:0:203348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x5:0x0].601, 2512 off763600 00000004:00080000:3.0:1787508757.617804:0:203348:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d46c6e40 with version 13628 00000004:00080000:1.0:1787508757.617893:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13628 rpc_version 13628 00000020:00100000:1.0:1787508757.617930:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787508757.617966:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090e4ba0e00 x1874324480221440/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 4256/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787508757.617998:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba0e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480221440:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508757.618064:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508757.618098:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d4534840 going to sleep for 11 seconds 00000100:00100000:2.0:1787508757.619520:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480221440 00000100:00100000:2.0:1787508757.619532:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480221440 00000100:00100000:2.0:1787508757.619587:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29923 00000100:00100000:2.0:1787508757.619599:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:202961:x1874324480221440:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508757.620768:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:202961:x1874324480221440:12345-0@lo:1000:osp_up0-1.0 Request processed in 1167us (2699us total) trans 12884944232 rc 0/0 00000100:00100000:2.0:1787508757.620793:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29923 00000100:00100000:1.0:1787508757.621696:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba0e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480221440:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1787508757.622197:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f35cad lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.622214:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f35cad lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.622226:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f35cad lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.622416:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f35cb4 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x295:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.622425:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f35cb4 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x295:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.622432:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f35cb4 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x295:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.622467:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e400/0xb126349c40f35cbb lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x28b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.622475:0:203348:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e400/0xb126349c40f35cbb lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x28b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.622484:0:203348:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e400/0xb126349c40f35cbb lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x28b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508757.622505:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480221568:0@lo:101:mdt00_003.0 00000100:00100000:3.0:1787508757.622560:0:203348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508757.622647:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d46c6540 going to sleep for 11 seconds 00000100:00100000:0.0:1787508757.622697:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480221568 00000100:00100000:0.0:1787508757.622705:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480221568 00000100:00100000:0.0:1787508757.623106:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29924 00000100:00100000:0.0:1787508757.623117:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:203348:x1874324480221568:12345-0@lo:101:mdt00_003.0 00010000:00010000:0.0:1787508757.623136:0:202231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508757.623153:0:202231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f35cc2 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x28b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f35cbb expref: -99 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.623175:0:202231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f35cc2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x28b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f35cbb expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.623187:0:202231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f35cc2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x28b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f35cbb expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.623195:0:202231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28b:0x0].0x0 (ffff9090ca4e2400) 00010000:00010000:0.0:1787508757.623198:0:202231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508757.623201:0:202231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5c00, rc 0) 00000100:00100000:0.0:1787508757.623297:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:203348:x1874324480221568:12345-0@lo:101:mdt00_003.0 Request processed in 181us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508757.623304:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29924 00000100:00100000:3.0:1787508757.623377:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480221568:0@lo:101:mdt00_003.0 00010000:00010000:3.0:1787508757.623392:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e400/0xb126349c40f35cbb lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x28b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f35cc2 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.623402:0:203348:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e400/0xb126349c40f35cbb lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x28b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f35cc2 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508757.623422:0:203348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c8240f9 reply state 0000000013a7c86b transno 8589962067 ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f35cb4 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x295:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.623435:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f35cb4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x295:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.623441:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x295:0x0].0x0 (ffff9090cc088c00) 00010000:00010000:3.0:1787508757.623443:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508757.623446:0:203348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787508757.623451:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e400/0xb126349c40f35cbb lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x28b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f35cc2 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.623459:0:203348:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e400/0xb126349c40f35cbb lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x28b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f35cc2 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787508757.623470:0:203348:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x28b:0x0] 00000004:00010000:3.0:1787508757.623477:0:203348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c8240f9 reply state 0000000013a7c86b transno 8589962067 ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f35cad lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.623485:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f35cad lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.623491:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13db:0x0].0x0 (ffff9090cc088f00) 00010000:00010000:3.0:1787508757.623493:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508757.623495:0:203348:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787508757.623500:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13db:0x0]: returning size 4096 00010000:00010000:3.0:1787508757.623509:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ec00/0xb126349c40f35c9f lrc: 4/0,1 mode: CW/CW res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.623515:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ec00/0xb126349c40f35c9f lrc: 4/0,1 mode: CW/CW res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.623521:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ec00/0xb126349c40f35c9f lrc: 3/0,0 mode: CW/CW res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.623528:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ec00/0xb126349c40f35c9f lrc: 4/0,0 mode: CW/CW res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.623535:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ec00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508757.623539:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ec00/0xb126349c40f35c9f lrc: 4/0,0 mode: CW/CW res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.623546:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ec00/0xb126349c40f35c9f lrc: 5/0,0 mode: CW/CW res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.623557:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090cc088a00) 00010000:00010000:3.0:1787508757.623559:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508757.623563:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ec00/0xb126349c40f35c9f lrc: 3/0,0 mode: --/CW res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.623569:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ec00/0xb126349c40f35c9f lrc: 0/0,0 mode: --/CW res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508757.623582:0:203348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c8240f9 reply state 0000000013a7c86b transno 8589962067 ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f35ca6 lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.623589:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f35ca6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.623594:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x27c99889 (ffff9090cc088000) 00010000:00010000:3.0:1787508757.623597:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508757.623599:0:203348:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1787508757.623706:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:344202:x1874324509651200:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 13293us (13683us total) trans 8589962067 rc 0/0 00000100:00100000:3.0:1787508757.623714:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94199 00000100:00100000:0.0:1787508757.643632:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508757.643742:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509651456 00000100:00100000:2.0:1787508757.643752:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509651456 00000100:00100000:2.0:1787508757.643825:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9820 00000100:00100000:2.0:1787508757.643836:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:287588:x1874324509651456:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508757.643851:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787508757.643876:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35c52 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb09 expref: 7 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.643908:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090d36fd900) 00010000:00010000:2.0:1787508757.643920:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35c36 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb02 expref: 6 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.643929:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508757.643932:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508757.644034:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:287588:x1874324509651456:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 199us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508757.644041:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9820 00000100:00100000:2.0:1787508757.647216:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508757.647246:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508757.647317:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509651840 00000100:00100000:3.0:1787508757.647326:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509651840 00000100:00100000:3.0:1787508757.647378:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15477 00000100:00100000:3.0:1787508757.647390:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:288263:x1874324509651840:12345-192.168.201.30@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787508757.647634:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:288263:x1874324509651840:12345-192.168.201.30@tcp:35:ldlm_bl.0 Request processed in 245us (385us total) trans 8589962068 rc 0/0 00000100:00100000:3.0:1787508757.647642:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15477 00000100:00100000:0.0:1787508757.648103:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509651584 00000100:00100000:0.0:1787508757.648109:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509651584 00000100:00100000:0.0:1787508757.648159:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9821 00000100:00100000:0.0:1787508757.648168:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed433480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:287588:x1874324509651584:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508757.648180:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787508757.648205:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35be9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeae6 expref: 8 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.648223:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508757.648234:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35c0c lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeaed expref: 7 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.648244:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090d36fd900) 00010000:00010000:0.0:1787508757.648253:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508757.648291:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed433480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:287588:x1874324509651584:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 124us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508757.648298:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9821 00000100:00100000:2.0:1787508757.651126:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508757.651207:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509651968 00000100:00100000:0.0:1787508757.651217:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509651968 00000100:00100000:0.0:1787508757.651281:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9822 00000100:00100000:0.0:1787508757.651291:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed433800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:288263:x1874324509651968:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508757.651306:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508757.651331:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fe00/0xb126349c40f35c91 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb25 expref: 15 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.651351:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090cc088a00) 00010000:00010000:0.0:1787508757.651355:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508757.651411:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed433800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:288263:x1874324509651968:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 121us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508757.651420:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9822 00000100:00100000:2.0:1787508757.697739:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508757.697812:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509652096 00000100:00100000:3.0:1787508757.697821:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509652096 00000100:00100000:3.0:1787508757.697875:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94200 00000100:00100000:3.0:1787508757.697886:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:344211:x1874324509652096:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:3.0:1787508757.697908:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508757.697931:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f35cc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeb2c expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.698039:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35cd0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.698053:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.698062:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508757.698104:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508757.698108:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508757.698130:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.698157:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f35cc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb2c expref: 8 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.698176:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb2c expref: 7 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.698183:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508757.698185:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508757.698187:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fe00, rc 0) 00000100:00100000:3.0:1787508757.698241:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:344211:x1874324509652096:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 359us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508757.698247:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94200 00000100:00100000:3.0:1787508757.700650:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508757.700743:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509652224 00000100:00100000:1.0:1787508757.700751:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509652224 00000100:00100000:1.0:1787508757.700808:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94201 00000100:00100000:1.0:1787508757.700816:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:344211:x1874324509652224:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:1.0:1787508757.700832:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508757.700849:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f35cd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeb33 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.700922:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35cde lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.700937:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35cde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.700992:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35cde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.701013:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35ce5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.701021:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.701027:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.701111:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f35cec lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.701119:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f35cec lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.701126:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f35cec lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508757.701147:0:209004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f35cec lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.701165:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35cde lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.701171:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35cde lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.701177:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35cde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.701184:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35cde lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.701190:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508757.701194:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35cde lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.701207:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35cde lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.701218:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508757.701221:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508757.701225:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35cde lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.701232:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35cde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.701246:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.701252:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35ce5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.701257:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.701262:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508757.701265:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.701271:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35ce5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.701278:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb0d038d2 (ffff9090d171f600) 00010000:00010000:1.0:1787508757.701280:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508757.701283:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35ce5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.701288:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35ce5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.701315:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f35cd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb33 expref: 9 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.701324:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f35cec lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb33 expref: 8 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.701329:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090d171f400) 00010000:00010000:1.0:1787508757.701331:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508757.701332:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b400, rc 0) 00000100:00100000:1.0:1787508757.701592:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:344211:x1874324509652224:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 775us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508757.701601:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94201 00000100:00100000:1.0:1787508757.705106:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508757.705205:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509652352 00000100:00100000:3.0:1787508757.705215:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509652352 00000100:00100000:3.0:1787508757.705293:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94202 00000100:00100000:3.0:1787508757.705301:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:344211:x1874324509652352:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:3.0:1787508757.705322:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508757.705339:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ec00/0xb126349c40f35cf3 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeb3a expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.705385:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f35cfa lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.705396:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f35cfa lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.705409:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f35cfa lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508757.705452:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13da:0x0]: returning size 4096 00000004:00200000:3.0:1787508757.705457:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1787508757.705492:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ec00/0xb126349c40f35cf3 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb3a expref: 16 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.705505:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f35cfa lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb3a expref: 15 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.705511:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090cc088a00) 00010000:00010000:3.0:1787508757.705513:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1787508757.705515:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f800, rc 0) 00000100:00100000:3.0:1787508757.705565:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:344211:x1874324509652352:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 265us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508757.705569:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94202 00000100:00100000:2.0:1787508757.707705:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508757.707782:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509652608 00000100:00100000:3.0:1787508757.707789:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509652608 00000100:00100000:3.0:1787508757.707869:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94203 00000100:00100000:3.0:1787508757.707877:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:344211:x1874324509652608:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:3.0:1787508757.707899:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508757.707914:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f35d01 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeb41 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.708009:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f600/0xb126349c40f35d08 lrc: 3/1,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.708022:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f600/0xb126349c40f35d08 lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.708032:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f600/0xb126349c40f35d08 lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.708048:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f35d0f lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.708056:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f35d0f lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.708062:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f35d0f lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508757.708205:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13db:0x0]: returning size 4096 00010000:00010000:3.0:1787508757.708264:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f600/0xb126349c40f35d08 lrc: 4/1,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.708269:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f600/0xb126349c40f35d08 lrc: 4/1,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.708273:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f600/0xb126349c40f35d08 lrc: 3/0,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.708277:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f600/0xb126349c40f35d08 lrc: 4/0,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.708281:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508757.708285:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f600/0xb126349c40f35d08 lrc: 4/0,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.708292:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f600/0xb126349c40f35d08 lrc: 5/0,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.708301:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090cc088a00) 00010000:00010000:3.0:1787508757.708303:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508757.708306:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f600/0xb126349c40f35d08 lrc: 3/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.708310:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f600/0xb126349c40f35d08 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.708318:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f35d0f lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.708321:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f35d0f lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.708325:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f35d0f lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.708328:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508757.708329:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f35d0f lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.708332:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f35d0f lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.708336:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x27c99889 (ffff9090cc088000) 00010000:00010000:3.0:1787508757.708337:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508757.708338:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f35d0f lrc: 2/0,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.708342:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f35d0f lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.708367:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f35d01 lrc: 1/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb41 expref: 17 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.708373:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090cc088a00) 00010000:00010000:3.0:1787508757.708374:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508757.708376:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f35d01 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb41 expref: 17 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.708382:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ea00, rc 0) 00000100:00100000:3.0:1787508757.708438:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:344211:x1874324509652608:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 560us (737us total) trans 8589962069 rc 301/301 00000100:00100000:3.0:1787508757.708445:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94203 00000100:00100000:2.0:1787508757.710164:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508757.710264:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509652736 00000100:00100000:0.0:1787508757.710273:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509652736 00000100:00100000:0.0:1787508757.710375:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94204 00000100:00100000:0.0:1787508757.710387:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:344211:x1874324509652736:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:0.0:1787508757.710410:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508757.710430:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f35d1d lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x295:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeb48 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.710481:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4a00/0xb126349c40f35d24 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x295:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.710494:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4a00/0xb126349c40f35d24 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x295:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.710503:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4a00/0xb126349c40f35d24 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x295:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508757.710545:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x295:0x0]: returning size 4096 00000004:00200000:0.0:1787508757.710550:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508757.710582:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f35d1d lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x295:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb48 expref: 18 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.710599:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4a00/0xb126349c40f35d24 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x295:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb48 expref: 17 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.710606:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x295:0x0].0x0 (ffff9090cc088c00) 00010000:00010000:0.0:1787508757.710609:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508757.710612:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4a00, rc 0) 00000100:00100000:0.0:1787508757.710663:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:344211:x1874324509652736:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 278us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508757.710669:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94204 00000100:00100000:1.0:1787508757.712644:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508757.713170:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509652864 00000100:00100000:3.0:1787508757.713181:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509652864 00000100:00100000:3.0:1787508757.713270:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94205 00000100:00100000:3.0:1787508757.713281:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:344211:x1874324509652864:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:3.0:1787508757.713297:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508757.713315:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f35d2b lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x28b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeb4f expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.713370:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35d32 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x28b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.713385:0:209004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f35cc2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a2:0x28b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f35cbb expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.713394:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35d32 lrc: 4/1,0 mode: --/PR res: [0x2000013a2:0x28b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.713426:0:209004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f35cc2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x28b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f35cbb expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508757.713442:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480221696:0@lo:104: 00000100:00100000:3.0:1787508757.713489:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508757.713536:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d46c6180 going to sleep for 11 seconds 00000100:00100000:2.0:1787508757.713594:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480221696 00000100:00100000:2.0:1787508757.713599:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480221696 00000100:00100000:2.0:1787508757.713637:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18203 00000100:00100000:2.0:1787508757.713645:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:209004:x1874324480221696:12345-0@lo:104: 00010000:00010000:2.0:1787508757.713657:0:202209:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e400/0xb126349c40f35cbb lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x28b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f35cc2 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508757.713826:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480221696:0@lo:104: 00010000:00010000:0.0:1787508757.713847:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35d32 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x28b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.714093:0:202209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787508757.714101:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:209004:x1874324480221696:12345-0@lo:104: Request processed in 457us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508757.714108:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18203 00010000:00010000:2.0:1787508757.714132:0:202215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787508757.714138:0:202215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e400/0xb126349c40f35cbb lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x28b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f35cc2 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.714151:0:202215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e400 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:2.0:1787508757.714156:0:202215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e400/0xb126349c40f35cbb lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x28b:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f35cc2 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508757.714164:0:202215:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e400/0xb126349c40f35cbb lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x28b:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f35cc2 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.714190:0:202215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e400/0xb126349c40f35cbb lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x28b:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f35cc2 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.714196:0:202215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787508757.714227:0:202215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e400/0xb126349c40f35cbb lrc: 1/0,0 mode: --/PW res: [0x2000013a2:0x28b:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f35cc2 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.714235:0:202215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e400/0xb126349c40f35cbb lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x28b:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f35cc2 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.714250:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508757.714253:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508757.714254:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508757.714262:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787508757.714272:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c993f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480221824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787508757.714306:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508757.714337:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480221824 00000100:00100000:2.0:1787508757.714341:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480221824 00010000:00010000:2.0:1787508757.714358:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f35cc2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x28b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f35cbb expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508757.714388:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27960 00000100:00100000:2.0:1787508757.714395:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3618:x1874324480221824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508757.714404:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1787508757.716554:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944232 is committed 00010000:00010000:2.0:1787508757.716658:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f35cc2 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x28b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f35cbb expref: 7 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.716676:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28b:0x0].0x0 (ffff9090ca4e2400) 00010000:00010000:2.0:1787508757.716681:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35d32 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x28b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.716690:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35d32 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.716698:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35d32 lrc: 4/1,0 mode: PR/PR res: [0x2000013a2:0x28b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.716812:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508757.716894:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480221824:12345-0@lo:103:ldlm_bl.0 Request processed in 2497us (2585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508757.716903:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27960 00000100:00100000:3.0:1787508757.717151:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c993f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480221824:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508757.717240:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35d32 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.717249:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35d32 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508757.717296:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a2:0x28b:0x0]: returning size 4096 00000004:00200000:0.0:1787508757.717302:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508757.717350:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f35d2b lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x28b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb4f expref: 10 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.717366:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35d32 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x28b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb4f expref: 9 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.717374:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28b:0x0].0x0 (ffff9090ca4e2400) 00010000:00010000:0.0:1787508757.717377:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508757.717380:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fc00, rc 0) 00000100:00100000:0.0:1787508757.717469:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:344211:x1874324509652864:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 4189us (4831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508757.717477:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94205 00000100:00100000:2.0:1787508757.748178:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508757.748312:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509652992 00000100:00100000:3.0:1787508757.748323:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509652992 00000100:00100000:3.0:1787508757.748390:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94206 00000100:00100000:3.0:1787508757.748402:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:344211:x1874324509652992:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:3.0:1787508757.748427:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508757.748448:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f35d39 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeb56 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.748543:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f35d40 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.748559:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f35d40 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13db:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.748570:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f35d40 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13db:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508757.748649:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13db:0x0]: returning size 4096 00000004:00200000:3.0:1787508757.748654:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1787508757.748675:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f35d40 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13db:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.748699:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f35d39 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13db:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb56 expref: 19 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.748717:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f35d40 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13db:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb56 expref: 18 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.748726:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13db:0x0].0x0 (ffff9090cc088f00) 00010000:00010000:3.0:1787508757.748729:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508757.748732:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f200, rc 0) 00000100:00100000:3.0:1787508757.749399:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+18:344211:x1874324509652992:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 994us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508757.749408:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94206 00000100:00100000:2.0:1787508757.779267:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508757.779364:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509653120 00000100:00100000:3.0:1787508757.779374:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509653120 00000100:00100000:3.0:1787508757.779435:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94207 00000100:00100000:3.0:1787508757.779446:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:344211:x1874324509653120:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:3.0:1787508757.779469:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508757.779491:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35d47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeb5d expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.779557:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35d4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.779571:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35d4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.779582:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35d4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508757.779626:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508757.779629:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508757.779652:0:203348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35d4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.779675:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35d47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb5d expref: 7 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.779693:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35d4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb5d expref: 6 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.779702:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508757.779705:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508757.779708:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f600, rc 0) 00000100:00100000:3.0:1787508757.779768:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:344211:x1874324509653120:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 323us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508757.779775:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94207 00000100:00100000:2.0:1787508757.820332:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508757.820448:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509653248 00000100:00100000:0.0:1787508757.820458:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509653248 00000100:00100000:0.0:1787508757.820526:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94208 00000100:00100000:0.0:1787508757.820536:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+18:344211:x1874324509653248:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:0.0:1787508757.820560:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508757.820581:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f35d55 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeb64 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.820651:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4c00/0xb126349c40f35d5c lrc: 3/1,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.820666:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4c00/0xb126349c40f35d5c lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.820677:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4c00/0xb126349c40f35d5c lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.820689:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f35d63 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.820697:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f35d63 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.820704:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f35d63 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.820810:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4800/0xb126349c40f35d6a lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.820819:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4800/0xb126349c40f35d6a lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13db:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.820826:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4800/0xb126349c40f35d6a lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13db:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508757.820912:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13db:0x0]: returning size 4096 00000004:00200000:0.0:1787508757.820917:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1787508757.820938:0:205405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4800/0xb126349c40f35d6a lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13db:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.820990:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4c00/0xb126349c40f35d5c lrc: 4/1,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.820996:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4c00/0xb126349c40f35d5c lrc: 4/1,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.821002:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4c00/0xb126349c40f35d5c lrc: 3/0,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.821007:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4c00/0xb126349c40f35d5c lrc: 4/0,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.821013:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508757.821017:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4c00/0xb126349c40f35d5c lrc: 4/0,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.821023:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4c00/0xb126349c40f35d5c lrc: 5/0,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.821034:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090cc088a00) 00010000:00010000:0.0:1787508757.821037:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508757.821041:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4c00/0xb126349c40f35d5c lrc: 3/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.821048:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4c00/0xb126349c40f35d5c lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.821061:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f35d63 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.821071:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f35d63 lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.821076:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f35d63 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.821081:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508757.821083:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f35d63 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.821089:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f35d63 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.821096:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x27c99889 (ffff9090cc088000) 00010000:00010000:0.0:1787508757.821525:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508757.821531:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f35d63 lrc: 2/0,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.821538:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f35d63 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.821570:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f35d55 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb64 expref: 20 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.821584:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4800/0xb126349c40f35d6a lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13db:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb64 expref: 19 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.821592:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13db:0x0].0x0 (ffff9090cc088f00) 00010000:00010000:0.0:1787508757.821595:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508757.821598:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4800, rc 0) 00000100:00100000:0.0:1787508757.821669:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+19:344211:x1874324509653248:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 1133us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508757.821677:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94208 00000100:00100000:2.0:1787508757.833673:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508757.841552:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509653376 00000100:00100000:0.0:1787508757.841566:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509653376 00000100:00100000:0.0:1787508757.841644:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9823 00000100:00100000:0.0:1787508757.841655:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+19:2400:x1874324509653376:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508757.841673:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508757.841703:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4800/0xb126349c40f35d6a lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13db:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb64 expref: 19 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.841736:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13db:0x0].0x0 (ffff9090cc088f00) 00010000:00010000:0.0:1787508757.841742:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508757.842549:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+18:2400:x1874324509653376:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 890us (8879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508757.842559:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9823 00000100:00100000:2.0:1787508757.882572:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508757.882739:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509653504 00000100:00100000:1.0:1787508757.882750:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509653504 00000100:00100000:1.0:1787508757.882880:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15478 00000100:00100000:1.0:1787508757.882903:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fdb9c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:344211:x1874324509653504:12345-192.168.201.30@tcp:33:check_fhandle_s.0 00000004:00200000:1.0:1787508757.883100:0:227154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13db:0x0]: returning size 4096 00000004:00200000:1.0:1787508757.883105:0:227154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:1.0:1787508757.883191:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fdb9c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:344211:x1874324509653504:12345-192.168.201.30@tcp:33:check_fhandle_s.0 Request processed in 301us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508757.883199:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15478 00000100:00100000:2.0:1787508757.885222:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508757.885458:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509653632 00000100:00100000:3.0:1787508757.885468:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509653632 00000100:00100000:3.0:1787508757.885529:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94209 00000100:00100000:3.0:1787508757.885540:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:344211:x1874324509653632:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:3.0:1787508757.885561:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508757.885584:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f35d71 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x295:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeb6b expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.885639:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f35d78 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x295:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.885654:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f35d78 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x295:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.885666:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f35d78 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x295:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508757.885706:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x295:0x0]: returning size 4096 00000004:00200000:3.0:1787508757.885710:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787508757.885763:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ea00/0xb126349c40f35d71 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x295:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb6b expref: 9 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.885785:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f35d78 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x295:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb6b expref: 8 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508757.885795:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x295:0x0].0x0 (ffff9090cc088c00) 00010000:00010000:3.0:1787508757.885798:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508757.885802:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fa00, rc 0) 00000100:00100000:3.0:1787508757.885874:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:344211:x1874324509653632:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 337us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508757.885889:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94209 00000100:00100000:2.0:1787508757.904824:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508757.905174:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509653760 00000100:00100000:0.0:1787508757.905184:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509653760 00000100:00100000:0.0:1787508757.905254:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94210 00000100:00100000:0.0:1787508757.905265:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:344211:x1874324509653760:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:0.0:1787508757.905287:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508757.905308:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4800/0xb126349c40f35d7f lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x28b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeb72 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.905372:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35d86 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x28b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.905389:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35d86 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.905400:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35d86 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508757.905443:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a2:0x28b:0x0]: returning size 4096 00000004:00200000:0.0:1787508757.905448:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508757.905490:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4800/0xb126349c40f35d7f lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x28b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb72 expref: 8 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.905508:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35d86 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x28b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb72 expref: 7 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.905515:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28b:0x0].0x0 (ffff9090ca4e2400) 00010000:00010000:0.0:1787508757.905518:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508757.905521:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4400, rc 0) 00000100:00100000:0.0:1787508757.905589:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:344211:x1874324509653760:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 324us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508757.905597:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94210 00000100:00100000:3.0:1787508757.917125:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508757.917274:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509653888 00000100:00100000:1.0:1787508757.917285:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509653888 00000100:00100000:1.0:1787508757.917352:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94211 00000100:00100000:1.0:1787508757.917363:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:344211:x1874324509653888:12345-192.168.201.30@tcp:34:check_fhandle_s.0 00000100:00100000:1.0:1787508757.917622:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:344211:x1874324509653888:12345-192.168.201.30@tcp:34:check_fhandle_s.0 Request processed in 260us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508757.917631:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94211 00000100:00100000:1.0:1787508757.920566:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508757.920897:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509654016 00000100:00100000:0.0:1787508757.920908:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509654016 00000100:00100000:0.0:1787508757.921016:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94212 00000100:00100000:0.0:1787508757.921028:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:344211:x1874324509654016:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:0.0:1787508757.921048:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508757.921069:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4800/0xb126349c40f35d8d lrc: 2/0,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeb79 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.921120:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4800/0xb126349c40f35d8d lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb79 expref: 9 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.921135:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4800/0xb126349c40f35d8d lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb79 expref: 9 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.921145:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090cc088a00) 00010000:00010000:0.0:1787508757.921147:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508757.921151:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4800, rc 0) 00000100:00100000:0.0:1787508757.921211:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:344211:x1874324509654016:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 186us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508757.921219:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94212 00000100:00100000:2.0:1787508757.925132:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508757.925219:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509654144 00000100:00100000:3.0:1787508757.925230:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509654144 00000100:00100000:3.0:1787508757.925292:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15479 00000100:00100000:3.0:1787508757.925303:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:344211:x1874324509654144:12345-192.168.201.30@tcp:37:check_fhandle_s.0 00000100:00100000:2.0:1787508757.937390:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:344211:x1874324509654144:12345-192.168.201.30@tcp:37:check_fhandle_s.0 Request processed in 12079us (12260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508757.937401:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15479 00000100:00100000:0.0:1787508757.943771:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508757.945264:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509654272 00000100:00100000:2.0:1787508757.945277:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509654272 00000100:00100000:2.0:1787508757.945352:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94213 00000100:00100000:2.0:1787508757.945362:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:344211:x1874324509654272:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:2.0:1787508757.945382:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508757.945402:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aaa00/0xb126349c40f35d94 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeb80 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.945470:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f35d9b lrc: 3/1,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.945485:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f35d9b lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.945496:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f35d9b lrc: 3/1,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.945505:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa400/0xb126349c40f35da2 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.945511:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa400/0xb126349c40f35da2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.945517:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa400/0xb126349c40f35da2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.945603:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f35da9 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13db:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.945612:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f35da9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13db:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.945618:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f35da9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13db:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508757.945693:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13db:0x0]: returning size 4096 00000004:00200000:2.0:1787508757.945698:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1787508757.945718:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f35da9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13db:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.945730:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f35d9b lrc: 4/1,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.945735:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f35d9b lrc: 4/1,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.945741:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f35d9b lrc: 3/0,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.945747:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f35d9b lrc: 4/0,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.945754:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508757.945758:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f35d9b lrc: 4/0,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.945765:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f35d9b lrc: 5/0,0 mode: CR/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.945777:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090cc088a00) 00010000:00010000:2.0:1787508757.945780:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508757.945784:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f35d9b lrc: 3/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.945790:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f35d9b lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.945804:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa400/0xb126349c40f35da2 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.945810:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa400/0xb126349c40f35da2 lrc: 2/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.945816:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa400/0xb126349c40f35da2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.945821:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508757.945824:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa400/0xb126349c40f35da2 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.945830:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa400/0xb126349c40f35da2 lrc: 4/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.945836:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x27c99889 (ffff9090cc088000) 00010000:00010000:2.0:1787508757.945839:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508757.945842:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa400/0xb126349c40f35da2 lrc: 2/0,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.945846:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa400/0xb126349c40f35da2 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.947121:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aaa00/0xb126349c40f35d94 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb80 expref: 11 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.947143:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f35da9 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13db:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb80 expref: 10 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.947151:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13db:0x0].0x0 (ffff9090cc088f00) 00010000:00010000:2.0:1787508757.947154:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508757.947157:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab000, rc 0) 00000100:00100000:2.0:1787508757.947225:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:344211:x1874324509654272:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 1864us (3464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508757.947233:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94213 00000100:00100000:0.0:1787508757.963666:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508757.964409:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509654400 00000100:00100000:2.0:1787508757.964423:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509654400 00000100:00100000:2.0:1787508757.964489:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94214 00000100:00100000:2.0:1787508757.964499:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:344211:x1874324509654400:12345-192.168.201.30@tcp:34:check_fhandle_s.0 00000004:00080000:2.0:1787508757.964624:0:203348:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1787508757.964687:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c993ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480221952:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787508757.964745:0:203348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508757.964832:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1e750c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508757.966343:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480221952 00000100:00100000:3.0:1787508757.966356:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480221952 00000100:00100000:3.0:1787508757.966419:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29925 00000100:00100000:3.0:1787508757.966429:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:203348:x1874324480221952:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787508757.966548:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:203348:x1874324480221952:12345-0@lo:1000:mdt00_003.0 Request processed in 121us (1803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508757.966556:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29925 00000100:00100000:0.0:1787508757.966673:0:203348:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944232 gen 2 00000004:00080000:0.0:1787508757.966679:0:203348:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944232 committed transno 12884944232 00000100:00100000:0.0:1787508757.966703:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c993ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:203348:1874324480221952:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787508757.966807:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:344211:x1874324509654400:12345-192.168.201.30@tcp:34:check_fhandle_s.0 Request processed in 2308us (3150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508757.966815:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94214 00000100:00100000:3.0:1787508757.970070:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508757.970220:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509654528 00000100:00100000:0.0:1787508757.970230:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509654528 00000100:00100000:0.0:1787508757.970289:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15480 00000100:00100000:0.0:1787508757.970299:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:344211:x1874324509654528:12345-192.168.201.30@tcp:37:check_fhandle_s.0 00000100:00100000:0.0:1787508757.980451:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:344211:x1874324509654528:12345-192.168.201.30@tcp:37:check_fhandle_s.0 Request processed in 10144us (10381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508757.980466:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15480 00000100:00100000:2.0:1787508757.984332:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508757.984482:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509654656 00000100:00100000:1.0:1787508757.984494:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509654656 00000100:00100000:1.0:1787508757.984560:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94215 00000100:00100000:1.0:1787508757.984570:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:344211:x1874324509654656:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:1.0:1787508757.984590:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508757.984613:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f35db0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeb87 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.984678:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35db7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.984692:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35db7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.984705:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35db7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.984720:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35dbe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.984727:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35dbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.984734:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35dbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.984796:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f35dc5 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.984804:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f35dc5 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.984811:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f35dc5 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508757.984831:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f35dc5 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.984850:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35db7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.984873:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35db7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.984886:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35db7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.984894:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35db7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.984900:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508757.984903:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35db7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.984911:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35db7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.984923:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508757.984927:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508757.984931:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35db7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.984936:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35db7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.984996:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35dbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.985003:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35dbe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.985009:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35dbe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.985014:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508757.985017:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35dbe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.985022:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35dbe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.985030:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb0d038d2 (ffff9090d171f600) 00010000:00010000:1.0:1787508757.985032:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508757.985035:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35dbe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.985041:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35dbe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb0d038d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.985070:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f35db0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb87 expref: 9 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.985083:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f35dc5 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb87 expref: 8 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508757.985090:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090d171f400) 00010000:00010000:1.0:1787508757.985092:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508757.985095:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b200, rc 0) 00000100:00100000:1.0:1787508757.985150:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:344211:x1874324509654656:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 582us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508757.985160:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94215 00000100:00100000:3.0:1787508757.988253:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508757.988353:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509654784 00000100:00100000:0.0:1787508757.988363:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509654784 00000100:00100000:0.0:1787508757.988424:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94216 00000100:00100000:0.0:1787508757.988434:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:344211:x1874324509654784:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:0.0:1787508757.988456:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508757.988477:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4000/0xb126349c40f35dcc lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeb8e expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.988538:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f35dd3 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.988552:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f35dd3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.988565:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f35dd3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508757.988613:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13da:0x0]: returning size 4096 00000004:00200000:0.0:1787508757.988617:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1787508757.988664:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4000/0xb126349c40f35dcc lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb8e expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.988682:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f35dd3 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb8e expref: 11 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508757.988695:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090cc088a00) 00010000:00010000:0.0:1787508757.988698:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508757.988701:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5800, rc 0) 00000100:00100000:0.0:1787508757.988779:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:344211:x1874324509654784:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 346us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508757.988786:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94216 00000100:00100000:0.0:1787508757.993910:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508757.994055:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509655040 00000100:00100000:2.0:1787508757.994065:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509655040 00000100:00100000:2.0:1787508757.994125:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94217 00000100:00100000:2.0:1787508757.994136:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:344211:x1874324509655040:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:2.0:1787508757.994159:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508757.994179:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f35dda lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeb95 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508757.994317:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13db:0x0]: returning size 4096 00010000:00010000:2.0:1787508757.994415:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f35dda lrc: 1/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb95 expref: 13 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.994429:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090cc088a00) 00010000:00010000:2.0:1787508757.994432:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508757.994438:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f35dda lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb95 expref: 13 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508757.994453:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aba00, rc 0) 00000100:00100000:2.0:1787508757.994517:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:344211:x1874324509655040:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 383us (616us total) trans 8589962070 rc 301/301 00000100:00100000:2.0:1787508757.994524:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94217 00010000:00010000:2.0:1787508758.074549:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508758.076053:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508758.076204:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509655296 00000100:00100000:1.0:1787508758.076215:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509655296 00000100:00100000:1.0:1787508758.076273:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15481 00000100:00100000:1.0:1787508758.076282:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:344211:x1874324509655296:12345-192.168.201.30@tcp:35:check_fhandle_s.0 00000100:00100000:1.0:1787508758.076499:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:344211:x1874324509655296:12345-192.168.201.30@tcp:35:check_fhandle_s.0 Request processed in 216us (453us total) trans 8589962071 rc 0/0 00000100:00100000:1.0:1787508758.076507:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15481 00000100:00100000:3.0:1787508758.078887:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508758.079092:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509655552 00000100:00100000:1.0:1787508758.079101:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509655552 00000100:00100000:1.0:1787508758.079162:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15482 00000100:00100000:1.0:1787508758.079172:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+18:344211:x1874324509655552:12345-192.168.201.30@tcp:35:check_fhandle_s.0 00000100:00100000:1.0:1787508758.079378:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+19:344211:x1874324509655552:12345-192.168.201.30@tcp:35:check_fhandle_s.0 Request processed in 206us (505us total) trans 8589962072 rc 0/0 00000100:00100000:1.0:1787508758.079385:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15482 00000100:00100000:0.0:1787508758.101773:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508758.101886:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509655680 00000100:00100000:2.0:1787508758.101896:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509655680 00000100:00100000:2.0:1787508758.102008:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94218 00000100:00100000:2.0:1787508758.102018:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:344236:x1874324509655680:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508758.102039:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508758.102060:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35de8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeb9c expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.102132:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35def lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.102147:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35def lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.102157:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35def lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.102173:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35df6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.102180:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35df6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.102186:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35df6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.102246:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35def lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.102253:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35def lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.102260:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35def lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.102266:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35def lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.102272:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508758.102277:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35def lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.102285:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35def lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.102296:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508758.102299:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508758.102304:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35def lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.102310:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35def lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.102324:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35df6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.102330:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35df6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.102336:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35df6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.102340:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508758.102343:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35df6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.102349:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35df6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.102355:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xee1c4022 (ffff9090d36fd000) 00010000:00010000:2.0:1787508758.102358:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508758.102361:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35df6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.102366:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35df6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.102401:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35de8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb9c expref: 10 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.102411:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508758.102413:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508758.102417:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35de8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb9c expref: 10 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.102425:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abe00, rc 0) 00000100:00100000:2.0:1787508758.102488:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:344236:x1874324509655680:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 471us (724us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508758.102495:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94218 00000100:00080000:3.0:1787508758.102927:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508758.113421:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508758.113501:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509655936 00000100:00100000:3.0:1787508758.113511:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509655936 00000100:00100000:3.0:1787508758.113573:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94219 00000100:00100000:3.0:1787508758.113583:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:344236:x1874324509655936:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:3.0:1787508758.113640:0:209004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508758.113667:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35cd0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb2c expref: 9 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.113686:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508758.113692:0:209004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508758.113775:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35dfd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.113790:0:209004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35d4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb5d expref: 7 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.113804:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35dfd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.113837:0:209004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35d4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb5d expref: 7 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.114035:0:209004:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35d4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb5d expref: 7 pid: 203348 timeout: 13829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508758.114057:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480222080:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508758.114242:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d46c6000 going to sleep for 11 seconds 00000100:00100000:0.0:1787508758.138011:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508758.138148:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480222080:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508758.138175:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35dfd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508758.138258:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509656064 00000100:00100000:1.0:1787508758.138266:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509656064 00000100:00080000:3.0:1787508758.138324:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787508758.138324:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35d4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb5d expref: 8 pid: 203348 timeout: 13829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508758.138365:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27961 00000100:00100000:1.0:1787508758.138373:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2400:x1874324509656064:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508758.138386:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508758.138391:0:229383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35d4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb5d expref: 8 pid: 203348 timeout: 13829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.138402:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35d4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb5d expref: 8 pid: 203348 timeout: 13829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.138419:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f35d4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb5d expref: 8 pid: 203348 timeout: 13829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.138431:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508758.138434:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35dfd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.138442:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35dfd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.138446:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35dfd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.138467:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508758.138490:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35dfd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.138496:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35dfd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.138520:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35e04 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508758.138520:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2400:x1874324509656064:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 146us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508758.138528:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27961 00010000:00010000:3.0:1787508758.138530:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35e04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.138541:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35e04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787508758.140429:0:209004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1:0x0].1789, 2344 off1843992 00000040:00080000:2.0:1787508758.140489:0:209004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x1:0x0].1795, 2544 off2049848 00000004:00080000:2.0:1787508758.140500:0:209004:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d46c6000 with version 3473 00000004:00080000:0.0:1787508758.140557:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3473 rpc_version 3473 00000020:00100000:0.0:1787508758.140596:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787508758.140607:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091f9b26a00 x1874324480222336/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787508758.140629:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b26a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480222336:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787508758.140699:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508758.140742:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3455cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787508758.140761:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480222336 00000100:00100000:2.0:1787508758.140768:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480222336 00000100:00100000:2.0:1787508758.140815:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29926 00000100:00100000:2.0:1787508758.140824:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:202248:x1874324480222336:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787508758.142091:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:202248:x1874324480222336:12345-0@lo:1000:osp_up1-0.0 Request processed in 1262us (1386us total) trans 8589962073 rc 0/0 00000100:00100000:2.0:1787508758.142100:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29926 00000100:00100000:0.0:1787508758.143157:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b26a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480222336:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1787508758.144235:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35e0b lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1270:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.144251:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35e0b lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1270:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.144260:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35e0b lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1270:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.144274:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35e12 lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x173:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.144278:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35e12 lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.144282:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35e12 lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.144312:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa600/0xb126349c40f35e19 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x16b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.144316:0:209004:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa600/0xb126349c40f35e19 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x16b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.144323:0:209004:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa600/0xb126349c40f35e19 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x16b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508758.144339:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c993c380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:209004:1874324480222464:0@lo:101:mdt00_005.0 00000100:00100000:2.0:1787508758.144391:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508758.144425:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cdd73480 going to sleep for 11 seconds 00000100:00100000:3.0:1787508758.144456:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480222464 00000100:00100000:3.0:1787508758.144465:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480222464 00000100:00100000:3.0:1787508758.144517:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29927 00000100:00100000:3.0:1787508758.144526:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:209004:x1874324480222464:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1787508758.144546:0:203182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508758.144612:0:203182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ee00/0xb126349c40f35e20 lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x16b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f35e19 expref: -99 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.144633:0:203182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ee00/0xb126349c40f35e20 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x16b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f35e19 expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.144645:0:203182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ee00/0xb126349c40f35e20 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x16b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f35e19 expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.144653:0:203182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x16b:0x0].0x0 (ffff9090cc088200) 00010000:00010000:3.0:1787508758.144656:0:203182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508758.144659:0:203182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ee00, rc 0) 00000100:00100000:3.0:1787508758.144772:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:209004:x1874324480222464:12345-0@lo:101:mdt00_005.0 Request processed in 246us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508758.144779:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29927 00000100:00100000:1.0:1787508758.144908:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c993c380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:209004:1874324480222464:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1787508758.144923:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa600/0xb126349c40f35e19 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x16b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f35e20 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.144933:0:209004:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa600/0xb126349c40f35e19 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x16b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f35e20 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508758.145131:0:209004:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ab6093b reply state 000000000ec7ffa3 transno 12884944233 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35e12 lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.145146:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35e12 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.145153:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x173:0x0].0x0 (ffff9090d36fde00) 00010000:00010000:1.0:1787508758.145155:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787508758.145158:0:209004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787508758.145164:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa600/0xb126349c40f35e19 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x16b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f35e20 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.145172:0:209004:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa600/0xb126349c40f35e19 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x16b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f35e20 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787508758.145184:0:209004:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd2:0x16b:0x0] 00000004:00010000:1.0:1787508758.145191:0:209004:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ab6093b reply state 000000000ec7ffa3 transno 12884944233 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35e0b lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1270:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.145199:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35e0b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1270:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.145205:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1270:0x0].0x0 (ffff9090d36fd000) 00010000:00010000:1.0:1787508758.145207:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787508758.145209:0:209004:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1787508758.145214:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1270:0x0]: returning size 4096 00010000:00010000:1.0:1787508758.145224:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35dfd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.145229:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35dfd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.145236:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35dfd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.145243:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35dfd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.145249:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ea00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508758.145254:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35dfd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.145260:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35dfd lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.145271:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508758.145273:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508758.145277:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35dfd lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.145283:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f35dfd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508758.145294:0:209004:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ab6093b reply state 000000000ec7ffa3 transno 12884944233 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35e04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.145302:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35e04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.145307:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xee1c4022 (ffff9090cc088400) 00010000:00010000:1.0:1787508758.145309:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787508758.145311:0:209004:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1787508758.145403:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:344236:x1874324509655936:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 31820us (31991us total) trans 12884944233 rc 0/0 00000100:00100000:1.0:1787508758.145411:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94219 00000100:00100000:0.0:1787508758.172046:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508758.172217:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509656192 00000100:00100000:2.0:1787508758.172227:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509656192 00000100:00100000:2.0:1787508758.172298:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9824 00000100:00100000:2.0:1787508758.172310:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9f19850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:288263:x1874324509656192:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508758.172325:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787508758.172349:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35d86 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x28b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb72 expref: 7 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.172369:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28b:0x0].0x0 (ffff9090ca4e2400) 00010000:00010000:2.0:1787508758.172380:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f35dc5 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb87 expref: 6 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.172389:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090d171f400) 00010000:00010000:2.0:1787508758.172404:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508758.172455:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9f19850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:288263:x1874324509656192:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 147us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508758.172463:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9824 00000100:00100000:3.0:1787508758.172510:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508758.172598:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509656320 00000100:00100000:1.0:1787508758.172603:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509656320 00000100:00100000:1.0:1787508758.172678:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9825 00000100:00100000:1.0:1787508758.172687:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:287589:x1874324509656320:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508758.172696:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787508758.172708:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f35d32 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x28b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb4f expref: 10 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.172728:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28b:0x0].0x0 (ffff9090ca4e2400) 00010000:00010000:1.0:1787508758.172743:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f35cec lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb33 expref: 9 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.172752:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090d171f400) 00010000:00010000:1.0:1787508758.172757:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508758.172784:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:287589:x1874324509656320:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 99us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508758.172791:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9825 00000100:00100000:3.0:1787508758.176557:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508758.176643:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508758.176932:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509656448 00000100:00100000:1.0:1787508758.177155:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509656448 00000100:00100000:2.0:1787508758.177245:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509656576 00000100:00100000:2.0:1787508758.177250:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509656576 00000100:00100000:2.0:1787508758.177299:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9826 00000100:00100000:2.0:1787508758.177309:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:287588:x1874324509656448:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508758.177324:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1787508758.177348:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f35d78 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x295:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb6b expref: 13 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.177368:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x295:0x0].0x0 (ffff9090cc088c00) 00010000:00010000:2.0:1787508758.177378:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f35da9 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13db:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb80 expref: 12 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.177394:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13db:0x0].0x0 (ffff9090cc088f00) 00010000:00010000:2.0:1787508758.177402:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5800/0xb126349c40f35dd3 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb8e expref: 11 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.177413:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4800/0xb126349c40f35d8d lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb79 expref: 10 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.177420:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090cc088a00) 00010000:00010000:2.0:1787508758.177423:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508758.177476:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:287588:x1874324509656448:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 168us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508758.177483:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9826 00000100:00100000:2.0:1787508758.177499:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9827 00000100:00100000:2.0:1787508758.177505:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+19:288110:x1874324509656576:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508758.177512:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787508758.177521:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f35d40 lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13db:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb56 expref: 19 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.177530:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13db:0x0].0x0 (ffff9090cc088f00) 00010000:00010000:2.0:1787508758.177537:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4a00/0xb126349c40f35d24 lrc: 0/0,0 mode: --/PR res: [0x240000bd1:0x295:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb48 expref: 18 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.177545:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x295:0x0].0x0 (ffff9090cc088c00) 00010000:00010000:2.0:1787508758.177551:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f800/0xb126349c40f35cfa lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13da:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeb3a expref: 17 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.177559:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090cc088a00) 00010000:00010000:2.0:1787508758.177562:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508758.177575:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:288110:x1874324509656576:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 71us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508758.177580:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9827 00000100:00100000:2.0:1787508758.221628:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508758.221715:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509656704 00000100:00100000:3.0:1787508758.221726:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509656704 00000100:00100000:3.0:1787508758.221797:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94220 00000100:00100000:3.0:1787508758.221807:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:344244:x1874324509656704:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:3.0:1787508758.221836:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508758.221856:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35e27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeba3 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.221929:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f35e2e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.221989:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f35e2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.222001:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f35e2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508758.222043:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508758.222047:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508758.222068:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f35e2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.222093:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35e27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeba3 expref: 10 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.222110:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f35e2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeba3 expref: 9 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.222118:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508758.222121:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508758.222124:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f400, rc 0) 00000100:00100000:3.0:1787508758.222187:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:344244:x1874324509656704:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 381us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508758.222195:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94220 00000100:00100000:0.0:1787508758.230247:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508758.232317:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509656960 00000100:00100000:1.0:1787508758.232332:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509656960 00000100:00100000:1.0:1787508758.232466:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94221 00000100:00100000:1.0:1787508758.232476:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:344244:x1874324509656960:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:1.0:1787508758.232496:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508758.232517:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f35e35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaebaa expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.232591:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35e3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.232606:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35e3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.232617:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35e3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.232627:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35e43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.232634:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35e43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.232641:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35e43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508758.232808:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1270:0x0]: returning size 4096 00010000:00010000:1.0:1787508758.232894:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35e3c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.232902:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35e3c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.232908:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35e3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.232915:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35e3c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.232924:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508758.232928:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35e3c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.232937:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35e3c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.233002:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508758.233005:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508758.233009:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35e3c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.233017:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f35e3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.233029:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35e43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.233035:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35e43 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.233041:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35e43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.233047:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508758.233049:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35e43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.233055:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35e43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.233066:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xee1c4022 (ffff9090cc088400) 00010000:00010000:1.0:1787508758.233068:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508758.233071:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35e43 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.233077:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f35e43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.235361:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f35e35 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebaa expref: 11 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.235380:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508758.235383:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508758.235388:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f35e35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebaa expref: 11 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.235405:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b400, rc 0) 00000100:00100000:1.0:1787508758.235530:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:344244:x1874324509656960:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 3054us (5292us total) trans 12884944234 rc 301/301 00000100:00100000:1.0:1787508758.235541:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94221 00000100:00100000:0.0:1787508758.239424:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508758.239518:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509657088 00000100:00100000:1.0:1787508758.239529:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509657088 00000100:00100000:1.0:1787508758.239623:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94222 00000100:00100000:1.0:1787508758.239635:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:344244:x1874324509657088:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:1.0:1787508758.239662:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508758.239683:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f35e51 lrc: 2/0,0 mode: --/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaebb1 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.239745:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35e58 lrc: 3/1,0 mode: --/PR res: [0x2000013a0:0x173:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.239759:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35e58 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.239769:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35e58 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508758.239818:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a0:0x173:0x0]: returning size 4096 00000004:00200000:1.0:1787508758.239823:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787508758.239870:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f35e51 lrc: 0/0,0 mode: --/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebb1 expref: 12 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.239898:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35e58 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebb1 expref: 11 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.239907:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x173:0x0].0x0 (ffff9090d36fde00) 00010000:00010000:1.0:1787508758.239910:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508758.239913:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a000, rc 0) 00000100:00100000:2.0:1787508758.241480:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:344244:x1874324509657088:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 1834us (2054us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508758.241494:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94222 00000100:00100000:0.0:1787508758.245033:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508758.245187:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509657216 00000100:00100000:1.0:1787508758.245196:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509657216 00000100:00100000:1.0:1787508758.245248:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94223 00000100:00100000:1.0:1787508758.245258:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:344244:x1874324509657216:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:1.0:1787508758.245280:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508758.245301:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f35e5f lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x16b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaebb8 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.245362:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b000/0xb126349c40f35e66 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x16b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.245374:0:209004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ee00/0xb126349c40f35e20 lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x16b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f35e19 expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.245379:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b000/0xb126349c40f35e66 lrc: 4/1,0 mode: --/PR res: [0x240000bd2:0x16b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.245409:0:209004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ee00/0xb126349c40f35e20 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x16b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f35e19 expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508758.245424:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:209004:1874324480222592:0@lo:104: 00000100:00100000:1.0:1787508758.245474:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508758.245515:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480222592 00000100:00100000:1.0:1787508758.245518:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d4534000 going to sleep for 11 seconds 00000100:00100000:3.0:1787508758.245520:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480222592 00000100:00100000:3.0:1787508758.245558:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18204 00000100:00100000:3.0:1787508758.245565:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed433480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:209004:x1874324480222592:12345-0@lo:104: 00010000:00010000:3.0:1787508758.245578:0:229363:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa600/0xb126349c40f35e19 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x16b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f35e20 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.245642:0:229363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787508758.245647:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed433480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:209004:x1874324480222592:12345-0@lo:104: Request processed in 83us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508758.245655:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18204 00010000:00010000:0.0:1787508758.245739:0:202214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508758.245744:0:202214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa600/0xb126349c40f35e19 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x16b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f35e20 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.245754:0:202214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa600 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:0.0:1787508758.245758:0:202214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa600/0xb126349c40f35e19 lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x16b:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f35e20 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508758.245763:0:202214:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa600/0xb126349c40f35e19 lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x16b:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f35e20 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.245785:0:202214:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa600/0xb126349c40f35e19 lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x16b:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f35e20 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.245791:0:202214:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787508758.245827:0:202214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa600/0xb126349c40f35e19 lrc: 1/0,0 mode: --/PW res: [0x240000bd2:0x16b:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f35e20 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.245835:0:202214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090cd2aa600/0xb126349c40f35e19 lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x16b:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f35e20 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.245853:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508758.245855:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508758.245857:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508758.245919:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480222720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787508758.245992:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508758.246133:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480222720 00000100:00100000:0.0:1787508758.246138:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480222720 00010000:00010000:0.0:1787508758.246158:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ee00/0xb126349c40f35e20 lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x16b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f35e19 expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508758.246189:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27962 00000100:00100000:0.0:1787508758.246196:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3616:x1874324480222720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508758.246208:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787508758.247152:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:209004:1874324480222592:0@lo:104: 00010000:00010000:1.0:1787508758.247177:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b000/0xb126349c40f35e66 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x16b:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787508758.250839:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589962073 is committed 00000001:00080000:0.0:1787508758.250866:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589962072 is committed 00000001:00080000:0.0:1787508758.250882:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589962071 is committed 00000020:00080000:0.0:1787508758.250899:0:202955:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9090d46c6780 refcount 2 committed 0 result 0 batchid 4294998392 00000020:00080000:0.0:1787508758.250905:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d46c6e40 00000020:00080000:0.0:1787508758.250909:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a2:0x5:0x0].601 00000020:00080000:0.0:1787508758.250913:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521c00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090c10b9e00 00000020:00080000:0.0:1787508758.250915:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd1:0xf:0x0].57 00000020:00080000:0.0:1787508758.250978:0:202955:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9090d46c6240 refcount 2 committed 0 result 0 batchid 4294998391 00000020:00080000:0.0:1787508758.250982:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d46c6f00 00000020:00080000:0.0:1787508758.250985:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a2:0x5:0x0].600 00000020:00080000:0.0:1787508758.250987:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521a00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090d9d28800 00000020:00080000:0.0:1787508758.250989:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd1:0xf:0x0].56 00010000:00010000:0.0:1787508758.251061:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8ee00/0xb126349c40f35e20 lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x16b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f35e19 expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.251080:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x16b:0x0].0x0 (ffff9090cc088200) 00010000:00010000:0.0:1787508758.251084:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b000/0xb126349c40f35e66 lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x16b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.251093:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b000/0xb126349c40f35e66 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x16b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.251101:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b000/0xb126349c40f35e66 lrc: 4/1,0 mode: PR/PR res: [0x240000bd2:0x16b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.251142:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508758.251207:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480222720:12345-0@lo:103:ldlm_bl.0 Request processed in 5011us (5214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508758.251215:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27962 00010000:00010000:1.0:1787508758.251291:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e000/0xb126349c40f35bdb lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.251297:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e000/0xb126349c40f35bdb lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.251302:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e000/0xb126349c40f35bdb lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.251306:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508758.251310:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e000/0xb126349c40f35bdb lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.251315:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e000/0xb126349c40f35bdb lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.251322:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x0 (ffff9090cc088a00) 00010000:00010000:1.0:1787508758.251324:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508758.251326:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e000/0xb126349c40f35bdb lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.251330:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e000/0xb126349c40f35bdb lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x13da:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.251343:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f35ca6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.251346:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f35ca6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.251349:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f35ca6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.251352:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508758.251354:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f35ca6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.251357:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f35ca6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.251361:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13da:0x0].0x27c99889 (ffff9090cc088000) 00010000:00010000:1.0:1787508758.251362:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508758.251364:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f35ca6 lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.251367:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e600/0xb126349c40f35ca6 lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x13da:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.251373:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f35cad lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.251377:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f35cad lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x13db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.251380:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f35cad lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.251382:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508758.251384:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f35cad lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.251387:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f35cad lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x13db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.251391:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13db:0x0].0x0 (ffff9090cc088f00) 00010000:00010000:1.0:1787508758.251392:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508758.251395:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f35cad lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x13db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.251400:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e200/0xb126349c40f35cad lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x13db:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.251410:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f35cb4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x295:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.251419:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f35cb4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x295:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.251424:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f35cb4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x295:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.251429:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508758.251431:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f35cb4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x295:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.251437:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f35cb4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x295:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.251444:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x295:0x0].0x0 (ffff9090cc088c00) 00010000:00010000:1.0:1787508758.251447:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508758.251449:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f35cb4 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x295:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.251455:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f000/0xb126349c40f35cb4 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x295:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787508758.251602:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294998392 committed batchid 4294998390 00000020:00080000:2.0:1787508758.251654:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998390 00000100:00100000:2.0:1787508758.251685:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480222720:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787508758.251791:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b000/0xb126349c40f35e66 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x16b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.251800:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b000/0xb126349c40f35e66 lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x16b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508758.251854:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd2:0x16b:0x0]: returning size 4096 00000004:00200000:3.0:1787508758.251860:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787508758.251915:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247ac00/0xb126349c40f35e5f lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x16b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebb8 expref: 8 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.251932:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b000/0xb126349c40f35e66 lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x16b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebb8 expref: 7 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.251978:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x16b:0x0].0x0 (ffff9090cc088200) 00010000:00010000:3.0:1787508758.251982:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508758.251985:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b000, rc 0) 00000100:00100000:3.0:1787508758.252038:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:344244:x1874324509657216:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 6782us (7013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508758.252044:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94223 00000100:00100000:0.0:1787508758.271088:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508758.271453:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509657344 00000100:00100000:2.0:1787508758.271465:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509657344 00000100:00100000:2.0:1787508758.271569:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94224 00000100:00100000:2.0:1787508758.271580:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:344244:x1874324509657344:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:2.0:1787508758.271603:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508758.271625:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f35e6d lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaebbf expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.271727:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35e74 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.271746:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35e74 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.271759:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35e74 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508758.272400:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1270:0x0]: returning size 4096 00000004:00200000:2.0:1787508758.272407:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1787508758.272430:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35e74 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.272460:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f35e6d lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebbf expref: 13 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.272481:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35e74 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebbf expref: 12 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.272490:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1270:0x0].0x0 (ffff9090d36fd000) 00010000:00010000:2.0:1787508758.272493:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508758.272497:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab200, rc 0) 00000100:00100000:2.0:1787508758.272573:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:344244:x1874324509657344:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 994us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508758.272581:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94224 00000100:00100000:0.0:1787508758.302154:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508758.302251:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509657472 00000100:00100000:1.0:1787508758.302261:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509657472 00000100:00100000:1.0:1787508758.302322:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94225 00000100:00100000:1.0:1787508758.302332:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:344244:x1874324509657472:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:1.0:1787508758.302354:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508758.302374:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f35e7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaebc6 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.302445:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f35e82 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.302460:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f35e82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.302471:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f35e82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508758.302525:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508758.302529:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508758.302551:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f35e82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.302577:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f35e7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebc6 expref: 7 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.302594:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f35e82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebc6 expref: 6 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.302603:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508758.302606:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508758.302609:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b400, rc 0) 00000100:00100000:1.0:1787508758.302684:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:344244:x1874324509657472:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 353us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508758.302691:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94225 00000100:00100000:3.0:1787508758.355283:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508758.355547:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509657600 00000100:00100000:2.0:1787508758.355556:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509657600 00000100:00100000:2.0:1787508758.355615:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94226 00000100:00100000:2.0:1787508758.355626:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:344244:x1874324509657600:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:2.0:1787508758.355650:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508758.355676:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f35e89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaebcd expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.355753:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35e90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.355769:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35e90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.355793:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35e90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.355805:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f35e97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.355813:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f35e97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.355820:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f35e97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.355925:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f35e9e lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.355935:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f35e9e lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.355995:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f35e9e lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508758.356072:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1270:0x0]: returning size 4096 00000004:00200000:2.0:1787508758.356077:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1787508758.356112:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f35e9e lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.356124:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35e90 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.356130:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35e90 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.356136:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35e90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.356142:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35e90 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.356148:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508758.356152:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35e90 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.356158:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35e90 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.356170:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508758.356173:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508758.356177:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35e90 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.356183:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35e90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.356198:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f35e97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.356208:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f35e97 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.356214:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f35e97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.356218:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508758.356221:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f35e97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.356228:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f35e97 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.356235:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xee1c4022 (ffff9090cc088400) 00010000:00010000:2.0:1787508758.356237:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508758.356240:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f35e97 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.356246:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f35e97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.356270:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f35e89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebcd expref: 14 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.356282:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f35e9e lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebcd expref: 13 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.356290:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1270:0x0].0x0 (ffff9090d36fd000) 00010000:00010000:2.0:1787508758.356292:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508758.356295:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab400, rc 0) 00000100:00100000:2.0:1787508758.356357:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:344244:x1874324509657600:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 731us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508758.356365:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94226 00000100:00100000:2.0:1787508758.367730:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508758.367900:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509657728 00000100:00100000:0.0:1787508758.367911:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509657728 00000100:00100000:0.0:1787508758.368019:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9828 00000100:00100000:0.0:1787508758.368031:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:2401:x1874324509657728:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508758.368047:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508758.368071:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f35e9e lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebcd expref: 13 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.368103:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1270:0x0].0x0 (ffff9090d36fd000) 00010000:00010000:0.0:1787508758.368108:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508758.368160:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:2401:x1874324509657728:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 131us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508758.368168:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9828 00000100:00100000:0.0:1787508758.400470:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508758.400577:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509657856 00000100:00100000:1.0:1787508758.400587:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509657856 00000100:00100000:1.0:1787508758.400647:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15483 00000100:00100000:1.0:1787508758.400657:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fdb9e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:344244:x1874324509657856:12345-192.168.201.30@tcp:33:check_fhandle_s.0 00000004:00200000:1.0:1787508758.400804:0:210243:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1270:0x0]: returning size 4096 00000004:00200000:1.0:1787508758.400810:0:210243:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:1.0:1787508758.401175:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fdb9e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:344244:x1874324509657856:12345-192.168.201.30@tcp:33:check_fhandle_s.0 Request processed in 431us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508758.401185:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15483 00000100:00100000:1.0:1787508758.403655:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508758.404032:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509657984 00000100:00100000:3.0:1787508758.404042:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509657984 00000100:00100000:3.0:1787508758.404171:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94227 00000100:00100000:3.0:1787508758.404182:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:344244:x1874324509657984:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:3.0:1787508758.404200:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508758.404220:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35ea5 lrc: 2/0,0 mode: --/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaebd4 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.404276:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35eac lrc: 3/1,0 mode: --/PR res: [0x2000013a0:0x173:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.404291:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35eac lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.404303:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35eac lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508758.404349:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a0:0x173:0x0]: returning size 4096 00000004:00200000:3.0:1787508758.404354:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787508758.404464:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35ea5 lrc: 0/0,0 mode: --/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebd4 expref: 8 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.404484:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35eac lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebd4 expref: 7 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.404493:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x173:0x0].0x0 (ffff9090d36fde00) 00010000:00010000:3.0:1787508758.404496:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508758.404500:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f000, rc 0) 00000100:00100000:3.0:1787508758.404605:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:344244:x1874324509657984:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 425us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508758.404613:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94227 00000100:00100000:0.0:1787508758.409110:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508758.409282:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509658112 00000100:00100000:2.0:1787508758.409293:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509658112 00000100:00100000:2.0:1787508758.409343:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94228 00000100:00100000:2.0:1787508758.409353:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:344244:x1874324509658112:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:2.0:1787508758.409377:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508758.409410:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f35eb3 lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x16b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaebdb expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.409474:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f35eba lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x16b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.409489:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f35eba lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x16b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.409501:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f35eba lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x16b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508758.409546:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd2:0x16b:0x0]: returning size 4096 00000004:00200000:2.0:1787508758.409551:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787508758.409586:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f35eb3 lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x16b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebdb expref: 7 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.409606:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f35eba lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x16b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebdb expref: 6 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.409621:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x16b:0x0].0x0 (ffff9090cc088200) 00010000:00010000:2.0:1787508758.409624:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508758.409627:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abc00, rc 0) 00000100:00100000:2.0:1787508758.409693:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:344244:x1874324509658112:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 341us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508758.409700:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94228 00000100:00100000:3.0:1787508758.412503:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508758.413280:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509658240 00000100:00100000:0.0:1787508758.413291:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509658240 00000100:00100000:0.0:1787508758.413351:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94229 00000100:00100000:0.0:1787508758.413361:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:344244:x1874324509658240:12345-192.168.201.30@tcp:34:check_fhandle_s.0 00000100:00100000:0.0:1787508758.413591:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:344244:x1874324509658240:12345-192.168.201.30@tcp:34:check_fhandle_s.0 Request processed in 230us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508758.413599:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94229 00000100:00100000:0.0:1787508758.417663:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508758.417762:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509658368 00000100:00100000:1.0:1787508758.417772:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509658368 00000100:00100000:1.0:1787508758.417844:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15484 00000100:00100000:1.0:1787508758.417854:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:344244:x1874324509658368:12345-192.168.201.30@tcp:37:check_fhandle_s.0 00000100:00100000:1.0:1787508758.424370:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:344244:x1874324509658368:12345-192.168.201.30@tcp:37:check_fhandle_s.0 Request processed in 6504us (6707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508758.424385:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15484 00000100:00100000:2.0:1787508758.427824:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508758.428031:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509658496 00000100:00100000:3.0:1787508758.428041:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509658496 00000100:00100000:3.0:1787508758.428223:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94230 00000100:00100000:3.0:1787508758.428234:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:344244:x1874324509658496:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:3.0:1787508758.428253:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508758.428273:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35ec1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaebe2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.428337:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f35ec8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.428352:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f35ec8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.428363:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f35ec8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.428375:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35ecf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.428382:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35ecf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.428466:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35ecf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.428553:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f35ed6 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.428562:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f35ed6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.428569:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f35ed6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508758.428643:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1270:0x0]: returning size 4096 00000004:00200000:3.0:1787508758.428648:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1787508758.428670:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f35ed6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.428680:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f35ec8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.428686:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f35ec8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.428692:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f35ec8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.428699:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f35ec8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.428705:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508758.428720:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f35ec8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.428729:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f35ec8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.428740:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508758.428743:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508758.428747:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f35ec8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.428754:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f35ec8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.428767:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35ecf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.428773:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35ecf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.428778:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35ecf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.428784:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508758.428786:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35ecf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.428792:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35ecf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.428797:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xee1c4022 (ffff9090cc088400) 00010000:00010000:3.0:1787508758.428799:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508758.428802:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35ecf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.428808:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35ecf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.428831:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35ec1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebe2 expref: 9 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.428843:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f35ed6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebe2 expref: 8 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.428851:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1270:0x0].0x0 (ffff9090d36fd000) 00010000:00010000:3.0:1787508758.428853:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508758.428855:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e000, rc 0) 00000100:00100000:3.0:1787508758.429029:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:344244:x1874324509658496:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 796us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508758.429037:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94230 00000100:00100000:0.0:1787508758.432383:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508758.432734:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509658752 00000100:00100000:2.0:1787508758.432744:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509658752 00000100:00100000:2.0:1787508758.432806:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94231 00000100:00100000:2.0:1787508758.432817:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:344244:x1874324509658752:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:2.0:1787508758.432840:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508758.432861:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f35edd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaebe9 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508758.433049:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1270:0x0]: returning size 4096 00010000:00010000:2.0:1787508758.433326:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f35edd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebe9 expref: 10 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.433342:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508758.433346:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508758.433351:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f35edd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebe9 expref: 10 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.433367:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab000, rc 0) 00000100:00100000:2.0:1787508758.433500:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:344244:x1874324509658752:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 684us (1125us total) trans 12884944235 rc 301/301 00000100:00100000:2.0:1787508758.433509:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94231 00000100:00100000:0.0:1787508758.476188:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508758.476304:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509659008 00000100:00100000:2.0:1787508758.476314:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509659008 00000100:00100000:2.0:1787508758.476378:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15485 00000100:00100000:2.0:1787508758.476389:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:344244:x1874324509659008:12345-192.168.201.30@tcp:35:check_fhandle_s.0 00000100:00100000:2.0:1787508758.476613:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:344244:x1874324509659008:12345-192.168.201.30@tcp:35:check_fhandle_s.0 Request processed in 224us (433us total) trans 12884944236 rc 0/0 00000100:00100000:2.0:1787508758.476622:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15485 00000100:00100000:3.0:1787508758.479472:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508758.479563:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509659264 00000100:00100000:0.0:1787508758.479573:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509659264 00000100:00100000:0.0:1787508758.479630:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15486 00000100:00100000:0.0:1787508758.479640:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:344244:x1874324509659264:12345-192.168.201.30@tcp:35:check_fhandle_s.0 00000100:00100000:0.0:1787508758.479913:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:344244:x1874324509659264:12345-192.168.201.30@tcp:35:check_fhandle_s.0 Request processed in 273us (448us total) trans 12884944237 rc 0/0 00000100:00100000:0.0:1787508758.479921:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15486 00000100:00100000:0.0:1787508758.494063:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508758.494173:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509659392 00000100:00100000:2.0:1787508758.494183:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509659392 00000100:00100000:2.0:1787508758.494244:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94232 00000100:00100000:2.0:1787508758.494255:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:344269:x1874324509659392:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508758.494281:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508758.494301:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f35eeb lrc: 2/0,0 mode: --/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaebf0 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.494370:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35ef2 lrc: 3/1,0 mode: --/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.494385:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35ef2 lrc: 3/1,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.494397:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35ef2 lrc: 3/1,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.494412:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35ef9 lrc: 3/1,0 mode: --/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.494419:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35ef9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.494426:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35ef9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.494491:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35ef2 lrc: 4/1,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.494499:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35ef2 lrc: 4/1,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.494506:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35ef2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.494514:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35ef2 lrc: 4/0,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.494520:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508758.494524:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35ef2 lrc: 4/0,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.494532:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35ef2 lrc: 5/0,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.494544:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x173:0x0].0x0 (ffff9090d36fde00) 00010000:00010000:2.0:1787508758.494547:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508758.494552:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35ef2 lrc: 3/0,0 mode: --/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.494558:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa600/0xb126349c40f35ef2 lrc: 0/0,0 mode: --/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.494573:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35ef9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.494579:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35ef9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.494585:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35ef9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.494590:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508758.494592:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35ef9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.494597:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35ef9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.494603:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x173:0x0].0x27c99889 (ffff9090e33ffa00) 00010000:00010000:2.0:1787508758.494605:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508758.494607:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35ef9 lrc: 2/0,0 mode: --/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.494612:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35ef9 lrc: 0/0,0 mode: --/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.494640:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f35eeb lrc: 1/0,0 mode: --/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebf0 expref: 14 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.494649:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x173:0x0].0x0 (ffff9090d36fde00) 00010000:00010000:2.0:1787508758.494651:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508758.494656:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab000/0xb126349c40f35eeb lrc: 0/0,0 mode: --/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebf0 expref: 14 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.494665:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab000, rc 0) 00000100:00100000:2.0:1787508758.494731:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:344269:x1874324509659392:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 477us (677us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508758.494739:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94232 00000100:00100000:3.0:1787508758.501121:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508758.501776:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509659648 00000100:00100000:1.0:1787508758.501799:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509659648 00000100:00100000:1.0:1787508758.501863:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94233 00000100:00100000:1.0:1787508758.502285:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:344269:x1874324509659648:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508758.502307:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508758.502328:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f35f00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaebf7 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.502488:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f35f07 lrc: 3/1,0 mode: --/CR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.502503:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f35f07 lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.502515:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f35f07 lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508758.502526:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1270:0x0]: returning size 4096 00010000:00010000:1.0:1787508758.502620:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f35f00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebf7 expref: 16 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.502638:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f35f07 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebf7 expref: 15 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.502647:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1270:0x0].0x0 (ffff9090d36fd000) 00010000:00010000:1.0:1787508758.502650:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787508758.502655:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a800, rc 0) 00000100:00100000:1.0:1787508758.502721:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:344269:x1874324509659648:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 430us (1596us total) trans 12884944238 rc 0/0 00000100:00100000:1.0:1787508758.502729:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94233 00000100:00100000:3.0:1787508758.509582:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508758.509675:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509659904 00000100:00100000:0.0:1787508758.509686:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509659904 00000100:00100000:0.0:1787508758.509755:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94234 00000100:00100000:0.0:1787508758.509766:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:344269:x1874324509659904:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:0.0:1787508758.509836:0:230618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508758.509864:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35e58 lrc: 0/0,0 mode: --/PR res: [0x2000013a0:0x173:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebb1 expref: 15 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.509891:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x173:0x0].0x0 (ffff9090d36fde00) 00010000:00010000:0.0:1787508758.509896:0:230618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508758.509997:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35f15 lrc: 3/0,1 mode: --/CW res: [0x2000013a0:0x173:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.510012:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35eac lrc: 2/0,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebd4 expref: 9 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.510023:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35f15 lrc: 4/0,1 mode: --/CW res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.510053:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35eac lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebd4 expref: 9 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.510066:0:230618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35eac lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebd4 expref: 9 pid: 209004 timeout: 13829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508758.510078:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbd880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480222848:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508758.510157:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3455cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787508758.513537:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508758.513620:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509660032 00000100:00100000:1.0:1787508758.513629:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509660032 00010000:00010000:1.0:1787508758.513668:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35eac lrc: 5/0,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebd4 expref: 10 pid: 209004 timeout: 13829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508758.513717:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27963 00000100:00100000:1.0:1787508758.513727:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2401:x1874324509660032:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508758.513742:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508758.513749:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35eac lrc: 5/0,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebd4 expref: 10 pid: 209004 timeout: 13829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.513769:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35eac lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebd4 expref: 10 pid: 209004 timeout: 13829 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.513804:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x173:0x0].0x0 (ffff9090d36fde00) 00010000:00010000:1.0:1787508758.513810:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35f15 lrc: 3/0,1 mode: --/CW res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.513821:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35f15 lrc: 3/0,1 mode: CW/CW res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.513829:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35f15 lrc: 4/0,1 mode: CW/CW res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.513850:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508758.513921:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2401:x1874324509660032:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 195us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508758.513930:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27963 00010000:00010000:3.0:1787508758.514813:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35eac lrc: 0/0,0 mode: --/PR res: [0x2000013a0:0x173:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebd4 expref: 9 pid: 209004 timeout: 13829 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508758.514832:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbd880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480222848:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508758.514855:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35f15 lrc: 3/0,1 mode: CW/CW res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.514865:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35f15 lrc: 3/0,1 mode: CW/CW res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.514880:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35f15 lrc: 3/0,1 mode: CW/CW res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.514903:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f35f1c lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.514914:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f35f1c lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.514924:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f35f1c lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787508758.515804:0:230618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a0:0x1:0x0].1790, 2312 off1846304 00000040:00080000:3.0:1787508758.515881:0:230618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd2:0x1:0x0].1796, 2512 off2052360 00000004:00080000:3.0:1787508758.515886:0:230618:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d46c6e40 with version 3474 00000004:00080000:0.0:1787508758.516090:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3474 rpc_version 3474 00000020:00100000:0.0:1787508758.516126:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787508758.516135:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d1cbd180 x1874324480223104/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4256/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787508758.516157:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbd180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480223104:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787508758.516216:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508758.516251:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3455780 going to sleep for 11 seconds 00000100:00100000:3.0:1787508758.516635:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480223104 00000100:00100000:3.0:1787508758.516644:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480223104 00000100:00100000:3.0:1787508758.516710:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29928 00000100:00100000:3.0:1787508758.516720:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:202248:x1874324480223104:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787508758.517458:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:202248:x1874324480223104:12345-0@lo:1000:osp_up1-0.0 Request processed in 737us (1238us total) trans 8589962074 rc 0/0 00000100:00100000:3.0:1787508758.517468:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29928 00000100:00100000:0.0:1787508758.517576:0:202248:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589962073 gen 2 00000004:00080000:0.0:1787508758.517582:0:202248:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589962073 committed transno 8589962073 00000100:00100000:0.0:1787508758.517613:0:202248:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9090d1cbd180 x1874324480223104/t8589962074(8589962074) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4256/4320 e 0 to 0 dl 1787508774 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787508758.517649:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbd180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480223104:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1787508758.518123:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35f23 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1271:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.518138:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35f23 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1271:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.518149:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35f23 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1271:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.518167:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35f2a lrc: 3/0,1 mode: --/PW res: [0x2000013a0:0x174:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.518176:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35f2a lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x174:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.518182:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35f2a lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x174:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.518213:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8e200/0xb126349c40f35f31 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x16c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.518220:0:230618:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8e200/0xb126349c40f35f31 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.518230:0:230618:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8e200/0xb126349c40f35f31 lrc: 3/0,1 mode: --/PW res: [0x240000bd2:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508758.518247:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9acc380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:230618:1874324480223232:0@lo:101:mdt00_006.0 00000100:00100000:3.0:1787508758.518286:0:230618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508758.518349:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9091ffa08f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787508758.519414:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480223232 00000100:00100000:0.0:1787508758.519424:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480223232 00000100:00100000:0.0:1787508758.519518:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29929 00000100:00100000:0.0:1787508758.519528:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:230618:x1874324480223232:12345-0@lo:101:mdt00_006.0 00010000:00010000:0.0:1787508758.519548:0:203182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508758.519566:0:203182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f35f38 lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x16c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f35f31 expref: -99 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.519589:0:203182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f35f38 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f35f31 expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.519602:0:203182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f35f38 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f35f31 expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.519611:0:203182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x16c:0x0].0x0 (ffff9090c96b8d00) 00010000:00010000:0.0:1787508758.519614:0:203182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508758.519618:0:203182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5400, rc 0) 00000100:00100000:0.0:1787508758.519677:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:230618:x1874324480223232:12345-0@lo:101:mdt00_006.0 Request processed in 151us (1390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508758.519683:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29929 00000100:00100000:3.0:1787508758.519751:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9acc380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-mdtlov_UUID:230618:1874324480223232:0@lo:101:mdt00_006.0 00010000:00010000:3.0:1787508758.519767:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8e200/0xb126349c40f35f31 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f35f38 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.519792:0:230618:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8e200/0xb126349c40f35f31 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f35f38 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508758.519812:0:230618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054e32efe reply state 0000000027298b65 transno 12884944239 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35f2a lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x174:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.519825:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35f2a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x174:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.519830:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x174:0x0].0x0 (ffff9090cc088100) 00010000:00010000:3.0:1787508758.519832:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508758.519835:0:230618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787508758.519841:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8e200/0xb126349c40f35f31 lrc: 4/0,1 mode: PW/PW res: [0x240000bd2:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f35f38 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.519848:0:230618:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8e200/0xb126349c40f35f31 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f35f38 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787508758.519859:0:230618:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000bd2:0x16c:0x0] 00000004:00010000:3.0:1787508758.519866:0:230618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054e32efe reply state 0000000027298b65 transno 12884944239 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35f23 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1271:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.519884:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35f23 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1271:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.519890:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1271:0x0].0x0 (ffff9090cc088800) 00010000:00010000:3.0:1787508758.519892:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508758.519894:0:230618:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1787508758.519899:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1271:0x0]: returning size 4096 00010000:00010000:3.0:1787508758.519908:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35f15 lrc: 4/0,1 mode: CW/CW res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.519915:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35f15 lrc: 4/0,1 mode: CW/CW res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.519921:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35f15 lrc: 3/0,0 mode: CW/CW res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.519928:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35f15 lrc: 4/0,0 mode: CW/CW res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.519935:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508758.519966:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35f15 lrc: 4/0,0 mode: CW/CW res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.519976:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35f15 lrc: 5/0,0 mode: CW/CW res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.519987:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x173:0x0].0x0 (ffff9090d36fde00) 00010000:00010000:3.0:1787508758.519989:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508758.519993:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35f15 lrc: 3/0,0 mode: --/CW res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.520000:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f35f15 lrc: 0/0,0 mode: --/CW res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508758.520012:0:230618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054e32efe reply state 0000000027298b65 transno 12884944239 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f35f1c lrc: 3/0,1 mode: PW/PW res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.520021:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f35f1c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.520027:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x173:0x0].0x27c99889 (ffff9090cc088b00) 00010000:00010000:3.0:1787508758.520030:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508758.520032:0:230618:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1787508758.520105:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:344269:x1874324509659904:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 10340us (10531us total) trans 12884944239 rc 0/0 00000100:00100000:3.0:1787508758.520114:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94234 00000100:00100000:0.0:1787508758.535132:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508758.535224:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509660160 00000100:00100000:2.0:1787508758.535234:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509660160 00000100:00100000:2.0:1787508758.535298:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9829 00000100:00100000:2.0:1787508758.535308:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9f19450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:288110:x1874324509660160:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508758.535323:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787508758.535348:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f35ed6 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebe2 expref: 9 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.535366:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1270:0x0].0x0 (ffff9090d36fd000) 00010000:00010000:2.0:1787508758.535378:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f35e82 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebc6 expref: 8 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.535387:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508758.535390:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508758.535449:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9f19450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:288110:x1874324509660160:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 143us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508758.535457:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9829 00000100:00100000:1.0:1787508758.537493:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508758.537537:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508758.537618:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509660544 00000100:00100000:0.0:1787508758.537627:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509660544 00000100:00100000:0.0:1787508758.537685:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9830 00000100:00100000:0.0:1787508758.537694:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed431880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:288292:x1874324509660544:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508758.537718:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508758.537740:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f35eba lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x16b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebdb expref: 6 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.537763:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x16b:0x0].0x0 (ffff9090cc088200) 00010000:00010000:0.0:1787508758.537768:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508758.537824:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed431880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:288292:x1874324509660544:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 130us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508758.537832:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9830 00000100:00100000:2.0:1787508758.538086:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509660416 00000100:00100000:2.0:1787508758.538091:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509660416 00000100:00100000:2.0:1787508758.538129:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15487 00000100:00100000:2.0:1787508758.538137:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:287588:x1874324509660416:12345-192.168.201.30@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787508758.538333:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:287588:x1874324509660416:12345-192.168.201.30@tcp:35:ldlm_bl.0 Request processed in 196us (849us total) trans 12884944240 rc 0/0 00000100:00100000:2.0:1787508758.538341:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15487 00000100:00100000:1.0:1787508758.541283:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508758.541370:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509660672 00000100:00100000:3.0:1787508758.541380:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509660672 00000100:00100000:3.0:1787508758.541440:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9831 00000100:00100000:3.0:1787508758.541451:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:288263:x1874324509660672:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508758.541466:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508758.541490:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b000/0xb126349c40f35e66 lrc: 0/0,0 mode: --/PR res: [0x240000bd2:0x16b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebb8 expref: 7 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.541511:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x16b:0x0].0x0 (ffff9090cc088200) 00010000:00010000:3.0:1787508758.541522:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508758.541579:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:288263:x1874324509660672:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 130us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508758.541586:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9831 00000100:00100000:0.0:1787508758.544821:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508758.544920:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509660800 00000100:00100000:2.0:1787508758.544930:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509660800 00000100:00100000:2.0:1787508758.545022:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9832 00000100:00100000:2.0:1787508758.545033:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:287588:x1874324509660800:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508758.545048:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787508758.545073:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f35f07 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebf7 expref: 17 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.545093:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1270:0x0].0x0 (ffff9090d36fd000) 00010000:00010000:2.0:1787508758.545105:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f35e2e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeba3 expref: 16 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.545114:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508758.545121:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35e74 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebbf expref: 15 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.545132:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1270:0x0].0x0 (ffff9090d36fd000) 00010000:00010000:2.0:1787508758.545135:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508758.545184:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:287588:x1874324509660800:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 152us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508758.545191:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9832 00000100:00100000:1.0:1787508758.604371:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508758.604471:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509660928 00000100:00100000:2.0:1787508758.604483:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509660928 00000100:00100000:2.0:1787508758.604554:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94235 00000100:00100000:2.0:1787508758.604564:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:344277:x1874324509660928:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:2.0:1787508758.604587:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508758.604606:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35f3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaebfe expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.604675:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35f46 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.604691:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35f46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.604702:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35f46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508758.604763:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508758.604768:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508758.604803:0:203348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35f46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.604827:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f35f3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebfe expref: 16 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.604850:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35f46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebfe expref: 15 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.604858:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508758.604861:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508758.604865:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aba00, rc 0) 00000100:00100000:2.0:1787508758.604998:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:344277:x1874324509660928:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 376us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508758.605007:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94235 00000100:00100000:1.0:1787508758.609352:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508758.609446:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509661056 00000100:00100000:0.0:1787508758.609456:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509661056 00000100:00100000:0.0:1787508758.609517:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94236 00000100:00100000:0.0:1787508758.609526:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:344277:x1874324509661056:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:0.0:1787508758.609555:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508758.609576:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f35f4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaec05 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.609637:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35f54 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.609653:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35f54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.609665:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35f54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.609676:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35f5b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.609682:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35f5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.609690:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35f5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.609803:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f35f62 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.609812:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f35f62 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.609820:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f35f62 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508758.609903:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1270:0x0]: returning size 4096 00000004:00200000:0.0:1787508758.609909:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1787508758.609932:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f35f62 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.610000:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35f54 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.610007:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35f54 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.610013:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35f54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.610020:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35f54 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.610026:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508758.610031:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35f54 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.610039:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35f54 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.610051:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508758.610054:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508758.610058:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35f54 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.610064:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f35f54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.610078:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35f5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.610084:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35f5b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.610090:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35f5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.610095:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508758.610097:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35f5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.610102:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35f5b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.610109:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xee1c4022 (ffff9090cc088400) 00010000:00010000:0.0:1787508758.610111:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508758.610114:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35f5b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.610120:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f35f5b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.610145:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f35f4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec05 expref: 17 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.610159:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4c00/0xb126349c40f35f62 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec05 expref: 16 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.610166:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1270:0x0].0x0 (ffff9090d36fd000) 00010000:00010000:0.0:1787508758.610168:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787508758.610171:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4c00, rc 0) 00000100:00100000:0.0:1787508758.610224:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:344277:x1874324509661056:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 697us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508758.610231:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94236 00000100:00100000:3.0:1787508758.618191:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508758.618326:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509661312 00000100:00100000:1.0:1787508758.618336:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509661312 00000100:00100000:1.0:1787508758.618401:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94237 00000100:00100000:1.0:1787508758.618412:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:344277:x1874324509661312:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:1.0:1787508758.618432:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508758.618453:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f35f69 lrc: 2/0,0 mode: --/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaec0c expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.618522:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f35f70 lrc: 3/1,0 mode: --/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.618537:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f35f70 lrc: 3/1,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.618549:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f35f70 lrc: 3/1,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.618560:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35f77 lrc: 3/1,0 mode: --/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.618569:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35f77 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.618576:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35f77 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508758.618722:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1271:0x0]: returning size 4096 00010000:00010000:1.0:1787508758.618795:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f35f70 lrc: 4/1,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.618803:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f35f70 lrc: 4/1,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.618809:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f35f70 lrc: 3/0,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.618816:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f35f70 lrc: 4/0,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.618825:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247aa00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508758.618829:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f35f70 lrc: 4/0,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.618836:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f35f70 lrc: 5/0,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.618849:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x173:0x0].0x0 (ffff9090d36fde00) 00010000:00010000:1.0:1787508758.618851:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508758.618856:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f35f70 lrc: 3/0,0 mode: --/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.618863:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247aa00/0xb126349c40f35f70 lrc: 0/0,0 mode: --/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.618887:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35f77 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.618893:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35f77 lrc: 2/0,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.618900:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35f77 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.618905:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508758.618908:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35f77 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.618913:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35f77 lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.618926:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x173:0x0].0x27c99889 (ffff9090cc088b00) 00010000:00010000:1.0:1787508758.618929:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508758.618931:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35f77 lrc: 2/0,0 mode: --/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.618937:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35f77 lrc: 0/0,0 mode: --/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.618999:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f35f69 lrc: 1/0,0 mode: --/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec0c expref: 18 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.619008:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x173:0x0].0x0 (ffff9090d36fde00) 00010000:00010000:1.0:1787508758.619010:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508758.619014:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f35f69 lrc: 0/0,0 mode: --/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec0c expref: 18 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.619022:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a400, rc 0) 00000100:00100000:1.0:1787508758.619080:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:344277:x1874324509661312:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 669us (898us total) trans 12884944241 rc 301/301 00000100:00100000:1.0:1787508758.619087:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94237 00000100:00100000:1.0:1787508758.621899:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508758.622086:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509661440 00000100:00100000:3.0:1787508758.622096:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509661440 00000100:00100000:3.0:1787508758.622156:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94238 00000100:00100000:3.0:1787508758.622167:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:344277:x1874324509661440:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:3.0:1787508758.622189:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508758.622209:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35f85 lrc: 2/0,0 mode: --/CR res: [0x2000013a0:0x174:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaec13 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.622261:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f35f8c lrc: 3/1,0 mode: --/PR res: [0x2000013a0:0x174:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.622274:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f35f8c lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x174:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.622289:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f35f8c lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x174:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508758.622331:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a0:0x174:0x0]: returning size 4096 00000004:00200000:3.0:1787508758.622336:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787508758.622370:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35f85 lrc: 0/0,0 mode: --/CR res: [0x2000013a0:0x174:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec13 expref: 19 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.622388:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f800/0xb126349c40f35f8c lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x174:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec13 expref: 18 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.622397:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x174:0x0].0x0 (ffff9090cc088100) 00010000:00010000:3.0:1787508758.622399:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508758.622403:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f800, rc 0) 00000100:00100000:3.0:1787508758.622487:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+18:344277:x1874324509661440:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 321us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508758.622495:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94238 00000100:00100000:0.0:1787508758.625905:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508758.627405:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509661568 00000100:00100000:2.0:1787508758.627421:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509661568 00000100:00100000:2.0:1787508758.627477:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94239 00000100:00100000:2.0:1787508758.627487:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:344277:x1874324509661568:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:2.0:1787508758.627507:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508758.627527:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f35f93 lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x16c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaec1a expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.627587:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa600/0xb126349c40f35f9a lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x16c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.627602:0:205405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f35f38 lrc: 2/0,0 mode: PW/PW res: [0x240000bd2:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f35f31 expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.627610:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa600/0xb126349c40f35f9a lrc: 4/1,0 mode: --/PR res: [0x240000bd2:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.627644:0:205405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f35f38 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f35f31 expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508758.627659:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c993ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:205405:1874324480223360:0@lo:104: 00000100:00100000:2.0:1787508758.627728:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508758.627810:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cdd73900 going to sleep for 11 seconds 00000100:00100000:3.0:1787508758.628340:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480223360 00000100:00100000:3.0:1787508758.628350:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480223360 00000100:00100000:3.0:1787508758.628423:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18205 00000100:00100000:3.0:1787508758.628432:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:205405:x1874324480223360:12345-0@lo:104: 00010000:00010000:3.0:1787508758.628444:0:202209:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8e200/0xb126349c40f35f31 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f35f38 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.628521:0:202209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787508758.628528:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:205405:x1874324480223360:12345-0@lo:104: Request processed in 98us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508758.628538:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18205 00000100:00100000:2.0:1787508758.628623:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c993ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:205405:1874324480223360:0@lo:104: 00010000:00010000:2.0:1787508758.628648:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa600/0xb126349c40f35f9a lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.628723:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508758.628731:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8e200/0xb126349c40f35f31 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f35f38 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.628739:0:204785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e200 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:0.0:1787508758.628746:0:204785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8e200/0xb126349c40f35f31 lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x16c:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f35f38 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508758.628755:0:204785:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8e200/0xb126349c40f35f31 lrc: 4/0,0 mode: PW/PW res: [0x240000bd2:0x16c:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f35f38 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.628813:0:204785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8e200/0xb126349c40f35f31 lrc: 2/0,0 mode: --/PW res: [0x240000bd2:0x16c:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f35f38 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.628820:0:204785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787508758.628854:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8e200/0xb126349c40f35f31 lrc: 1/0,0 mode: --/PW res: [0x240000bd2:0x16c:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f35f38 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.628862:0:204785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9090e4c8e200/0xb126349c40f35f31 lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x16c:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f35f38 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.628890:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508758.628892:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508758.628893:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508758.629157:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480223488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787508758.629205:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508758.629316:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480223488 00000100:00100000:0.0:1787508758.629322:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480223488 00010000:00010000:0.0:1787508758.629348:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f35f38 lrc: 3/0,0 mode: PW/PW res: [0x240000bd2:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f35f31 expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508758.629386:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27964 00000100:00100000:0.0:1787508758.629393:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+7:3617:x1874324480223488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508758.629404:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1787508758.633050:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589962074 is committed 00000020:00080000:0.0:1787508758.633068:0:202955:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 4294998392 batchid updated 00000020:00080000:2.0:1787508758.633147:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998392 00000004:00080000:2.0:1787508758.633211:0:202975:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090cdd73900 with version 13629 00000020:00080000:2.0:1787508758.633230:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294998391 cancel update log [0x2000013a2:0x5:0x0].600: rc = 0 00000020:00080000:2.0:1787508758.633309:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294998391 cancel update log [0x240000bd1:0xf:0x0].56: rc = 0 00000004:00080000:2.0:1787508758.633332:0:202975:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090cdd73000 with version 13630 00000020:00080000:2.0:1787508758.633335:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294998392 cancel update log [0x2000013a2:0x5:0x0].601: rc = 0 00000020:00080000:2.0:1787508758.633356:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294998392 cancel update log [0x240000bd1:0xf:0x0].57: rc = 0 00000020:00080000:2.0:1787508758.633362:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998392 00010000:00010000:1.0:1787508758.633496:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5400/0xb126349c40f35f38 lrc: 0/0,0 mode: --/PW res: [0x240000bd2:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f35f31 expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.633516:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x16c:0x0].0x0 (ffff9090c96b8d00) 00010000:00010000:1.0:1787508758.633522:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa600/0xb126349c40f35f9a lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.633539:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa600/0xb126349c40f35f9a lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.633547:0:202212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa600/0xb126349c40f35f9a lrc: 4/1,0 mode: PR/PR res: [0x240000bd2:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.633574:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508758.633656:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480223488:12345-0@lo:103:ldlm_bl.0 Request processed in 4262us (4449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508758.633667:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27964 00010000:00010000:2.0:1787508758.633804:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa600/0xb126349c40f35f9a lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.633813:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa600/0xb126349c40f35f9a lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508758.633861:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd2:0x16c:0x0]: returning size 4096 00000004:00200000:2.0:1787508758.633876:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787508758.633925:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab200/0xb126349c40f35f93 lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec1a expref: 8 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.633982:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa600/0xb126349c40f35f9a lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec1a expref: 7 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.633991:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x16c:0x0].0x0 (ffff9090c96b8d00) 00010000:00010000:2.0:1787508758.633994:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508758.633998:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa600, rc 0) 00000004:00080000:0.0:1787508758.634053:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13629 rpc_version 13629 00000020:00100000:0.0:1787508758.634081:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787508758.634089:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d1cbd500 x1874324480223744/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787508758.634115:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbd500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480223744:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508758.634440:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480223488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787508758.635206:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:344277:x1874324509661568:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 7715us (9306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508758.635215:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94239 00000100:00100000:0.0:1787508758.635359:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508758.635394:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3455780 going to sleep for 11 seconds 00000100:00100000:3.0:1787508758.635555:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480223744 00000100:00100000:3.0:1787508758.635562:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480223744 00000100:00100000:3.0:1787508758.635639:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29930 00000100:00100000:3.0:1787508758.635649:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:202961:x1874324480223744:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508758.635825:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:202961:x1874324480223744:12345-0@lo:1000:osp_up0-1.0 Request processed in 177us (465us total) trans 12884944242 rc 0/0 00000100:00100000:3.0:1787508758.635832:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29930 00000100:00100000:0.0:1787508758.636183:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbd500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480223744:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1787508758.636196:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13630 rpc_version 13630 00000020:00100000:0.0:1787508758.636215:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787508758.636221:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d1cbf480 x1874324480224000/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787508758.636240:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbf480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480224000:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787508758.636272:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508758.636298:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d3455780 going to sleep for 11 seconds 00000100:00100000:2.0:1787508758.636342:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480224000 00000100:00100000:2.0:1787508758.636347:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480224000 00000100:00100000:2.0:1787508758.636385:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29931 00000100:00100000:2.0:1787508758.636392:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:202961:x1874324480224000:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508758.636490:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202961:x1874324480224000:12345-0@lo:1000:osp_up0-1.0 Request processed in 97us (216us total) trans 12884944243 rc 0/0 00000100:00100000:2.0:1787508758.636498:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29931 00000100:00100000:2.0:1787508758.636529:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbf480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480224000:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508758.641338:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508758.641402:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508758.641431:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508758.641464:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508758.641485:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508758.641549:0:208927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509661824 00000100:00100000:0.0:1787508758.641559:0:208927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509661824 00000100:00100000:0.0:1787508758.641625:0:208927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509662080 00000100:00100000:0.0:1787508758.641628:0:208927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509662080 00000100:00100000:0.0:1787508758.641642:0:208927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509661952 00000100:00100000:0.0:1787508758.641644:0:208927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509661952 00000100:00100000:0.0:1787508758.641656:0:208927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509662208 00000100:00100000:0.0:1787508758.641658:0:208927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509662208 00000100:00100000:0.0:1787508758.641675:0:208927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2478 00000100:00100000:0.0:1787508758.641684:0:208927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2400:x1874324509661824:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508758.641758:0:208927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2400:x1874324509661824:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 75us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508758.641766:0:208927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2478 00000100:00100000:0.0:1787508758.641790:0:208927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2479 00000100:00100000:0.0:1787508758.641796:0:208927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509662080:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508758.641817:0:208927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509662080:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508758.641822:0:208927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2479 00000100:00100000:0.0:1787508758.641831:0:208927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2480 00000100:00100000:0.0:1787508758.641836:0:208927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2400:x1874324509661952:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508758.641852:0:208927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2400:x1874324509661952:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 17us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508758.641858:0:208927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2480 00000100:00100000:0.0:1787508758.641877:0:208927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2481 00000100:00100000:0.0:1787508758.641884:0:208927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2400:x1874324509662208:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508758.641903:0:208927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2400:x1874324509662208:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 20us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508758.641908:0:208927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2481 00000100:00100000:2.0:1787508758.642446:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509661696 00000100:00100000:2.0:1787508758.642453:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509661696 00000100:00100000:2.0:1787508758.642498:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1034 00000100:00100000:2.0:1787508758.642505:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed59bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2400:x1874324509661696:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508758.642538:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed59bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2400:x1874324509661696:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 33us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508758.642544:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1034 00000100:00080000:1.0:1787508758.642649:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787508758.642653:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508758.666333:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508758.666420:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509662336 00000100:00100000:3.0:1787508758.666430:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509662336 00000100:00100000:3.0:1787508758.666491:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94240 00000100:00100000:3.0:1787508758.666501:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+18:344277:x1874324509662336:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:3.0:1787508758.666521:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508758.666542:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f35fa1 lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x1271:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaec21 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.666642:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35fa8 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1271:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.666657:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35fa8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1271:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.666669:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35fa8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1271:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508758.666761:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1271:0x0]: returning size 4096 00000004:00200000:3.0:1787508758.666767:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1787508758.666804:0:209004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35fa8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1271:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.666830:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f200/0xb126349c40f35fa1 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1271:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec21 expref: 20 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.666848:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f000/0xb126349c40f35fa8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1271:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec21 expref: 19 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.666858:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1271:0x0].0x0 (ffff9090cc088800) 00010000:00010000:3.0:1787508758.666861:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508758.666864:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f000, rc 0) 00000100:00100000:2.0:1787508758.667279:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+19:344277:x1874324509662336:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 776us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508758.667288:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94240 00000100:00100000:3.0:1787508758.694680:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508758.695067:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509662464 00000100:00100000:1.0:1787508758.695079:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509662464 00000100:00100000:1.0:1787508758.695144:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94241 00000100:00100000:1.0:1787508758.695155:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:344277:x1874324509662464:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:1.0:1787508758.695180:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508758.695202:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f35faf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaec28 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.695276:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35fb6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.695291:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.695302:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508758.695352:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508758.695355:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508758.695375:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.695400:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f35faf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec28 expref: 9 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.695418:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec28 expref: 8 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.695427:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508758.695430:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508758.695434:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a000, rc 0) 00000100:00100000:1.0:1787508758.695505:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:344277:x1874324509662464:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 351us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508758.695513:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94241 00000100:00100000:0.0:1787508758.730489:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508758.730555:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509662592 00000100:00100000:2.0:1787508758.730565:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509662592 00000100:00100000:2.0:1787508758.730675:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94242 00000100:00100000:2.0:1787508758.730688:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+19:344277:x1874324509662592:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:2.0:1787508758.730773:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508758.730903:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35fbd lrc: 2/0,0 mode: --/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaec2f expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.731020:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35fc4 lrc: 3/1,0 mode: --/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.731035:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35fc4 lrc: 3/1,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.731047:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35fc4 lrc: 3/1,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.731059:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35fcb lrc: 3/1,0 mode: --/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.731067:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35fcb lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.731074:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35fcb lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.731345:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f35fd2 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1271:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.731356:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f35fd2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1271:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.731364:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f35fd2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1271:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508758.731449:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1271:0x0]: returning size 4096 00000004:00200000:2.0:1787508758.731455:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1787508758.731478:0:203348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f35fd2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1271:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.731490:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35fc4 lrc: 4/1,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.731497:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35fc4 lrc: 4/1,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.731504:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35fc4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.731511:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35fc4 lrc: 4/0,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.731517:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508758.731522:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35fc4 lrc: 4/0,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.731531:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35fc4 lrc: 5/0,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.731544:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x173:0x0].0x0 (ffff9090d36fde00) 00010000:00010000:2.0:1787508758.731547:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508758.731552:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35fc4 lrc: 3/0,0 mode: --/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.731558:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f35fc4 lrc: 0/0,0 mode: --/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.731573:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35fcb lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.731582:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35fcb lrc: 2/0,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.731587:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35fcb lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.731592:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508758.731595:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35fcb lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.731601:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35fcb lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.731609:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x173:0x0].0x27c99889 (ffff9090cc088b00) 00010000:00010000:2.0:1787508758.731611:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508758.731614:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35fcb lrc: 2/0,0 mode: --/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.731619:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35fcb lrc: 0/0,0 mode: --/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.731647:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35fbd lrc: 0/0,0 mode: --/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec2f expref: 21 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.731661:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f35fd2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1271:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec2f expref: 20 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.731668:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1271:0x0].0x0 (ffff9090cc088800) 00010000:00010000:2.0:1787508758.731671:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508758.731674:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aac00, rc 0) 00000100:00100000:2.0:1787508758.732057:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:344277:x1874324509662592:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 1369us (1573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508758.732066:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94242 00000100:00100000:3.0:1787508758.742462:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508758.742582:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509662720 00000100:00100000:1.0:1787508758.742594:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509662720 00000100:00100000:1.0:1787508758.742671:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9833 00000100:00100000:1.0:1787508758.742683:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:2400:x1874324509662720:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508758.742717:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508758.742747:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f35fd2 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1271:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec2f expref: 20 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.742770:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1271:0x0].0x0 (ffff9090cc088800) 00010000:00010000:1.0:1787508758.742775:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508758.742854:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+19:2400:x1874324509662720:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 173us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508758.742863:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9833 00000100:00100000:2.0:1787508758.767390:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508758.767517:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509662848 00000100:00100000:0.0:1787508758.767529:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509662848 00000100:00100000:0.0:1787508758.767644:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15488 00000100:00100000:0.0:1787508758.767655:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fdb9fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:344277:x1874324509662848:12345-192.168.201.30@tcp:33:check_fhandle_s.0 00000004:00200000:0.0:1787508758.767841:0:202229:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1271:0x0]: returning size 4096 00000004:00200000:0.0:1787508758.767847:0:202229:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:0.0:1787508758.767929:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fdb9fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:344277:x1874324509662848:12345-192.168.201.30@tcp:33:check_fhandle_s.0 Request processed in 276us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508758.767981:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15488 00000100:00100000:3.0:1787508758.770214:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508758.770366:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509662976 00000100:00100000:2.0:1787508758.770374:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509662976 00000100:00100000:2.0:1787508758.770438:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94243 00000100:00100000:2.0:1787508758.770449:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9aced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:344277:x1874324509662976:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:2.0:1787508758.770468:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508758.770490:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35fd9 lrc: 2/0,0 mode: --/CR res: [0x2000013a0:0x174:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaec36 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.770547:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35fe0 lrc: 3/1,0 mode: --/PR res: [0x2000013a0:0x174:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.770561:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35fe0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x174:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.770572:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35fe0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x174:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508758.770611:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a0:0x174:0x0]: returning size 4096 00000004:00200000:2.0:1787508758.770615:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787508758.770652:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35fd9 lrc: 0/0,0 mode: --/CR res: [0x2000013a0:0x174:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec36 expref: 10 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.770673:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa000/0xb126349c40f35fe0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x174:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec36 expref: 9 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.770686:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x174:0x0].0x0 (ffff9090cc088100) 00010000:00010000:2.0:1787508758.770689:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508758.770692:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa000, rc 0) 00000100:00100000:2.0:1787508758.770760:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9aced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:344277:x1874324509662976:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 313us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508758.770767:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94243 00000100:00100000:3.0:1787508758.776040:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508758.776207:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509663104 00000100:00100000:1.0:1787508758.776218:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509663104 00000100:00100000:1.0:1787508758.776285:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94244 00000100:00100000:1.0:1787508758.776296:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:344277:x1874324509663104:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:1.0:1787508758.776318:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508758.776339:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f35fe7 lrc: 2/0,0 mode: --/CR res: [0x240000bd2:0x16c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaec3d expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.776406:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247aa00/0xb126349c40f35fee lrc: 3/1,0 mode: --/PR res: [0x240000bd2:0x16c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.776419:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247aa00/0xb126349c40f35fee lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.776430:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247aa00/0xb126349c40f35fee lrc: 3/1,0 mode: PR/PR res: [0x240000bd2:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508758.776488:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd2:0x16c:0x0]: returning size 4096 00000004:00200000:1.0:1787508758.776493:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787508758.776535:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f35fe7 lrc: 0/0,0 mode: --/CR res: [0x240000bd2:0x16c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec3d expref: 7 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.776552:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247aa00/0xb126349c40f35fee lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x16c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec3d expref: 6 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508758.776562:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x16c:0x0].0x0 (ffff9090c96b8d00) 00010000:00010000:1.0:1787508758.776565:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508758.776568:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247aa00, rc 0) 00000100:00100000:1.0:1787508758.776624:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ace680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:344277:x1874324509663104:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 329us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508758.776630:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94244 00000100:00100000:2.0:1787508758.781153:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508758.781407:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509663232 00000100:00100000:3.0:1787508758.781417:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509663232 00000100:00100000:3.0:1787508758.781473:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94245 00000100:00100000:3.0:1787508758.781484:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:344277:x1874324509663232:12345-192.168.201.30@tcp:34:check_fhandle_s.0 00000100:00100000:3.0:1787508758.781766:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:344277:x1874324509663232:12345-192.168.201.30@tcp:34:check_fhandle_s.0 Request processed in 282us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508758.781775:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94245 00000100:00100000:0.0:1787508758.784195:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508758.784361:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509663360 00000100:00100000:2.0:1787508758.784371:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509663360 00000100:00100000:2.0:1787508758.784437:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94246 00000100:00100000:2.0:1787508758.784449:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:344277:x1874324509663360:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:2.0:1787508758.784471:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508758.784495:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35ff5 lrc: 2/0,0 mode: --/PR res: [0x2000013a0:0x173:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaec44 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.784532:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35ff5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec44 expref: 10 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.784546:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aaa00/0xb126349c40f35ff5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec44 expref: 10 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.784555:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x173:0x0].0x0 (ffff9090d36fde00) 00010000:00010000:2.0:1787508758.784558:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508758.784562:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aaa00, rc 0) 00000100:00100000:2.0:1787508758.784625:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:344277:x1874324509663360:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 178us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508758.784634:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94246 00000100:00100000:1.0:1787508758.788329:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508758.788443:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509663488 00000100:00100000:2.0:1787508758.788453:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509663488 00000100:00100000:2.0:1787508758.788515:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15489 00000100:00100000:2.0:1787508758.788526:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:344277:x1874324509663488:12345-192.168.201.30@tcp:37:check_fhandle_s.0 00000100:00100000:2.0:1787508758.794342:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:344277:x1874324509663488:12345-192.168.201.30@tcp:37:check_fhandle_s.0 Request processed in 5804us (6011us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508758.794358:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15489 00000100:00100000:0.0:1787508758.797805:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508758.797989:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509663616 00000100:00100000:3.0:1787508758.797999:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509663616 00000100:00100000:3.0:1787508758.798107:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94247 00000100:00100000:3.0:1787508758.798120:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:344277:x1874324509663616:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:3.0:1787508758.798142:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508758.798167:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f35ffc lrc: 2/0,0 mode: --/PR res: [0x240000bd2:0x16b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaec4b expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.798204:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f35ffc lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x16b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec4b expref: 7 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.798216:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8f200/0xb126349c40f35ffc lrc: 3/0,0 mode: PR/PR res: [0x240000bd2:0x16b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec4b expref: 7 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.798224:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd2:0x16b:0x0].0x0 (ffff9090cc088200) 00010000:00010000:3.0:1787508758.798227:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508758.798231:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f200, rc 0) 00000100:00100000:3.0:1787508758.798297:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:344277:x1874324509663616:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 179us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508758.798304:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94247 00000100:00100000:1.0:1787508758.801610:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508758.802032:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509663744 00000100:00100000:2.0:1787508758.802043:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509663744 00000100:00100000:2.0:1787508758.802229:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15490 00000100:00100000:2.0:1787508758.802242:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:344277:x1874324509663744:12345-192.168.201.30@tcp:37:check_fhandle_s.0 00000100:00100000:1.0:1787508758.808043:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:344277:x1874324509663744:12345-192.168.201.30@tcp:37:check_fhandle_s.0 Request processed in 5791us (6432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508758.808059:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15490 00000100:00100000:0.0:1787508758.811654:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508758.811813:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509663872 00000100:00100000:3.0:1787508758.811824:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509663872 00000100:00100000:3.0:1787508758.819180:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94248 00000100:00100000:3.0:1787508758.819206:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:344277:x1874324509663872:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:3.0:1787508758.819228:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508758.819251:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f36003 lrc: 2/0,0 mode: --/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaec52 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.819320:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3600a lrc: 3/1,0 mode: --/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.819337:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3600a lrc: 3/1,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.819353:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3600a lrc: 3/1,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.819365:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f36011 lrc: 3/1,0 mode: --/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.819371:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f36011 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.819378:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f36011 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.819456:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f36018 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1271:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.819464:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f36018 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1271:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.819471:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f36018 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1271:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508758.819561:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1271:0x0]: returning size 4096 00000004:00200000:3.0:1787508758.819566:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1787508758.819591:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f36018 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1271:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.819601:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3600a lrc: 4/1,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.819607:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3600a lrc: 4/1,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.819617:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3600a lrc: 3/0,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.819623:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3600a lrc: 4/0,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.819629:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508758.819633:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3600a lrc: 4/0,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.819640:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3600a lrc: 5/0,0 mode: CR/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.819652:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x173:0x0].0x0 (ffff9090d36fde00) 00010000:00010000:3.0:1787508758.819655:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508758.819660:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3600a lrc: 3/0,0 mode: --/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.819666:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3600a lrc: 0/0,0 mode: --/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.819679:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f36011 lrc: 3/1,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.819684:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f36011 lrc: 2/0,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.819689:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f36011 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.819694:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ea00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508758.819697:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f36011 lrc: 3/0,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.819719:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f36011 lrc: 4/0,0 mode: PR/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.819730:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x173:0x0].0x27c99889 (ffff9090cc088b00) 00010000:00010000:3.0:1787508758.819732:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508758.819735:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f36011 lrc: 2/0,0 mode: --/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.819740:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f36011 lrc: 0/0,0 mode: --/PR res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.819765:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f36003 lrc: 0/0,0 mode: --/CR res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec52 expref: 12 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.819777:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f600/0xb126349c40f36018 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1271:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec52 expref: 11 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508758.819783:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1271:0x0].0x0 (ffff9090cc088800) 00010000:00010000:3.0:1787508758.819785:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508758.819787:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f600, rc 0) 00000100:00100000:3.0:1787508758.819875:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:344277:x1874324509663872:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 673us (8224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508758.819883:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94248 00000100:00100000:2.0:1787508758.832409:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508758.832602:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509664000 00000100:00100000:0.0:1787508758.832612:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509664000 00000100:00100000:0.0:1787508758.832666:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94249 00000100:00100000:0.0:1787508758.832677:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:344277:x1874324509664000:12345-192.168.201.30@tcp:34:check_fhandle_s.0 00000100:00100000:0.0:1787508758.832919:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:344277:x1874324509664000:12345-192.168.201.30@tcp:34:check_fhandle_s.0 Request processed in 243us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508758.832928:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94249 00000100:00100000:2.0:1787508758.838914:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508758.839093:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509664128 00000100:00100000:1.0:1787508758.839105:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509664128 00000100:00100000:1.0:1787508758.839166:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15491 00000100:00100000:1.0:1787508758.839177:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:344277:x1874324509664128:12345-192.168.201.30@tcp:37:check_fhandle_s.0 00000100:00100000:2.0:1787508758.848510:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:344277:x1874324509664128:12345-192.168.201.30@tcp:37:check_fhandle_s.0 Request processed in 9321us (9594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508758.848525:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15491 00000100:00100000:1.0:1787508758.857549:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508758.859259:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509664256 00000100:00100000:0.0:1787508758.859274:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509664256 00000100:00100000:0.0:1787508758.859356:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94250 00000100:00100000:0.0:1787508758.859368:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:344277:x1874324509664256:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:0.0:1787508758.859391:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508758.859414:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f3601f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaec59 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.859489:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f36026 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.859507:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f36026 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.859518:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f36026 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.859529:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4800/0xb126349c40f3602d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.859541:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4800/0xb126349c40f3602d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.859548:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4800/0xb126349c40f3602d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.859637:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f36034 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.859647:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f36034 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.859653:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f36034 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508758.859724:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1270:0x0]: returning size 4096 00000004:00200000:0.0:1787508758.859729:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:0.0:1787508758.859750:0:205405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f36034 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.859763:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f36026 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.859770:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f36026 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.859777:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f36026 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.859783:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f36026 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.859792:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508758.859796:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f36026 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.859804:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f36026 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.859816:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508758.859819:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508758.859823:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f36026 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.859828:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f36026 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.859841:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4800/0xb126349c40f3602d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.859848:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4800/0xb126349c40f3602d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.859854:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4800/0xb126349c40f3602d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.859860:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508758.859874:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4800/0xb126349c40f3602d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.859881:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4800/0xb126349c40f3602d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.859892:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xee1c4022 (ffff9090cc088400) 00010000:00010000:0.0:1787508758.859895:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508758.859898:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4800/0xb126349c40f3602d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.859904:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4800/0xb126349c40f3602d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.859930:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f3601f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec59 expref: 13 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.860017:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4a00/0xb126349c40f36034 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1270:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec59 expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508758.860026:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1270:0x0].0x0 (ffff9090d36fd000) 00010000:00010000:0.0:1787508758.860028:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508758.860031:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4a00, rc 0) 00000100:00100000:0.0:1787508758.860116:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:344277:x1874324509664256:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 749us (2580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508758.860124:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94250 00000100:00100000:3.0:1787508758.863847:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508758.863999:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509664512 00000100:00100000:2.0:1787508758.864009:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509664512 00000100:00100000:2.0:1787508758.864068:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94251 00000100:00100000:2.0:1787508758.864079:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:344277:x1874324509664512:12345-192.168.201.30@tcp:101:check_fhandle_s.0 00010000:00010000:2.0:1787508758.864110:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508758.864132:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f3603b lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x1271:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaec60 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508758.864279:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1271:0x0]: returning size 4096 00010000:00010000:2.0:1787508758.864375:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f3603b lrc: 1/0,0 mode: --/CR res: [0x2000013a4:0x1271:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec60 expref: 14 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.864390:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1271:0x0].0x0 (ffff9090cc088800) 00010000:00010000:2.0:1787508758.864393:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787508758.864398:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f3603b lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1271:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec60 expref: 14 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508758.864412:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa200, rc 0) 00000100:00100000:2.0:1787508758.864464:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:344277:x1874324509664512:12345-192.168.201.30@tcp:101:check_fhandle_s.0 Request processed in 386us (626us total) trans 12884944244 rc 301/301 00000100:00100000:2.0:1787508758.864471:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94251 00000100:00100000:3.0:1787508758.941433:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508758.941556:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509664768 00000100:00100000:0.0:1787508758.941570:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509664768 00000100:00100000:0.0:1787508758.941647:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15492 00000100:00100000:0.0:1787508758.941659:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:344277:x1874324509664768:12345-192.168.201.30@tcp:35:check_fhandle_s.0 00000100:00100000:0.0:1787508758.941922:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:344277:x1874324509664768:12345-192.168.201.30@tcp:35:check_fhandle_s.0 Request processed in 264us (499us total) trans 12884944245 rc 0/0 00000100:00100000:0.0:1787508758.941933:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15492 00000100:00100000:1.0:1787508758.953721:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508758.953817:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509665024 00000100:00100000:3.0:1787508758.953828:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509665024 00000100:00100000:3.0:1787508758.953902:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15493 00000100:00100000:3.0:1787508758.953913:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fdb9f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+19:344277:x1874324509665024:12345-192.168.201.30@tcp:35:check_fhandle_s.0 00000100:00100000:3.0:1787508758.954486:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fdb9f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:344277:x1874324509665024:12345-192.168.201.30@tcp:35:check_fhandle_s.0 Request processed in 572us (774us total) trans 12884944246 rc 0/0 00000100:00100000:3.0:1787508758.954495:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15493 00010000:00010000:2.0:1787508759.098194:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508759.226247:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787508759.226345:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787508759.226368:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480224256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787508759.226443:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508759.226494:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480224128:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787508759.226526:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508759.226583:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480224256 00000100:00100000:2.0:1787508759.226591:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480224256 00000100:00100000:2.0:1787508759.226658:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480224128 00000100:00080000:1.0:1787508759.226661:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787508759.226662:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480224128 00000100:00100000:2.0:1787508759.226688:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1737 00000100:00080000:1.0:1787508759.226691:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787508759.226707:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480224256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787508759.226735:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 131576384 pending 0 free 3881955328 avail 3650433024 00000100:00100000:2.0:1787508759.226769:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480224256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508759.226774:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1737 00000100:00100000:2.0:1787508759.226788:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1738 00000100:00100000:2.0:1787508759.226795:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480224128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787508759.226804:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 131576384 pending 0 free 3881955328 avail 3650433024 00000100:00100000:2.0:1787508759.226840:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480224128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508759.226845:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1738 00000100:00100000:3.0:1787508759.226997:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480224256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508759.227079:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480224128:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787508760.122087:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508760.250560:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480224512:0@lo:400:kworker.0 00000100:00100000:1.0:1787508760.250639:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508760.250686:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480225024:0@lo:400:kworker.0 00000100:00100000:1.0:1787508760.250711:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508760.250738:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874324480225536:0@lo:400:kworker.0 00000100:00100000:1.0:1787508760.250762:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508760.250784:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1787508760.250790:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79de3f65-4bad-42d0-a46f-842a654b33a0:3617:1874324480224384:0@lo:400:kworker.0 00000100:00100000:1.0:1787508760.250831:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508760.250860:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874324480224896:0@lo:400:kworker.0 00000100:00100000:0.0:1787508760.250872:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480224512 00000100:00100000:0.0:1787508760.250882:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480224512 00000100:00100000:1.0:1787508760.250889:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508760.250909:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480225408:0@lo:400:kworker.0 00000100:00100000:1.0:1787508760.250969:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508760.250976:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480225024 00000100:00100000:0.0:1787508760.250981:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480225024 00000100:00100000:1.0:1787508760.250994:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480225920:0@lo:400:kworker.0 00000100:00100000:0.0:1787508760.251008:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29932 00000100:00100000:0.0:1787508760.251019:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480224512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508760.251024:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508760.251071:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480224768:0@lo:400:kworker.0 00000100:00100000:0.0:1787508760.251094:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480224512:12345-0@lo:400:kworker.0 Request processed in 77us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508760.251107:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29932 00000100:00100000:1.0:1787508760.251109:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508760.251130:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29933 00000100:00100000:1.0:1787508760.251132:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480225280:0@lo:400:kworker.0 00000100:00100000:0.0:1787508760.251140:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3617:x1874324480225024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508760.251599:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480224640:0@lo:400:kworker.0 00000100:00100000:0.0:1787508760.251871:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3617:x1874324480225024:12345-0@lo:400:kworker.0 Request processed in 731us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508760.251879:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29933 00000100:00100000:1.0:1787508760.254995:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508760.255120:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874324480225792:0@lo:400:kworker.0 00000100:00100000:1.0:1787508760.255247:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508760.255652:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480225536 00000100:00100000:1.0:1787508760.255661:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480225536 00000100:00100000:1.0:1787508760.255719:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480224896 00000100:00100000:1.0:1787508760.255723:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480224896 00000100:00100000:2.0:1787508760.255738:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480224768 00000100:00100000:2.0:1787508760.255745:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480224768 00000100:00100000:1.0:1787508760.255755:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480225408 00000100:00100000:1.0:1787508760.255760:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480225408 00000100:00100000:1.0:1787508760.255779:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480225920 00000100:00100000:1.0:1787508760.255783:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480225920 00000100:00100000:2.0:1787508760.255785:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480225280 00000100:00100000:2.0:1787508760.255790:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480225280 00000100:00100000:1.0:1787508760.255799:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480225792 00000100:00100000:1.0:1787508760.255804:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480225792 00000100:00100000:2.0:1787508760.255820:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2482 00000100:00100000:2.0:1787508760.255831:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480224768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508760.255897:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480224768:12345-0@lo:400:kworker.0 Request processed in 67us (4791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508760.255903:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2482 00000100:00100000:2.0:1787508760.255920:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2483 00000100:00100000:2.0:1787508760.255937:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480225280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508760.255984:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480225280:12345-0@lo:400:kworker.0 Request processed in 58us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508760.255990:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2483 00000100:00100000:2.0:1787508760.256012:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3126 00000100:00100000:3.0:1787508760.256139:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3127 00000100:00100000:1.0:1787508760.256204:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3128 00000100:00100000:0.0:1787508760.259670:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3129 00000100:00100000:0.0:1787508760.259700:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480225920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508760.259823:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480225920:12345-0@lo:400:kworker.0 Request processed in 139us (8801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508760.259830:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3129 00000100:00100000:0.0:1787508760.260012:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3130 00000100:00100000:3.0:1787508760.260390:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874324480224896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508760.260411:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874324480225536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508760.260442:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874324480224896:12345-0@lo:400:kworker.0 Request processed in 4295us (9552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508760.260450:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3127 00000100:00100000:2.0:1787508760.260468:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874324480225536:12345-0@lo:400:kworker.0 Request processed in 4448us (9703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508760.260477:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3126 00000100:00100000:3.0:1787508760.260516:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508760.260567:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480224640 00000100:00100000:3.0:1787508760.260574:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480224640 00000100:00100000:3.0:1787508760.260616:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2484 00000100:00100000:3.0:1787508760.260623:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3618:x1874324480224640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508760.260659:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3618:x1874324480224640:12345-0@lo:400:kworker.0 Request processed in 37us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508760.260666:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2484 00000100:00100000:3.0:1787508760.260703:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480224640:0@lo:400:kworker.0 00000100:00100000:3.0:1787508760.260714:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480225152:0@lo:400:kworker.0 00000100:00100000:2.0:1787508760.260730:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480224768:0@lo:400:kworker.0 00000100:00100000:2.0:1787508760.260752:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480225280:0@lo:400:kworker.0 00000100:00100000:3.0:1787508760.260757:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508760.260792:0:225834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480225152 00000100:00100000:3.0:1787508760.260796:0:225834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480225152 00000100:00100000:3.0:1787508760.260835:0:225834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2485 00000100:00100000:3.0:1787508760.260842:0:225834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480225152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508760.260873:0:225834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480225152:12345-0@lo:400:kworker.0 Request processed in 32us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508760.260879:0:225834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2485 00000100:00100000:3.0:1787508760.260905:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480225152:0@lo:400:kworker.0 00000100:00100000:3.0:1787508760.260913:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874324480225664:0@lo:400:kworker.0 00000100:00100000:3.0:1787508760.261168:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508760.261214:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480225664 00000100:00100000:2.0:1787508760.261219:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480225664 00000100:00100000:2.0:1787508760.261261:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3131 00000100:00100000:2.0:1787508760.261267:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874324480225664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508760.261305:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874324480225664:12345-0@lo:400:kworker.0 Request processed in 38us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508760.261312:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3131 00000100:00100000:3.0:1787508760.261350:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874324480225664:0@lo:400:kworker.0 00000100:00100000:1.0:1787508760.261853:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480225408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508760.261857:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874324480225792:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787508760.261876:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787508760.261882:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787508760.261884:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787508760.261911:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874324480224896:0@lo:400:kworker.0 00000100:00100000:1.0:1787508760.261922:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480225920:0@lo:400:kworker.0 00000100:00100000:1.0:1787508760.261994:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480225024:0@lo:400:kworker.0 00000100:00100000:1.0:1787508760.262009:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874324480225536:0@lo:400:kworker.0 00000100:00100000:1.0:1787508760.262020:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589962074 gen 2 00000004:00080000:1.0:1787508760.262025:0:3617:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589962074 committed transno 8589962074 00000100:00100000:0.0:1787508760.262097:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874324480225792:12345-0@lo:400:kworker.0 Request processed in 2076us (6848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508760.262106:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3130 00000100:00100000:1.0:1787508760.262109:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480224512:0@lo:400:kworker.0 00000100:00100000:0.0:1787508760.262149:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480224384 00000100:00100000:0.0:1787508760.262154:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480224384 00000100:00100000:0.0:1787508760.262193:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:0.0:1787508760.262200:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed59b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3617:x1874324480224384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508760.262243:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed59b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3617:x1874324480224384:12345-0@lo:400:kworker.0 Request processed in 43us (11411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508760.262250:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:0.0:1787508760.262289:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79de3f65-4bad-42d0-a46f-842a654b33a0:3617:1874324480224384:0@lo:400:kworker.0 00000100:00100000:0.0:1787508760.263095:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480225408:12345-0@lo:400:kworker.0 Request processed in 6881us (12123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508760.263104:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3128 00000100:00100000:3.0:1787508760.263127:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480225408:0@lo:400:kworker.0 00000100:00100000:2.0:1787508760.263188:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874324480225792:0@lo:400:kworker.0 00000100:00100000:2.0:1787508760.762395:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787508760.762414:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480226048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787508760.762474:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508760.762620:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480226048 00000100:00100000:1.0:1787508760.762628:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480226048 00000100:00100000:1.0:1787508760.762689:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1739 00000100:00100000:1.0:1787508760.762698:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1874324480226048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787508760.762729:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49631808 pending 28672 free 3909767168 avail 3678244864 00000100:00100000:1.0:1787508760.762784:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1874324480226048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508760.762789:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1739 00000100:00100000:3.0:1787508760.762875:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480226048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787508760.763909:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787508760.763929:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480226176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787508760.763976:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508760.764061:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480226176 00000100:00100000:0.0:1787508760.764066:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480226176 00000100:00100000:0.0:1787508760.764100:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1740 00000100:00100000:0.0:1787508760.764105:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480226176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787508760.764117:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49631808 pending 28672 free 3909767168 avail 3678244864 00000100:00100000:0.0:1787508760.764154:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480226176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508760.764159:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1740 00000100:00100000:2.0:1787508760.764256:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480226176:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787508761.151655:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508761.788163:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787508761.788190:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480226304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787508761.788262:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508761.788365:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480226304 00000100:00100000:1.0:1787508761.788375:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480226304 00000100:00100000:1.0:1787508761.788431:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29934 00000100:00100000:1.0:1787508761.788441:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480226304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787508761.788477:0:202232:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442734080 avail 1296494592 00000100:00100000:1.0:1787508761.788524:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480226304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508761.788544:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29934 00000100:00100000:3.0:1787508761.788645:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787508761.788657:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480226432:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787508761.788689:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508761.788719:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480226432 00000100:00100000:3.0:1787508761.788724:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480226432 00000100:00100000:3.0:1787508761.788750:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29935 00000100:00100000:3.0:1787508761.788756:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3617:x1874324480226432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787508761.788775:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440657408 avail 1294417920 00000100:00100000:3.0:1787508761.788809:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3617:x1874324480226432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508761.788815:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29935 00000100:00100000:3.0:1787508761.788856:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480226432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787508761.789174:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480226304:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787508762.171795:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787508762.812368:0:203722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589941255 is committed 00000001:00080000:0.0:1787508762.812386:0:203722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589941254 is committed 00010000:00010000:2.0:1787508763.194143:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508763.753797:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508763.753835:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508763.753862:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508763.753896:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508763.753914:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508763.753932:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508763.753979:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508763.754011:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509665408 00000100:00100000:0.0:1787508763.754020:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509665408 00000100:00100000:0.0:1787508763.754074:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509665920 00000100:00100000:0.0:1787508763.754078:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509665920 00000100:00100000:0.0:1787508763.754098:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509665280 00000100:00100000:0.0:1787508763.754101:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509665280 00000100:00100000:0.0:1787508763.754124:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3132 00000100:00100000:0.0:1787508763.754133:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2401:x1874324509665408:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508763.754224:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2401:x1874324509665408:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 91us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508763.754232:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3132 00000100:00100000:0.0:1787508763.754249:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3133 00000100:00100000:0.0:1787508763.754256:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2401:x1874324509665920:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508763.754280:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2401:x1874324509665920:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508763.754286:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3133 00000100:00100000:0.0:1787508763.754296:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3134 00000100:00100000:0.0:1787508763.754302:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:2401:x1874324509665280:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508763.754331:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:2401:x1874324509665280:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 29us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508763.754336:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3134 00000100:00100000:0.0:1787508763.754354:0:208928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509665664 00000100:00100000:0.0:1787508763.754357:0:208928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509665664 00000100:00100000:0.0:1787508763.754381:0:208928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509666176 00000100:00100000:0.0:1787508763.754383:0:208928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509666176 00000100:00100000:0.0:1787508763.754398:0:208928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509665536 00000100:00100000:0.0:1787508763.754401:0:208928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509665536 00000100:00100000:0.0:1787508763.754421:0:208928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2486 00000100:00100000:0.0:1787508763.754428:0:208928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2401:x1874324509665664:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508763.754454:0:208928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2401:x1874324509665664:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 27us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508763.754461:0:208928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2486 00000100:00100000:0.0:1787508763.754472:0:208928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2487 00000100:00100000:0.0:1787508763.754478:0:208928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2401:x1874324509666176:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508763.754502:0:208928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2401:x1874324509666176:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508763.754508:0:208928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2487 00000100:00100000:0.0:1787508763.754518:0:208928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2488 00000100:00100000:0.0:1787508763.754524:0:208928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2401:x1874324509665536:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508763.754548:0:208928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2401:x1874324509665536:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508763.754557:0:208928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2488 00000100:00100000:3.0:1787508763.755001:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509665152 00000100:00100000:3.0:1787508763.755007:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509665152 00000100:00100000:3.0:1787508763.755047:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1036 00000100:00100000:3.0:1787508763.755056:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed59a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2401:x1874324509665152:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508763.755092:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed59a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2401:x1874324509665152:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 38us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508763.755099:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1036 00000100:00080000:1.0:1787508763.756082:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787508763.756091:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787508763.756094:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787508763.756097:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787508763.778452:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508763.778504:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508763.778532:0:203996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509666048 00000100:00100000:3.0:1787508763.778541:0:203996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509666048 00000100:00100000:3.0:1787508763.778600:0:203996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2489 00000100:00100000:3.0:1787508763.778609:0:203996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2401:x1874324509666048:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508763.778679:0:203996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2401:x1874324509666048:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 71us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508763.778687:0:203996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2489 00000100:00080000:3.0:1787508763.778711:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787508763.778847:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509665792 00000100:00100000:2.0:1787508763.778852:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509665792 00000100:00100000:2.0:1787508763.778910:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3135 00000100:00100000:2.0:1787508763.778918:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2401:x1874324509665792:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508763.778989:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2401:x1874324509665792:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 72us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508763.778996:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3135 00000100:00080000:3.0:1787508763.779407:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1787508763.856215:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944246 is committed 00000001:00080000:2.0:1787508763.856233:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944245 is committed 00000001:00080000:2.0:1787508763.856240:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944243 is committed 00000020:00080000:2.0:1787508763.856253:0:202206:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9090d46c6900 refcount 2 committed 0 result 0 batchid 8589961994 00000020:00080000:2.0:1787508763.856259:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521e00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d46c6e40 00000020:00080000:2.0:1787508763.856263:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd2:0x1:0x0].1796 00000020:00080000:2.0:1787508763.856265:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090cc49bc00 00000020:00080000:2.0:1787508763.856268:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1:0x0].1790 00000020:00080000:2.0:1787508763.856292:0:202206:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9090d46c6cc0 refcount 2 committed 0 result 0 batchid 8589961993 00000020:00080000:2.0:1787508763.856296:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521400 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d46c6000 00000020:00080000:2.0:1787508763.856299:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd2:0x1:0x0].1795 00000020:00080000:2.0:1787508763.856302:0:202206:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cf521700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9091e6a54400 00000020:00080000:2.0:1787508763.856304:0:202206:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a0:0x1:0x0].1789 00000020:00080000:1.0:1787508763.858105:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589961994 committed batchid 8589961992 00000020:00080000:1.0:1787508763.858197:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961992 00010000:00010000:0.0:1787508763.859296:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35e04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859313:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35e04 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859321:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35e04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859326:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508763.859331:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35e04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859339:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35e04 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859356:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xee1c4022 (ffff9090cc088400) 00010000:00010000:0.0:1787508763.859359:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508763.859363:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35e04 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859369:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f35e04 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xee1c4022 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859389:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35e0b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1270:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859395:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35e0b lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x1270:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859406:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35e0b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1270:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859411:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508763.859414:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35e0b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1270:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859420:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35e0b lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x1270:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859428:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1270:0x0].0x0 (ffff9090d36fd000) 00010000:00010000:0.0:1787508763.859430:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508763.859433:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35e0b lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x1270:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859439:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f35e0b lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x1270:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859450:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35e12 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859456:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35e12 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859462:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35e12 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859466:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508763.859469:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35e12 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859478:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35e12 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859484:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x173:0x0].0x0 (ffff9090d36fde00) 00010000:00010000:0.0:1787508763.859486:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508763.859489:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35e12 lrc: 2/0,0 mode: --/TXN res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859494:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f35e12 lrc: 0/0,0 mode: --/TXN res: [0x2000013a0:0x173:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859509:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f35f1c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859516:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f35f1c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859521:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f35f1c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859526:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ee00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508763.859529:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f35f1c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859535:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f35f1c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859542:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x173:0x0].0x27c99889 (ffff9090cc088b00) 00010000:00010000:0.0:1787508763.859544:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508763.859547:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f35f1c lrc: 2/0,0 mode: --/TXN res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859552:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f35f1c lrc: 0/0,0 mode: --/TXN res: [0x2000013a0:0x173:0x0].0x27c99889 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859563:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35f23 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1271:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859568:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35f23 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x1271:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859573:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35f23 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1271:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859577:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508763.859580:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35f23 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1271:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859585:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35f23 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x1271:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859591:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1271:0x0].0x0 (ffff9090cc088800) 00010000:00010000:0.0:1787508763.859593:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508763.859596:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35f23 lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x1271:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859601:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f35f23 lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x1271:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859609:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35f2a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a0:0x174:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859615:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35f2a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a0:0x174:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859620:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35f2a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x174:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859624:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508763.859627:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35f2a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a0:0x174:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859633:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35f2a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a0:0x174:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859639:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a0:0x174:0x0].0x0 (ffff9090cc088100) 00010000:00010000:0.0:1787508763.859642:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508763.859645:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35f2a lrc: 2/0,0 mode: --/TXN res: [0x2000013a0:0x174:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508763.859651:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f35f2a lrc: 0/0,0 mode: --/TXN res: [0x2000013a0:0x174:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508764.219445:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508764.346398:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787508764.346423:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480226688:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787508764.346490:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508764.346554:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480226688 00000100:00100000:3.0:1787508764.346560:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480226688 00000100:00100000:3.0:1787508764.346605:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1741 00000100:00100000:3.0:1787508764.346611:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480226688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787508764.346635:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 131576384 pending 0 free 3881955328 avail 3650433024 00000100:00100000:3.0:1787508764.346674:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480226688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508764.346681:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1741 00000100:00080000:3.0:1787508764.346707:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508764.346741:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480226688:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787508764.346807:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480226560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787508764.346840:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508764.346932:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480226560 00000100:00100000:3.0:1787508764.346936:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480226560 00000100:00100000:3.0:1787508764.346982:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1742 00000100:00100000:3.0:1787508764.346986:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480226560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787508764.346994:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 131576384 pending 0 free 3881955328 avail 3650433024 00000100:00100000:3.0:1787508764.347018:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480226560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508764.347021:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1742 00000100:00100000:3.0:1787508764.347041:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480226560:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787508764.347087:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787508765.245924:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508765.370520:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480226944:0@lo:400:kworker.0 00000100:00100000:2.0:1787508765.370606:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508765.370667:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480227456:0@lo:400:kworker.0 00000100:00100000:2.0:1787508765.370690:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508765.370703:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874324480227968:0@lo:400:kworker.0 00000100:00100000:2.0:1787508765.370724:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508765.370753:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787508765.370759:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480227072:0@lo:400:kworker.0 00000100:00100000:2.0:1787508765.370784:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508765.370806:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480227584:0@lo:400:kworker.0 00000100:00100000:2.0:1787508765.370827:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508765.370866:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480228096:0@lo:400:kworker.0 00000100:00100000:2.0:1787508765.370889:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508765.370917:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480226944 00000100:00100000:2.0:1787508765.370923:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480226944 00000100:00100000:2.0:1787508765.371026:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480227456 00000100:00100000:2.0:1787508765.371030:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480227456 00000100:00100000:2.0:1787508765.371054:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29936 00000100:00100000:2.0:1787508765.371063:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480226944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508765.371116:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480226944:12345-0@lo:400:kworker.0 Request processed in 54us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508765.371122:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29936 00000100:00100000:2.0:1787508765.371138:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29937 00000100:00100000:2.0:1787508765.371144:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480227456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508765.371168:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480227456:12345-0@lo:400:kworker.0 Request processed in 25us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508765.371174:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29937 00000100:00100000:2.0:1787508765.371190:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480227072 00000100:00100000:2.0:1787508765.371193:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480227072 00000100:00100000:2.0:1787508765.371223:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480227584 00000100:00100000:2.0:1787508765.371226:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480227584 00000100:00100000:2.0:1787508765.371245:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2490 00000100:00100000:2.0:1787508765.371251:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480227072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508765.371280:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480227072:12345-0@lo:400:kworker.0 Request processed in 30us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508765.371286:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2490 00000100:00100000:2.0:1787508765.371296:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2491 00000100:00100000:2.0:1787508765.371302:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480227584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508765.371328:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480227584:12345-0@lo:400:kworker.0 Request processed in 26us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508765.371336:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2491 00000100:00100000:2.0:1787508765.371382:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589941255 gen 2 00000004:00080000:2.0:1787508765.371389:0:3616:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9090e4ba1500, transno 8589941255 00000100:00100000:2.0:1787508765.371402:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480227072:0@lo:400:kworker.0 00000100:00100000:2.0:1787508765.371413:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480227584:0@lo:400:kworker.0 00000100:00100000:2.0:1787508765.371423:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480226944:0@lo:400:kworker.0 00000100:00100000:2.0:1787508765.371430:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944243 gen 2 00000004:00080000:2.0:1787508765.371435:0:3616:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944242 committed transno 12884944243 00000004:00080000:2.0:1787508765.371452:0:3616:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944243 committed transno 12884944243 00000100:00100000:2.0:1787508765.371463:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480227456:0@lo:400:kworker.0 00000100:00100000:3.0:1787508765.371771:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79de3f65-4bad-42d0-a46f-842a654b33a0:3619:1874324480226816:0@lo:400:kworker.0 00000100:00100000:3.0:1787508765.371813:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508765.371861:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480227328:0@lo:400:kworker.0 00000100:00100000:3.0:1787508765.371884:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508765.371902:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874324480227840:0@lo:400:kworker.0 00000100:00100000:3.0:1787508765.371922:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508765.371959:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874324480228352:0@lo:400:kworker.0 00000100:00100000:3.0:1787508765.371985:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508765.372020:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787508765.372027:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480227200:0@lo:400:kworker.0 00000100:00100000:3.0:1787508765.372050:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508765.372068:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480227712:0@lo:400:kworker.0 00000100:00100000:3.0:1787508765.372088:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508765.372103:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874324480228224:0@lo:400:kworker.0 00000100:00100000:3.0:1787508765.372121:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508765.372156:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480227968 00000100:00100000:3.0:1787508765.372161:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480227968 00000100:00100000:3.0:1787508765.372193:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480228096 00000100:00100000:3.0:1787508765.372196:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480228096 00000100:00100000:3.0:1787508765.372209:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480227328 00000100:00100000:3.0:1787508765.372211:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480227328 00000100:00100000:3.0:1787508765.372220:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480227840 00000100:00100000:3.0:1787508765.372221:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480227840 00000100:00100000:3.0:1787508765.372230:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480228352 00000100:00100000:3.0:1787508765.372232:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480228352 00000100:00100000:3.0:1787508765.372245:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480228224 00000100:00100000:3.0:1787508765.372247:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480228224 00000100:00100000:3.0:1787508765.372261:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3136 00000100:00100000:3.0:1787508765.372267:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874324480227968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508765.372309:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874324480227968:12345-0@lo:400:kworker.0 Request processed in 40us (1583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508765.372315:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3136 00000100:00100000:3.0:1787508765.372333:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3137 00000100:00100000:3.0:1787508765.372339:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480228096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508765.372367:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480228096:12345-0@lo:400:kworker.0 Request processed in 29us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508765.372374:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3137 00000100:00100000:3.0:1787508765.372386:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3138 00000100:00100000:3.0:1787508765.372392:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480227328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508765.372421:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480227328:12345-0@lo:400:kworker.0 Request processed in 30us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508765.372427:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3138 00000100:00100000:3.0:1787508765.372439:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3139 00000100:00100000:3.0:1787508765.372444:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874324480227840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508765.372470:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874324480227840:12345-0@lo:400:kworker.0 Request processed in 26us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508765.372476:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3139 00000100:00100000:3.0:1787508765.372488:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3140 00000100:00100000:3.0:1787508765.372494:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874324480228352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508765.372521:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874324480228352:12345-0@lo:400:kworker.0 Request processed in 27us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508765.372527:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3140 00000100:00100000:3.0:1787508765.372548:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3141 00000100:00100000:3.0:1787508765.372554:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874324480228224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508765.372580:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874324480228224:12345-0@lo:400:kworker.0 Request processed in 27us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508765.372600:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3141 00000100:00100000:3.0:1787508765.372623:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480227200 00000100:00100000:3.0:1787508765.372627:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480227200 00000100:00100000:3.0:1787508765.372648:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480227712 00000100:00100000:3.0:1787508765.372651:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480227712 00000100:00100000:3.0:1787508765.372670:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2492 00000100:00100000:3.0:1787508765.372676:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480227200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508765.372707:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480227200:12345-0@lo:400:kworker.0 Request processed in 31us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508765.372712:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2492 00000100:00100000:3.0:1787508765.372724:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2493 00000100:00100000:3.0:1787508765.372730:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480227712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508765.372752:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480227712:12345-0@lo:400:kworker.0 Request processed in 23us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508765.372757:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2493 00000100:00100000:3.0:1787508765.372799:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480227200:0@lo:400:kworker.0 00000100:00100000:3.0:1787508765.372809:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480227712:0@lo:400:kworker.0 00000100:00100000:3.0:1787508765.372817:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874324480228224:0@lo:400:kworker.0 00000100:00100000:3.0:1787508765.372827:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480227328:0@lo:400:kworker.0 00000100:00100000:3.0:1787508765.372835:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874324480227840:0@lo:400:kworker.0 00000100:00100000:3.0:1787508765.372856:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874324480228352:0@lo:400:kworker.0 00000100:00100000:3.0:1787508765.372890:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480228096:0@lo:400:kworker.0 00000100:00100000:3.0:1787508765.372901:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874324480227968:0@lo:400:kworker.0 00000100:00080000:0.0:1787508765.373459:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508765.373464:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787508765.373467:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787508765.373591:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480226816 00000100:00100000:2.0:1787508765.373597:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480226816 00000100:00100000:2.0:1787508765.373637:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:2.0:1787508765.373645:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091da87f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3619:x1874324480226816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508765.373691:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091da87f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3619:x1874324480226816:12345-0@lo:400:kworker.0 Request processed in 48us (1878us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508765.373698:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:0.0:1787508765.373873:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79de3f65-4bad-42d0-a46f-842a654b33a0:3619:1874324480226816:0@lo:400:kworker.0 00000001:02000400:2.0:1787508765.759367:0:234671:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 103: Test size correctness with lockahead ========================================================== 14:12:44 (1787508764) 00000100:00100000:3.0:1787508765.882183:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480228480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787508765.882256:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508765.882317:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480228480 00000100:00100000:3.0:1787508765.882325:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480228480 00000100:00100000:3.0:1787508765.882372:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1743 00000100:00100000:3.0:1787508765.882381:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480228480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787508765.882410:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49603136 pending 0 free 3909767168 avail 3678244864 00000100:00100000:3.0:1787508765.882452:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480228480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508765.882459:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1743 00000100:00100000:3.0:1787508765.882507:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480228480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787508765.886881:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787508765.886904:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480228608:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787508765.887238:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508765.888101:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480228608 00000100:00100000:1.0:1787508765.888111:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480228608 00000100:00100000:1.0:1787508765.888164:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1744 00000100:00100000:1.0:1787508765.888174:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480228608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787508765.888198:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49603136 pending 0 free 3909767168 avail 3678244864 00000100:00100000:1.0:1787508765.888254:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480228608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508765.888274:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1744 00000100:00100000:1.0:1787508765.888324:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480228608:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787508765.996189:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508765.996926:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509666304 00000100:00100000:3.0:1787508765.996976:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509666304 00000100:00100000:3.0:1787508765.998559:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94252 00000100:00100000:3.0:1787508765.998572:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:344733:x1874324509666304:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1787508765.998594:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508765.998616:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f36049 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaec67 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508765.998677:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f36050 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508765.998691:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f36050 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508765.998702:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f36050 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508765.998751:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36057 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508765.998758:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36057 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508765.998768:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36057 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508765.998840:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f36050 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508765.998846:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f36050 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508765.998852:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f36050 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508765.998858:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f36050 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508765.998864:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ea00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508765.998867:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f36050 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508765.998874:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f36050 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508765.998886:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508765.998889:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508765.998893:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f36050 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508765.998900:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f36050 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508765.998911:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36057 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508765.998918:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36057 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508765.998924:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36057 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508765.998928:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508765.998932:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36057 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508765.998937:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36057 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508765.998968:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x74d8b32 (ffff9090d6c69d00) 00010000:00010000:3.0:1787508765.998971:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508765.998973:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36057 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508765.998978:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36057 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508765.999234:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f36049 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec67 expref: 11 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508765.999245:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508765.999247:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508765.999252:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f36049 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec67 expref: 11 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508765.999265:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fa00, rc 0) 00000100:00100000:3.0:1787508766.000052:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:344733:x1874324509666304:12345-192.168.201.30@tcp:101:bash.0 Request processed in 1477us (3869us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508766.000062:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94252 00000100:00080000:0.0:1787508766.007545:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787508766.034215:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508766.034463:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509666432 00000100:00100000:3.0:1787508766.034476:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509666432 00000100:00100000:3.0:1787508766.034547:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94253 00000100:00100000:3.0:1787508766.034570:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:344884:x1874324509666432:12345-192.168.201.30@tcp:41:stat.0 00000004:00000024:3.0:1787508766.034630:0:202227:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 7791722496 avail 7328677888 00000100:00100000:3.0:1787508766.034710:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:344884:x1874324509666432:12345-192.168.201.30@tcp:41:stat.0 Request processed in 141us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508766.034718:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94253 00000100:00100000:1.0:1787508766.089073:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508766.089168:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509666688 00000100:00100000:0.0:1787508766.089178:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509666688 00000100:00100000:0.0:1787508766.089250:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94254 00000100:00100000:0.0:1787508766.089262:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:344888:x1874324509666688:12345-192.168.201.30@tcp:36:lfs.0 00000100:00100000:0.0:1787508766.089365:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b52d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480228736:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508766.089413:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508766.089450:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c966e0c0 going to sleep for 11 seconds 00000100:00080000:2.0:1787508766.089517:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787508766.089561:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480228736 00000100:00100000:3.0:1787508766.089567:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480228736 00000100:00100000:3.0:1787508766.089658:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29938 00000100:00100000:3.0:1787508766.089667:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:205405:x1874324480228736:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508766.089756:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:205405:x1874324480228736:12345-0@lo:1000:mdt00_004.0 Request processed in 90us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508766.089763:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29938 00000100:00100000:0.0:1787508766.089808:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b52d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480228736:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508766.089870:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b52d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480228864:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508766.089892:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508766.101736:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480228864 00000100:00100000:1.0:1787508766.101751:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480228864 00000100:00100000:1.0:1787508766.101818:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29939 00000100:00100000:1.0:1787508766.101841:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:205405:x1874324480228864:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787508766.105844:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:205405:x1874324480228864:12345-0@lo:1000:mdt00_004.0 Request processed in 3997us (15930us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787508766.105861:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29939 00000100:00100000:1.0:1787508766.109897:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c966e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508766.109977:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b52d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480228864:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1787508766.110060:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f3605e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.110070:0:205405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f3605e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.110081:0:205405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f3605e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508766.110101:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce780a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480228992:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1787508766.110159:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508766.110196:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d19679c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508766.110290:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480228992 00000100:00100000:3.0:1787508766.110297:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480228992 00000100:00100000:3.0:1787508766.110362:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29940 00000100:00100000:3.0:1787508766.110372:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:205405:x1874324480228992:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1787508766.110390:0:203182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508766.110407:0:203182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f36065 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f3605e expref: -99 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.110434:0:203182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35f46 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebfe expref: 9 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.110443:0:203182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35fb6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec28 expref: 9 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.110451:0:203182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f36065 lrc: 5/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f3605e expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.110478:0:203182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec28 expref: 9 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.110491:0:203182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35fb6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec28 expref: 9 pid: 202227 timeout: 13837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508766.110501:0:203182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf1180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480229120:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508766.110583:0:203182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35f46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebfe expref: 9 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.110592:0:203182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35f46 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebfe expref: 9 pid: 203348 timeout: 13837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508766.110602:0:203182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf0a80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480229248:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508766.110625:0:203182:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090e6fc3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787508766.114395:0:203182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf1180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480229120:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508766.114424:0:203182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf0a80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:203182:1874324480229248:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508766.114462:0:203182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f36065 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3605e expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.114475:0:203182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508766.114478:0:203182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508766.114481:0:203182:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f36065 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3605e expref: 7 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.114491:0:203182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fa00, rc 0) 00000100:00100000:3.0:1787508766.114558:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:205405:x1874324480228992:12345-0@lo:101:mdt00_004.0 Request processed in 4186us (4398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508766.114566:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29940 00000100:00100000:1.0:1787508766.114706:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce780a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480228992:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1787508766.114724:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f3605e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f36065 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.114735:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f3605e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f36065 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508766.115746:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508766.115841:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508766.115915:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509666816 00000100:00100000:0.0:1787508766.115924:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509666816 00010000:00010000:0.0:1787508766.115996:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35fb6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec28 expref: 10 pid: 202227 timeout: 13837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508766.116031:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27965 00000100:00100000:0.0:1787508766.116041:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce780e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2400:x1874324509666816:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508766.116057:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508766.116064:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35fb6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec28 expref: 10 pid: 202227 timeout: 13837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.116077:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec28 expref: 10 pid: 202227 timeout: 13837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.116105:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f35fb6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec28 expref: 10 pid: 202227 timeout: 13837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.116125:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508766.116131:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f36065 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3605e expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.116139:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508766.116184:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce780e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2400:x1874324509666816:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 145us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508766.116192:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27965 00000100:00100000:0.0:1787508766.116207:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509666944 00000100:00100000:0.0:1787508766.116210:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509666944 00010000:00010000:0.0:1787508766.116224:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35f46 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebfe expref: 10 pid: 203348 timeout: 13837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508766.116244:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27966 00000100:00100000:0.0:1787508766.116251:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9f1a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2400:x1874324509666944:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508766.116259:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508766.116264:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35f46 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebfe expref: 10 pid: 203348 timeout: 13837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.116274:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35f46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebfe expref: 10 pid: 203348 timeout: 13837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.116287:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f35f46 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaebfe expref: 10 pid: 203348 timeout: 13837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.116299:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508766.116304:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f36065 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3605e expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.116313:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f36065 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f3605e expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.116322:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f36065 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xb126349c40f3605e expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.116354:0:202211:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f36065 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3605e expref: 6 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508766.116369:0:202211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b53800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:202211:1874324480229376:0@lo:105: 00000100:00100000:0.0:1787508766.116412:0:202211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508766.116447:0:202211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c966e180 going to sleep for 11 seconds 00000100:00100000:0.0:1787508766.116526:0:229363:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787508766.116536:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480229376 00000100:00100000:0.0:1787508766.116553:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480229376 00000100:00100000:0.0:1787508766.116581:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18206 00000100:00100000:0.0:1787508766.116588:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8311c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:202211:x1874324480229376:12345-0@lo:105: 00010000:00010000:0.0:1787508766.116598:0:229363:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f3605e lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f36065 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.116606:0:229363:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f3605e lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f36065 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.116615:0:229363:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f3605e lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f36065 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.116627:0:229363:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f3605e lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f36065 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.116634:0:229363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f3605e lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f36065 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.116641:0:229363:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f3605e lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f36065 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.116658:0:229363:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090d247a400) 00000100:00100000:0.0:1787508766.116689:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8311c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:202211:x1874324480229376:12345-0@lo:105: Request processed in 101us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508766.116695:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18206 00000100:00100000:0.0:1787508766.116746:0:202211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b53800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:202211:1874324480229376:0@lo:105: 00010000:00010000:0.0:1787508766.116760:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508766.116785:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9f1a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:2400:x1874324509666944:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 534us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508766.116791:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27966 00000100:00080000:1.0:1787508766.117233:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787508766.117245:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f3605e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f36065 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.117252:0:205405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f3605e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f36065 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787508766.117271:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787508766.117309:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f3606c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.117316:0:205405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f3606c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.117326:0:205405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f3606c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508766.117342:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce780a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480229504:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1787508766.117367:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508766.117391:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d19679c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508766.117443:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480229504 00000100:00100000:3.0:1787508766.117447:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480229504 00000100:00100000:3.0:1787508766.117476:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29941 00000100:00100000:3.0:1787508766.117480:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:205405:x1874324480229504:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1787508766.117492:0:202231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508766.117504:0:202231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36073 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f3606c expref: -99 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.117519:0:202231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36073 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f3606c expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.117527:0:202231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36073 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3606c expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.117544:0:202231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x74d8b32 (ffff9090d6c69d00) 00010000:00010000:3.0:1787508766.117546:0:202231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508766.117548:0:202231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fc00, rc 0) 00000100:00100000:3.0:1787508766.117581:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480229504:12345-0@lo:101:mdt00_004.0 Request processed in 100us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508766.117587:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29941 00000100:00100000:2.0:1787508766.118008:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce780a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480229504:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1787508766.118023:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f3606c lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f36073 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.118029:0:205405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f3606c lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f36073 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787508766.118039:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1787508766.118066:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b60700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480229632:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508766.118089:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508766.118109:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d764d540 going to sleep for 11 seconds 00000100:00100000:1.0:1787508766.118155:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480229632 00000100:00100000:1.0:1787508766.118159:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480229632 00000100:00100000:1.0:1787508766.118183:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29942 00000100:00100000:1.0:1787508766.118187:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480229632:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787508766.118239:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480229632:12345-0@lo:1000:mdt00_004.0 Request processed in 52us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508766.118246:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29942 00000100:00100000:2.0:1787508766.118306:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b60700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480229632:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508766.118342:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b60700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480229760:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508766.118358:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508766.118376:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d764d540 going to sleep for 11 seconds 00000100:00100000:1.0:1787508766.118645:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480229760 00000100:00100000:1.0:1787508766.118650:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480229760 00000100:00100000:1.0:1787508766.118689:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29943 00000100:00100000:1.0:1787508766.118695:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480229760:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787508766.118775:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480229760:12345-0@lo:1000:mdt00_004.0 Request processed in 79us (413us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787508766.118782:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29943 00000100:00100000:2.0:1787508766.118925:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b60700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480229760:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508766.119023:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b60700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480229888:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508766.119049:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508766.119072:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d764d540 going to sleep for 11 seconds 00000100:00100000:3.0:1787508766.119151:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480229888 00000100:00100000:3.0:1787508766.119156:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480229888 00000100:00100000:3.0:1787508766.119185:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29944 00000100:00100000:3.0:1787508766.119192:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480229888:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508766.119253:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480229888:12345-0@lo:1000:mdt00_004.0 Request processed in 61us (203us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787508766.119260:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29944 00000100:00100000:2.0:1787508766.119561:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b60700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480229888:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508766.119611:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b60700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480230016:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508766.119635:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508766.119659:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d764d540 going to sleep for 11 seconds 00000100:00100000:3.0:1787508766.121935:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480230016 00000100:00100000:3.0:1787508766.121990:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480230016 00000100:00100000:3.0:1787508766.122051:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29945 00000100:00100000:3.0:1787508766.122061:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480230016:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508766.122191:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480230016:12345-0@lo:1000:mdt00_004.0 Request processed in 131us (2554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508766.122199:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29945 00000100:00100000:2.0:1787508766.123330:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b60700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480230016:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508766.123420:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b60700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480230144:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508766.123475:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508766.124064:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d764d540 going to sleep for 11 seconds 00000100:00100000:3.0:1787508766.124133:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480230144 00000100:00100000:3.0:1787508766.124139:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480230144 00000100:00100000:3.0:1787508766.124191:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29946 00000100:00100000:3.0:1787508766.124200:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480230144:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508766.124294:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480230144:12345-0@lo:1000:mdt00_004.0 Request processed in 94us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508766.124302:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29946 00000100:00100000:2.0:1787508766.125093:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b60700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480230144:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508766.125166:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b60700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480230272:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787508766.125210:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508766.125239:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d764d540 going to sleep for 11 seconds 00000100:00100000:3.0:1787508766.125374:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480230272 00000100:00100000:3.0:1787508766.125379:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480230272 00000100:00100000:3.0:1787508766.125418:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29947 00000100:00100000:3.0:1787508766.125426:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480230272:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508766.125488:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480230272:12345-0@lo:1000:mdt00_004.0 Request processed in 63us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508766.125495:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29947 00000100:00100000:2.0:1787508766.126626:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b60700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480230272:0@lo:1000:mdt00_004.0 00000040:00080000:2.0:1787508766.128970:0:205405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xf:0x0].58, 2168 off95688 00000040:00080000:2.0:1787508766.129063:0:205405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x5:0x0].602, 2368 off765968 00000004:00080000:2.0:1787508766.129071:0:205405:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d764df00 with version 13631 00000004:00080000:3.0:1787508766.129697:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13631 rpc_version 13631 00000020:00100000:3.0:1787508766.129752:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787508766.129764:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090c6bf0a80 x1874324480230528/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787508766.129787:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf0a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480230528:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508766.129871:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508766.129910:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090e6fc3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787508766.130214:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480230528 00000100:00100000:2.0:1787508766.130222:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480230528 00000100:00100000:2.0:1787508766.130281:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29948 00000100:00100000:2.0:1787508766.130290:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202961:x1874324480230528:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508766.131062:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:202961:x1874324480230528:12345-0@lo:1000:osp_up0-1.0 Request processed in 771us (1189us total) trans 12884944247 rc 0/0 00000100:00100000:2.0:1787508766.131070:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29948 00000100:00100000:3.0:1787508766.131497:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf0a80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480230528:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1787508766.132067:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f3607a lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.132086:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f3607a lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.136980:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f3607a lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.137074:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aae00/0xb126349c40f36081 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x296:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.137087:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aae00/0xb126349c40f36081 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x296:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.137094:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aae00/0xb126349c40f36081 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x296:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.137135:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abe00/0xb126349c40f36088 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.137142:0:205405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abe00/0xb126349c40f36088 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.137154:0:205405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abe00/0xb126349c40f36088 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508766.137181:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b60700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480230656:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1787508766.137250:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508766.137431:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d764d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508766.137596:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480230656 00000100:00100000:3.0:1787508766.137604:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480230656 00000100:00100000:3.0:1787508766.137706:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29949 00000100:00100000:3.0:1787508766.137717:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:205405:x1874324480230656:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1787508766.137748:0:202232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508766.137767:0:202232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f3608f lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f36088 expref: -99 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.137788:0:202232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f3608f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f36088 expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.137804:0:202232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f3608f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f36088 expref: 10 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.137812:0:202232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28c:0x0].0x0 (ffff9090d6c69200) 00010000:00010000:3.0:1787508766.137815:0:202232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508766.137819:0:202232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ea00, rc 0) 00000100:00100000:3.0:1787508766.137920:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:205405:x1874324480230656:12345-0@lo:101:mdt00_004.0 Request processed in 203us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508766.137927:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29949 00000100:00100000:0.0:1787508766.142134:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b60700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480230656:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1787508766.142165:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abe00/0xb126349c40f36088 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3608f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.142180:0:205405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abe00/0xb126349c40f36088 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3608f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508766.142209:0:205405:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba7522b9 reply state 00000000c1700151 transno 8589962075 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aae00/0xb126349c40f36081 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x296:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.142223:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aae00/0xb126349c40f36081 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x296:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.142231:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x296:0x0].0x0 (ffff9090e33fff00) 00010000:00010000:0.0:1787508766.142234:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787508766.142238:0:205405:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787508766.142243:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abe00/0xb126349c40f36088 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3608f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.142251:0:205405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abe00/0xb126349c40f36088 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3608f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787508766.142263:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x28c:0x0] 00000004:00010000:0.0:1787508766.142287:0:205405:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba7522b9 reply state 00000000c1700151 transno 8589962075 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f3607a lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.142295:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f3607a lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.142300:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13dc:0x0].0x0 (ffff9090e33ff200) 00010000:00010000:0.0:1787508766.142302:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787508766.142304:0:205405:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:0.0:1787508766.142309:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13dc:0x0]: returning size 4096 00000004:00080000:0.0:1787508766.142319:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787508766.142326:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f3605e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f36065 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.142333:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f3605e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f36065 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.142344:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f3605e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f36065 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.142367:0:205405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787508766.142371:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1787508766.142376:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f3606c lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f36073 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.142383:0:205405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f3606c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f36073 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508766.142502:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:344888:x1874324509666688:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 53241us (53436us total) trans 8589962075 rc 0/0 00000100:00100000:0.0:1787508766.142512:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94254 00010000:00010000:2.0:1787508766.142820:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787508766.142836:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f3605e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xb126349c40f36065 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.142844:0:204785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a400 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:2.0:1787508766.142850:0:204785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f3605e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xb126349c40f36065 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508766.142858:0:204785:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f3605e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xb126349c40f36065 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.142899:0:204785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f3605e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f36065 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.142906:0:204785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787508766.142959:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f3605e lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f36065 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.142966:0:204785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a400/0xb126349c40f3605e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f36065 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.142979:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508766.142981:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508766.142982:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508766.143021:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787508766.143036:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480230784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787508766.143090:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508766.143206:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480230784 00000100:00100000:2.0:1787508766.143213:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480230784 00000100:00100000:2.0:1787508766.143262:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9834 00000100:00100000:2.0:1787508766.143272:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+10:3619:x1874324480230784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508766.143285:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508766.143302:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f36065 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f3605e expref: 10 pid: 203182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.143315:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508766.143320:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508766.143359:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+9:3619:x1874324480230784:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508766.143366:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9834 00000100:00100000:0.0:1787508766.143433:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480230784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508766.162590:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508766.162693:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509667072 00000100:00100000:2.0:1787508766.162704:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509667072 00000100:00100000:2.0:1787508766.162769:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94255 00000100:00100000:2.0:1787508766.162782:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:344889:x1874324509667072:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508766.162803:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508766.162837:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f36096 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaec6e expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.162904:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3609d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.162917:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3609d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.162927:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3609d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508766.163000:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508766.163004:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508766.163024:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3609d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.163049:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f36096 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec6e expref: 11 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.163069:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3609d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec6e expref: 10 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.163077:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508766.163080:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508766.163083:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab200, rc 0) 00000100:00100000:2.0:1787508766.163136:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:344889:x1874324509667072:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 356us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508766.163143:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94255 00000100:00100000:1.0:1787508766.166935:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508766.170300:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509667328 00000100:00100000:3.0:1787508766.170318:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509667328 00000100:00100000:3.0:1787508766.170397:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94256 00000100:00100000:3.0:1787508766.170408:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:344889:x1874324509667328:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508766.170429:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508766.170432:0:209004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787508766.170457:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3609d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec6e expref: 10 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.170481:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508766.170486:0:209004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508766.170501:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f360a4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaec75 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.170749:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f360ab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.170763:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f360ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.170773:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f360ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.170786:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f360b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.170796:0:209004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36073 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f3606c expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.170806:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f360b2 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.170857:0:209004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36073 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f3606c expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508766.170873:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480230912:0@lo:104: 00000100:00100000:3.0:1787508766.170935:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508766.170993:0:202209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480230912 00000100:00100000:2.0:1787508766.170999:0:202209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480230912 00000100:00100000:3.0:1787508766.171020:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090e6fc3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787508766.171048:0:202209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18207 00000100:00100000:2.0:1787508766.171056:0:202209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:209004:x1874324480230912:12345-0@lo:104: 00010000:00010000:2.0:1787508766.171069:0:202209:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f3606c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f36073 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.171128:0:202209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787508766.171134:0:202209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:209004:x1874324480230912:12345-0@lo:104: Request processed in 79us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508766.171140:0:202209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18207 00000100:00100000:3.0:1787508766.171185:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480230912:0@lo:104: 00010000:00010000:3.0:1787508766.171203:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f360b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.171260:0:202215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787508766.171268:0:202215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f3606c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f36073 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.171277:0:202215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:0.0:1787508766.171283:0:202215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f3606c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f36073 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508766.171291:0:202215:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f3606c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f36073 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.171322:0:202215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f3606c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f36073 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.171328:0:202215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787508766.171358:0:202215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f3606c lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f36073 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.171366:0:202215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247b600/0xb126349c40f3606c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f36073 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508766.171378:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480231040:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508766.171383:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508766.171387:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508766.171389:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508766.171413:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508766.175242:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480231040 00000100:00100000:0.0:1787508766.175386:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480231040 00010000:00010000:2.0:1787508766.175662:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36073 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f3606c expref: 9 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508766.175711:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27967 00000100:00100000:2.0:1787508766.175722:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3619:x1874324480231040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787508766.175751:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1787508766.182430:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944247 is committed 00000020:00080000:3.0:1787508766.182445:0:202206:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8589961994 batchid updated 00000020:00080000:1.0:1787508766.182584:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961994 00000004:00080000:1.0:1787508766.182650:0:202262:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d1967c00 with version 3475 00000020:00080000:1.0:1787508766.182670:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589961993 cancel update log [0x240000bd2:0x1:0x0].1795: rc = 0 00000004:00080000:0.0:1787508766.182793:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3475 rpc_version 3475 00000020:00100000:0.0:1787508766.182839:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787508766.182852:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d0b50a80 x1874324480231296/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787508766.182883:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b50a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480231296:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787508766.184222:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508766.184330:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c966e000 going to sleep for 11 seconds 00000100:00100000:0.0:1787508766.185917:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480231296 00000100:00100000:0.0:1787508766.185932:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480231296 00000100:00100000:0.0:1787508766.186252:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29950 00000100:00100000:0.0:1787508766.186653:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:202248:x1874324480231296:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787508766.186862:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:202248:x1874324480231296:12345-0@lo:1000:osp_up1-0.0 Request processed in 213us (2644us total) trans 8589962076 rc 0/0 00000100:00100000:0.0:1787508766.186871:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29950 00000100:00100000:0.0:1787508766.186934:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b50a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480231296:0@lo:1000:osp_up1-0.0 00000020:00080000:1.0:1787508766.196154:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589961993 cancel update log [0x2000013a0:0x1:0x0].1789: rc = 0 00000004:00080000:1.0:1787508766.196230:0:202262:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9090d1967d80 with version 3476 00000020:00080000:1.0:1787508766.196397:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 8589961994 cancel update log [0x240000bd2:0x1:0x0].1796: rc = 0 00000004:00080000:0.0:1787508766.196397:0:202248:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090d0b04480 version 3476 rpc_version 3476 00000020:00100000:0.0:1787508766.196445:0:202248:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000020:00080000:1.0:1787508766.196454:0:202262:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 8589961994 cancel update log [0x2000013a0:0x1:0x0].1790: rc = 0 00000100:00100000:0.0:1787508766.196460:0:202248:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091f9acc000 x1874324480231552/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00080000:1.0:1787508766.196465:0:202262:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589961994 00000100:00100000:0.0:1787508766.196494:0:202248:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9acc000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480231552:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787508766.197170:0:202248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508766.198756:0:202248:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c966e000 going to sleep for 11 seconds 00010000:00010000:2.0:1787508766.199039:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36073 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f3606c expref: 8 pid: 202231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.199062:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x74d8b32 (ffff9090d6c69d00) 00010000:00010000:2.0:1787508766.199069:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f360b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.199079:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f360b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.199087:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f360b2 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.199124:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508766.199198:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f360b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508766.199203:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+7:3619:x1874324480231040:12345-0@lo:103:ldlm_bl.0 Request processed in 23481us (27787us total) trans 0 rc 0/0 00010000:00010000:0.0:1787508766.199213:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f360b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508766.199220:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27967 00000100:00100000:1.0:1787508766.199368:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480231040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787508766.199464:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a87480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:209004:1874324480231680:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787508766.199501:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508766.205191:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c966ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1787508766.205698:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480231552 00000100:00100000:3.0:1787508766.205708:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480231552 00000100:00100000:3.0:1787508766.205822:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480231680 00000100:00100000:3.0:1787508766.205835:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480231680 00000100:00100000:1.0:1787508766.213249:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29951 00000100:00100000:1.0:1787508766.213281:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:202248:x1874324480231552:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787508766.213517:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:202248:x1874324480231552:12345-0@lo:1000:osp_up1-0.0 Request processed in 252us (16943us total) trans 8589962077 rc 0/0 00000100:00100000:1.0:1787508766.213525:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29951 00000100:00100000:1.0:1787508766.213555:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29952 00000100:00100000:1.0:1787508766.213562:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:209004:x1874324480231680:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787508766.213637:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:209004:x1874324480231680:12345-0@lo:1000:mdt00_005.0 Request processed in 75us (14135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508766.213643:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29952 00000100:00100000:1.0:1787508766.213698:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a87480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:209004:1874324480231680:0@lo:1000:mdt00_005.0 00010000:00010000:1.0:1787508766.213760:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f360b9 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.213777:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f360b9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.213789:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f360b9 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.213804:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f360ab lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.213811:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f360ab lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.213818:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f360ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.213836:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f360ab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.213843:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ec00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508766.213847:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f360ab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.213859:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f360ab lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.213870:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508766.213873:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508766.213879:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f360ab lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.213885:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f360ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.213899:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f360b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.213905:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f360b2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.213911:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f360b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.213915:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fa00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508766.213918:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f360b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.213923:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f360b2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.213931:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x74d8b32 (ffff9090d6c69d00) 00010000:00010000:1.0:1787508766.213933:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508766.213936:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f360b2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.214279:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fa00/0xb126349c40f360b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.214331:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f360a4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec75 expref: 11 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.214345:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247be00/0xb126349c40f360b9 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec75 expref: 10 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.214352:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13dc:0x0].0x0 (ffff9090d171fe00) 00010000:00010000:1.0:1787508766.214354:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508766.214356:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247be00, rc 0) 00000100:00100000:1.0:1787508766.214407:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:344889:x1874324509667328:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 44000us (47483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508766.214414:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94256 00000100:00100000:0.0:1787508766.214640:0:202248:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9acc000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:202248:1874324480231552:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787508766.217752:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508766.217848:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509667584 00000100:00100000:2.0:1787508766.217858:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509667584 00000100:00100000:2.0:1787508766.217922:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94257 00000100:00100000:2.0:1787508766.217933:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:344889:x1874324509667584:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508766.217981:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508766.218002:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa400/0xb126349c40f360c0 lrc: 2/0,0 mode: --/CW res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaec7c expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508766.218161:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13dc:0x0]: returning size 4096 00010000:00010000:2.0:1787508766.218189:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa400/0xb126349c40f360c0 lrc: 1/0,0 mode: --/CW res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec7c expref: 10 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.218202:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13dc:0x0].0x0 (ffff9090e33ff200) 00010000:00010000:2.0:1787508766.218204:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508766.218209:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa400/0xb126349c40f360c0 lrc: 0/0,0 mode: --/CW res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec7c expref: 10 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.218225:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa400, rc 0) 00000100:00100000:2.0:1787508766.218287:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:344889:x1874324509667584:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 356us (555us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508766.218298:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94257 00000100:00100000:1.0:1787508766.232218:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508766.232297:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509667712 00000100:00100000:0.0:1787508766.232308:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509667712 00000100:00100000:0.0:1787508766.232441:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94258 00000100:00100000:0.0:1787508766.232453:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:344889:x1874324509667712:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508766.232475:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508766.232499:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f360c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaec83 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.232595:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f360ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.232609:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f360ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.232620:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f360ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508766.232673:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787508766.232677:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508766.232712:0:205405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f360ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.232737:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f360c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec83 expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.232756:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f360ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec83 expref: 11 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.232765:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508766.232768:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508766.232772:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5e00, rc 0) 00000100:00100000:0.0:1787508766.232852:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:344889:x1874324509667712:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 402us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508766.232860:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94258 00000100:00100000:1.0:1787508766.236455:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508766.236550:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509667968 00000100:00100000:3.0:1787508766.236561:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509667968 00000100:00100000:3.0:1787508766.236631:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94259 00000100:00100000:3.0:1787508766.236641:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:344889:x1874324509667968:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508766.236660:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508766.236680:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f360d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaec8a expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.236756:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f360dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.236769:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f360dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.236780:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f360dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.236795:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f360e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.236802:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f360e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.236809:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f360e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.236884:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f360ea lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.236893:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f360ea lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.236900:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f360ea lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.236914:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f360dc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.236920:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f360dc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.236926:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f360dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.236932:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f360dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.236937:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508766.237479:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f360dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.237488:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f360dc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.237502:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508766.237506:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508766.237510:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f360dc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.237517:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f360dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.237531:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f360e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.237537:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f360e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.237543:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f360e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.237548:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ee00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508766.237551:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f360e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.237556:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f360e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.237563:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x74d8b32 (ffff9090cc088500) 00010000:00010000:3.0:1787508766.237566:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508766.237569:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f360e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.237575:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f360e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.237613:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f360d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec8a expref: 13 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.237632:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f360ea lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec8a expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.237640:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13dc:0x0].0x0 (ffff9090d171fe00) 00010000:00010000:3.0:1787508766.237643:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508766.237646:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fe00, rc 0) 00000100:00100000:2.0:1787508766.237841:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:344889:x1874324509667968:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1198us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508766.237852:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94259 00000100:00100000:1.0:1787508766.243812:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508766.244001:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509668224 00000100:00100000:0.0:1787508766.244012:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509668224 00000100:00100000:0.0:1787508766.244067:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94260 00000100:00100000:0.0:1787508766.244077:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:344889:x1874324509668224:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508766.244100:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508766.244121:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4000/0xb126349c40f360f1 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaec91 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508766.244277:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13dc:0x0]: returning size 4096 00010000:00010000:0.0:1787508766.244359:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4000/0xb126349c40f360f1 lrc: 1/0,0 mode: --/CR res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec91 expref: 11 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.244373:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13dc:0x0].0x0 (ffff9090e33ff200) 00010000:00010000:0.0:1787508766.244376:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508766.244381:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4000/0xb126349c40f360f1 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec91 expref: 11 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.244393:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4000, rc 0) 00000100:00100000:0.0:1787508766.244457:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:344889:x1874324509668224:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 381us (654us total) trans 8589962078 rc 301/301 00000100:00100000:0.0:1787508766.244464:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94260 00000100:00100000:0.0:1787508766.247584:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508766.247667:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509668352 00000100:00100000:3.0:1787508766.247678:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509668352 00000100:00100000:3.0:1787508766.247760:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9835 00000100:00100000:3.0:1787508766.247771:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:2400:x1874324509668352:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508766.247789:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508766.247815:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f360ea lrc: 0/0,0 mode: --/PR res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec8a expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.247847:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13dc:0x0].0x0 (ffff9090d171fe00) 00010000:00010000:3.0:1787508766.247852:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508766.247912:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:2400:x1874324509668352:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 143us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508766.247919:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9835 00000100:00100000:3.0:1787508766.251145:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508766.251292:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509668480 00000100:00100000:0.0:1787508766.251303:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509668480 00000100:00100000:0.0:1787508766.251370:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94261 00000100:00100000:0.0:1787508766.251381:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:344889:x1874324509668480:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508766.251407:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508766.251428:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f360ff lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x296:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaec98 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.251495:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4800/0xb126349c40f36106 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x296:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.251511:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4800/0xb126349c40f36106 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x296:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.251523:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4800/0xb126349c40f36106 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x296:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508766.251571:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x296:0x0]: returning size 4096 00000004:00200000:0.0:1787508766.251588:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508766.251626:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f360ff lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x296:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec98 expref: 12 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.251647:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4800/0xb126349c40f36106 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x296:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec98 expref: 11 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.251656:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x296:0x0].0x0 (ffff9090e33fff00) 00010000:00010000:0.0:1787508766.251659:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508766.251662:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4800, rc 0) 00000100:00100000:0.0:1787508766.251726:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:344889:x1874324509668480:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 347us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508766.251733:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94261 00000100:00100000:1.0:1787508766.257247:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508766.257354:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509668608 00000100:00100000:0.0:1787508766.257365:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509668608 00000100:00100000:0.0:1787508766.257472:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94262 00000100:00100000:0.0:1787508766.257484:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:344889:x1874324509668608:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1787508766.257510:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508766.257532:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f3610d lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaec9f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.257608:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f36114 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.257623:0:205405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f3608f lrc: 2/0,0 mode: PW/PW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f36088 expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.257632:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f36114 lrc: 4/1,0 mode: --/PR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508766.257666:0:205405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f3608f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f36088 expref: 6 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508766.257681:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a85880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480231808:0@lo:104: 00000100:00100000:0.0:1787508766.257734:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508766.257875:0:229363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480231808 00000100:00100000:3.0:1787508766.257879:0:229363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480231808 00000100:00100000:3.0:1787508766.257917:0:229363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18208 00000100:00100000:3.0:1787508766.257925:0:229363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:205405:x1874324480231808:12345-0@lo:104: 00010000:00010000:3.0:1787508766.257965:0:229363:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abe00/0xb126349c40f36088 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f3608f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508766.258018:0:229363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787508766.258024:0:229363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:205405:x1874324480231808:12345-0@lo:104: Request processed in 100us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508766.258032:0:229363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18208 00000100:00100000:0.0:1787508766.258298:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c966e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787508766.258321:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a85880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480231808:0@lo:104: 00010000:00010000:0.0:1787508766.258342:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f36114 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.259126:0:226765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787508766.259134:0:226765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abe00/0xb126349c40f36088 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f3608f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.259145:0:226765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abe00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:2.0:1787508766.259150:0:226765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abe00/0xb126349c40f36088 lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f3608f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508766.259160:0:226765:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abe00/0xb126349c40f36088 lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f3608f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.259197:0:226765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abe00/0xb126349c40f36088 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3608f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.259204:0:226765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787508766.259270:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480231936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508766.259318:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508766.259386:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480231936 00000100:00100000:3.0:1787508766.259392:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480231936 00010000:00010000:3.0:1787508766.259416:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f3608f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f36088 expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508766.259444:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27968 00000100:00100000:3.0:1787508766.259453:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce780a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+7:3616:x1874324480231936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787508766.259464:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508766.260773:0:226765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abe00/0xb126349c40f36088 lrc: 1/0,0 mode: --/PW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3608f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.260787:0:226765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090cd2abe00/0xb126349c40f36088 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3608f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.260808:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508766.260810:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508766.260812:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508766.261819:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f3608f lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f36088 expref: 7 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.261847:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28c:0x0].0x0 (ffff9090d6c69200) 00010000:00010000:1.0:1787508766.261852:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f36114 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.261863:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f36114 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.261871:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f36114 lrc: 4/1,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.261904:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508766.262050:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f36114 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.262059:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f36114 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508766.262118:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a2:0x28c:0x0]: returning size 4096 00000004:00200000:2.0:1787508766.262123:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787508766.262167:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f3610d lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec9f expref: 13 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.262182:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f36114 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec9f expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.262189:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28c:0x0].0x0 (ffff9090d6c69200) 00010000:00010000:2.0:1787508766.262191:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508766.262194:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5a00, rc 0) 00000100:00100000:2.0:1787508766.262548:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:344889:x1874324509668608:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 5063us (5306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508766.262557:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94262 00000100:00100000:1.0:1787508766.262757:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce780a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480231936:12345-0@lo:103:ldlm_bl.0 Request processed in 3305us (3438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508766.262766:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27968 00000100:00100000:2.0:1787508766.262891:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480231936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787508766.266322:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508766.266439:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509668864 00000100:00100000:2.0:1787508766.266449:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509668864 00000100:00100000:2.0:1787508766.266509:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94263 00000100:00100000:2.0:1787508766.266519:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:344889:x1874324509668864:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:2.0:1787508766.266611:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f3611b lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.266628:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f3611b lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508766.266640:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f3611b lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787508766.266891:0:202226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xf:0x0].59, 216 off95904 00000040:00080000:2.0:1787508766.266934:0:202226:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x5:0x0].603, 296 off766264 00000004:00080000:2.0:1787508766.266973:0:202226:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d764d840 with version 13632 00000004:00080000:2.0:1787508766.266991:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13632 rpc_version 13632 00000020:00100000:2.0:1787508766.267016:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787508766.267025:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091f9b60380 x1874324480232192/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1040/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787508766.267046:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b60380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480232192:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508766.267100:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508766.267121:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9091fd21a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508766.267393:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480232192 00000100:00100000:1.0:1787508766.267400:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480232192 00000100:00100000:1.0:1787508766.267444:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29953 00000100:00100000:1.0:1787508766.267451:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:202961:x1874324480232192:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508766.267629:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:202961:x1874324480232192:12345-0@lo:1000:osp_up0-1.0 Request processed in 178us (527us total) trans 12884944248 rc 0/0 00000100:00100000:1.0:1787508766.267637:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29953 00000100:00100000:1.0:1787508766.267673:0:202961:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944247 gen 2 00000004:00080000:1.0:1787508766.267678:0:202961:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944247 committed transno 12884944247 00000100:00100000:1.0:1787508766.267703:0:202961:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9091f9b60380 x1874324480232192/t12884944248(12884944248) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1040/4320 e 0 to 0 dl 1787508782 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787508766.267723:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b60380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480232192:0@lo:1000:osp_up0-1.0 00000004:00010000:1.0:1787508766.267847:0:202226:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001858572b reply state 00000000632a2161 transno 8589962079 ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f3611b lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.267865:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f3611b lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508766.267877:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13dc:0x0].0x0 (ffff9090e33ff200) 00010000:00010000:1.0:1787508766.267880:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:1.0:1787508766.267884:0:202226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787508766.267892:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13dc:0x0]: returning size 4096 00000100:00100000:1.0:1787508766.268049:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:344889:x1874324509668864:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 1530us (1734us total) trans 8589962079 rc 0/0 00000100:00100000:1.0:1787508766.268057:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94263 00000100:00100000:3.0:1787508766.270722:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508766.271085:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509669120 00000100:00100000:1.0:1787508766.271096:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509669120 00000100:00100000:1.0:1787508766.271147:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15494 00000100:00100000:1.0:1787508766.271158:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:344889:x1874324509669120:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:1.0:1787508766.271567:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:344889:x1874324509669120:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 409us (854us total) trans 8589962080 rc 0/0 00000100:00100000:1.0:1787508766.271583:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15494 00010000:00010000:0.0:1787508766.271727:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508766.906080:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787508766.906107:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480232320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787508766.906182:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508766.906236:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480232320 00000100:00100000:3.0:1787508766.906244:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480232320 00000100:00100000:3.0:1787508766.906296:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29954 00000100:00100000:3.0:1787508766.906307:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3616:x1874324480232320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787508766.906346:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440645120 avail 1294405632 00000100:00100000:3.0:1787508766.906396:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3616:x1874324480232320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508766.906403:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29954 00000100:00100000:3.0:1787508766.906458:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480232320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787508766.906914:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787508766.906925:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480232448:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787508766.906988:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508766.907019:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480232448 00000100:00100000:3.0:1787508766.907023:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480232448 00000100:00100000:3.0:1787508766.907055:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29955 00000100:00100000:3.0:1787508766.907061:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3619:x1874324480232448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787508766.907084:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442721792 avail 1296482304 00000100:00100000:3.0:1787508766.907118:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3619:x1874324480232448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508766.907124:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29955 00000100:00100000:3.0:1787508766.907157:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480232448:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787508767.155439:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508767.155509:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509669248 00000100:00100000:0.0:1787508767.155519:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509669248 00000100:00100000:0.0:1787508767.155584:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94264 00000100:00100000:0.0:1787508767.155596:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:344899:x1874324509669248:12345-192.168.201.30@tcp:101:lockahead_test.0 00010000:00010000:0.0:1787508767.155619:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508767.155641:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f36122 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeca6 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.155705:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f36129 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.155720:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f36129 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.155734:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f36129 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508767.155775:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787508767.155779:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508767.155833:0:203348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f36129 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.155860:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f36122 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeca6 expref: 11 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.155877:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f36129 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeca6 expref: 10 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.155886:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508767.155889:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508767.155893:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5200, rc 0) 00000100:00100000:0.0:1787508767.156089:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:344899:x1874324509669248:12345-192.168.201.30@tcp:101:lockahead_test.0 Request processed in 494us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508767.156100:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94264 00000100:00100000:0.0:1787508767.168251:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508767.168293:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509669376 00000100:00100000:0.0:1787508767.168302:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509669376 00000100:00100000:0.0:1787508767.168373:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94265 00000100:00100000:0.0:1787508767.168386:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:344899:x1874324509669376:12345-192.168.201.30@tcp:101:lockahead_test.0 00010000:00010000:0.0:1787508767.168405:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508767.168427:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f36130 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaecad expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.168496:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f36137 lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.168510:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f36137 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.168522:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f36137 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.168557:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f3613e lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.168564:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f3613e lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.168571:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f3613e lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.168645:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f36137 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.168653:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f36137 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.168659:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f36137 lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.168665:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f36137 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.168672:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508767.168676:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f36137 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.168683:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f36137 lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.168695:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28c:0x0].0x0 (ffff9090d6c69200) 00010000:00010000:0.0:1787508767.168699:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508767.168703:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f36137 lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.168710:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f36137 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.168724:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f3613e lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.168731:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f3613e lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.168737:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f3613e lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.168742:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508767.168745:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f3613e lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.168752:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f3613e lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.168759:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28c:0x0].0x97f25b81 (ffff9090ca4e2f00) 00010000:00010000:0.0:1787508767.168762:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508767.168765:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f3613e lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.168771:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f3613e lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.168805:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f36130 lrc: 1/0,0 mode: --/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecad expref: 13 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.168829:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28c:0x0].0x0 (ffff9090d6c69200) 00010000:00010000:0.0:1787508767.168832:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508767.168836:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f36130 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecad expref: 13 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.168846:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5600, rc 0) 00000100:00100000:0.0:1787508767.168907:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:344899:x1874324509669376:12345-192.168.201.30@tcp:101:lockahead_test.0 Request processed in 524us (802us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508767.168915:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94265 00000100:00080000:0.0:1787508767.168960:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508767.180832:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508767.181586:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509669632 00000100:00100000:3.0:1787508767.181596:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509669632 00000100:00100000:3.0:1787508767.181661:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94266 00000100:00100000:3.0:1787508767.181673:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:344899:x1874324509669632:12345-192.168.201.30@tcp:101:lockahead_test.0 00010000:00010000:3.0:1787508767.181695:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508767.181698:0:205405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787508767.181729:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f36114 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec9f expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.181746:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28c:0x0].0x0 (ffff9090d6c69200) 00010000:00010000:3.0:1787508767.181757:0:205405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508767.181772:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f36145 lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaecb4 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.181896:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3614c lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.181910:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3614c lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.181920:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3614c lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.181933:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36153 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.181969:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36153 lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.181976:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36153 lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787508767.182517:0:205405:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x1530:0x0], index 0: 0 00010000:00010000:3.0:1787508767.182665:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3615a lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1273:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.182676:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3615a lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1273:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.182683:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3615a lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1273:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.182717:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3614c lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.182729:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3614c lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.182734:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3614c lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.182741:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3614c lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.182747:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508767.182751:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3614c lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.182758:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3614c lrc: 5/0,0 mode: CW/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.182767:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28c:0x0].0x0 (ffff9090cc088500) 00010000:00010000:3.0:1787508767.182770:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508767.182774:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3614c lrc: 3/0,0 mode: --/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.182780:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3614c lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508767.182794:0:205405:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aaea02d1 reply state 0000000020e12543 transno 12884944249 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36153 lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.182805:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36153 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.182822:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28c:0x0].0x97f25b81 (ffff9090cc088f00) 00010000:00010000:3.0:1787508767.182825:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508767.182828:0:205405:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787508767.182860:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f36145 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecb4 expref: 14 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.182877:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3615a lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1273:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecb4 expref: 13 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.182885:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1273:0x0].0x0 (ffff9090cc088000) 00010000:00010000:3.0:1787508767.182887:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787508767.182889:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e800, rc 0) 00000100:00100000:3.0:1787508767.182988:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:344899:x1874324509669632:12345-192.168.201.30@tcp:101:lockahead_test.0 Request processed in 1317us (2163us total) trans 12884944249 rc 0/0 00000100:00100000:3.0:1787508767.182997:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94266 00000100:00100000:3.0:1787508767.194317:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508767.194350:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509669760 00000100:00100000:3.0:1787508767.194362:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509669760 00000100:00100000:3.0:1787508767.194419:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94267 00000100:00100000:3.0:1787508767.194429:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:344899:x1874324509669760:12345-192.168.201.30@tcp:101:lockahead_test.0 00010000:00010000:3.0:1787508767.194452:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508767.194474:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f36168 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaecbb expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.194544:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f3616f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.194560:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f3616f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.194575:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f3616f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.194590:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36176 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.194597:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36176 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.194604:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36176 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.194675:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f3617d lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.194683:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f3617d lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.194690:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f3617d lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508767.194712:0:209004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f3617d lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.194727:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f3616f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.194733:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f3616f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.194739:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f3616f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.194750:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f3616f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.194757:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8f400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508767.194761:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f3616f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.194769:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f3616f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.194781:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508767.194784:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508767.194788:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f3616f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.194795:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f3616f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.194806:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36176 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.194826:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36176 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.194831:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36176 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.194836:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508767.194838:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36176 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.194848:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36176 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.194856:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x74d8b32 (ffff9090cc088a00) 00010000:00010000:3.0:1787508767.194858:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508767.194861:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36176 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.194867:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36176 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x74d8b32 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.194896:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f36168 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecbb expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.194909:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ea00/0xb126349c40f3617d lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecbb expref: 11 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.194915:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13dc:0x0].0x0 (ffff9090d171fe00) 00010000:00010000:3.0:1787508767.194918:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508767.194920:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ea00, rc 0) 00000100:00100000:3.0:1787508767.195006:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:344899:x1874324509669760:12345-192.168.201.30@tcp:101:lockahead_test.0 Request processed in 577us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508767.195013:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94267 00000100:00100000:3.0:1787508767.199295:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508767.200098:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509669888 00000100:00100000:3.0:1787508767.200111:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509669888 00000100:00100000:3.0:1787508767.200180:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94268 00000100:00100000:3.0:1787508767.200191:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:344899:x1874324509669888:12345-192.168.201.30@tcp:101:lockahead_test.0 00010000:00010000:3.0:1787508767.200211:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508767.200232:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f36184 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaecc2 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.200300:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f3618b lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.200315:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f3618b lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.200329:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f3618b lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508767.200436:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13dc:0x0]: returning size 4096 00000004:00200000:3.0:1787508767.200441:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787508767.200495:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8e400/0xb126349c40f36184 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecc2 expref: 9 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.200512:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090e4c8fa00/0xb126349c40f3618b lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecc2 expref: 8 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.200521:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13dc:0x0].0x0 (ffff9090e33ff200) 00010000:00010000:3.0:1787508767.200524:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1787508767.200528:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fa00, rc 0) 00000100:00100000:3.0:1787508767.200592:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:344899:x1874324509669888:12345-192.168.201.30@tcp:101:lockahead_test.0 Request processed in 403us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508767.200599:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94268 00000100:00080000:3.0:1787508767.200626:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787508767.203451:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508767.205569:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509670016 00000100:00100000:2.0:1787508767.205582:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509670016 00000100:00100000:2.0:1787508767.205650:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94269 00000100:00100000:2.0:1787508767.205661:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:344899:x1874324509670016:12345-192.168.201.30@tcp:101:lockahead_test.0 00010000:00010000:2.0:1787508767.205682:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508767.205705:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f36192 lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x296:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaecc9 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508767.205763:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f36199 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x296:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508767.205777:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f36199 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x296:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508767.205790:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f36199 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x296:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508767.205845:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x296:0x0]: returning size 4096 00000004:00200000:2.0:1787508767.205851:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787508767.205889:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aba00/0xb126349c40f36192 lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x296:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecc9 expref: 10 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508767.205906:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab000/0xb126349c40f36199 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x296:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecc9 expref: 9 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508767.205915:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x296:0x0].0x0 (ffff9090e33fff00) 00010000:00010000:2.0:1787508767.205918:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508767.205922:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab000, rc 0) 00000100:00100000:2.0:1787508767.206008:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:344899:x1874324509670016:12345-192.168.201.30@tcp:101:lockahead_test.0 Request processed in 348us (2565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508767.206016:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94269 00000100:00100000:3.0:1787508767.209137:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508767.209331:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509670144 00000100:00100000:2.0:1787508767.209341:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509670144 00000100:00100000:2.0:1787508767.209402:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94270 00000100:00100000:2.0:1787508767.209413:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:344899:x1874324509670144:12345-192.168.201.30@tcp:101:lockahead_test.0 00010000:00010000:2.0:1787508767.209433:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508767.209457:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f361a0 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaecd0 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508767.209518:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f361a7 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508767.209532:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f361a7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508767.209543:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f361a7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508767.209587:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a2:0x28c:0x0]: returning size 4096 00000004:00200000:2.0:1787508767.209591:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787508767.209630:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f361a0 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecd0 expref: 13 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508767.209651:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f361a7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecd0 expref: 12 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508767.209660:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28c:0x0].0x0 (ffff9090e33ff700) 00010000:00010000:2.0:1787508767.209663:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508767.209666:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab200, rc 0) 00000100:00100000:2.0:1787508767.209726:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:344899:x1874324509670144:12345-192.168.201.30@tcp:101:lockahead_test.0 Request processed in 315us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508767.209734:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94270 00000100:00100000:2.0:1787508767.220351:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508767.221177:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509670400 00000100:00100000:3.0:1787508767.221189:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509670400 00000100:00100000:3.0:1787508767.221255:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94271 00000100:00100000:3.0:1787508767.221266:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:344899:x1874324509670400:12345-192.168.201.30@tcp:101:lockahead_test.0 00010000:00010000:3.0:1787508767.221285:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508767.221308:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f361ae lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaecd7 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.221386:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f361b5 lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.221400:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f361b5 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.221411:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f361b5 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.221421:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f361bc lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.221427:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f361bc lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.221433:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f361bc lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.221536:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f361c3 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1273:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.221544:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f361c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1273:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.221551:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f361c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1273:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.221631:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f361b5 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.221639:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f361b5 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.221644:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f361b5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.221651:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f361b5 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.221657:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508767.221661:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f361b5 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.221669:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f361b5 lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.221682:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28c:0x0].0x0 (ffff9090e33ff700) 00010000:00010000:3.0:1787508767.221684:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508767.221688:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f361b5 lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.221694:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f361b5 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.221708:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f361bc lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.221713:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f361bc lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.221718:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f361bc lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.221722:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ec00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508767.221725:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f361bc lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.221731:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f361bc lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.221738:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28c:0x0].0x97f25b81 (ffff9090cc088f00) 00010000:00010000:3.0:1787508767.221741:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508767.221743:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f361bc lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.221748:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f361bc lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.221784:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f361ae lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecd7 expref: 15 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.221798:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f361c3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1273:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecd7 expref: 14 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508767.221816:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1273:0x0].0x0 (ffff9090cc088000) 00010000:00010000:3.0:1787508767.221820:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787508767.221823:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fc00, rc 0) 00000100:00100000:3.0:1787508767.221893:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:344899:x1874324509670400:12345-192.168.201.30@tcp:101:lockahead_test.0 Request processed in 628us (1551us total) trans 12884944250 rc 0/0 00000100:00100000:3.0:1787508767.221901:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94271 00000100:00100000:3.0:1787508767.225594:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508767.225969:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509670528 00000100:00100000:0.0:1787508767.225979:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509670528 00000100:00100000:0.0:1787508767.226197:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15080 00000100:00100000:0.0:1787508767.226210:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2401:x1874324509670528:12345-192.168.201.30@tcp:101:lockahead_test.0 00010000:00010000:0.0:1787508767.226228:0:203726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508767.226250:0:203726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fe407b7/0xb126349c40f361d1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaecde expref: -99 pid: 203726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787508767.226276:0:203726:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1530:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787508767.226300:0:203726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1530:0x0].0x0 since=13738s v=(0 0) 00010000:00010000:0.0:1787508767.226305:0:203726:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1530:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787508767.226311:0:203726:0:(ldlm_extent.c:378:ldlm_extent_policy()) ### Not expanding manually requested lock ns: filter-lustre-OST0000_UUID lock: 000000009fe407b7/0xb126349c40f361d1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000020000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecde expref: 7 pid: 203726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.226322:0:203726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fe407b7/0xb126349c40f361d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000020000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecde expref: 7 pid: 203726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.226337:0:203726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009fe407b7/0xb126349c40f361d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000020000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecde expref: 7 pid: 203726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.226350:0:203726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5600, rc 0) 00000100:00080000:1.0:1787508767.226499:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787508767.226573:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2401:x1874324509670528:12345-192.168.201.30@tcp:101:lockahead_test.0 Request processed in 366us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508767.226580:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15080 00010000:00010000:2.0:1787508767.290378:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508767.355908:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508767.356064:0:225834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509670656 00000100:00100000:0.0:1787508767.356076:0:225834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509670656 00000100:00100000:0.0:1787508767.356144:0:225834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15081 00000100:00100000:0.0:1787508767.356155:0:225834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2400:x1874324509670656:12345-192.168.201.30@tcp:101:lockahead_test.0 00010000:00010000:0.0:1787508767.356173:0:225834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508767.356195:0:225834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8508683/0xb126349c40f361d8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaece5 expref: -99 pid: 225834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.356223:0:225834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1530:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787508767.356227:0:225834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1530:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787508767.356233:0:225834:0:(ldlm_extent.c:378:ldlm_extent_policy()) ### Not expanding manually requested lock ns: filter-lustre-OST0000_UUID lock: 00000000b8508683/0xb126349c40f361d8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000020000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaece5 expref: 8 pid: 225834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.356243:0:225834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8508683/0xb126349c40f361d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000020000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaece5 expref: 8 pid: 225834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.356258:0:225834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b8508683/0xb126349c40f361d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000020000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaece5 expref: 8 pid: 225834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.356271:0:225834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4000, rc 0) 00000100:00100000:2.0:1787508767.363501:0:225834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2400:x1874324509670656:12345-192.168.201.30@tcp:101:lockahead_test.0 Request processed in 7333us (7588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508767.363517:0:225834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15081 00000100:00100000:2.0:1787508767.457702:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508767.461369:0:208928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509670784 00000100:00100000:0.0:1787508767.461389:0:208928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509670784 00000100:00100000:1.0:1787508767.461664:0:208928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15082 00000100:00100000:1.0:1787508767.461677:0:208928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2401:x1874324509670784:12345-192.168.201.30@tcp:101:lockahead_test.0 00010000:00010000:1.0:1787508767.461698:0:208928:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508767.461718:0:208928:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045f06e9a/0xb126349c40f361df lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1530:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaecec expref: -99 pid: 208928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508767.461782:0:208928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce780e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:208928:1874324480232576:192.168.201.30@tcp:106: 00000100:00100000:1.0:1787508767.461903:0:208928:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1967180 going to sleep for 11 seconds 00000100:00080000:3.0:1787508767.462834:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787508767.478121:0:208928:0:(ldlm_lockd.c:784:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: 00000000b8508683/0xb126349c40f361d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000020000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaece5 expref: 7 pid: 225834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508767.478163:0:208928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce780e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:208928:1874324480232576:192.168.201.30@tcp:106: 00010000:00010000:2.0:1787508767.478200:0:208928:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000045f06e9a/0xb126349c40f361df lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1530:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecec expref: 7 pid: 208928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508767.478426:0:208928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045f06e9a/0xb126349c40f361df lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1530:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecec expref: 7 pid: 208928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508767.478441:0:208928:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ac00, rc 0) 00000100:00100000:2.0:1787508767.478712:0:208928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2401:x1874324509670784:12345-192.168.201.30@tcp:101:lockahead_test.0 Request processed in 17037us (21018us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508767.478730:0:208928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15082 00000100:00100000:2.0:1787508767.485011:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508767.485101:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509670912 00000100:00100000:0.0:1787508767.485113:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509670912 00000100:00100000:0.0:1787508767.485183:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15083 00000100:00100000:0.0:1787508767.485195:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2400:x1874324509670912:12345-192.168.201.30@tcp:101:lockahead_test.0 00010000:00010000:0.0:1787508767.485215:0:225841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508767.485234:0:225841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000928b6167/0xb126349c40f361e6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1530:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaecf3 expref: -99 pid: 225841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508767.485300:0:225841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:225841:1874324480232704:192.168.201.30@tcp:106: 00000100:00100000:0.0:1787508767.485398:0:225841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d46c6240 going to sleep for 11 seconds 00010000:00010000:0.0:1787508767.490539:0:225841:0:(ldlm_lockd.c:784:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: 00000000b8508683/0xb126349c40f361d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000020000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaece5 expref: 9 pid: 225834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508767.490694:0:225841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:225841:1874324480232704:192.168.201.30@tcp:106: 00010000:00010000:0.0:1787508767.490792:0:225841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000928b6167/0xb126349c40f361e6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1530:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecf3 expref: 9 pid: 225841 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.490827:0:225841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000928b6167/0xb126349c40f361e6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1530:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecf3 expref: 9 pid: 225841 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508767.490842:0:225841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4200, rc 0) 00000100:00100000:0.0:1787508767.491136:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2400:x1874324509670912:12345-192.168.201.30@tcp:101:lockahead_test.0 Request processed in 5940us (6134us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508767.491145:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15083 00000100:00100000:1.0:1787508767.502031:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508767.502241:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509671168 00000100:00100000:2.0:1787508767.502251:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509671168 00000100:00100000:2.0:1787508767.502313:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15495 00000100:00100000:2.0:1787508767.502323:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:344899:x1874324509671168:12345-192.168.201.30@tcp:35:lockahead_test.0 00000100:00100000:2.0:1787508767.502667:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:344899:x1874324509671168:12345-192.168.201.30@tcp:35:lockahead_test.0 Request processed in 343us (644us total) trans 12884944251 rc 0/0 00000100:00100000:2.0:1787508767.502676:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15495 00000100:00100000:3.0:1787508767.507284:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508767.507536:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509671424 00000100:00100000:2.0:1787508767.507545:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509671424 00000100:00100000:2.0:1787508767.507616:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15496 00000100:00100000:2.0:1787508767.507628:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:344899:x1874324509671424:12345-192.168.201.30@tcp:35:lockahead_test.0 00000100:00100000:2.0:1787508767.508174:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:344899:x1874324509671424:12345-192.168.201.30@tcp:35:lockahead_test.0 Request processed in 546us (898us total) trans 12884944252 rc 0/0 00000100:00100000:2.0:1787508767.508183:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15496 00010000:00010000:0.0:1787508768.315447:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508768.872519:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508768.872574:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508768.872612:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508768.872631:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508768.872645:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509671808 00000100:00100000:3.0:1787508768.872646:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508768.872654:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509671808 00000100:00100000:3.0:1787508768.872661:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508768.872679:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508768.872695:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508768.872806:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508768.872979:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509671552 00000100:00100000:0.0:1787508768.872984:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509671552 00000100:00100000:0.0:1787508768.873020:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1038 00000100:00100000:0.0:1787508768.873029:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091cbbc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2401:x1874324509671552:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508768.873100:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091cbbc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2401:x1874324509671552:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 71us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508768.873111:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1038 00000100:00100000:0.0:1787508768.873144:0:208927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509672064 00000100:00100000:0.0:1787508768.873147:0:208927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509672064 00000100:00100000:0.0:1787508768.873172:0:208927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509672576 00000100:00100000:0.0:1787508768.873175:0:208927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509672576 00000100:00100000:0.0:1787508768.873191:0:208927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509671936 00000100:00100000:0.0:1787508768.873195:0:208927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509671936 00000100:00100000:0.0:1787508768.873225:0:208927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509672448 00000100:00100000:0.0:1787508768.873228:0:208927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509672448 00000100:00100000:0.0:1787508768.873249:0:208927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2494 00000100:00100000:0.0:1787508768.873256:0:208927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2401:x1874324509672064:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508768.873286:0:208927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2401:x1874324509672064:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 31us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508768.873293:0:208927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2494 00000100:00100000:0.0:1787508768.873304:0:208927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2495 00000100:00100000:0.0:1787508768.873311:0:208927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2401:x1874324509672576:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508768.873331:0:208927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2401:x1874324509672576:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508768.873337:0:208927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2495 00000100:00100000:0.0:1787508768.873347:0:208927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2496 00000100:00100000:0.0:1787508768.873352:0:208927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2401:x1874324509671936:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508768.873373:0:208927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2401:x1874324509671936:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508768.873379:0:208927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2496 00000100:00100000:0.0:1787508768.873390:0:208927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2497 00000100:00100000:0.0:1787508768.873398:0:208927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2401:x1874324509672448:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508768.873420:0:208927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2401:x1874324509672448:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508768.873426:0:208927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2497 00000100:00080000:0.0:1787508768.873444:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787508768.873449:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787508768.880629:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509672320 00000100:00100000:1.0:1787508768.880646:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509672320 00000100:00100000:1.0:1787508768.880700:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509671680 00000100:00100000:1.0:1787508768.880704:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509671680 00000100:00100000:1.0:1787508768.880720:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509672192 00000100:00100000:1.0:1787508768.880722:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509672192 00000100:00100000:1.0:1787508768.880753:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3142 00000100:00100000:1.0:1787508768.880762:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:2401:x1874324509671808:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508768.880850:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:2401:x1874324509671808:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 89us (8276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508768.880857:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3142 00000100:00100000:1.0:1787508768.880874:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3143 00000100:00100000:1.0:1787508768.880880:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2401:x1874324509672320:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508768.880902:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2401:x1874324509672320:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (8270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508768.880908:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3143 00000100:00100000:1.0:1787508768.880919:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3144 00000100:00100000:1.0:1787508768.880925:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:2401:x1874324509671680:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508768.880967:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:2401:x1874324509671680:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 42us (8304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508768.880973:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3144 00000100:00100000:1.0:1787508768.880985:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3145 00000100:00100000:1.0:1787508768.880991:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2401:x1874324509672192:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508768.881011:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2401:x1874324509672192:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (8315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508768.881017:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3145 00000100:00080000:1.0:1787508768.881051:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787508769.339249:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508769.466763:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787508769.466801:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480232832:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787508769.466874:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508769.467276:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787508769.467289:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480232960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787508769.467324:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508769.467411:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480232832 00000100:00100000:2.0:1787508769.467419:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480232832 00000100:00100000:2.0:1787508769.467501:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480232960 00000100:00100000:2.0:1787508769.467504:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480232960 00000100:00100000:2.0:1787508769.467532:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1745 00000100:00100000:2.0:1787508769.467550:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480232832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787508769.467580:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 131576384 pending 0 free 3881955328 avail 3650433024 00000100:00100000:2.0:1787508769.467631:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480232832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508769.467633:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1746 00000100:00100000:2.0:1787508769.467638:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1745 00000100:00100000:1.0:1787508769.467642:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480232960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787508769.467653:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 131576384 pending 0 free 3881955328 avail 3650433024 00000100:00100000:2.0:1787508769.467683:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480232832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787508769.467686:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480232960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508769.467691:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1746 00000100:00100000:0.0:1787508769.468071:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480232960:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787508769.468092:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787508770.363437:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508770.490302:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79de3f65-4bad-42d0-a46f-842a654b33a0:3617:1874324480233088:0@lo:400:kworker.0 00000100:00100000:3.0:1787508770.490379:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480233344:0@lo:400:kworker.0 00000100:00100000:3.0:1787508770.490431:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508770.490479:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480233856:0@lo:400:kworker.0 00000100:00100000:1.0:1787508770.490500:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508770.490503:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508770.490521:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480234368:0@lo:400:kworker.0 00000100:00100000:3.0:1787508770.490547:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508770.490572:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787508770.490577:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480233216:0@lo:400:kworker.0 00000100:00100000:3.0:1787508770.490604:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508770.490620:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874324480233600:0@lo:400:kworker.0 00000100:00100000:3.0:1787508770.490622:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480233728:0@lo:400:kworker.0 00000100:00100000:3.0:1787508770.490642:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508770.490645:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508770.490659:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480234240:0@lo:400:kworker.0 00000100:00100000:1.0:1787508770.490659:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480234112:0@lo:400:kworker.0 00000100:00100000:1.0:1787508770.490680:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508770.490772:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480234624:0@lo:400:kworker.0 00000100:00100000:2.0:1787508770.490786:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480233472:0@lo:400:kworker.0 00000100:00100000:1.0:1787508770.490803:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508770.490820:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508770.490841:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480233984:0@lo:400:kworker.0 00000100:00100000:1.0:1787508770.490842:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480233088 00000100:00100000:1.0:1787508770.490851:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480233088 00000100:00100000:2.0:1787508770.490862:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508770.490879:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480234496:0@lo:400:kworker.0 00000100:00100000:2.0:1787508770.490898:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508770.490910:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:1.0:1787508770.490921:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091cbbc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3617:x1874324480233088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508770.490931:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480233344 00000100:00100000:2.0:1787508770.490934:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480233344 00000100:00100000:2.0:1787508770.490997:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480233856 00000100:00100000:2.0:1787508770.491001:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480233856 00000100:00100000:1.0:1787508770.491003:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091cbbc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3617:x1874324480233088:12345-0@lo:400:kworker.0 Request processed in 83us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508770.491011:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000100:00100000:2.0:1787508770.491022:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480233472 00000100:00100000:2.0:1787508770.491025:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480233472 00000100:00100000:2.0:1787508770.491040:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480233984 00000100:00100000:2.0:1787508770.491042:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480233984 00000100:00100000:1.0:1787508770.491049:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480234368 00000100:00100000:1.0:1787508770.491053:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480234368 00000100:00100000:2.0:1787508770.491060:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2498 00000100:00100000:2.0:1787508770.491066:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480233344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508770.491080:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480233600 00000100:00100000:1.0:1787508770.491084:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480233600 00000100:00100000:2.0:1787508770.491102:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480233344:12345-0@lo:400:kworker.0 Request processed in 36us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508770.491102:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480234112 00000100:00100000:1.0:1787508770.491104:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480234112 00000100:00100000:2.0:1787508770.491109:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2498 00000100:00100000:1.0:1787508770.491115:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480234624 00000100:00100000:1.0:1787508770.491118:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480234624 00000100:00100000:2.0:1787508770.491120:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2499 00000100:00100000:2.0:1787508770.491125:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480233856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508770.491130:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480234496 00000100:00100000:1.0:1787508770.491132:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480234496 00000100:00100000:1.0:1787508770.491148:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3146 00000100:00100000:2.0:1787508770.491151:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480233856:12345-0@lo:400:kworker.0 Request processed in 26us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508770.491154:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480234368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508770.491157:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2499 00000100:00100000:2.0:1787508770.491167:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2500 00000100:00100000:2.0:1787508770.491172:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480233472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508770.491183:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480234368:12345-0@lo:400:kworker.0 Request processed in 29us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508770.491189:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3146 00000100:00100000:2.0:1787508770.491199:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480233472:12345-0@lo:400:kworker.0 Request processed in 27us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508770.491201:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3147 00000100:00100000:2.0:1787508770.491205:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2500 00000100:00100000:1.0:1787508770.491207:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874324480233600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508770.491214:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2501 00000100:00100000:2.0:1787508770.491219:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480233984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508770.491232:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874324480233600:12345-0@lo:400:kworker.0 Request processed in 25us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508770.491239:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3147 00000100:00100000:2.0:1787508770.491240:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480233984:12345-0@lo:400:kworker.0 Request processed in 22us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508770.491246:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2501 00000100:00100000:1.0:1787508770.491249:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3148 00000100:00100000:1.0:1787508770.491255:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480234112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508770.491267:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3149 00000100:00100000:2.0:1787508770.491274:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480234624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508770.491278:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480234112:12345-0@lo:400:kworker.0 Request processed in 24us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508770.491284:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3148 00000100:00100000:1.0:1787508770.491296:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3150 00000100:00100000:2.0:1787508770.491299:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480234624:12345-0@lo:400:kworker.0 Request processed in 26us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508770.491302:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480234496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508770.491305:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3149 00000100:00080000:2.0:1787508770.491325:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787508770.491326:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480234496:12345-0@lo:400:kworker.0 Request processed in 24us (427us total) trans 0 rc 0/0 00000100:00080000:2.0:1787508770.491329:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787508770.491332:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3150 00000100:00080000:2.0:1787508770.491333:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787508770.491379:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480233472:0@lo:400:kworker.0 00000100:00100000:1.0:1787508770.491379:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874324480233600:0@lo:400:kworker.0 00000100:00100000:2.0:1787508770.491390:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480233984:0@lo:400:kworker.0 00000100:00100000:2.0:1787508770.491399:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480234496:0@lo:400:kworker.0 00000100:00100000:1.0:1787508770.491493:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480234112:0@lo:400:kworker.0 00000100:00100000:1.0:1787508770.491503:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480234624:0@lo:400:kworker.0 00000100:00100000:1.0:1787508770.491511:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79de3f65-4bad-42d0-a46f-842a654b33a0:3617:1874324480233088:0@lo:400:kworker.0 00000100:00100000:3.0:1787508770.493452:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508770.493525:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480233344:0@lo:400:kworker.0 00000100:00100000:3.0:1787508770.493541:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480233856:0@lo:400:kworker.0 00000100:00100000:3.0:1787508770.493555:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480234368:0@lo:400:kworker.0 00000100:00100000:3.0:1787508770.493605:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480233216 00000100:00100000:3.0:1787508770.493612:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480233216 00000100:00100000:1.0:1787508770.493684:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480233728 00000100:00100000:1.0:1787508770.493690:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480233728 00000100:00100000:3.0:1787508770.493727:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29956 00000100:00100000:1.0:1787508770.493734:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29957 00000100:00100000:3.0:1787508770.493737:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3619:x1874324480233216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508770.493740:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3619:x1874324480233728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508770.493835:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480234240 00000100:00100000:2.0:1787508770.493839:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480234240 00000100:00100000:2.0:1787508770.493895:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3151 00000100:00100000:2.0:1787508770.493902:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480234240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508770.493959:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3619:x1874324480233728:12345-0@lo:400:kworker.0 Request processed in 201us (3298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508770.493966:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3619:x1874324480233216:12345-0@lo:400:kworker.0 Request processed in 205us (3336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508770.493966:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29957 00000100:00100000:3.0:1787508770.493972:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29956 00000100:00100000:3.0:1787508770.494027:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480233216:0@lo:400:kworker.0 00000100:00100000:3.0:1787508770.494036:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480233728:0@lo:400:kworker.0 00000100:00080000:3.0:1787508770.494063:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787508770.496361:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480234240:12345-0@lo:400:kworker.0 Request processed in 2446us (2900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508770.496379:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3151 00000100:00100000:2.0:1787508770.496506:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480234240:0@lo:400:kworker.0 00000100:00100000:3.0:1787508770.616571:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508770.616817:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509672832 00000100:00100000:1.0:1787508770.616831:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509672832 00000100:00100000:1.0:1787508770.616972:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94272 00000100:00100000:1.0:1787508770.616985:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:344911:x1874324509672832:12345-192.168.201.30@tcp:36:lockahead_test.0 00010000:00010000:1.0:1787508770.617060:0:203348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508770.617096:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3615a lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1273:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecb4 expref: 15 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508770.617119:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1273:0x0].0x0 (ffff9090cc088000) 00010000:00010000:1.0:1787508770.617125:0:203348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787508770.617157:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f361ed lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508770.617178:0:203348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f361a7 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecd0 expref: 14 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508770.617189:0:203348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f361ed lrc: 4/0,1 mode: --/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508770.617237:0:203348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f361a7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecd0 expref: 14 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508770.617253:0:203348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f361a7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecd0 expref: 14 pid: 202226 timeout: 13841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508770.617269:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:203348:1874324480234752:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508770.617372:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d764d0c0 going to sleep for 11 seconds 00000100:00080000:3.0:1787508770.622165:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787508770.624992:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508770.625036:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509672960 00000100:00100000:3.0:1787508770.625048:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509672960 00010000:00010000:3.0:1787508770.625116:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f361a7 lrc: 5/0,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecd0 expref: 15 pid: 202226 timeout: 13841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508770.625163:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27969 00000100:00100000:3.0:1787508770.625175:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2401:x1874324509672960:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508770.625195:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508770.625203:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f361a7 lrc: 5/0,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecd0 expref: 15 pid: 202226 timeout: 13841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.625220:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f361a7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecd0 expref: 15 pid: 202226 timeout: 13841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.625248:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28c:0x0].0x0 (ffff9090e33ff700) 00010000:00010000:3.0:1787508770.625254:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f361ed lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.625266:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f361ed lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.625275:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f361ed lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.625298:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508770.625364:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2401:x1874324509672960:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 190us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508770.625372:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27969 00000100:00080000:3.0:1787508770.625475:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787508770.625864:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f361a7 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecd0 expref: 14 pid: 202226 timeout: 13841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508770.625889:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:203348:1874324480234752:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508770.625919:0:203348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f361ed lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.625930:0:203348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f361ed lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.625936:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f361ed lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.625981:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f361f4 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.625998:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f361f4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.626007:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f361f4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.626133:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f361fb lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x1273:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.626144:0:203348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f361c3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x1273:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecd7 expref: 13 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.626153:0:203348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f361fb lrc: 4/0,1 mode: --/EX res: [0x2000013a4:0x1273:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.626191:0:203348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f361c3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1273:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecd7 expref: 13 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.626208:0:203348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f361c3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1273:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecd7 expref: 13 pid: 203348 timeout: 13841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508770.626223:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a84e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:203348:1874324480234880:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508770.626309:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d46c6180 going to sleep for 11 seconds 00000100:00100000:1.0:1787508770.635511:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508770.635623:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509673088 00000100:00100000:3.0:1787508770.635637:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509673088 00010000:00010000:3.0:1787508770.635705:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f361c3 lrc: 5/0,0 mode: PR/PR res: [0x2000013a4:0x1273:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecd7 expref: 14 pid: 203348 timeout: 13841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508770.635768:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27970 00000100:00100000:3.0:1787508770.635781:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2400:x1874324509673088:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508770.635802:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508770.635810:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f361c3 lrc: 5/0,0 mode: PR/PR res: [0x2000013a4:0x1273:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecd7 expref: 14 pid: 203348 timeout: 13841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.635829:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f361c3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1273:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecd7 expref: 14 pid: 203348 timeout: 13841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.635858:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1273:0x0].0x0 (ffff9090cc088000) 00010000:00010000:3.0:1787508770.635864:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f361fb lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x1273:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.635875:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f361fb lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1273:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.635883:0:202212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f361fb lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x1273:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.635907:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508770.636012:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2400:x1874324509673088:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 232us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508770.636021:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27970 00010000:00010000:0.0:1787508770.637855:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f361c3 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1273:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecd7 expref: 13 pid: 203348 timeout: 13841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508770.637885:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a84e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:203348:1874324480234880:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508770.637924:0:203348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f361fb lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1273:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.637936:0:203348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f361fb lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1273:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.641637:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f361fb lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1273:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787508770.642300:0:203348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2341, 64 off158016 00000004:00080000:0.0:1787508770.642315:0:203348:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 13741687373805ns, next at 13742687370233ns, rc = 0 00010000:00010000:0.0:1787508770.642405:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f36202 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1273:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.642424:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f36202 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1273:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.642438:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f36202 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1273:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.642447:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f36202 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x1273:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.642455:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f36202 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x1273:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.642463:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f36202 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1273:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.642827:0:203348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787508770.642859:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f361fb lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1273:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.642872:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f361fb lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x1273:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.642880:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f361fb lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1273:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.642886:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508770.642891:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f361fb lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1273:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.642900:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f361fb lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x1273:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.642915:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1273:0x0].0x0 (ffff9090cc088000) 00010000:00010000:0.0:1787508770.642918:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787508770.642924:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f361fb lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x1273:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.642931:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f361fb lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x1273:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.642994:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f361ed lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.643001:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f361ed lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.643008:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f361ed lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.643014:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f361ed lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.643021:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508770.643023:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f361ed lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.643029:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f361ed lrc: 5/0,0 mode: CW/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.643038:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28c:0x0].0x0 (ffff9090e33ff700) 00010000:00010000:0.0:1787508770.643040:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508770.643044:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f361ed lrc: 3/0,0 mode: --/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.643050:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a200/0xb126349c40f361ed lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508770.643070:0:203348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cbaa04cf reply state 00000000b5b2c9a3 transno 12884944253 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f361f4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.643083:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f361f4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.643090:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28c:0x0].0x97f25b81 (ffff9090cc088f00) 00010000:00010000:0.0:1787508770.643092:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787508770.643095:0:203348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787508770.643224:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:344911:x1874324509672832:12345-192.168.201.30@tcp:36:lockahead_test.0 Request processed in 26234us (26675us total) trans 12884944253 rc 0/0 00000100:00100000:0.0:1787508770.643235:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94272 00010000:00010000:3.0:1787508770.645483:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787508770.645639:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f36202 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x1273:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.645657:0:204785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4600 already unused, calling callback (ffffffffc0d0a230) 00010000:00010000:3.0:1787508770.645783:0:204785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f36202 lrc: 2/0,0 mode: PW/PW res: [0x2000013a4:0x1273:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.645794:0:204785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f36202 lrc: 3/0,0 mode: PW/PW res: [0x2000013a4:0x1273:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.645818:0:204785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1273:0x0].0x0 (ffff9090cc088000) 00010000:00010000:3.0:1787508770.645822:0:204785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787508770.645827:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f36202 lrc: 1/0,0 mode: --/PW res: [0x2000013a4:0x1273:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.645834:0:204785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f36202 lrc: 0/0,0 mode: --/PW res: [0x2000013a4:0x1273:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.645860:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508770.645862:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508770.645864:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508770.646880:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508770.647248:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509673216 00000100:00100000:3.0:1787508770.647328:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509673216 00000100:00100000:3.0:1787508770.647469:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94273 00000100:00100000:3.0:1787508770.647483:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:344911:x1874324509673216:12345-192.168.201.30@tcp:101:lockahead_test.0 00010000:00010000:3.0:1787508770.647530:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508770.647569:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6244000/0xb126349c40f36209 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaecfa expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.647673:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f36210 lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.647698:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f36210 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.647712:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f36210 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.647724:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36217 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.647733:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36217 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.647739:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36217 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.647801:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f36210 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.647810:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f36210 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.647817:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f36210 lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.647825:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f36210 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.647831:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d6245000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508770.647836:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f36210 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.647848:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f36210 lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.647864:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28c:0x0].0x0 (ffff9090cc088a00) 00010000:00010000:3.0:1787508770.647867:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508770.647873:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f36210 lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.647879:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f36210 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.647895:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36217 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.647902:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36217 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.647908:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36217 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.647913:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d6245e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508770.647916:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36217 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.647922:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36217 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.647931:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28c:0x0].0x97f25b81 (ffff9090cc088f00) 00010000:00010000:3.0:1787508770.647934:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508770.647936:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36217 lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.647989:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36217 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.648030:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6244000/0xb126349c40f36209 lrc: 1/0,0 mode: --/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecfa expref: 17 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.648043:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28c:0x0].0x0 (ffff9090cc088a00) 00010000:00010000:3.0:1787508770.648046:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508770.648051:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6244000/0xb126349c40f36209 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecfa expref: 17 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.648068:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d6244000, rc 0) 00000100:00100000:3.0:1787508770.648167:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:344911:x1874324509673216:12345-192.168.201.30@tcp:101:lockahead_test.0 Request processed in 685us (1296us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508770.648177:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94273 00000100:00100000:1.0:1787508770.652291:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508770.652446:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509673472 00000100:00100000:0.0:1787508770.652461:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509673472 00000100:00100000:0.0:1787508770.652651:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94274 00000100:00100000:0.0:1787508770.652677:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:344911:x1874324509673472:12345-192.168.201.30@tcp:101:lockahead_test.0 00010000:00010000:0.0:1787508770.652716:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508770.652759:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3621e lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaed01 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.652921:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f36225 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.652977:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f36225 lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.652993:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f36225 lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.653009:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3622c lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.653020:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3622c lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.653028:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3622c lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787508770.653479:0:202226:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x1531:0x0], index 0: 0 00010000:00010000:0.0:1787508770.654394:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f36233 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1274:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.654412:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f36233 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1274:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.654424:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f36233 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1274:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.654471:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f36225 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.654480:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f36225 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.654486:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f36225 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.655969:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f36225 lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.655990:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508770.655997:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f36225 lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.656006:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f36225 lrc: 5/0,0 mode: CW/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.656029:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28c:0x0].0x0 (ffff9090c96b8600) 00010000:00010000:0.0:1787508770.656032:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508770.656039:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f36225 lrc: 3/0,0 mode: --/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.656047:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f36225 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508770.656067:0:202226:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be504ad7 reply state 0000000052b4c56f transno 12884944254 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3622c lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.656084:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3622c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.656093:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28c:0x0].0x97f25b81 (ffff9090cc088f00) 00010000:00010000:0.0:1787508770.656096:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787508770.656100:0:202226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787508770.656166:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3621e lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed01 expref: 19 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.656191:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5800/0xb126349c40f36233 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1274:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed01 expref: 18 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.656199:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1274:0x0].0x0 (ffff9090c96b8200) 00010000:00010000:0.0:1787508770.656202:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787508770.656205:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5800, rc 0) 00000100:00100000:0.0:1787508770.656310:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+19:344911:x1874324509673472:12345-192.168.201.30@tcp:101:lockahead_test.0 Request processed in 3646us (4033us total) trans 12884944254 rc 0/0 00000100:00100000:0.0:1787508770.656321:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94274 00000100:00100000:0.0:1787508770.661848:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508770.662014:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509673728 00000100:00100000:3.0:1787508770.662028:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509673728 00000100:00100000:3.0:1787508770.662103:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94275 00000100:00100000:3.0:1787508770.662117:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:344911:x1874324509673728:12345-192.168.201.30@tcp:101:lockahead_test.0 00010000:00010000:3.0:1787508770.662146:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508770.662180:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6244000/0xb126349c40f36241 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaed08 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.662286:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36248 lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.662303:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36248 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.662317:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36248 lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.662329:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f3624f lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.662338:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f3624f lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.662346:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f3624f lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.662484:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245600/0xb126349c40f36256 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1274:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.662492:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245600/0xb126349c40f36256 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1274:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.662499:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245600/0xb126349c40f36256 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1274:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.662731:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36248 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.662740:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36248 lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.662757:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36248 lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.662766:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36248 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.662773:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d6245e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508770.662779:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36248 lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.662788:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36248 lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.662803:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28c:0x0].0x0 (ffff9090cc088a00) 00010000:00010000:3.0:1787508770.662806:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508770.662812:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36248 lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.662819:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36248 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.662839:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f3624f lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.662847:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f3624f lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.662853:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f3624f lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.662859:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d6245000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508770.662862:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f3624f lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.662868:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f3624f lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.662879:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28c:0x0].0x97f25b81 (ffff9090cc088f00) 00010000:00010000:3.0:1787508770.662882:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508770.662885:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f3624f lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.662890:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f3624f lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.662935:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6244000/0xb126349c40f36241 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x28c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed08 expref: 16 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.663659:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245600/0xb126349c40f36256 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1274:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed08 expref: 15 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508770.663669:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1274:0x0].0x0 (ffff9090c96b8200) 00010000:00010000:3.0:1787508770.663671:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787508770.663675:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d6245600, rc 0) 00000100:00100000:3.0:1787508770.663867:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:344911:x1874324509673728:12345-192.168.201.30@tcp:101:lockahead_test.0 Request processed in 1751us (2033us total) trans 12884944255 rc 0/0 00000100:00100000:3.0:1787508770.663878:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94275 00000100:00100000:1.0:1787508770.676333:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508770.676415:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509673856 00000100:00100000:0.0:1787508770.676428:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509673856 00000100:00100000:0.0:1787508770.676519:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15084 00000100:00100000:0.0:1787508770.676532:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2401:x1874324509673856:12345-192.168.201.30@tcp:101:lockahead_test.0 00010000:00010000:0.0:1787508770.676557:0:225840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508770.676586:0:225840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012917839/0xb126349c40f36264 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1531:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaed0f expref: -99 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787508770.676619:0:225840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1531:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787508770.676647:0:225840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1531:0x0].0x0 since=13741s v=(0 0) 00010000:00010000:0.0:1787508770.676653:0:225840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1531:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787508770.676673:0:225840:0:(ldlm_extent.c:378:ldlm_extent_policy()) ### Not expanding manually requested lock ns: filter-lustre-OST0000_UUID lock: 0000000012917839/0xb126349c40f36264 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x1531:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000020000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed0f expref: 9 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.676688:0:225840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012917839/0xb126349c40f36264 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1531:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000020000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed0f expref: 9 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.676708:0:225840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012917839/0xb126349c40f36264 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1531:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000020000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed0f expref: 9 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508770.676723:0:225840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5400, rc 0) 00000100:00100000:0.0:1787508770.676809:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2401:x1874324509673856:12345-192.168.201.30@tcp:101:lockahead_test.0 Request processed in 279us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508770.676817:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15084 00000100:00080000:3.0:1787508770.677629:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508770.813825:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508770.814078:0:225835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509673984 00000100:00100000:2.0:1787508770.814092:0:225835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509673984 00000100:00100000:2.0:1787508770.814175:0:225835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15085 00000100:00100000:2.0:1787508770.814190:0:225835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0874a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2401:x1874324509673984:12345-192.168.201.30@tcp:101:lockahead_test.0 00010000:00010000:2.0:1787508770.814213:0:225835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508770.814241:0:225835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000650db6b/0xb126349c40f3626b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1531:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaed16 expref: -99 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508770.814277:0:225835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1531:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787508770.814283:0:225835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1531:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787508770.814290:0:225835:0:(ldlm_extent.c:378:ldlm_extent_policy()) ### Not expanding manually requested lock ns: filter-lustre-OST0000_UUID lock: 000000000650db6b/0xb126349c40f3626b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x1531:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000020000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed16 expref: 10 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508770.814558:0:225835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000650db6b/0xb126349c40f3626b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1531:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000020000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed16 expref: 10 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508770.814575:0:225835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000650db6b/0xb126349c40f3626b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1531:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000020000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed16 expref: 10 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508770.814588:0:225835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa200, rc 0) 00000100:00100000:2.0:1787508770.814662:0:225835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0874a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2401:x1874324509673984:12345-192.168.201.30@tcp:101:lockahead_test.0 Request processed in 476us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508770.814670:0:225835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15085 00000100:00100000:0.0:1787508770.916573:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508770.916684:0:208927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509674112 00000100:00100000:2.0:1787508770.916698:0:208927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509674112 00000100:00080000:3.0:1787508770.916791:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787508770.916811:0:208927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15086 00000100:00100000:2.0:1787508770.916825:0:208927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2401:x1874324509674112:12345-192.168.201.30@tcp:101:lockahead_test.0 00010000:00010000:2.0:1787508770.916850:0:208927:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508770.916875:0:208927:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093cbe2e9/0xb126349c40f36272 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1531:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaed1d expref: -99 pid: 208927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508770.916988:0:208927:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:208927:1874324480235008:192.168.201.30@tcp:106: 00000100:00100000:2.0:1787508770.917122:0:208927:0:(client.c:2715:ptlrpc_set_wait()) set ffff9091fd21a3c0 going to sleep for 11 seconds 00002000:00010000:2.0:1787508770.925778:0:208927:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000401:0x1531:0x0] updating lvb size: 0 -> 1048576 00002000:00010000:2.0:1787508770.925794:0:208927:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000401:0x1531:0x0] updating lvb mtime: 0 -> 1787508771 00002000:00010000:2.0:1787508770.925797:0:208927:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0x1531:0x0] updating lvb atime: 0 -> 1787508771 00002000:00010000:2.0:1787508770.925801:0:208927:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000401:0x1531:0x0] updating lvb ctime: 0 -> 1787508771 00002000:00010000:2.0:1787508770.925803:0:208927:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x280000401:0x1531:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:2.0:1787508770.925839:0:208927:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:208927:1874324480235008:192.168.201.30@tcp:106: 00010000:00010000:2.0:1787508770.925889:0:208927:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000093cbe2e9/0xb126349c40f36272 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1531:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed1d expref: 7 pid: 208927 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508770.925925:0:208927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093cbe2e9/0xb126349c40f36272 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1531:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed1d expref: 7 pid: 208927 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508770.925979:0:208927:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abe00, rc 0) 00000100:00100000:2.0:1787508770.926074:0:208927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2401:x1874324509674112:12345-192.168.201.30@tcp:101:lockahead_test.0 Request processed in 9250us (9512us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508770.926085:0:208927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15086 00000100:00100000:1.0:1787508770.939120:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508770.939513:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509674240 00000100:00100000:0.0:1787508770.939528:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509674240 00000100:00100000:0.0:1787508770.939631:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15087 00000100:00100000:0.0:1787508770.939643:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2402:x1874324509674240:12345-192.168.201.30@tcp:101:lockahead_test.0 00010000:00010000:0.0:1787508770.939667:0:225837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508770.939691:0:225837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000928b6167/0xb126349c40f36279 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1531:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaed24 expref: -99 pid: 225837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508770.940858:0:225837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a85c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:225837:1874324480235136:192.168.201.30@tcp:106: 00000100:00100000:0.0:1787508770.941013:0:225837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d46c6900 going to sleep for 11 seconds 00000100:00100000:2.0:1787508770.953060:0:225837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a85c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:225837:1874324480235136:192.168.201.30@tcp:106: 00010000:00010000:2.0:1787508770.953126:0:225837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000928b6167/0xb126349c40f36279 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1531:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed24 expref: 11 pid: 225837 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508770.953160:0:225837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000928b6167/0xb126349c40f36279 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1531:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed24 expref: 11 pid: 225837 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508770.953177:0:225837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4200, rc 0) 00000100:00100000:2.0:1787508770.953286:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2402:x1874324509674240:12345-192.168.201.30@tcp:101:lockahead_test.0 Request processed in 13644us (14180us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508770.953298:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15087 00000100:00100000:1.0:1787508770.962911:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508770.970997:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509674496 00000100:00100000:2.0:1787508770.971020:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509674496 00000100:00100000:3.0:1787508770.971261:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15497 00000100:00100000:3.0:1787508770.971276:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+19:344911:x1874324509674496:12345-192.168.201.30@tcp:35:lockahead_test.0 00000100:00100000:3.0:1787508770.971726:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:344911:x1874324509674496:12345-192.168.201.30@tcp:35:lockahead_test.0 Request processed in 451us (8828us total) trans 12884944256 rc 0/0 00000100:00100000:3.0:1787508770.971740:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15497 00000100:00100000:1.0:1787508770.984713:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508770.984879:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509674752 00000100:00100000:2.0:1787508770.984893:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509674752 00000100:00100000:2.0:1787508770.984988:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15498 00000100:00100000:2.0:1787508770.985000:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:344911:x1874324509674752:12345-192.168.201.30@tcp:35:lockahead_test.0 00000100:00100000:2.0:1787508770.985315:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:344911:x1874324509674752:12345-192.168.201.30@tcp:35:lockahead_test.0 Request processed in 315us (615us total) trans 12884944257 rc 0/0 00000100:00100000:2.0:1787508770.985325:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15498 00000100:00100000:0.0:1787508771.002422:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480235264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787508771.002532:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508771.002669:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480235264 00000100:00100000:2.0:1787508771.002679:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480235264 00000100:00100000:2.0:1787508771.002761:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1747 00000100:00100000:2.0:1787508771.002773:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480235264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787508771.002816:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49603136 pending 0 free 3909767168 avail 3678244864 00000100:00100000:2.0:1787508771.002886:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480235264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508771.002893:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1747 00000100:00100000:1.0:1787508771.003058:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480235264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787508771.003403:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787508771.003414:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480235392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787508771.003449:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508771.003553:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480235392 00000100:00100000:1.0:1787508771.003559:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480235392 00000100:00100000:1.0:1787508771.003599:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1748 00000100:00100000:1.0:1787508771.003608:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480235392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787508771.003626:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49603136 pending 0 free 3909767168 avail 3678244864 00000100:00100000:1.0:1787508771.003679:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480235392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508771.003685:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1748 00000100:00100000:0.0:1787508771.004186:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480235392:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787508771.386248:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787508771.390894:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944257 is committed 00000001:00080000:3.0:1787508771.390930:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944256 is committed 00000004:00080000:3.0:1787508771.390976:0:202206:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 277 committed 00000001:00080000:3.0:1787508771.391001:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944248 is committed 00010000:00010000:1.0:1787508771.391126:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36153 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508771.391140:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36153 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508771.391150:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36153 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508771.391158:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ee00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508771.391163:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36153 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508771.391172:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36153 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508771.391189:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28c:0x0].0x97f25b81 (ffff9090cc088f00) 00010000:00010000:1.0:1787508771.391193:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508771.391198:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36153 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508771.391205:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36153 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508771.391226:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f361f4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508771.391233:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f361f4 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508771.391239:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f361f4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508771.391245:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508771.391248:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f361f4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508771.391259:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f361f4 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508771.391268:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28c:0x0].0x97f25b81 (ffff9090cc088f00) 00010000:00010000:1.0:1787508771.391271:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508771.391273:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f361f4 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508771.391279:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f361f4 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508771.391292:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3622c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508771.391299:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3622c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508771.391306:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3622c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508771.391322:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508771.391326:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3622c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508771.391329:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1787508771.391334:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3622c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508771.391345:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28c:0x0].0x97f25b81 (ffff9090cc088f00) 00010000:00010000:1.0:1787508771.391349:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508771.391353:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3622c lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508771.391360:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480235520:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787508771.391365:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f3622c lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x28c:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508771.391476:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508771.392142:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480235520 00000100:00100000:1.0:1787508771.392155:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480235520 00000100:00100000:1.0:1787508771.392218:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15088 00000100:00100000:1.0:1787508771.392228:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480235520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787508771.392260:0:225831:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5424 count 1 00010000:00010000:1.0:1787508771.392286:0:225831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003209cef6/0xb126349c40f36280 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508771.392597:0:225831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009fe407b7/0xb126349c40f361d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000020000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecde expref: 9 pid: 203726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508771.392611:0:225831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b8508683/0xb126349c40f361d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000020000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaece5 expref: 9 pid: 225834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508771.392756:0:225831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 2 to [0x280000401:0x1530:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1787508771.392762:0:225831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1530:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1787508771.392768:0:225831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003209cef6/0xb126349c40f36280 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508771.392806:0:225831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b8508683/0xb126349c40f361d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000020010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaece5 expref: 9 pid: 225834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508771.392823:0:225831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b8508683/0xb126349c40f361d8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x70000420010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaece5 expref: 9 pid: 225834 timeout: 13842 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508771.392839:0:225831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0875c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:225831:1874324480235648:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508771.392969:0:225831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009fe407b7/0xb126349c40f361d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000020010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecde expref: 9 pid: 203726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508771.392980:0:225831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009fe407b7/0xb126349c40f361d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x70000420010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecde expref: 9 pid: 203726 timeout: 13842 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508771.392991:0:225831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0875880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:225831:1874324480235776:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508771.396867:0:225831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d764d780 going to sleep for 11 seconds 00000100:00100000:0.0:1787508771.402906:0:225831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0875c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:225831:1874324480235648:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508771.402920:0:225831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0875880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:225831:1874324480235776:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508771.402993:0:225831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003209cef6/0xb126349c40f36280 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508771.403779:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508771.403882:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509674880 00000100:00100000:3.0:1787508771.403891:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509674880 00010000:00010000:3.0:1787508771.403930:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b8508683/0xb126349c40f361d8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000420010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaece5 expref: 10 pid: 225834 timeout: 13842 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508771.403999:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27971 00000100:00100000:3.0:1787508771.404010:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9f18050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2401:x1874324509674880:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508771.404026:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508771.404032:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b8508683/0xb126349c40f361d8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000420010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaece5 expref: 10 pid: 225834 timeout: 13842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508771.404046:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b8508683/0xb126349c40f361d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000420010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaece5 expref: 10 pid: 225834 timeout: 13842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508771.404068:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8508683/0xb126349c40f361d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801420010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaece5 expref: 10 pid: 225834 timeout: 13842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508771.404086:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508771.404141:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9f18050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2401:x1874324509674880:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 133us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508771.404148:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27971 00000100:00100000:1.0:1787508771.409775:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508771.410448:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509675008 00000100:00100000:3.0:1787508771.410460:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509675008 00010000:00010000:3.0:1787508771.410504:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009fe407b7/0xb126349c40f361d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x60000420010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecde expref: 9 pid: 203726 timeout: 13842 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508771.410545:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27972 00000100:00100000:3.0:1787508771.410557:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0876d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2400:x1874324509675008:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508771.410574:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508771.410580:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009fe407b7/0xb126349c40f361d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x60000420010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecde expref: 9 pid: 203726 timeout: 13842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508771.410594:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009fe407b7/0xb126349c40f361d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000420010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecde expref: 9 pid: 203726 timeout: 13842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508771.410630:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fe407b7/0xb126349c40f361d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801420010020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaecde expref: 9 pid: 203726 timeout: 13842 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508771.410648:0:202211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1530:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1787508771.410652:0:202211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1530:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1787508771.410658:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003209cef6/0xb126349c40f36280 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508771.410668:0:202211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003209cef6/0xb126349c40f36280 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508771.410701:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508771.410763:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0876d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2400:x1874324509675008:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 208us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508771.410772:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27972 00010000:00010000:1.0:1787508771.410970:0:225831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003209cef6/0xb126349c40f36280 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508771.410981:0:225831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003209cef6/0xb126349c40f36280 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508771.410997:0:225831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003209cef6/0xb126349c40f36280 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508771.411005:0:225831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003209cef6/0xb126349c40f36280 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508771.411036:0:225831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787508771.411259:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3617:x1874324480235520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19032us (19783us total) trans 8589941256 rc 0/0 00000100:00100000:1.0:1787508771.411268:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15088 00000004:00080000:0.0:1787508771.411802:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9091f9a86680/2, rc 0, transno 8589941256 00000100:00100000:0.0:1787508771.411810:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480235520:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787508771.412499:0:226765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787508771.412508:0:226765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003209cef6/0xb126349c40f36280 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508771.412520:0:226765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc0d0a230) 00010000:00010000:3.0:1787508771.412525:0:226765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003209cef6/0xb126349c40f36280 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508771.412536:0:226765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003209cef6/0xb126349c40f36280 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508771.412555:0:226765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003209cef6/0xb126349c40f36280 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508771.412563:0:226765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003209cef6/0xb126349c40f36280 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1530:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508771.412585:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508771.412587:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508771.412589:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508772.026550:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787508772.026576:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480236032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787508772.026647:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508772.026707:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480236032 00000100:00100000:1.0:1787508772.026717:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480236032 00000100:00100000:1.0:1787508772.026790:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29958 00000100:00100000:1.0:1787508772.026801:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480236032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787508772.026835:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440645120 avail 1294405632 00000100:00100000:1.0:1787508772.026889:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480236032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508772.026897:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29958 00000100:00100000:0.0:1787508772.026911:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944248 gen 2 00000004:00080000:0.0:1787508772.026918:0:3619:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944248 committed transno 12884944248 00000100:00100000:0.0:1787508772.026991:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480236032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787508772.027239:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480235904:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787508772.027270:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508772.027833:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480235904 00000100:00100000:0.0:1787508772.027840:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480235904 00000100:00100000:0.0:1787508772.027886:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29959 00000100:00100000:0.0:1787508772.027894:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3617:x1874324480235904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787508772.027917:0:202232:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442721792 avail 1296482304 00000100:00100000:0.0:1787508772.027986:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3617:x1874324480235904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508772.027993:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29959 00000100:00100000:2.0:1787508772.028070:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480235904:0@lo:41:osp-pre-1-0.0 00000001:00080000:1.0:1787508772.029703:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589962080 is committed 00000020:00080000:1.0:1787508772.029719:0:202955:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9090d764de40 refcount 2 committed 0 result 0 batchid 4294998394 00000020:00080000:1.0:1787508772.029733:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cbc97000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d764d840 00000020:00080000:1.0:1787508772.029738:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a2:0x5:0x0].603 00000020:00080000:1.0:1787508772.029742:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cbc97800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090e6f7f600 00000020:00080000:1.0:1787508772.029744:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd1:0xf:0x0].59 00010000:00010000:0.0:1787508772.029788:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f3607a lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508772.029800:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f3607a lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787508772.029803:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998392 00010000:00010000:0.0:1787508772.029813:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f3607a lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508772.029820:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508772.029825:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f3607a lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508772.029832:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f3607a lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508772.029851:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13dc:0x0].0x0 (ffff9090e33ff200) 00010000:00010000:0.0:1787508772.029854:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508772.029858:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f3607a lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508772.029864:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2abc00/0xb126349c40f3607a lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787508772.029880:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589962077 is committed 00010000:00010000:0.0:1787508772.029880:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aae00/0xb126349c40f36081 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x296:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508772.029890:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aae00/0xb126349c40f36081 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x296:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787508772.029893:0:202955:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9090d764d540 refcount 2 committed 0 result 0 batchid 4294998393 00010000:00010000:0.0:1787508772.029898:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aae00/0xb126349c40f36081 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x296:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508772.029903:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508772.029906:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aae00/0xb126349c40f36081 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x296:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508772.029912:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aae00/0xb126349c40f36081 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x296:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508772.029919:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x296:0x0].0x0 (ffff9090e33fff00) 00010000:00010000:0.0:1787508772.029922:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508772.029924:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aae00/0xb126349c40f36081 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x296:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508772.029930:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aae00/0xb126349c40f36081 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x296:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508772.029983:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f3611b lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508772.029990:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f3611b lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508772.030000:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f3611b lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508772.030005:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508772.030009:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f3611b lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508772.030015:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f3611b lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508772.030023:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13dc:0x0].0x0 (ffff9090e33ff200) 00010000:00010000:0.0:1787508772.030025:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787508772.030028:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f3611b lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508772.030035:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aac00/0xb126349c40f3611b lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x13dc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787508772.030044:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cbc97d00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9090d764df00 00000020:00080000:1.0:1787508772.030049:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a2:0x5:0x0].602 00000020:00080000:1.0:1787508772.030052:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090cbc97f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090e6f7fa00 00000020:00080000:1.0:1787508772.030055:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd1:0xf:0x0].58 00000020:00080000:3.0:1787508772.030100:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294998394 committed batchid 4294998392 00000020:00080000:3.0:1787508772.030159:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998392 00010000:00010000:0.0:1787508772.410774:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508773.016114:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508773.016336:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509675136 00000100:00100000:0.0:1787508773.016347:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509675136 00000100:00100000:0.0:1787508773.016468:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94276 00000100:00100000:0.0:1787508773.016479:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:344914:x1874324509675136:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:0.0:1787508773.016513:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508773.016536:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f36287 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaed2b expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508773.016600:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f3628e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508773.016615:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f3628e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508773.016628:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f3628e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508773.016647:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f36295 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x97f25b81 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508773.016653:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f36295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508773.016659:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f36295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508773.016730:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f3628e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508773.016737:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f3628e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508773.016753:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f3628e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508773.016759:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f3628e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508773.016765:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508773.016769:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f3628e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508773.016775:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f3628e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508773.016787:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508773.016790:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508773.016794:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f3628e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508773.016801:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f3628e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508773.016814:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f36295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508773.016820:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f36295 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508773.016827:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f36295 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508773.016831:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508773.016834:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f36295 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508773.016850:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f36295 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508773.016856:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x97f25b81 (ffff9090c96b8300) 00010000:00010000:0.0:1787508773.016859:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508773.016862:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f36295 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508773.016867:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f36295 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x97f25b81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508773.016897:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f36287 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed2b expref: 13 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508773.016911:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508773.016914:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508773.016917:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f36287 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed2b expref: 13 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508773.016927:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5600, rc 0) 00000100:00100000:0.0:1787508773.017427:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:344914:x1874324509675136:12345-192.168.201.30@tcp:101:rm.0 Request processed in 552us (925us total) trans 0 rc 301/301 00000100:00100000:0.0:1787508773.017434:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94276 00000100:00080000:3.0:1787508773.017666:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787508773.436875:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508773.993366:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508773.993405:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508773.993429:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508773.993451:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508773.993471:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508773.993491:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508773.993512:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508773.993532:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508773.993554:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508773.993581:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509675264 00000100:00100000:0.0:1787508773.993590:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509675264 00000100:00100000:0.0:1787508773.993638:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1040 00000100:00100000:0.0:1787508773.993648:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091cbbc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509675264:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508773.993728:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091cbbc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509675264:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 80us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508773.993736:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1040 00000100:00100000:0.0:1787508773.993770:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509675520 00000100:00100000:0.0:1787508773.993774:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509675520 00000100:00100000:0.0:1787508773.993810:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509676032 00000100:00100000:0.0:1787508773.993813:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509676032 00000100:00100000:0.0:1787508773.993832:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509675392 00000100:00100000:0.0:1787508773.993835:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509675392 00000100:00100000:0.0:1787508773.993851:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509675904 00000100:00100000:0.0:1787508773.993853:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509675904 00000100:00100000:0.0:1787508773.993870:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3152 00000100:00100000:0.0:1787508773.993878:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2403:x1874324509675520:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508773.993908:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2403:x1874324509675520:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 31us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508773.993914:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3152 00000100:00100000:0.0:1787508773.993926:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3153 00000100:00100000:0.0:1787508773.993932:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2403:x1874324509676032:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508773.993982:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2403:x1874324509676032:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 50us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508773.993988:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3153 00000100:00100000:0.0:1787508773.994000:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3154 00000100:00100000:0.0:1787508773.994006:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:2403:x1874324509675392:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508773.994035:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:2403:x1874324509675392:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 30us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508773.994041:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3154 00000100:00100000:0.0:1787508773.994051:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3155 00000100:00100000:0.0:1787508773.994057:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2403:x1874324509675904:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508773.994081:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2403:x1874324509675904:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508773.994087:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3155 00000100:00080000:0.0:1787508773.994231:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787508773.994235:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787508773.994886:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509675776 00000100:00100000:2.0:1787508773.994893:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509675776 00000100:00100000:2.0:1787508773.994936:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509676288 00000100:00100000:2.0:1787508773.994962:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509676288 00000100:00100000:2.0:1787508773.994986:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509675648 00000100:00100000:2.0:1787508773.994989:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509675648 00000100:00100000:2.0:1787508773.995005:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509676160 00000100:00100000:2.0:1787508773.995008:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509676160 00000100:00100000:2.0:1787508773.995028:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2502 00000100:00100000:2.0:1787508773.995037:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2403:x1874324509675776:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508773.995085:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2403:x1874324509675776:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 50us (1655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508773.995092:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2502 00000100:00100000:2.0:1787508773.995106:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2503 00000100:00100000:2.0:1787508773.995112:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2403:x1874324509676288:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508773.995134:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2403:x1874324509676288:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (1663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508773.995139:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2503 00000100:00100000:2.0:1787508773.995150:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2504 00000100:00100000:2.0:1787508773.995155:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509675648:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508773.995177:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509675648:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (1664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508773.995182:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2504 00000100:00100000:2.0:1787508773.995192:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2505 00000100:00100000:2.0:1787508773.995198:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2403:x1874324509676160:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508773.995218:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2403:x1874324509676160:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (1664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508773.995224:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2505 00000100:00080000:3.0:1787508773.995404:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787508773.995409:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787508774.458266:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508774.590265:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787508774.590289:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480236160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787508774.590361:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508774.590461:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480236160 00000100:00100000:1.0:1787508774.590468:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480236160 00000100:00100000:1.0:1787508774.590532:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1749 00000100:00100000:1.0:1787508774.590543:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480236160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787508774.590571:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 131576384 pending 0 free 3881955328 avail 3650433024 00000100:00100000:1.0:1787508774.590617:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480236160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508774.590624:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1749 00000100:00080000:2.0:1787508774.590697:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787508774.590730:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480236160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787508774.590916:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787508774.590926:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480236288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787508774.590981:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508774.591243:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480236288 00000100:00100000:1.0:1787508774.591248:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480236288 00000100:00100000:1.0:1787508774.591289:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1750 00000100:00100000:1.0:1787508774.591296:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480236288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787508774.591308:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 131576384 pending 0 free 3881955328 avail 3650433024 00000100:00100000:1.0:1787508774.591351:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480236288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508774.591357:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1750 00000100:00080000:2.0:1787508774.591406:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508774.591461:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480236288:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787508775.486001:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508775.614591:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79de3f65-4bad-42d0-a46f-842a654b33a0:3617:1874324480236416:0@lo:400:kworker.0 00000100:00100000:0.0:1787508775.614678:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508775.614731:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874324480236928:0@lo:400:kworker.0 00000100:00100000:0.0:1787508775.614756:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508775.614777:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480237440:0@lo:400:kworker.0 00000100:00100000:0.0:1787508775.614796:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508775.614812:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480237952:0@lo:400:kworker.0 00000100:00100000:0.0:1787508775.614830:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508775.614855:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787508775.614861:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480236800:0@lo:400:kworker.0 00000100:00100000:0.0:1787508775.614883:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508775.614901:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480237312:0@lo:400:kworker.0 00000100:00100000:0.0:1787508775.614921:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508775.614957:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480237824:0@lo:400:kworker.0 00000100:00100000:0.0:1787508775.614978:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508775.615003:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480236672:0@lo:400:kworker.0 00000100:00100000:0.0:1787508775.615024:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508775.615039:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480237184:0@lo:400:kworker.0 00000100:00100000:0.0:1787508775.615055:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508775.615070:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480237696:0@lo:400:kworker.0 00000100:00100000:0.0:1787508775.615086:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508775.615101:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787508775.615106:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480236544:0@lo:400:kworker.0 00000100:00100000:0.0:1787508775.615123:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508775.615137:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480237056:0@lo:400:kworker.0 00000100:00100000:0.0:1787508775.615152:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508775.615164:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480237568:0@lo:400:kworker.0 00000100:00100000:0.0:1787508775.615181:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508775.615205:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480236928 00000100:00100000:0.0:1787508775.615212:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480236928 00000100:00100000:0.0:1787508775.615251:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480237440 00000100:00100000:0.0:1787508775.615254:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480237440 00000100:00100000:0.0:1787508775.615264:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480237952 00000100:00100000:0.0:1787508775.615267:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480237952 00000100:00100000:0.0:1787508775.615285:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480237824 00000100:00100000:0.0:1787508775.615288:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480237824 00000100:00100000:0.0:1787508775.615299:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480237696 00000100:00100000:0.0:1787508775.615301:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480237696 00000100:00100000:0.0:1787508775.615314:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480237568 00000100:00100000:0.0:1787508775.615316:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480237568 00000100:00100000:0.0:1787508775.615331:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3156 00000100:00100000:0.0:1787508775.615339:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874324480236928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508775.615463:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480236416 00000100:00100000:3.0:1787508775.615467:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480236416 00000100:00100000:3.0:1787508775.615496:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:3.0:1787508775.615504:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091cbbc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3617:x1874324480236416:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787508775.615602:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787508775.615606:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787508775.615699:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874324480236928:12345-0@lo:400:kworker.0 Request processed in 360us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508775.615707:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3156 00000100:00100000:0.0:1787508775.615726:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3157 00000100:00100000:0.0:1787508775.615732:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480237440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508775.615804:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091cbbc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3617:x1874324480236416:12345-0@lo:400:kworker.0 Request processed in 301us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508775.615811:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:0.0:1787508775.615845:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480237440:12345-0@lo:400:kworker.0 Request processed in 112us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508775.615851:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3157 00000100:00100000:0.0:1787508775.615863:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3158 00000100:00100000:0.0:1787508775.615869:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480237952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508775.615898:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480237952:12345-0@lo:400:kworker.0 Request processed in 30us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508775.615903:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3158 00000100:00100000:0.0:1787508775.615913:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3159 00000100:00100000:0.0:1787508775.615918:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480237824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508775.615975:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480237824:12345-0@lo:400:kworker.0 Request processed in 22us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508775.615981:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3159 00000100:00100000:0.0:1787508775.615994:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3160 00000100:00100000:0.0:1787508775.616000:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480237696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508775.616040:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480237696:12345-0@lo:400:kworker.0 Request processed in 41us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508775.616046:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3160 00000100:00100000:0.0:1787508775.616058:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3161 00000100:00100000:0.0:1787508775.616064:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480237568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508775.616088:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480237568:12345-0@lo:400:kworker.0 Request processed in 25us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508775.616093:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3161 00000100:00100000:0.0:1787508775.616118:0:225833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480236800 00000100:00100000:0.0:1787508775.616122:0:225833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480236800 00000100:00100000:0.0:1787508775.616143:0:225833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480237312 00000100:00100000:0.0:1787508775.616145:0:225833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480237312 00000100:00100000:0.0:1787508775.616159:0:225833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480236672 00000100:00100000:0.0:1787508775.616161:0:225833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480236672 00000100:00100000:0.0:1787508775.616180:0:225833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480237184 00000100:00100000:0.0:1787508775.616183:0:225833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480237184 00000100:00100000:0.0:1787508775.616200:0:225833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2506 00000100:00100000:0.0:1787508775.616205:0:225833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480236800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508775.616236:0:225833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480236800:12345-0@lo:400:kworker.0 Request processed in 31us (1351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508775.616241:0:225833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2506 00000100:00100000:0.0:1787508775.616252:0:225833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2507 00000100:00100000:0.0:1787508775.616257:0:225833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480237312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508775.616281:0:225833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480237312:12345-0@lo:400:kworker.0 Request processed in 24us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508775.616287:0:225833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2507 00000100:00100000:0.0:1787508775.616296:0:225833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2508 00000100:00100000:0.0:1787508775.616302:0:225833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3619:x1874324480236672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508775.616326:0:225833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3619:x1874324480236672:12345-0@lo:400:kworker.0 Request processed in 25us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508775.616331:0:225833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2508 00000100:00100000:0.0:1787508775.616341:0:225833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2509 00000100:00100000:0.0:1787508775.616346:0:225833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480237184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508775.616368:0:225833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480237184:12345-0@lo:400:kworker.0 Request processed in 23us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508775.616374:0:225833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2509 00000100:00100000:0.0:1787508775.616410:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480236544 00000100:00100000:0.0:1787508775.616413:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480236544 00000100:00100000:0.0:1787508775.616547:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480237056 00000100:00100000:0.0:1787508775.616551:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480237056 00000100:00100000:0.0:1787508775.616572:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29960 00000100:00100000:0.0:1787508775.616647:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480236544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508775.616696:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480236544:12345-0@lo:400:kworker.0 Request processed in 119us (1571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508775.616702:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29960 00000100:00100000:0.0:1787508775.616715:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29961 00000100:00100000:0.0:1787508775.616720:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480237056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508775.616747:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480237056:12345-0@lo:400:kworker.0 Request processed in 26us (1593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508775.616752:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29961 00000100:00080000:0.0:1787508775.616801:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508775.616905:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874324480236928:0@lo:400:kworker.0 00000100:00100000:1.0:1787508775.616921:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480237440:0@lo:400:kworker.0 00000100:00100000:1.0:1787508775.616933:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480237952:0@lo:400:kworker.0 00000100:00100000:1.0:1787508775.616983:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480236800:0@lo:400:kworker.0 00000100:00100000:1.0:1787508775.616993:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480237312:0@lo:400:kworker.0 00000100:00100000:1.0:1787508775.617002:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480237824:0@lo:400:kworker.0 00000100:00100000:1.0:1787508775.617012:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79de3f65-4bad-42d0-a46f-842a654b33a0:3617:1874324480236416:0@lo:400:kworker.0 00000100:00100000:3.0:1787508775.617230:0:3619:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 8589962077 gen 2 00000004:00080000:3.0:1787508775.617237:0:3619:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589962076 committed transno 8589962077 00000004:00080000:3.0:1787508775.617253:0:3619:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589962077 committed transno 8589962077 00000100:00100000:3.0:1787508775.617263:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480236544:0@lo:400:kworker.0 00000100:00100000:3.0:1787508775.617275:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480237056:0@lo:400:kworker.0 00000100:00100000:3.0:1787508775.617285:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480237568:0@lo:400:kworker.0 00000100:00100000:3.0:1787508775.617297:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480236672:0@lo:400:kworker.0 00000100:00100000:3.0:1787508775.617307:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480237184:0@lo:400:kworker.0 00000100:00100000:3.0:1787508775.617316:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480237696:0@lo:400:kworker.0 00000100:00100000:1.0:1787508776.124214:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787508776.124236:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480238080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787508776.124307:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508776.124360:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480238080 00000100:00100000:1.0:1787508776.124368:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480238080 00000100:00100000:1.0:1787508776.124417:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1751 00000100:00100000:1.0:1787508776.124427:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874324480238080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787508776.124458:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49603136 pending 0 free 3909767168 avail 3678244864 00000100:00100000:1.0:1787508776.124503:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1874324480238080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508776.124510:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1751 00000100:00100000:1.0:1787508776.124558:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480238080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787508776.124720:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787508776.124730:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480238208:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787508776.124775:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508776.124912:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480238208 00000100:00100000:3.0:1787508776.124917:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480238208 00000100:00100000:3.0:1787508776.124985:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1752 00000100:00100000:3.0:1787508776.124993:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480238208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787508776.125004:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49603136 pending 0 free 3909767168 avail 3678244864 00000100:00100000:3.0:1787508776.125039:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480238208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508776.125045:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1752 00000100:00100000:0.0:1787508776.125667:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480238208:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787508776.506263:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787508777.150327:0:203722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589941256 is committed 00000100:00100000:1.0:1787508777.151350:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787508777.151370:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480238336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787508777.151442:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508777.151500:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480238336 00000100:00100000:1.0:1787508777.151508:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480238336 00000100:00100000:1.0:1787508777.151699:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29962 00000100:00100000:1.0:1787508777.151710:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480238336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787508777.151741:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442721792 avail 1296482304 00000100:00100000:1.0:1787508777.151796:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480238336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508777.151803:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29962 00000100:00100000:1.0:1787508777.151959:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480238336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787508777.165416:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787508777.165439:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480238464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787508777.165520:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508777.165852:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480238464 00000100:00100000:0.0:1787508777.165861:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480238464 00000100:00100000:2.0:1787508777.166311:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29963 00000100:00100000:2.0:1787508777.166322:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480238464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787508777.166356:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440645120 avail 1294405632 00000100:00100000:2.0:1787508777.166405:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480238464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508777.166412:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29963 00000100:00100000:2.0:1787508777.166455:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480238464:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787508777.536622:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787508777.671968:0:202955:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 4294998394 batchid updated 00000020:00080000:1.0:1787508777.673098:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998394 00000004:00080000:1.0:1787508777.673165:0:202975:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d317be40 with version 13633 00000020:00080000:1.0:1787508777.673177:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294998393 cancel update log [0x2000013a2:0x5:0x0].602: rc = 0 00000020:00080000:1.0:1787508777.673259:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294998393 cancel update log [0x240000bd1:0xf:0x0].58: rc = 0 00000004:00080000:1.0:1787508777.673283:0:202975:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090d46c6e40 with version 13634 00000020:00080000:1.0:1787508777.673286:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294998394 cancel update log [0x2000013a2:0x5:0x0].603: rc = 0 00000020:00080000:1.0:1787508777.673306:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294998394 cancel update log [0x240000bd1:0xf:0x0].59: rc = 0 00000020:00080000:1.0:1787508777.673310:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998394 00000004:00080000:1.0:1787508777.673320:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13633 rpc_version 13633 00000020:00100000:1.0:1787508777.673369:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787508777.673379:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d0877480 x1874324480238720/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787508777.673404:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0877480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480238720:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508777.673477:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508777.673527:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090e6fc3900 going to sleep for 11 seconds 00000100:00100000:1.0:1787508777.673550:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480238720 00000100:00100000:1.0:1787508777.673556:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480238720 00000100:00100000:1.0:1787508777.673609:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29964 00000100:00100000:1.0:1787508777.673619:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:202961:x1874324480238720:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508777.675017:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:202961:x1874324480238720:12345-0@lo:1000:osp_up0-1.0 Request processed in 1391us (1532us total) trans 12884944258 rc 0/0 00000100:00100000:1.0:1787508777.675030:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29964 00000100:00100000:1.0:1787508777.675104:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0877480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480238720:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1787508777.675118:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13634 rpc_version 13634 00000020:00100000:1.0:1787508777.675136:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787508777.675143:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9090d0875f80 x1874324480238976/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787508777.675163:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0875f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480238976:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508777.675201:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508777.678976:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090e6fc3900 going to sleep for 11 seconds 00000100:00100000:0.0:1787508777.684930:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480238976 00000100:00100000:0.0:1787508777.684959:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480238976 00000100:00100000:0.0:1787508777.685031:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29965 00000100:00100000:0.0:1787508777.685042:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:202961:x1874324480238976:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787508777.685252:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:202961:x1874324480238976:12345-0@lo:1000:osp_up0-1.0 Request processed in 212us (10051us total) trans 12884944259 rc 0/0 00000100:00100000:0.0:1787508777.685261:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29965 00000100:00100000:0.0:1787508777.689433:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0875f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480238976:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1787508778.556057:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508779.116542:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508779.116592:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508779.116635:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508779.116659:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508779.116676:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508779.116693:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508779.116709:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508779.116725:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508779.116746:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508779.116777:0:203728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509676928 00000100:00100000:0.0:1787508779.116787:0:203728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509676928 00000100:00100000:0.0:1787508779.116843:0:203728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509677440 00000100:00100000:0.0:1787508779.116846:0:203728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509677440 00000100:00100000:0.0:1787508779.116867:0:203728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509676800 00000100:00100000:0.0:1787508779.116870:0:203728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509676800 00000100:00100000:0.0:1787508779.116885:0:203728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509677312 00000100:00100000:0.0:1787508779.116888:0:203728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509677312 00000100:00100000:0.0:1787508779.116911:0:203728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2510 00000100:00100000:0.0:1787508779.116920:0:203728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2402:x1874324509676928:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508779.117032:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2511 00000100:00100000:1.0:1787508779.117042:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2402:x1874324509677440:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508779.117115:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2402:x1874324509677440:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 75us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508779.117123:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2511 00000100:00100000:1.0:1787508779.117142:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2512 00000100:00100000:1.0:1787508779.117148:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509676800:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508779.117174:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509676800:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508779.117181:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2512 00000100:00100000:1.0:1787508779.117192:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2513 00000100:00100000:1.0:1787508779.117199:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2402:x1874324509677312:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508779.117220:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2402:x1874324509677312:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508779.117226:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2513 00000100:00080000:1.0:1787508779.117336:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787508779.117341:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508779.117352:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509676672 00000100:00100000:1.0:1787508779.117355:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509676672 00000100:00100000:1.0:1787508779.117388:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509677184 00000100:00100000:1.0:1787508779.117391:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509677184 00000100:00100000:1.0:1787508779.117407:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509676544 00000100:00100000:1.0:1787508779.117410:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509676544 00000100:00100000:1.0:1787508779.117426:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3162 00000100:00100000:1.0:1787508779.117432:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2402:x1874324509676672:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508779.117462:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2402:x1874324509676672:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 30us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508779.117468:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3162 00000100:00100000:1.0:1787508779.117478:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509677056 00000100:00100000:1.0:1787508779.117482:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509677056 00000100:00100000:1.0:1787508779.117497:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3163 00000100:00100000:1.0:1787508779.117503:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2402:x1874324509677184:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508779.117527:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2402:x1874324509677184:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508779.117533:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3163 00000100:00100000:1.0:1787508779.117545:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3164 00000100:00100000:1.0:1787508779.117552:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:2402:x1874324509676544:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508779.117579:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:2402:x1874324509676544:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 28us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508779.117585:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3164 00000100:00100000:1.0:1787508779.117595:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3165 00000100:00100000:1.0:1787508779.117760:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2402:x1874324509677056:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508779.117785:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2402:x1874324509677056:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 184us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508779.117791:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3165 00000100:00080000:1.0:1787508779.117824:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787508779.117828:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787508779.118183:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509676416 00000100:00100000:2.0:1787508779.118188:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509676416 00000100:00100000:2.0:1787508779.118230:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1042 00000100:00100000:2.0:1787508779.118237:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091cbbc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509676416:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508779.118271:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091cbbc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509676416:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 35us (1740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508779.118278:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1042 00000100:00100000:0.0:1787508779.118650:0:203728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2402:x1874324509676928:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 1730us (2012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508779.118659:0:203728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2510 00010000:00010000:0.0:1787508779.585316:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508779.706224:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787508779.706258:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480239104:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787508779.706360:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508779.706559:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480239104 00000100:00100000:3.0:1787508779.706570:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480239104 00000100:00100000:3.0:1787508779.706670:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1753 00000100:00100000:3.0:1787508779.706681:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480239104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787508779.706719:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 131576384 pending 0 free 3881955328 avail 3650433024 00000100:00100000:3.0:1787508779.706775:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480239104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508779.706783:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1753 00000100:00100000:2.0:1787508779.706889:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480239104:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787508779.706971:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508779.707111:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787508779.707124:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480239232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787508779.707169:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508779.707255:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480239232 00000100:00100000:2.0:1787508779.707260:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480239232 00000100:00100000:2.0:1787508779.707310:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1754 00000100:00100000:2.0:1787508779.707318:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480239232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787508779.707333:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 131576384 pending 0 free 3881955328 avail 3650433024 00000100:00100000:2.0:1787508779.707367:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480239232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508779.707374:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1754 00000100:00080000:0.0:1787508779.707432:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508779.707455:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480239232:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1787508780.272003:0:234964:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 104: Verify that MDS stores atime/mtime/ctime during close ========================================================== 14:12:58 (1787508778) 00010000:00010000:1.0:1787508780.602918:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508780.730641:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480239616:0@lo:400:kworker.0 00000100:00100000:0.0:1787508780.730745:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508780.730836:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480240128:0@lo:400:kworker.0 00000100:00100000:0.0:1787508780.730865:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508780.730896:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874324480240640:0@lo:400:kworker.0 00000100:00100000:0.0:1787508780.730925:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508780.730998:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787508780.731005:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480239744:0@lo:400:kworker.0 00000100:00100000:1.0:1787508780.731141:0:225832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480239616 00000100:00100000:1.0:1787508780.731154:0:225832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480239616 00000100:00100000:1.0:1787508780.731230:0:225832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480240128 00000100:00100000:1.0:1787508780.731234:0:225832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480240128 00000100:00100000:1.0:1787508780.731264:0:225832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2514 00000100:00100000:1.0:1787508780.731276:0:225832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480239616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508780.731348:0:225832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480239616:12345-0@lo:400:kworker.0 Request processed in 74us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508780.731357:0:225832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2514 00000100:00100000:1.0:1787508780.731376:0:225832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2515 00000100:00100000:1.0:1787508780.731383:0:225832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480240128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508780.731411:0:225832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480240128:12345-0@lo:400:kworker.0 Request processed in 29us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508780.731418:0:225832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2515 00000100:00100000:0.0:1787508780.731794:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508780.731833:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480240256:0@lo:400:kworker.0 00000100:00100000:0.0:1787508780.731862:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508780.731891:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480240768:0@lo:400:kworker.0 00000100:00100000:0.0:1787508780.731918:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508780.731997:0:3618:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589941256 gen 2 00000004:00080000:0.0:1787508780.732003:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9091f9a86680, transno 8589941256 00000100:00100000:0.0:1787508780.732020:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480239616:0@lo:400:kworker.0 00000100:00100000:0.0:1787508780.732115:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480240128:0@lo:400:kworker.0 00000100:00100000:0.0:1787508780.732156:0:225834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480239744 00000100:00100000:0.0:1787508780.732161:0:225834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480239744 00000100:00100000:0.0:1787508780.732200:0:225834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480240256 00000100:00100000:0.0:1787508780.732203:0:225834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480240256 00000100:00100000:0.0:1787508780.732221:0:225834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2516 00000100:00100000:0.0:1787508780.732228:0:225834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480239744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508780.732275:0:225834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480239744:12345-0@lo:400:kworker.0 Request processed in 46us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508780.732282:0:225834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2516 00000100:00100000:0.0:1787508780.732297:0:225834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2517 00000100:00100000:0.0:1787508780.732304:0:225834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480240256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508780.732330:0:225834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480240256:12345-0@lo:400:kworker.0 Request processed in 27us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508780.732335:0:225834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2517 00000100:00100000:0.0:1787508780.732352:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480240640 00000100:00100000:0.0:1787508780.732355:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480240640 00000100:00100000:0.0:1787508780.732387:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480240768 00000100:00100000:0.0:1787508780.732390:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480240768 00000100:00100000:0.0:1787508780.732410:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3166 00000100:00100000:0.0:1787508780.732416:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874324480240640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508780.732449:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874324480240640:12345-0@lo:400:kworker.0 Request processed in 34us (1524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508780.732456:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3166 00000100:00100000:0.0:1787508780.732467:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3167 00000100:00100000:0.0:1787508780.732473:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480240768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508780.732503:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480240768:12345-0@lo:400:kworker.0 Request processed in 30us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508780.732508:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3167 00000100:00080000:0.0:1787508780.732528:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787508780.732534:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508780.732538:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787508780.732748:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480239744:0@lo:400:kworker.0 00000100:00100000:0.0:1787508780.732761:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480240256:0@lo:400:kworker.0 00000100:00100000:0.0:1787508780.732769:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480240768:0@lo:400:kworker.0 00000100:00100000:0.0:1787508780.732780:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874324480240640:0@lo:400:kworker.0 00000100:00100000:2.0:1787508780.733095:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480239360:0@lo:400:kworker.0 00000100:00100000:2.0:1787508780.733146:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508780.733188:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874324480239872:0@lo:400:kworker.0 00000100:00100000:2.0:1787508780.733210:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508780.733228:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874324480240384:0@lo:400:kworker.0 00000100:00100000:2.0:1787508780.733246:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508780.733259:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874324480240896:0@lo:400:kworker.0 00000100:00100000:2.0:1787508780.733276:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508780.733296:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787508780.733303:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480239488:0@lo:400:kworker.0 00000100:00100000:2.0:1787508780.733327:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508780.733344:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480240000:0@lo:400:kworker.0 00000100:00100000:2.0:1787508780.733365:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508780.733380:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874324480240512:0@lo:400:kworker.0 00000100:00100000:2.0:1787508780.733401:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508780.733619:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480239872 00000100:00100000:3.0:1787508780.733628:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480239872 00000100:00100000:3.0:1787508780.733677:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480240384 00000100:00100000:3.0:1787508780.733680:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480240384 00000100:00100000:3.0:1787508780.733696:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480240896 00000100:00100000:3.0:1787508780.733699:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480240896 00000100:00100000:3.0:1787508780.733723:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480240512 00000100:00100000:3.0:1787508780.733725:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480240512 00000100:00100000:3.0:1787508780.733743:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3168 00000100:00100000:3.0:1787508780.733751:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874324480239872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508780.733805:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874324480239872:12345-0@lo:400:kworker.0 Request processed in 55us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508780.733812:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3168 00000100:00100000:3.0:1787508780.733836:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3169 00000100:00100000:3.0:1787508780.733841:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874324480240384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508780.733868:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874324480240384:12345-0@lo:400:kworker.0 Request processed in 28us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508780.733878:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3169 00000100:00100000:3.0:1787508780.733890:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3170 00000100:00100000:3.0:1787508780.733895:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874324480240896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508780.733923:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874324480240896:12345-0@lo:400:kworker.0 Request processed in 29us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508780.733929:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3170 00000100:00100000:3.0:1787508780.733987:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3171 00000100:00100000:3.0:1787508780.733994:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874324480240512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508780.734022:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874324480240512:12345-0@lo:400:kworker.0 Request processed in 29us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508780.734154:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3171 00000100:00080000:3.0:1787508780.734180:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787508780.734184:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787508780.734216:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874324480240512:0@lo:400:kworker.0 00000100:00100000:3.0:1787508780.734227:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874324480239872:0@lo:400:kworker.0 00000100:00100000:3.0:1787508780.734235:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874324480240384:0@lo:400:kworker.0 00000100:00100000:3.0:1787508780.734244:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874324480240896:0@lo:400:kworker.0 00000100:00100000:1.0:1787508780.734460:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480239488 00000100:00100000:1.0:1787508780.734466:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480239488 00000100:00100000:1.0:1787508780.734522:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480240000 00000100:00100000:1.0:1787508780.734526:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480240000 00000100:00100000:1.0:1787508780.734545:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29966 00000100:00100000:1.0:1787508780.734552:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480239488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508780.734609:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480239488:12345-0@lo:400:kworker.0 Request processed in 57us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508780.734614:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29966 00000100:00100000:1.0:1787508780.734627:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29967 00000100:00100000:1.0:1787508780.734632:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3616:x1874324480240000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508780.734666:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3616:x1874324480240000:12345-0@lo:400:kworker.0 Request processed in 34us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508780.734672:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29967 00000100:00100000:3.0:1787508780.734894:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480239488:0@lo:400:kworker.0 00000100:00100000:3.0:1787508780.734908:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480240000:0@lo:400:kworker.0 00000100:00100000:0.0:1787508780.736682:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480239360 00000100:00100000:0.0:1787508780.736697:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480239360 00000100:00100000:0.0:1787508780.736773:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:0.0:1787508780.736781:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091cbbc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480239360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508780.736881:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091cbbc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480239360:12345-0@lo:400:kworker.0 Request processed in 101us (3734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508780.736886:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00100000:3.0:1787508780.737218:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480239360:0@lo:400:kworker.0 00000100:00100000:2.0:1787508781.242170:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787508781.242194:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480241024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787508781.242264:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508781.242415:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480241024 00000100:00100000:0.0:1787508781.242423:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480241024 00000100:00100000:0.0:1787508781.242493:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1755 00000100:00100000:0.0:1787508781.242503:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480241024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787508781.242532:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49603136 pending 0 free 3909767168 avail 3678244864 00000100:00100000:0.0:1787508781.242592:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480241024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508781.242600:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1755 00000100:00100000:2.0:1787508781.242814:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480241024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787508781.242966:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787508781.242977:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480241152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787508781.243006:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508781.243091:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480241152 00000100:00100000:0.0:1787508781.243096:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480241152 00000100:00100000:0.0:1787508781.243126:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1756 00000100:00100000:0.0:1787508781.243134:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480241152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787508781.243148:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49603136 pending 0 free 3909767168 avail 3678244864 00000100:00100000:0.0:1787508781.243191:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480241152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508781.243198:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1756 00000100:00100000:1.0:1787508781.243260:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480241152:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787508781.626198:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508782.266586:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787508782.266609:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480241280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787508782.266681:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508782.266727:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480241280 00000100:00100000:1.0:1787508782.266734:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480241280 00000100:00100000:1.0:1787508782.266782:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29968 00000100:00100000:1.0:1787508782.266791:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480241280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787508782.266823:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442721792 avail 1296482304 00000100:00100000:1.0:1787508782.266873:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480241280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508782.266881:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29968 00000100:00100000:1.0:1787508782.266931:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480241280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787508782.269056:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787508782.269078:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480241408:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787508782.269140:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508782.269245:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480241408 00000100:00100000:0.0:1787508782.269253:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480241408 00000100:00100000:0.0:1787508782.269313:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29969 00000100:00100000:0.0:1787508782.269322:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:3617:x1874324480241408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787508782.269358:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440645120 avail 1294405632 00000100:00100000:0.0:1787508782.269406:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:3617:x1874324480241408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508782.269413:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29969 00000100:00100000:1.0:1787508782.271124:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480241408:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787508782.430177:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508782.430250:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509677696 00000100:00100000:3.0:1787508782.430260:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509677696 00000100:00080000:0.0:1787508782.430365:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787508782.430858:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94277 00000100:00100000:3.0:1787508782.430870:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:345514:x1874324509677696:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:3.0:1787508782.430891:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508782.430894:0:209004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787508782.430920:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f360ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaec83 expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508782.430965:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508782.430971:0:209004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508782.430984:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6244000/0xb126349c40f3629c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaed32 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508782.431089:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f362a3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508782.431103:0:209004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f36129 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeca6 expref: 11 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508782.431112:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f362a3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508782.431142:0:209004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f36129 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeca6 expref: 11 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508782.431157:0:209004:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f36129 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeca6 expref: 11 pid: 203348 timeout: 13853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508782.431170:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce781180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480241536:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508782.431249:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cf6f3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787508782.435055:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508782.435091:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509677824 00000100:00100000:0.0:1787508782.435100:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509677824 00010000:00010000:0.0:1787508782.435150:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f36129 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeca6 expref: 12 pid: 203348 timeout: 13853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508782.435184:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27973 00000100:00100000:0.0:1787508782.435194:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2401:x1874324509677824:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508782.435209:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508782.435215:0:225839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f36129 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeca6 expref: 12 pid: 203348 timeout: 13853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508782.435230:0:225839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f36129 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeca6 expref: 12 pid: 203348 timeout: 13853 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508782.435256:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508782.435261:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f362a3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508782.435273:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f362a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508782.435280:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f362a3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508782.435297:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508782.435343:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2401:x1874324509677824:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 150us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508782.435351:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27973 00000100:00080000:0.0:1787508782.435376:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787508782.435467:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f36129 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeca6 expref: 11 pid: 203348 timeout: 13853 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508782.435484:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce781180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480241536:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508782.435504:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f362a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508782.435513:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f362a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508782.435520:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f362a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508782.435541:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f362aa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x27849676 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508782.435565:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f362aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508782.435573:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f362aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787508782.436021:0:209004:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x158d:0x0], index 1: 0 00010000:00010000:0.0:1787508782.436180:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f362b1 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508782.436190:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f362b1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508782.436197:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f362b1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508782.436231:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f362a3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508782.436239:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f362a3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508782.436245:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f362a3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508782.436252:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f362a3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508782.436259:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d6245000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508782.436263:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f362a3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508782.436275:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f362a3 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508782.436285:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508782.436288:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508782.436292:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f362a3 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508782.436298:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f362a3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508782.436310:0:209004:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf6408d0 reply state 0000000027503eff transno 12884944260 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f362aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508782.436321:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f362aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508782.436328:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x27849676 (ffff9090c96b8100) 00010000:00010000:0.0:1787508782.436330:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787508782.436333:0:209004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787508782.436363:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6244000/0xb126349c40f3629c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed32 expref: 14 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508782.436376:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f362b1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed32 expref: 13 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508782.436383:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1275:0x0].0x0 (ffff9090c96b8800) 00010000:00010000:0.0:1787508782.436386:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787508782.436388:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5c00, rc 0) 00000100:00100000:0.0:1787508782.436433:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:345514:x1874324509677696:12345-192.168.201.30@tcp:101:dd.0 Request processed in 5567us (6268us total) trans 12884944260 rc 0/0 00000100:00100000:0.0:1787508782.436442:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94277 00000100:00100000:0.0:1787508782.445903:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508782.446424:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509677952 00000100:00100000:3.0:1787508782.446436:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509677952 00000100:00100000:3.0:1787508782.446836:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15089 00000100:00100000:3.0:1787508782.446848:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:345514:x1874324509677952:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:3.0:1787508782.446866:0:225841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508782.446888:0:225841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db375ae6/0xb126349c40f362bf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaed39 expref: -99 pid: 225841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787508782.446914:0:225841:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x158d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787508782.446935:0:225841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x158d:0x0].0x0 since=13753s v=(0 0) 00010000:00010000:3.0:1787508782.446974:0:225841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x158d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787508782.446985:0:225841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db375ae6/0xb126349c40f362bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed39 expref: 8 pid: 225841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508782.447004:0:225841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000db375ae6/0xb126349c40f362bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed39 expref: 8 pid: 225841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508782.447018:0:225841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d6245e00, rc 0) 00000100:00100000:3.0:1787508782.447075:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:345514:x1874324509677952:12345-192.168.201.30@tcp:101:dd.0 Request processed in 230us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508782.447083:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15089 00000100:00100000:3.0:1787508782.451260:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508782.451362:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509678208 00000100:00100000:2.0:1787508782.451372:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509678208 00000100:00100000:2.0:1787508782.451433:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15499 00000100:00100000:2.0:1787508782.451444:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fdb9c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:345514:x1874324509678208:12345-192.168.201.30@tcp:35:dd.0 00000100:00100000:2.0:1787508782.451757:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fdb9c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:345514:x1874324509678208:12345-192.168.201.30@tcp:35:dd.0 Request processed in 313us (504us total) trans 12884944261 rc 0/0 00000100:00100000:2.0:1787508782.451765:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15499 00000100:00080000:0.0:1787508782.453891:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508782.474993:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508782.475027:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509678336 00000100:00100000:3.0:1787508782.475037:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509678336 00000100:00100000:3.0:1787508782.475092:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94278 00000100:00100000:3.0:1787508782.475103:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:345517:x1874324509678336:12345-192.168.201.30@tcp:101:stat.0 00010000:00010000:3.0:1787508782.475126:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508782.475150:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6244000/0xb126349c40f362c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaed40 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508782.475215:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f362cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508782.475230:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f362cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508782.475243:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f362cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508782.475303:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508782.475308:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508782.475328:0:205405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f362cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508782.475356:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6244000/0xb126349c40f362c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed40 expref: 17 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508782.475376:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f362cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed40 expref: 16 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508782.475385:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508782.475388:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508782.475393:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d6245000, rc 0) 00000100:00100000:3.0:1787508782.475448:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:345517:x1874324509678336:12345-192.168.201.30@tcp:101:stat.0 Request processed in 348us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508782.475455:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94278 00010000:00010000:3.0:1787508782.650144:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508783.674723:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787508783.808044:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944261 is committed 00000001:00080000:3.0:1787508783.808062:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944259 is committed 00010000:00010000:1.0:1787508783.808129:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f362aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508783.808141:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f362aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508783.808149:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f362aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508783.808155:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5a00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508783.808160:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f362aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508783.808168:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f362aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508783.808184:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x27849676 (ffff9090c96b8100) 00010000:00010000:1.0:1787508783.808187:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508783.808193:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f362aa lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508783.808199:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5a00/0xb126349c40f362aa lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508784.246259:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508784.246309:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508784.246348:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508784.246381:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508784.246417:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508784.246440:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508784.246459:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508784.246476:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508784.246498:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508784.246535:0:208927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509678848 00000100:00100000:0.0:1787508784.246544:0:208927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509678848 00000100:00100000:0.0:1787508784.246597:0:208927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509679360 00000100:00100000:0.0:1787508784.246600:0:208927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509679360 00000100:00100000:0.0:1787508784.246616:0:208927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509678976 00000100:00100000:0.0:1787508784.246618:0:208927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509678976 00000100:00100000:0.0:1787508784.246632:0:208927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509679488 00000100:00100000:0.0:1787508784.246634:0:208927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509679488 00000100:00100000:0.0:1787508784.246651:0:208927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2518 00000100:00100000:0.0:1787508784.246660:0:208927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2401:x1874324509678848:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508784.246813:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509678592 00000100:00100000:1.0:1787508784.246818:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509678592 00000100:00100000:1.0:1787508784.246850:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509679104 00000100:00100000:1.0:1787508784.246853:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509679104 00000100:00100000:1.0:1787508784.246872:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509678720 00000100:00100000:1.0:1787508784.246875:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509678720 00000100:00100000:1.0:1787508784.246904:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509679232 00000100:00100000:1.0:1787508784.246907:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509679232 00000100:00100000:1.0:1787508784.246922:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3172 00000100:00100000:1.0:1787508784.246929:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:2401:x1874324509678592:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508784.247003:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:2401:x1874324509678592:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 74us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508784.247011:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3172 00000100:00100000:1.0:1787508784.247028:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3173 00000100:00100000:1.0:1787508784.247034:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2401:x1874324509679104:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508784.247059:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2401:x1874324509679104:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508784.247065:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3173 00000100:00100000:1.0:1787508784.247077:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3174 00000100:00100000:1.0:1787508784.247083:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2401:x1874324509678720:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508784.247107:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2401:x1874324509678720:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508784.247113:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3174 00000100:00100000:1.0:1787508784.247124:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3175 00000100:00100000:1.0:1787508784.247129:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2401:x1874324509679232:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508784.247151:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2401:x1874324509679232:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508784.247157:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3175 00000100:00100000:1.0:1787508784.247176:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509678464 00000100:00100000:1.0:1787508784.247180:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509678464 00000100:00100000:1.0:1787508784.247206:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1044 00000100:00100000:1.0:1787508784.247212:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091cbbc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2401:x1874324509678464:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508784.247235:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091cbbc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2401:x1874324509678464:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508784.247241:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1044 00000100:00100000:1.0:1787508784.247269:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2519 00000100:00100000:1.0:1787508784.247276:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2401:x1874324509679360:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508784.247300:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2401:x1874324509679360:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508784.247306:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2519 00000100:00100000:1.0:1787508784.247320:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2520 00000100:00100000:1.0:1787508784.247327:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2401:x1874324509678976:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508784.247347:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2401:x1874324509678976:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508784.247353:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2520 00000100:00100000:1.0:1787508784.247362:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2521 00000100:00100000:1.0:1787508784.247367:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2401:x1874324509679488:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508784.247383:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2401:x1874324509679488:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 16us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508784.247388:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2521 00000100:00080000:1.0:1787508784.247437:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787508784.247440:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787508784.247443:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787508784.247446:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787508784.247814:0:208927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2401:x1874324509678848:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 1152us (1502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508784.247822:0:208927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2518 00010000:00010000:1.0:1787508784.698664:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508784.827237:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480241664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508784.827318:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508784.827501:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480241664 00000100:00100000:2.0:1787508784.827520:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480241664 00000100:00100000:2.0:1787508784.827597:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1757 00000100:00100000:2.0:1787508784.827608:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480241664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787508784.827638:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 131576384 pending 0 free 3881955328 avail 3650433024 00000100:00100000:2.0:1787508784.827686:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480241664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508784.827694:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1757 00000100:00080000:1.0:1787508784.827861:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508784.827898:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480241664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508784.829687:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480241792:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787508784.829750:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508784.831555:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480241792 00000100:00100000:0.0:1787508784.831567:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480241792 00000100:00100000:0.0:1787508784.831699:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1758 00000100:00100000:0.0:1787508784.831718:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480241792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787508784.831742:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 131576384 pending 0 free 3881955328 avail 3650433024 00000100:00100000:0.0:1787508784.831933:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480241792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 225us (2182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508784.831956:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1758 00000100:00100000:3.0:1787508784.832076:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480241792:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787508784.832543:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508785.539664:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508785.543073:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509679744 00000100:00100000:1.0:1787508785.543087:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509679744 00000100:00100000:1.0:1787508785.543175:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94279 00000100:00100000:1.0:1787508785.543186:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:345536:x1874324509679744:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:1.0:1787508785.543206:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508785.543209:0:202228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787508785.543237:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245000/0xb126349c40f362cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed40 expref: 13 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508785.543260:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508785.543265:0:202228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787508785.543279:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f362d4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaed47 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508785.543394:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f362db lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508785.543406:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f362db lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508785.543419:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f362db lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508785.543429:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1275:0x0]: returning size 1024 00010000:00010000:1.0:1787508785.543552:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f362d4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed47 expref: 15 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508785.543565:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f362db lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed47 expref: 14 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508785.543572:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1275:0x0].0x0 (ffff9090c96b8800) 00010000:00010000:1.0:1787508785.543574:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787508785.543576:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b600, rc 0) 00000100:00100000:1.0:1787508785.543649:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:345536:x1874324509679744:12345-192.168.201.30@tcp:101:dd.0 Request processed in 465us (3995us total) trans 12884944262 rc 0/0 00000100:00100000:1.0:1787508785.543656:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94279 00000100:00100000:3.0:1787508785.549698:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508785.549747:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508785.549769:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509679872 00000100:00100000:1.0:1787508785.549787:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509679872 00000100:00100000:1.0:1787508785.549859:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94280 00000100:00100000:1.0:1787508785.549870:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:345536:x1874324509679872:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:1.0:1787508785.549895:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508785.549915:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f362e9 lrc: 2/0,0 mode: --/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaed4e expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508785.549980:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f362f0 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508785.549998:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f362f0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508785.550010:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f362f0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508785.550295:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509680000 00000100:00100000:0.0:1787508785.550300:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509680000 00000100:00100000:0.0:1787508785.550344:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9836 00000100:00100000:0.0:1787508785.550352:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce781180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:2402:x1874324509680000:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508785.550364:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508785.550380:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f362db lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed47 expref: 16 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508785.550394:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1275:0x0].0x0 (ffff9090c96b8800) 00010000:00010000:0.0:1787508785.550399:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508785.550456:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce781180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:2402:x1874324509680000:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 104us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508785.550464:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9836 00010000:00010000:1.0:1787508785.550682:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f362e9 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed4e expref: 15 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508785.550697:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b400/0xb126349c40f362f0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed4e expref: 14 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508785.550704:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1275:0x0].0x0 (ffff9090c96b8800) 00010000:00010000:1.0:1787508785.550707:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787508785.550709:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b400, rc 0) 00000100:00100000:1.0:1787508785.550915:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:345536:x1874324509679872:12345-192.168.201.30@tcp:101:dd.0 Request processed in 1046us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508785.550922:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94280 00000100:00100000:0.0:1787508785.580435:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508785.580532:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509680256 00000100:00100000:2.0:1787508785.580542:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509680256 00000100:00100000:2.0:1787508785.580602:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15500 00000100:00100000:2.0:1787508785.580612:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:345536:x1874324509680256:12345-192.168.201.30@tcp:35:dd.0 00000100:00100000:2.0:1787508785.580900:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:345536:x1874324509680256:12345-192.168.201.30@tcp:35:dd.0 Request processed in 288us (472us total) trans 12884944263 rc 0/0 00000100:00100000:2.0:1787508785.580908:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15500 00000100:00100000:0.0:1787508785.642331:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508785.642487:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509680384 00000100:00100000:3.0:1787508785.642509:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509680384 00000100:00100000:3.0:1787508785.642578:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94281 00000100:00100000:3.0:1787508785.642590:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:345539:x1874324509680384:12345-192.168.201.30@tcp:101:stat.0 00010000:00010000:3.0:1787508785.642616:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508785.642638:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f362f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaed55 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508785.642704:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f362fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508785.642720:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f362fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508785.642731:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f362fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508785.642774:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508785.642778:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508785.642796:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f362fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508785.642889:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f362f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed55 expref: 17 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508785.642908:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f362fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed55 expref: 16 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508785.642917:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508785.642920:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508785.642923:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fc00, rc 0) 00000100:00100000:2.0:1787508785.643278:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:345539:x1874324509680384:12345-192.168.201.30@tcp:101:stat.0 Request processed in 687us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508785.643287:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94281 00010000:00010000:2.0:1787508785.722178:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508785.851273:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787508785.853016:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480242176:0@lo:400:kworker.0 00000100:00100000:3.0:1787508785.853118:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508785.853172:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787508785.853178:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480242048:0@lo:400:kworker.0 00000100:00100000:3.0:1787508785.853208:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508785.853257:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480242176 00000100:00100000:3.0:1787508785.853267:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480242176 00000100:00100000:3.0:1787508785.853343:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2522 00000100:00100000:3.0:1787508785.853355:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480242176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508785.853419:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480242176:12345-0@lo:400:kworker.0 Request processed in 67us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508785.853427:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2522 00000100:00100000:3.0:1787508785.853459:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480242048 00000100:00100000:3.0:1787508785.853463:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480242048 00000100:00100000:3.0:1787508785.853505:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29970 00000100:00100000:3.0:1787508785.853512:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480242048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508785.853549:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480242048:12345-0@lo:400:kworker.0 Request processed in 37us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508785.853556:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29970 00000100:00080000:3.0:1787508785.853574:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787508785.853613:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480242048:0@lo:400:kworker.0 00000100:00100000:3.0:1787508785.853627:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480242176:0@lo:400:kworker.0 00000100:00100000:3.0:1787508785.860010:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480242304:0@lo:400:kworker.0 00000100:00100000:3.0:1787508785.860126:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508785.860178:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480241920:0@lo:400:kworker.0 00000100:00100000:3.0:1787508785.860214:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508785.860315:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480241920 00000100:00100000:3.0:1787508785.860326:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480241920 00000100:00100000:3.0:1787508785.860384:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:3.0:1787508785.860394:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed92f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480241920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508785.860461:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed92f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480241920:12345-0@lo:400:kworker.0 Request processed in 67us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508785.860469:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:3.0:1787508785.860544:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480241920:0@lo:400:kworker.0 00000100:00100000:0.0:1787508785.861108:0:225832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480242304 00000100:00100000:0.0:1787508785.861115:0:225832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480242304 00000100:00100000:0.0:1787508785.861174:0:225832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2523 00000100:00100000:0.0:1787508785.861183:0:225832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480242304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508785.863597:0:225832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480242304:12345-0@lo:400:kworker.0 Request processed in 2400us (3456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508785.863616:0:225832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2523 00000100:00100000:2.0:1787508785.869571:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480242560:0@lo:400:kworker.0 00000100:00100000:2.0:1787508785.869689:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508785.870119:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480242560 00000100:00100000:0.0:1787508785.870131:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480242560 00000100:00100000:0.0:1787508785.870206:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29971 00000100:00100000:0.0:1787508785.870218:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf19b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480242560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508785.872962:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480242688:0@lo:400:kworker.0 00000100:00100000:3.0:1787508785.873112:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480242304:0@lo:400:kworker.0 00000100:00100000:3.0:1787508785.873139:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787508785.873148:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480242432:0@lo:400:kworker.0 00000100:00100000:0.0:1787508785.877447:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf19b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480242560:12345-0@lo:400:kworker.0 Request processed in 7215us (7742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508785.877468:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29971 00000100:00100000:2.0:1787508785.878684:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508785.878867:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944259 gen 2 00000004:00080000:2.0:1787508785.878876:0:3616:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944258 committed transno 12884944259 00000004:00080000:2.0:1787508785.878900:0:3616:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944259 committed transno 12884944259 00000100:00100000:2.0:1787508785.878918:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480242560:0@lo:400:kworker.0 00000100:00100000:0.0:1787508785.879357:0:225834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480242688 00000100:00100000:0.0:1787508785.879367:0:225834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480242688 00000100:00100000:0.0:1787508785.879455:0:225834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2524 00000100:00100000:0.0:1787508785.879466:0:225834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480242688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508785.880905:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874324480243072:0@lo:400:kworker.0 00000100:00100000:0.0:1787508785.881091:0:225834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480242688:12345-0@lo:400:kworker.0 Request processed in 1623us (2410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508785.881103:0:225834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2524 00000100:00080000:0.0:1787508785.881153:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787508785.881169:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874324480242944:0@lo:400:kworker.0 00000100:00100000:0.0:1787508785.881211:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508785.881860:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787508785.881869:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480242816:0@lo:400:kworker.0 00000100:00100000:3.0:1787508785.888041:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508785.888133:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480242944 00000100:00100000:3.0:1787508785.888148:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480242944 00000100:00100000:3.0:1787508785.888217:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480242432 00000100:00100000:3.0:1787508785.888221:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480242432 00000100:00100000:3.0:1787508785.888265:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3176 00000100:00100000:3.0:1787508785.888279:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874324480242944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508785.888361:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874324480242944:12345-0@lo:400:kworker.0 Request processed in 86us (7149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508785.888370:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3176 00000100:00100000:3.0:1787508785.888395:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3177 00000100:00100000:3.0:1787508785.888401:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480242432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508785.888433:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480242432:12345-0@lo:400:kworker.0 Request processed in 32us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508785.888439:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3177 00000100:00100000:3.0:1787508785.888520:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480242432:0@lo:400:kworker.0 00000100:00100000:3.0:1787508785.888655:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480243328:0@lo:400:kworker.0 00000100:00100000:3.0:1787508785.888694:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508785.892885:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480243328 00000100:00100000:3.0:1787508785.892904:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480243328 00000100:00100000:3.0:1787508785.893027:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3178 00000100:00100000:3.0:1787508785.893044:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480243328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508785.893177:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480243328:12345-0@lo:400:kworker.0 Request processed in 140us (4482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508785.893185:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3178 00000100:00100000:3.0:1787508785.893469:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480243328:0@lo:400:kworker.0 00000100:00100000:3.0:1787508785.893514:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787508785.893528:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480243456:0@lo:400:kworker.0 00000100:00100000:3.0:1787508785.893576:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508785.893641:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480243456 00000100:00100000:3.0:1787508785.893647:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480243456 00000100:00100000:3.0:1787508785.893680:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3179 00000100:00100000:3.0:1787508785.893687:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480243456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508785.894306:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480243456:12345-0@lo:400:kworker.0 Request processed in 541us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508785.894317:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3179 00000100:00100000:3.0:1787508785.894372:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480243456:0@lo:400:kworker.0 00000100:00100000:0.0:1787508785.901913:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508785.902044:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874324480242944:0@lo:400:kworker.0 00000100:00080000:0.0:1787508785.902106:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508785.902113:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787508785.902138:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874324480243200:0@lo:400:kworker.0 00000100:00100000:0.0:1787508785.902189:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508785.902245:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480242688:0@lo:400:kworker.0 00000100:00100000:0.0:1787508785.902288:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480243200 00000100:00100000:0.0:1787508785.902296:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480243200 00000100:00100000:0.0:1787508785.902363:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3180 00000100:00100000:0.0:1787508785.902374:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874324480243200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508785.902437:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874324480243200:12345-0@lo:400:kworker.0 Request processed in 64us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508785.902444:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3180 00000100:00080000:0.0:1787508785.902469:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787508785.902494:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874324480243200:0@lo:400:kworker.0 00000100:00100000:3.0:1787508785.904409:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480242816 00000100:00100000:3.0:1787508785.904427:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480242816 00000100:00100000:3.0:1787508785.904501:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2525 00000100:00100000:3.0:1787508785.904513:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480242816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508785.904629:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480242816:12345-0@lo:400:kworker.0 Request processed in 119us (2728us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508785.904636:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2525 00000100:00100000:0.0:1787508785.905550:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480242816:0@lo:400:kworker.0 00000100:00100000:2.0:1787508785.907888:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508785.908157:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480243072 00000100:00100000:3.0:1787508785.908170:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480243072 00000100:00100000:3.0:1787508785.908263:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3181 00000100:00100000:3.0:1787508785.908276:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874324480243072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508785.908357:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874324480243072:12345-0@lo:400:kworker.0 Request processed in 85us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508785.908365:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3181 00000100:00080000:0.0:1787508785.908577:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508785.908827:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874324480243072:0@lo:400:kworker.0 00000100:00100000:2.0:1787508786.367622:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480243584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787508786.367727:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508786.367894:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480243584 00000100:00100000:3.0:1787508786.367905:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480243584 00000100:00100000:3.0:1787508786.367985:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1759 00000100:00100000:1.0:1787508786.368918:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480243712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787508786.369001:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508786.369176:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480243584:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787508786.369183:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480243712 00000100:00100000:1.0:1787508786.369190:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480243712 00002000:00000024:3.0:1787508786.369217:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49603136 pending 0 free 3909767168 avail 3678244864 00000100:00100000:1.0:1787508786.369327:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1760 00000100:00100000:1.0:1787508786.369372:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480243712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787508786.369384:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49603136 pending 0 free 3909767168 avail 3678244864 00000100:00100000:3.0:1787508786.369417:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480243584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1422us (1691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508786.369417:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480243712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508786.369425:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1760 00000100:00100000:0.0:1787508786.369496:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480243584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787508786.369573:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480243712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787508786.377488:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1759 00010000:00010000:0.0:1787508786.747004:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508787.388864:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9acc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480243840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787508787.389009:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508787.389095:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480243840 00000100:00100000:3.0:1787508787.389104:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480243840 00000100:00100000:3.0:1787508787.389170:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29972 00000100:00100000:3.0:1787508787.389182:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480243840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787508787.389241:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442721792 avail 1296482304 00000100:00100000:3.0:1787508787.389306:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480243840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508787.389314:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29972 00000100:00100000:3.0:1787508787.389391:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9acc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480243840:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787508787.389540:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480243968:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787508787.389576:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508787.389614:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480243968 00000100:00100000:0.0:1787508787.389619:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480243968 00000100:00100000:0.0:1787508787.389653:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29973 00000100:00100000:0.0:1787508787.389660:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480243968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787508787.389685:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440645120 avail 1294405632 00000100:00100000:0.0:1787508787.389724:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480243968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508787.389734:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29973 00000100:00100000:0.0:1787508787.389767:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480243968:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787508787.770345:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508787.816082:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508787.816150:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508787.816760:0:208928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509680640 00000100:00100000:1.0:1787508787.816778:0:208928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509680640 00000100:00100000:1.0:1787508787.816878:0:208928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15090 00000100:00100000:1.0:1787508787.816892:0:208928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2403:x1874324509680640:12345-192.168.201.30@tcp:16:kworker.0 00000100:00100000:1.0:1787508787.817068:0:208928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2403:x1874324509680640:12345-192.168.201.30@tcp:16:kworker.0 Request processed in 179us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508787.817076:0:208928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15090 00000100:00080000:0.0:1787508787.817148:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787508787.831727:0:205404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509680512 00000100:00100000:2.0:1787508787.831751:0:205404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509680512 00002000:00100000:2.0:1787508787.831839:0:205404:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x158d:0x0] (0->1023) req@ffff9090c6bf3100 x1874324509680512/t0(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:243/0 lens 1512/0 e 0 to 0 dl 1787508798 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787508787.831861:0:205404:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090c6bf3100 with x1874324509680512 ext(0->1023) 00002000:00010000:2.0:1787508787.831869:0:205404:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9090c6bf3100 00000100:00100000:2.0:1787508787.831923:0:205404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:2.0:1787508787.831935:0:205404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2403:x1874324509680512:12345-192.168.201.30@tcp:4:dd.0 00000100:00100000:2.0:1787508787.838625:0:205404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2403:x1874324509680512:12345-192.168.201.30@tcp:4:dd.0 Request processed in 6680us (22461us total) trans 8589940564 rc 0/0 00000100:00100000:2.0:1787508787.838642:0:205404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 52 00002000:00100000:2.0:1787508787.838655:0:205404:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x158d:0x0] (0->1023) req@ffff9090c6bf3100 x1874324509680512/t8589940564(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:243/0 lens 1512/448 e 0 to 0 dl 1787508798 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787508787.838665:0:205404:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090c6bf3100 with x1874324509680512 ext(0->1023) 00002000:00010000:2.0:1787508787.838672:0:205404:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9090c6bf3100 00010000:00010000:1.0:1787508788.794341:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508789.356812:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508789.356874:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508789.356912:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508789.356997:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508789.357029:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508789.357056:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508789.357075:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508789.357093:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508789.357119:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508789.357153:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509680768 00000100:00100000:2.0:1787508789.357318:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509680896 00000100:00100000:2.0:1787508789.357330:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509680896 00000100:00100000:2.0:1787508789.357412:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509681408 00000100:00100000:2.0:1787508789.357415:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509681408 00000100:00100000:2.0:1787508789.357479:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509681024 00000100:00100000:2.0:1787508789.357483:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509681024 00000100:00100000:2.0:1787508789.357505:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509681536 00000100:00100000:2.0:1787508789.357509:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509681536 00000100:00100000:2.0:1787508789.357530:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3182 00000100:00100000:2.0:1787508789.357541:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:2403:x1874324509680896:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508789.357643:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:2403:x1874324509680896:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 103us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508789.358088:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3182 00000100:00100000:2.0:1787508789.358115:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3183 00000100:00100000:2.0:1787508789.358124:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2403:x1874324509681408:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508789.358155:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2403:x1874324509681408:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 33us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508789.358229:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3183 00000100:00100000:2.0:1787508789.358244:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3184 00000100:00100000:2.0:1787508789.358251:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2403:x1874324509681024:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508789.358279:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2403:x1874324509681024:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 28us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508789.358285:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3184 00000100:00100000:2.0:1787508789.358297:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3185 00000100:00100000:2.0:1787508789.358303:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2403:x1874324509681536:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508789.358326:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2403:x1874324509681536:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508789.358388:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3185 00000100:00100000:2.0:1787508789.358416:0:225835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509681152 00000100:00100000:2.0:1787508789.358422:0:225835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509681152 00000100:00100000:2.0:1787508789.358651:0:225835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509681664 00000100:00100000:0.0:1787508789.358663:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509681280 00000100:00100000:0.0:1787508789.358668:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509681280 00000100:00100000:0.0:1787508789.358698:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509681792 00000100:00100000:0.0:1787508789.358701:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509681792 00000100:00100000:2.0:1787508789.358719:0:225835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509681664 00000100:00100000:0.0:1787508789.358723:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2526 00000100:00100000:0.0:1787508789.358730:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509681152:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508789.358742:0:225835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2527 00000100:00100000:2.0:1787508789.358748:0:225835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2403:x1874324509681280:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508789.358762:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509681152:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 33us (1888us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508789.358768:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2526 00000100:00100000:2.0:1787508789.358770:0:225835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2403:x1874324509681280:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (1695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508789.358775:0:225835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2527 00000100:00100000:0.0:1787508789.358780:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2528 00000100:00100000:2.0:1787508789.358785:0:225835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2529 00000100:00100000:0.0:1787508789.358786:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2403:x1874324509681792:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508789.358791:0:225835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2403:x1874324509681664:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508789.358807:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2403:x1874324509681792:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (1688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508789.358808:0:225835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2403:x1874324509681664:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 18us (1812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508789.358814:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2528 00000100:00100000:2.0:1787508789.358899:0:225835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2529 00000100:00080000:1.0:1787508789.358970:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787508789.358976:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787508789.358979:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787508789.358982:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787508789.358988:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509680768 00000100:00100000:3.0:1787508789.359083:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1046 00000100:00100000:3.0:1787508789.359093:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed92e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509680768:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508789.359154:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed92e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509680768:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 63us (2125us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508789.359162:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1046 00000100:00100000:0.0:1787508789.433243:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508789.435392:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509681920 00000100:00100000:2.0:1787508789.435414:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509681920 00000100:00100000:2.0:1787508789.435557:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94282 00000100:00100000:2.0:1787508789.435570:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:345559:x1874324509681920:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:2.0:1787508789.435598:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508789.436344:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f36305 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaed5c expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508789.436540:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f3630c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508789.436558:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f3630c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508789.436576:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f3630c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508789.436872:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508789.437560:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508789.437598:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f3630c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508789.438022:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aba00/0xb126349c40f36305 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed5c expref: 13 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508789.438054:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f3630c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed5c expref: 12 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508789.438064:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508789.438067:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508789.438072:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab800, rc 0) 00000100:00100000:2.0:1787508789.439771:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:345559:x1874324509681920:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 4188us (6528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508789.439787:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94282 00000100:00100000:2.0:1787508789.448016:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508789.448973:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509682176 00000100:00100000:3.0:1787508789.448991:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509682176 00000100:00100000:3.0:1787508789.449075:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94283 00000100:00100000:3.0:1787508789.449088:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:345559:x1874324509682176:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:3.0:1787508789.449118:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508789.449122:0:202228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787508789.449168:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f3630c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed5c expref: 12 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508789.449201:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508789.449207:0:202228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508789.449227:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36313 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaed63 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508789.449904:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3631a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508789.449924:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3631a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508789.449935:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3631a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508789.449998:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f36321 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508789.450006:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f36321 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508789.450014:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f36321 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508789.450093:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f36328 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508789.450103:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f36328 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508789.450111:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f36328 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508789.450122:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1275:0x0]: returning size 1024 00010000:00010000:3.0:1787508789.450242:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3631a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508789.450250:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3631a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508789.450257:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3631a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508789.450264:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3631a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508789.450271:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508789.450276:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3631a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508789.450288:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3631a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508789.450300:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508789.450303:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508789.450307:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3631a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508789.450313:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3631a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508789.450325:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f36321 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508789.450332:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f36321 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508789.451857:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f36321 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508789.451866:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508789.451870:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f36321 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508789.452981:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f36321 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508789.453010:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x27849676 (ffff9090d6c69c00) 00010000:00010000:3.0:1787508789.453013:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508789.453019:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f36321 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508789.453028:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f36321 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508789.453120:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36313 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed63 expref: 14 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508789.453138:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f36328 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed63 expref: 13 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508789.453147:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1275:0x0].0x0 (ffff9090c96b8800) 00010000:00010000:3.0:1787508789.453149:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787508789.453153:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ec00, rc 0) 00000100:00100000:3.0:1787508789.457091:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:345559:x1874324509682176:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 7991us (9076us total) trans 12884944264 rc 0/0 00000100:00100000:3.0:1787508789.457106:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94283 00000100:00100000:3.0:1787508789.467798:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508789.468044:0:208927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509682304 00000100:00100000:0.0:1787508789.468057:0:208927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509682304 00000100:00100000:0.0:1787508789.468134:0:208927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15091 00000100:00100000:0.0:1787508789.468146:0:208927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:345559:x1874324509682304:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:0.0:1787508789.468343:0:208927:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508789.468371:0:208927:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8508683/0xb126349c40f36336 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaed6a expref: -99 pid: 208927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508789.468671:0:208927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000db375ae6/0xb126349c40f362bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed39 expref: 9 pid: 225841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508789.468683:0:208927:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x158d:0x0].0x0 since=7s v=(0 0) 00010000:00010000:0.0:1787508789.468689:0:208927:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x158d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787508789.468696:0:208927:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8508683/0xb126349c40f36336 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 3 type: EXT [8192->16383] (req 8192->16383) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed6a expref: 8 pid: 208927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508789.468740:0:208927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000db375ae6/0xb126349c40f362bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed39 expref: 9 pid: 225841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508789.468816:0:208927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000db375ae6/0xb126349c40f362bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed39 expref: 9 pid: 225841 timeout: 13860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508789.468835:0:208927:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:208927:1874324480244096:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508789.469854:0:208927:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c6b58540 going to sleep for 11 seconds 00000100:00100000:0.0:1787508789.476873:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508789.477296:0:208927:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:208927:1874324480244096:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508789.477410:0:208927:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b8508683/0xb126349c40f36336 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 3 type: EXT [8192->16383] (req 8192->16383) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed6a expref: 8 pid: 208927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508789.477456:0:208927:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4000, rc 0) 00000100:00100000:2.0:1787508789.477546:0:208927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:345559:x1874324509682304:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 9400us (9942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508789.477559:0:208927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15091 00000100:00100000:1.0:1787508789.477750:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509682432 00000100:00100000:1.0:1787508789.477770:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509682432 00010000:00010000:1.0:1787508789.478135:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000db375ae6/0xb126349c40f362bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed39 expref: 10 pid: 225841 timeout: 13860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508789.478296:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27974 00000100:00100000:1.0:1787508789.478307:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2401:x1874324509682432:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508789.478327:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787508789.478503:0:205406:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x158d:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:1.0:1787508789.478508:0:205406:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x158d:0x0] updating lvb mtime from disk: 0 -> 1787508786 00002000:00010000:1.0:1787508789.478510:0:205406:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x158d:0x0] updating lvb ctime from disk: 0 -> 1787508786 00002000:00010000:1.0:1787508789.478512:0:205406:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x158d:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787508789.478520:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000db375ae6/0xb126349c40f362bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed39 expref: 10 pid: 225841 timeout: 13860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508789.478536:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000db375ae6/0xb126349c40f362bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed39 expref: 10 pid: 225841 timeout: 13860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508789.478568:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db375ae6/0xb126349c40f362bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed39 expref: 10 pid: 225841 timeout: 13860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508789.478587:0:205406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x158d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787508789.478592:0:205406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x158d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787508789.480185:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8508683/0xb126349c40f36336 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed6a expref: 7 pid: 208927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508789.480208:0:205406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8508683/0xb126349c40f36336 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed6a expref: 7 pid: 208927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508789.480275:0:205406:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b8508683/0xb126349c40f36336 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed6a expref: 7 pid: 208927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508789.480295:0:205406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:205406:1874324480244224:192.168.201.30@tcp:105: 00000100:00100000:1.0:1787508789.480431:0:205406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090e6fc3900 going to sleep for 11 seconds 00000100:00100000:1.0:1787508789.487807:0:205406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:205406:1874324480244224:192.168.201.30@tcp:105: 00010000:00010000:1.0:1787508789.487845:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508789.487931:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:2401:x1874324509682432:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 9624us (11071us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508789.487995:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27974 00010000:00010000:2.0:1787508789.820930:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508789.946534:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787508789.946571:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480244352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508789.946682:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508789.946849:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480244352 00000100:00100000:2.0:1787508789.946860:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480244352 00000100:00100000:3.0:1787508789.947118:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1761 00000100:00100000:3.0:1787508789.947134:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480244352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787508789.947285:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 140014144 pending 28672 free 3881951232 avail 3650428928 00000100:00100000:3.0:1787508789.947357:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480244352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 228us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508789.947365:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1761 00000100:00100000:0.0:1787508789.947709:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787508789.947723:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480244480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787508789.947761:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508789.947825:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480244480 00000100:00100000:0.0:1787508789.947830:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480244480 00000100:00100000:0.0:1787508789.947861:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1762 00000100:00100000:0.0:1787508789.947868:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480244480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787508789.947896:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 140014144 pending 28672 free 3881951232 avail 3650428928 00000100:00100000:0.0:1787508789.947930:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480244480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508789.947936:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1762 00000100:00080000:1.0:1787508789.948281:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508789.948330:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480244352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787508789.948514:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480244480:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787508790.852907:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508790.970371:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480244992:0@lo:400:kworker.0 00000100:00100000:2.0:1787508790.970489:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508790.970539:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480245504:0@lo:400:kworker.0 00000100:00100000:2.0:1787508790.970567:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508790.970587:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480246016:0@lo:400:kworker.0 00000100:00100000:2.0:1787508790.970613:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508790.970643:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787508790.970649:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480244864:0@lo:400:kworker.0 00000100:00100000:2.0:1787508790.970674:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508790.970692:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480245376:0@lo:400:kworker.0 00000100:00100000:2.0:1787508790.970713:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508790.970729:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874324480245888:0@lo:400:kworker.0 00000100:00100000:2.0:1787508790.970750:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508790.970783:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480244992 00000100:00100000:2.0:1787508790.970791:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480244992 00000100:00100000:2.0:1787508790.970848:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480245504 00000100:00100000:2.0:1787508790.970851:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480245504 00000100:00100000:2.0:1787508790.970863:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480244864 00000100:00100000:2.0:1787508790.970865:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480244864 00000100:00100000:2.0:1787508790.970885:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480245376 00000100:00100000:2.0:1787508790.970887:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480245376 00000100:00100000:2.0:1787508790.970904:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2530 00000100:00100000:2.0:1787508790.970911:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480244992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508790.970994:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480244992:12345-0@lo:400:kworker.0 Request processed in 83us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508790.970999:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2530 00000100:00100000:2.0:1787508790.971015:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2531 00000100:00100000:2.0:1787508790.971020:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480245504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508790.971046:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480245504:12345-0@lo:400:kworker.0 Request processed in 26us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508790.971055:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2531 00000100:00100000:2.0:1787508790.971067:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2532 00000100:00100000:2.0:1787508790.971073:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480244864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508790.971099:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480244864:12345-0@lo:400:kworker.0 Request processed in 27us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508790.971105:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2532 00000100:00100000:2.0:1787508790.971116:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2533 00000100:00100000:2.0:1787508790.971121:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480245376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508790.971146:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480245376:12345-0@lo:400:kworker.0 Request processed in 25us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508790.971153:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2533 00000100:00100000:2.0:1787508790.971176:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480246016 00000100:00100000:2.0:1787508790.971180:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480246016 00000100:00100000:2.0:1787508790.971205:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480245888 00000100:00100000:2.0:1787508790.971208:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480245888 00000100:00100000:2.0:1787508790.971221:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3186 00000100:00100000:2.0:1787508790.971225:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480246016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508790.971246:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480246016:12345-0@lo:400:kworker.0 Request processed in 21us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508790.971250:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3186 00000100:00100000:2.0:1787508790.971257:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3187 00000100:00100000:2.0:1787508790.971260:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874324480245888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508790.971275:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874324480245888:12345-0@lo:400:kworker.0 Request processed in 15us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508790.971278:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3187 00000100:00080000:2.0:1787508790.971297:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787508790.971300:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787508790.971302:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787508790.971336:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480244864:0@lo:400:kworker.0 00000100:00100000:2.0:1787508790.971348:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480245376:0@lo:400:kworker.0 00000100:00100000:2.0:1787508790.971357:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874324480245888:0@lo:400:kworker.0 00000100:00100000:2.0:1787508790.971366:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480244992:0@lo:400:kworker.0 00000100:00100000:2.0:1787508790.971374:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480245504:0@lo:400:kworker.0 00000100:00100000:2.0:1787508790.971382:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480246016:0@lo:400:kworker.0 00000100:00100000:0.0:1787508790.971552:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480244736:0@lo:400:kworker.0 00000100:00100000:0.0:1787508790.971591:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508790.971627:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480245248:0@lo:400:kworker.0 00000100:00100000:0.0:1787508790.971651:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508790.971672:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480245760:0@lo:400:kworker.0 00000100:00100000:0.0:1787508790.971689:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508790.971706:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1787508790.971710:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79de3f65-4bad-42d0-a46f-842a654b33a0:3619:1874324480244608:0@lo:400:kworker.0 00000100:00100000:0.0:1787508790.971730:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508790.971751:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480245120:0@lo:400:kworker.0 00000100:00100000:0.0:1787508790.971764:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508790.971776:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874324480245632:0@lo:400:kworker.0 00000100:00100000:0.0:1787508790.971797:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508790.971813:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874324480246144:0@lo:400:kworker.0 00000100:00100000:0.0:1787508790.971833:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508790.971877:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480244736 00000100:00100000:0.0:1787508790.971881:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480244736 00000100:00100000:0.0:1787508790.971913:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480245248 00000100:00100000:0.0:1787508790.971916:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480245248 00000100:00100000:0.0:1787508790.971935:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29974 00000100:00100000:0.0:1787508790.971970:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480244736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508790.972013:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480244736:12345-0@lo:400:kworker.0 Request processed in 72us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508790.972020:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29974 00000100:00100000:0.0:1787508790.972036:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29975 00000100:00100000:0.0:1787508790.972042:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480245248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508790.972069:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480245248:12345-0@lo:400:kworker.0 Request processed in 28us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508790.972075:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29975 00000100:00100000:0.0:1787508790.972093:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480245760 00000100:00100000:0.0:1787508790.972096:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480245760 00000100:00100000:0.0:1787508790.972125:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480245120 00000100:00100000:0.0:1787508790.972128:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480245120 00000100:00100000:0.0:1787508790.972139:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480245632 00000100:00100000:0.0:1787508790.972140:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480245632 00000100:00100000:0.0:1787508790.972149:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480246144 00000100:00100000:0.0:1787508790.972152:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480246144 00000100:00100000:0.0:1787508790.972167:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3188 00000100:00100000:0.0:1787508790.972173:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480245760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508790.972203:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480245760:12345-0@lo:400:kworker.0 Request processed in 31us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508790.972208:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3188 00000100:00100000:0.0:1787508790.972216:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3189 00000100:00100000:0.0:1787508790.972219:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480245120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508790.972236:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480245120:12345-0@lo:400:kworker.0 Request processed in 17us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508790.972241:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3189 00000100:00100000:0.0:1787508790.972246:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3190 00000100:00100000:0.0:1787508790.972249:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874324480245632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508790.972262:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874324480245632:12345-0@lo:400:kworker.0 Request processed in 12us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508790.972265:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3190 00000100:00100000:0.0:1787508790.972270:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3191 00000100:00100000:0.0:1787508790.972273:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874324480246144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508790.972286:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874324480246144:12345-0@lo:400:kworker.0 Request processed in 13us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508790.972290:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3191 00000100:00100000:0.0:1787508790.972302:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480244608 00000100:00100000:0.0:1787508790.972305:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480244608 00000100:00100000:0.0:1787508790.972321:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:0.0:1787508790.972324:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed92c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3619:x1874324480244608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508790.972342:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed92c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3619:x1874324480244608:12345-0@lo:400:kworker.0 Request processed in 18us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508790.972346:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00080000:0.0:1787508790.972373:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508790.972377:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787508790.972410:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79de3f65-4bad-42d0-a46f-842a654b33a0:3619:1874324480244608:0@lo:400:kworker.0 00000100:00100000:0.0:1787508790.972423:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480245120:0@lo:400:kworker.0 00000100:00100000:0.0:1787508790.972432:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874324480245632:0@lo:400:kworker.0 00000100:00100000:0.0:1787508790.973898:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874324480246144:0@lo:400:kworker.0 00000100:00100000:0.0:1787508790.973927:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480244736:0@lo:400:kworker.0 00000100:00100000:0.0:1787508790.973936:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480245248:0@lo:400:kworker.0 00000100:00100000:0.0:1787508790.973955:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480245760:0@lo:400:kworker.0 00000001:00080000:3.0:1787508790.978687:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944264 is committed 00000001:00080000:3.0:1787508790.978710:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944263 is committed 00000100:00100000:2.0:1787508791.410241:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508791.410627:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509682688 00000100:00100000:0.0:1787508791.410642:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509682688 00000100:00100000:0.0:1787508791.410746:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94284 00000100:00100000:0.0:1787508791.410759:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:345561:x1874324509682688:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1787508791.410784:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508791.410788:0:230618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787508791.410831:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f362fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed55 expref: 14 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508791.410865:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508791.410872:0:230618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508791.410896:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3633d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaed71 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508791.411101:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f36344 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508791.411114:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f36344 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508791.411123:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f36344 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508791.411429:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1275:0x0]: returning size 1024 00010000:00010000:0.0:1787508791.411595:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3633d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed71 expref: 16 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508791.411615:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f36344 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed71 expref: 15 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508791.411629:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1275:0x0].0x0 (ffff9090c96b8800) 00010000:00010000:0.0:1787508791.411632:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787508791.411636:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4e00, rc 0) 00000100:00100000:0.0:1787508791.411719:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:345561:x1874324509682688:12345-192.168.201.30@tcp:101:dd.0 Request processed in 964us (1494us total) trans 12884944265 rc 0/0 00000100:00100000:0.0:1787508791.411727:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94284 00000100:00080000:2.0:1787508791.412072:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787508791.431897:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508791.435875:0:208928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509682816 00000100:00100000:1.0:1787508791.435899:0:208928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509682816 00000100:00080000:2.0:1787508791.436022:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508791.436043:0:208928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15092 00000100:00100000:1.0:1787508791.436062:0:208928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:345561:x1874324509682816:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:1.0:1787508791.436088:0:208928:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508791.436114:0:208928:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7a8fae3/0xb126349c40f36352 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaed78 expref: -99 pid: 208928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508791.436157:0:208928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8508683/0xb126349c40f36336 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed6a expref: 7 pid: 208927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508791.436168:0:208928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x158d:0x0].0x0 since=2s v=(1 0) 00010000:00010000:1.0:1787508791.436173:0:208928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x158d:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1787508791.436179:0:208928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7a8fae3/0xb126349c40f36352 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed78 expref: 10 pid: 208928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508791.436226:0:208928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b8508683/0xb126349c40f36336 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed6a expref: 7 pid: 208927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508791.436249:0:208928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b8508683/0xb126349c40f36336 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed6a expref: 7 pid: 208927 timeout: 13862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508791.436267:0:208928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:208928:1874324480246272:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508791.436427:0:208928:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090e6fc3900 going to sleep for 11 seconds 00000100:00100000:1.0:1787508791.452881:0:208928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:208928:1874324480246272:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508791.452933:0:208928:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f7a8fae3/0xb126349c40f36352 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed78 expref: 10 pid: 208928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508791.453001:0:208928:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a600, rc 0) 00000100:00100000:1.0:1787508791.453076:0:208928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:345561:x1874324509682816:12345-192.168.201.30@tcp:101:dd.0 Request processed in 17020us (21338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508791.453086:0:208928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15092 00000100:00100000:2.0:1787508791.457822:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508791.458157:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509682944 00000100:00100000:0.0:1787508791.458170:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509682944 00000100:00100000:0.0:1787508791.458268:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9837 00000100:00100000:0.0:1787508791.458283:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:2400:x1874324509682944:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508791.458312:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508791.458356:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f36344 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed71 expref: 15 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508791.458385:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1275:0x0].0x0 (ffff9090c96b8800) 00010000:00010000:0.0:1787508791.458400:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508791.458500:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:2400:x1874324509682944:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 220us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508791.458509:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9837 00000100:00100000:1.0:1787508791.459601:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508791.460698:0:203732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509683072 00000100:00100000:0.0:1787508791.460713:0:203732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509683072 00002000:00100000:0.0:1787508791.460798:0:203732:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x158d:0x0] (8192->16383) req@ffff9090d55a5500 x1874324509683072/t0(0) o4->eb35f31c-097f-45a3-8275-bc75f97f89ee@192.168.201.30@tcp:247/0 lens 8680/0 e 0 to 0 dl 1787508802 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787508791.460812:0:203732:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090d55a5500 with x1874324509683072 ext(8192->16383) 00010000:00010000:0.0:1787508791.460823:0:203732:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b8508683/0xb126349c40f36336 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed6a expref: 8 pid: 208927 timeout: 13862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508791.460845:0:203732:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b8508683/0xb126349c40f36336 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed6a expref: 8 pid: 208927 timeout: 13862 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787508791.460854:0:203732:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9090d55a5500 00000100:00100000:0.0:1787508791.460895:0:203732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:0.0:1787508791.460907:0:203732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2403:x1874324509683072:12345-192.168.201.30@tcp:4:multiop.0 00000100:00080000:2.0:1787508791.461366:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508791.463990:0:203732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2403:x1874324509683072:12345-192.168.201.30@tcp:4:multiop.0 Request processed in 3070us (4381us total) trans 8589940565 rc 0/0 00000100:00100000:0.0:1787508791.464008:0:203732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00002000:00100000:0.0:1787508791.464023:0:203732:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x158d:0x0] (8192->16383) req@ffff9090d55a5500 x1874324509683072/t8589940565(0) o4->eb35f31c-097f-45a3-8275-bc75f97f89ee@192.168.201.30@tcp:247/0 lens 8680/448 e 0 to 0 dl 1787508802 ref 1 fl Complete:H/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787508791.464036:0:203732:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090d55a5500 with x1874324509683072 ext(8192->16383) 00010000:00010000:0.0:1787508791.464048:0:203732:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b8508683/0xb126349c40f36336 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed6a expref: 10 pid: 208927 timeout: 13862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508791.464071:0:203732:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b8508683/0xb126349c40f36336 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed6a expref: 10 pid: 208927 timeout: 13862 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787508791.464079:0:203732:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9090d55a5500 00000100:00100000:1.0:1787508791.475911:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508791.480100:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509683200 00000100:00100000:0.0:1787508791.480123:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509683200 00010000:00010000:0.0:1787508791.480196:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b8508683/0xb126349c40f36336 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed6a expref: 10 pid: 208927 timeout: 13862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508791.480263:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27975 00000100:00100000:0.0:1787508791.480275:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2402:x1874324509683200:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508791.480295:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787508791.480320:0:229383:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x158d:0x0] updating lvb size from disk: 1024 -> 16384 00002000:00010000:0.0:1787508791.480568:0:229383:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x158d:0x0] updating lvb mtime from disk: 1787508786 -> 1787508790 00002000:00010000:0.0:1787508791.480570:0:229383:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x158d:0x0] updating lvb ctime from disk: 1787508786 -> 1787508790 00002000:00010000:0.0:1787508791.480573:0:229383:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x158d:0x0] updating lvb blocks from disk: 8 -> 24 00010000:00010000:0.0:1787508791.480583:0:229383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b8508683/0xb126349c40f36336 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed6a expref: 10 pid: 208927 timeout: 13862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508791.480603:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b8508683/0xb126349c40f36336 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed6a expref: 10 pid: 208927 timeout: 13862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508791.480650:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8508683/0xb126349c40f36336 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed6a expref: 10 pid: 208927 timeout: 13862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508791.480673:0:229383:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x158d:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1787508791.480677:0:229383:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x158d:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1787508791.480688:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7a8fae3/0xb126349c40f36352 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed78 expref: 9 pid: 208928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508791.480704:0:229383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7a8fae3/0xb126349c40f36352 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed78 expref: 9 pid: 208928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508791.480755:0:229383:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f7a8fae3/0xb126349c40f36352 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed78 expref: 9 pid: 208928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508791.480772:0:229383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:229383:1874324480246400:192.168.201.30@tcp:105: 00000100:00100000:0.0:1787508791.480898:0:229383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c6b58d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787508791.483048:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480246528:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787508791.483137:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508791.483647:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480246528 00000100:00100000:0.0:1787508791.483658:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480246528 00000100:00100000:0.0:1787508791.483716:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1763 00000100:00100000:0.0:1787508791.483727:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480246528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787508791.483767:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49603136 pending 0 free 3909767168 avail 3678244864 00000100:00100000:0.0:1787508791.483830:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480246528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508791.483839:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1763 00000100:00100000:2.0:1787508791.487353:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480246528:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787508791.489169:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480246656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787508791.489269:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508791.489447:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480246656 00000100:00100000:0.0:1787508791.489468:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480246656 00000100:00100000:0.0:1787508791.489539:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1764 00000100:00100000:0.0:1787508791.489551:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480246656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787508791.489579:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49603136 pending 0 free 3909767168 avail 3678244864 00000100:00100000:0.0:1787508791.490088:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480246656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 538us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508791.490098:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1764 00000100:00100000:3.0:1787508791.490841:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480246656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787508791.491929:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508791.492144:0:203733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509683328 00000100:00100000:1.0:1787508791.492154:0:203733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509683328 00002000:00100000:1.0:1787508791.492220:0:203733:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x158d:0x0] (0->4095) req@ffff9090c6b57100 x1874324509683328/t0(0) o3->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:247/0 lens 488/0 e 0 to 0 dl 1787508802 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787508791.492233:0:203733:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090c6b57100 with x1874324509683328 ext(0->4095) 00002000:00010000:1.0:1787508791.492240:0:203733:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9090c6b57100 00000100:00100000:1.0:1787508791.492275:0:203733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:1.0:1787508791.492287:0:203733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2401:x1874324509683328:12345-192.168.201.30@tcp:3:dd.0 00000100:00100000:1.0:1787508791.492549:0:203733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2401:x1874324509683328:12345-192.168.201.30@tcp:3:dd.0 Request processed in 264us (626us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787508791.492557:0:203733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 53 00002000:00100000:1.0:1787508791.492564:0:203733:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x158d:0x0] (0->4095) req@ffff9090c6b57100 x1874324509683328/t0(0) o3->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:247/0 lens 488/4536 e 0 to 0 dl 1787508802 ref 1 fl Complete:/600/0 rc 4096/4096 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787508791.492573:0:203733:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090c6b57100 with x1874324509683328 ext(0->4095) 00002000:00010000:1.0:1787508791.492576:0:203733:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9090c6b57100 00000100:00100000:0.0:1787508791.495058:0:229383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:229383:1874324480246400:192.168.201.30@tcp:105: 00010000:00010000:0.0:1787508791.495093:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508791.495171:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2402:x1874324509683200:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 14897us (19274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508791.495184:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27975 00000100:00100000:2.0:1787508791.504431:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508791.504801:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509683584 00000100:00100000:3.0:1787508791.504816:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509683584 00000100:00100000:3.0:1787508791.504902:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15501 00000100:00100000:3.0:1787508791.504914:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:345561:x1874324509683584:12345-192.168.201.30@tcp:35:dd.0 00000001:00080000:3.0:1787508791.505272:0:210243:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884944266 00000100:00100000:3.0:1787508791.505443:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:345561:x1874324509683584:12345-192.168.201.30@tcp:35:dd.0 Request processed in 530us (1035us total) trans 12884944267 rc 0/0 00000100:00100000:3.0:1787508791.505452:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15501 00000020:00080000:3.0:1787508791.505458:0:210243:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787508791.868903:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508792.506405:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787508792.506439:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480246784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787508792.506544:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508792.506676:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480246784 00000100:00100000:0.0:1787508792.506686:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480246784 00000100:00100000:0.0:1787508792.506772:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29976 00000100:00100000:0.0:1787508792.506784:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480246784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787508792.506841:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440645120 avail 1294405632 00000100:00100000:0.0:1787508792.506907:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480246784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508792.506914:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29976 00000100:00100000:2.0:1787508792.507190:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480246784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787508792.508469:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480246912:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787508792.508548:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508792.513022:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480246912 00000100:00100000:1.0:1787508792.513044:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480246912 00000100:00100000:1.0:1787508792.513147:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29977 00000100:00100000:1.0:1787508792.513160:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480246912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787508792.513223:0:202232:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442721792 avail 1296482304 00000100:00100000:1.0:1787508792.513364:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480246912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 206us (4815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508792.513382:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29977 00000100:00100000:3.0:1787508792.514023:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480246912:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787508792.891039:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508792.937786:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508792.937844:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508792.938226:0:203731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509683712 00000100:00100000:0.0:1787508792.938240:0:203731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509683712 00002000:00100000:0.0:1787508792.938315:0:203731:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x158d:0x0] (0->4095) req@ffff9090d1cbe300 x1874324509683712/t0(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:248/0 lens 4584/0 e 0 to 0 dl 1787508803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787508792.938318:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509683840 00000100:00100000:1.0:1787508792.938323:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509683840 00002000:00100000:0.0:1787508792.938327:0:203731:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090d1cbe300 with x1874324509683712 ext(0->4095) 00002000:00010000:0.0:1787508792.938335:0:203731:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9090d1cbe300 00000100:00100000:1.0:1787508792.938380:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15093 00000100:00100000:0.0:1787508792.938380:0:203731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:0.0:1787508792.938390:0:203731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:2402:x1874324509683712:12345-192.168.201.30@tcp:4:dd.0 00000100:00100000:1.0:1787508792.938391:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:2402:x1874324509683840:12345-192.168.201.30@tcp:16:kworker.0 00000100:00100000:0.0:1787508792.941359:0:203731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:2402:x1874324509683712:12345-192.168.201.30@tcp:4:dd.0 Request processed in 2952us (3496us total) trans 8589940566 rc 0/0 00000100:00100000:0.0:1787508792.941387:0:203731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 54 00002000:00100000:0.0:1787508792.941404:0:203731:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x158d:0x0] (0->4095) req@ffff9090d1cbe300 x1874324509683712/t8589940566(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:248/0 lens 4584/448 e 0 to 0 dl 1787508803 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787508792.941418:0:203731:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090d1cbe300 with x1874324509683712 ext(0->4095) 00002000:00010000:0.0:1787508792.941426:0:203731:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9090d1cbe300 00000001:00080000:1.0:1787508792.942843:0:204539:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589940565 is committed 00000001:00080000:1.0:1787508792.942868:0:204539:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589940564 is committed 00000100:00100000:2.0:1787508792.953833:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2402:x1874324509683840:12345-192.168.201.30@tcp:16:kworker.0 Request processed in 15425us (16044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508792.953850:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15093 00000100:00100000:2.0:1787508793.557214:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508793.557344:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509684096 00000100:00100000:0.0:1787508793.557370:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509684096 00000100:00100000:0.0:1787508793.557460:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15502 00000100:00100000:0.0:1787508793.557474:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:345559:x1874324509684096:12345-192.168.201.30@tcp:35:multiop.0 00000100:00100000:0.0:1787508793.558315:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:345559:x1874324509684096:12345-192.168.201.30@tcp:35:multiop.0 Request processed in 837us (1109us total) trans 12884944268 rc 0/0 00000100:00100000:0.0:1787508793.558327:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15502 00000100:00080000:2.0:1787508793.559905:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787508793.622102:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508793.622217:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509684224 00000100:00100000:0.0:1787508793.622227:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509684224 00000100:00100000:0.0:1787508793.622310:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94285 00000100:00100000:0.0:1787508793.622330:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:345565:x1874324509684224:12345-192.168.201.30@tcp:101:stat.0 00010000:00010000:0.0:1787508793.622379:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508793.622397:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f36359 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaed7f expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508793.622454:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f36360 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508793.622468:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f36360 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508793.622480:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f36360 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508793.622520:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787508793.622524:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508793.622542:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f36360 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508793.622564:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f36359 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed7f expref: 18 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508793.622582:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f36360 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed7f expref: 17 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508793.622590:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508793.622593:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508793.622596:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4e00, rc 0) 00000100:00080000:2.0:1787508793.622877:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787508793.622908:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:345565:x1874324509684224:12345-192.168.201.30@tcp:101:stat.0 Request processed in 587us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508793.622915:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94285 00010000:00010000:2.0:1787508793.927377:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508794.472782:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508794.472829:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508794.472849:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508794.472865:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508794.472890:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508794.472911:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508794.472937:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508794.472966:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509684352 00000100:00100000:3.0:1787508794.472977:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509684352 00000100:00100000:1.0:1787508794.472978:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508794.472996:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508794.473016:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509684736 00000100:00100000:1.0:1787508794.473019:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509684736 00000100:00100000:3.0:1787508794.473028:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1048 00000100:00100000:3.0:1787508794.473037:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed92c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509684352:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508794.473051:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509685248 00000100:00100000:1.0:1787508794.473054:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509685248 00000100:00100000:1.0:1787508794.473068:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509684864 00000100:00100000:1.0:1787508794.473070:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509684864 00000100:00100000:1.0:1787508794.473097:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509685376 00000100:00100000:1.0:1787508794.473100:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509685376 00000100:00100000:3.0:1787508794.473105:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed92c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509684352:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 69us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508794.473113:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1048 00000100:00100000:1.0:1787508794.473118:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2534 00000100:00100000:1.0:1787508794.473124:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509684736:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508794.473151:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509684736:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 27us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508794.473157:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2534 00000100:00100000:1.0:1787508794.473168:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2535 00000100:00100000:1.0:1787508794.473173:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2402:x1874324509685248:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508794.473192:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2402:x1874324509685248:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 18us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508794.473198:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2535 00000100:00100000:1.0:1787508794.473207:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2536 00000100:00100000:1.0:1787508794.473212:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2402:x1874324509684864:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508794.473232:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2402:x1874324509684864:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 20us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508794.473238:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2536 00000100:00100000:1.0:1787508794.473254:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2537 00000100:00100000:1.0:1787508794.473261:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2402:x1874324509685376:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508794.473296:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2402:x1874324509685376:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 35us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508794.473302:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2537 00000100:00100000:1.0:1787508794.473320:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509684480 00000100:00100000:1.0:1787508794.473323:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509684480 00000100:00100000:1.0:1787508794.473522:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509684992 00000100:00100000:1.0:1787508794.473526:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509684992 00000100:00100000:1.0:1787508794.473544:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509684608 00000100:00100000:1.0:1787508794.473547:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509684608 00000100:00100000:1.0:1787508794.473561:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509685120 00000100:00100000:1.0:1787508794.473564:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509685120 00000100:00100000:1.0:1787508794.473578:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3192 00000100:00100000:1.0:1787508794.473584:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:2402:x1874324509684480:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508794.473612:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:2402:x1874324509684480:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 28us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508794.473619:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3192 00000100:00100000:1.0:1787508794.473631:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3193 00000100:00100000:1.0:1787508794.473637:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2402:x1874324509684992:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508794.473666:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:2402:x1874324509684992:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 29us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508794.473672:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3193 00000100:00100000:1.0:1787508794.473684:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3194 00000100:00100000:1.0:1787508794.473690:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2402:x1874324509684608:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508794.473725:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2402:x1874324509684608:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 35us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508794.473731:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3194 00000100:00100000:1.0:1787508794.473742:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3195 00000100:00100000:1.0:1787508794.473748:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2402:x1874324509685120:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508794.473770:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2402:x1874324509685120:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508794.473775:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3195 00000100:00080000:3.0:1787508794.474065:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787508794.474070:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787508794.474072:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787508794.940678:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508795.049193:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508795.049229:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509685632 00000100:00100000:2.0:1787508795.049256:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509685632 00000100:00100000:2.0:1787508795.049321:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94286 00000100:00100000:2.0:1787508795.049341:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:345585:x1874324509685632:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:2.0:1787508795.049360:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508795.049363:0:202226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787508795.049390:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f36360 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed7f expref: 17 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508795.049406:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508795.049411:0:202226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508795.049423:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f36367 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaed86 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508795.049523:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f3636e lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508795.049535:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f3636e lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508795.049545:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f3636e lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508795.049554:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1275:0x0]: returning size 16384 00010000:00010000:2.0:1787508795.049655:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f36367 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed86 expref: 19 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508795.049674:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f3636e lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed86 expref: 18 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508795.049682:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1275:0x0].0x0 (ffff9090c96b8800) 00010000:00010000:2.0:1787508795.049684:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787508795.049687:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abe00, rc 0) 00000100:00100000:2.0:1787508795.049740:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+18:345585:x1874324509685632:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 411us (557us total) trans 12884944269 rc 0/0 00000100:00100000:2.0:1787508795.049748:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94286 00000100:00080000:2.0:1787508795.049771:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787508795.065675:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508795.065814:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509685760 00000100:00100000:2.0:1787508795.065824:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509685760 00000100:00100000:2.0:1787508795.066010:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9838 00000100:00100000:2.0:1787508795.066021:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9f1a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+18:2403:x1874324509685760:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508795.066038:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508795.066061:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f3636e lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed86 expref: 18 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508795.066201:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1275:0x0].0x0 (ffff9090c96b8800) 00010000:00010000:2.0:1787508795.066206:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508795.066484:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9f1a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:2403:x1874324509685760:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 462us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508795.066491:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9838 00000100:00100000:3.0:1787508795.066523:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787508795.066539:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480247040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787508795.066579:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508795.066753:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480247040 00000100:00100000:2.0:1787508795.066758:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480247040 00000100:00100000:2.0:1787508795.066809:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1765 00000100:00100000:2.0:1787508795.066816:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480247040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787508795.066840:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 156828224 pending 28672 free 3881943040 avail 3650420736 00000100:00080000:3.0:1787508795.066881:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787508795.066882:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480247040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508795.066888:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1765 00000100:00100000:3.0:1787508795.066914:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480247040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787508795.067809:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787508795.067823:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480247168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787508795.067860:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508795.067935:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480247168 00000100:00100000:1.0:1787508795.067983:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480247168 00000100:00100000:1.0:1787508795.068036:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1766 00000100:00100000:1.0:1787508795.068045:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480247168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787508795.068059:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 156828224 pending 28672 free 3881943040 avail 3650420736 00000100:00100000:1.0:1787508795.068105:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480247168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508795.068111:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1766 00000100:00080000:3.0:1787508795.068145:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508795.068519:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480247168:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787508795.962300:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508796.091564:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480247680:0@lo:400:kworker.0 00000100:00100000:2.0:1787508796.091645:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508796.091719:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480248192:0@lo:400:kworker.0 00000100:00100000:2.0:1787508796.091742:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508796.091766:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480248704:0@lo:400:kworker.0 00000100:00100000:2.0:1787508796.091790:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508796.091812:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1787508796.091817:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480247296:0@lo:400:kworker.0 00000100:00100000:2.0:1787508796.091846:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508796.091864:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874324480247808:0@lo:400:kworker.0 00000100:00100000:2.0:1787508796.091882:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508796.091898:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874324480248320:0@lo:400:kworker.0 00000100:00100000:2.0:1787508796.091916:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508796.091932:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874324480248832:0@lo:400:kworker.0 00000100:00100000:2.0:1787508796.091978:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508796.092011:0:203728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480247680 00000100:00100000:2.0:1787508796.092019:0:203728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480247680 00000100:00100000:2.0:1787508796.092076:0:203728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480248192 00000100:00100000:2.0:1787508796.092080:0:203728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480248192 00000100:00100000:2.0:1787508796.092111:0:203728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2538 00000100:00100000:2.0:1787508796.092120:0:203728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480247680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508796.092177:0:203728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480247680:12345-0@lo:400:kworker.0 Request processed in 58us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508796.092184:0:203728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2538 00000100:00100000:2.0:1787508796.092200:0:203728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2539 00000100:00100000:2.0:1787508796.092206:0:203728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480248192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508796.092366:0:203728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480248192:12345-0@lo:400:kworker.0 Request processed in 160us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508796.092373:0:203728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2539 00000100:00100000:2.0:1787508796.092392:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480248704 00000100:00100000:2.0:1787508796.092396:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480248704 00000100:00100000:2.0:1787508796.092426:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3196 00000100:00100000:2.0:1787508796.092432:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480248704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508796.092462:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480248704:12345-0@lo:400:kworker.0 Request processed in 31us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508796.092468:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3196 00000100:00100000:2.0:1787508796.092477:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480247808 00000100:00100000:2.0:1787508796.092480:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480247808 00000100:00100000:2.0:1787508796.092494:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480248320 00000100:00100000:2.0:1787508796.092497:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480248320 00000100:00100000:2.0:1787508796.092507:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480248832 00000100:00100000:2.0:1787508796.092510:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480248832 00000100:00100000:2.0:1787508796.092522:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3197 00000100:00100000:2.0:1787508796.092528:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874324480247808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508796.092553:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874324480247808:12345-0@lo:400:kworker.0 Request processed in 25us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508796.092562:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3197 00000100:00100000:2.0:1787508796.092571:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3198 00000100:00100000:2.0:1787508796.092576:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874324480248320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508796.092597:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874324480248320:12345-0@lo:400:kworker.0 Request processed in 21us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508796.092602:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3198 00000100:00100000:2.0:1787508796.092610:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3199 00000100:00100000:2.0:1787508796.092615:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874324480248832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508796.092638:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874324480248832:12345-0@lo:400:kworker.0 Request processed in 23us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508796.092643:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3199 00000100:00100000:2.0:1787508796.092693:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874324480247808:0@lo:400:kworker.0 00000100:00100000:2.0:1787508796.092703:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874324480248320:0@lo:400:kworker.0 00000100:00100000:2.0:1787508796.092713:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874324480248832:0@lo:400:kworker.0 00000100:00100000:2.0:1787508796.092720:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480247680:0@lo:400:kworker.0 00000100:00100000:2.0:1787508796.092727:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480248192:0@lo:400:kworker.0 00000100:00100000:2.0:1787508796.092734:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480248704:0@lo:400:kworker.0 00000100:00080000:3.0:1787508796.092897:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787508796.092903:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787508796.092983:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480247296 00000100:00100000:1.0:1787508796.092988:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480247296 00000100:00100000:1.0:1787508796.093026:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:1.0:1787508796.093034:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed92fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480247296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508796.093090:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed92fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480247296:12345-0@lo:400:kworker.0 Request processed in 57us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508796.093096:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:1.0:1787508796.093138:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480247552:0@lo:400:kworker.0 00000100:00100000:1.0:1787508796.093167:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508796.093187:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480248064:0@lo:400:kworker.0 00000100:00100000:1.0:1787508796.093208:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508796.093222:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480248576:0@lo:400:kworker.0 00000100:00100000:1.0:1787508796.093255:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508796.093276:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787508796.093282:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480247424:0@lo:400:kworker.0 00000100:00100000:1.0:1787508796.093307:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508796.093332:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480247936:0@lo:400:kworker.0 00000100:00100000:1.0:1787508796.093353:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508796.093368:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480248448:0@lo:400:kworker.0 00000100:00100000:1.0:1787508796.093385:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508796.093409:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480247424 00000100:00100000:1.0:1787508796.093413:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480247424 00000100:00100000:1.0:1787508796.093438:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480247936 00000100:00100000:1.0:1787508796.093441:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480247936 00000100:00100000:1.0:1787508796.093457:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29978 00000100:00100000:1.0:1787508796.093463:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480247424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508796.093496:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480247424:12345-0@lo:400:kworker.0 Request processed in 33us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508796.093505:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29978 00000100:00100000:1.0:1787508796.093515:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29979 00000100:00100000:1.0:1787508796.093521:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480247936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508796.093546:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480247936:12345-0@lo:400:kworker.0 Request processed in 26us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508796.093552:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29979 00000100:00100000:1.0:1787508796.093574:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480248576 00000100:00100000:1.0:1787508796.093577:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480248576 00000100:00100000:1.0:1787508796.093603:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480248448 00000100:00100000:1.0:1787508796.093607:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480248448 00000100:00100000:1.0:1787508796.093626:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3200 00000100:00100000:1.0:1787508796.093632:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480248576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508796.093659:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480248576:12345-0@lo:400:kworker.0 Request processed in 27us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508796.093665:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3200 00000100:00100000:1.0:1787508796.093674:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3201 00000100:00100000:1.0:1787508796.093679:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480248448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508796.093699:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480248448:12345-0@lo:400:kworker.0 Request processed in 20us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508796.093704:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3201 00000100:00100000:1.0:1787508796.093735:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480247424:0@lo:400:kworker.0 00000100:00100000:1.0:1787508796.093743:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480247936:0@lo:400:kworker.0 00000100:00100000:1.0:1787508796.093750:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480248448:0@lo:400:kworker.0 00000100:00100000:1.0:1787508796.093757:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480248576:0@lo:400:kworker.0 00000100:00080000:3.0:1787508796.093991:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787508796.093994:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787508796.094062:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480247552 00000100:00100000:0.0:1787508796.094067:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480247552 00000100:00100000:0.0:1787508796.094110:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480248064 00000100:00100000:0.0:1787508796.094113:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480248064 00000100:00100000:0.0:1787508796.094133:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2540 00000100:00100000:0.0:1787508796.094139:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480247552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508796.094179:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480247552:12345-0@lo:400:kworker.0 Request processed in 40us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508796.094184:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2540 00000100:00100000:0.0:1787508796.094195:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2541 00000100:00100000:0.0:1787508796.094200:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480248064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508796.094219:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480248064:12345-0@lo:400:kworker.0 Request processed in 20us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508796.094224:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2541 00000100:00100000:0.0:1787508796.094270:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480247552:0@lo:400:kworker.0 00000100:00100000:0.0:1787508796.094279:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480248064:0@lo:400:kworker.0 00000100:00080000:3.0:1787508796.094409:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787508796.094614:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480247296:0@lo:400:kworker.0 00000100:00100000:3.0:1787508796.602488:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787508796.602508:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480248960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787508796.602567:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508796.602638:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480248960 00000100:00100000:2.0:1787508796.602645:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480248960 00000100:00100000:2.0:1787508796.602687:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1767 00000100:00100000:2.0:1787508796.602694:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480248960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787508796.602718:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49603136 pending 0 free 3909767168 avail 3678244864 00000100:00100000:2.0:1787508796.602757:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480248960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508796.602764:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1767 00000100:00100000:3.0:1787508796.602850:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480248960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787508796.603024:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480249088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787508796.603051:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508796.603213:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480249088 00000100:00100000:2.0:1787508796.603218:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480249088 00000100:00100000:2.0:1787508796.603249:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1768 00000100:00100000:2.0:1787508796.603256:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480249088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787508796.603269:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49603136 pending 0 free 3909767168 avail 3678244864 00000100:00100000:2.0:1787508796.603319:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480249088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508796.603326:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1768 00000100:00100000:3.0:1787508796.603395:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480249088:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787508796.986695:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508797.040963:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508797.041101:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509686016 00000100:00100000:0.0:1787508797.041111:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509686016 00000100:00100000:0.0:1787508797.041185:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15503 00000100:00100000:0.0:1787508797.041196:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:345585:x1874324509686016:12345-192.168.201.30@tcp:35:multiop.0 00000100:00080000:1.0:1787508797.041361:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787508797.041447:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+18:345585:x1874324509686016:12345-192.168.201.30@tcp:35:multiop.0 Request processed in 253us (517us total) trans 12884944270 rc 0/0 00000100:00100000:0.0:1787508797.041455:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15503 00000001:00080000:0.0:1787508797.049789:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944270 is committed 00000001:00080000:0.0:1787508797.049813:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944268 is committed 00000100:00100000:1.0:1787508797.626915:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787508797.626953:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480249216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787508797.627035:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508797.627092:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480249216 00000100:00100000:1.0:1787508797.627101:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480249216 00000100:00100000:1.0:1787508797.627150:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29980 00000100:00100000:1.0:1787508797.627160:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480249216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787508797.627454:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442721792 avail 1296482304 00000100:00100000:1.0:1787508797.627515:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480249216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 356us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508797.627522:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29980 00000100:00100000:3.0:1787508797.627612:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480249216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787508797.633976:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787508797.634000:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480249344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787508797.634090:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508797.634140:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480249344 00000100:00100000:0.0:1787508797.634148:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480249344 00000100:00100000:0.0:1787508797.634369:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29981 00000100:00100000:0.0:1787508797.634382:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480249344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787508797.634418:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440645120 avail 1294405632 00000100:00100000:0.0:1787508797.634467:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480249344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508797.634474:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29981 00000100:00100000:0.0:1787508797.634519:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480249344:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787508798.017812:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508798.363859:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508798.366172:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509686144 00000100:00100000:3.0:1787508798.366256:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509686144 00000100:00100000:3.0:1787508798.366382:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94287 00000100:00100000:3.0:1787508798.366395:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:345606:x1874324509686144:12345-192.168.201.30@tcp:101:stat.0 00010000:00010000:3.0:1787508798.366423:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508798.366443:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3637c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaed8d expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508798.366511:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36383 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508798.366525:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36383 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508798.366536:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36383 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508798.366578:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508798.366581:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508798.366600:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36383 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508798.366623:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3637c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed8d expref: 15 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508798.366640:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36383 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed8d expref: 14 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508798.366649:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508798.366652:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508798.366655:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e800, rc 0) 00000100:00100000:3.0:1787508798.366724:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:345606:x1874324509686144:12345-192.168.201.30@tcp:101:stat.0 Request processed in 332us (2875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508798.366730:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94287 00010000:00010000:0.0:1787508799.041456:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787508799.170512:0:204539:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589940566 is committed 00000100:00100000:1.0:1787508799.592391:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508799.592532:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509686400 00000100:00100000:2.0:1787508799.592542:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509686400 00000100:00080000:1.0:1787508799.592672:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508799.592918:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3202 00000100:00100000:2.0:1787508799.592930:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:2402:x1874324509686400:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508799.593063:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:2402:x1874324509686400:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 136us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508799.593071:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3202 00000100:00100000:0.0:1787508799.593169:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508799.593299:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508799.593345:0:225833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509686656 00000100:00100000:1.0:1787508799.593350:0:225833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509686656 00000100:00100000:1.0:1787508799.593390:0:225833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2542 00000100:00100000:1.0:1787508799.593398:0:225833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509686656:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508799.593434:0:225833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509686656:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 37us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508799.593440:0:225833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2542 00000100:00080000:1.0:1787508799.593461:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787508799.612829:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508799.612875:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508799.612900:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508799.613259:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509686912 00000100:00100000:3.0:1787508799.613270:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509686912 00000100:00100000:3.0:1787508799.613288:0:225838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509687168 00000100:00100000:3.0:1787508799.613290:0:225838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509687168 00000100:00100000:3.0:1787508799.613349:0:225838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2543 00000100:00100000:3.0:1787508799.613359:0:225838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2402:x1874324509687168:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508799.613428:0:225838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2402:x1874324509687168:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 71us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508799.613436:0:225838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2543 00000100:00080000:3.0:1787508799.613458:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787508799.613552:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787508799.613581:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3203 00000100:00100000:3.0:1787508799.613587:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2402:x1874324509686912:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508799.613619:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2402:x1874324509686912:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 33us (20321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508799.613625:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3203 00000100:00100000:3.0:1787508799.620330:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509686272 00000100:00100000:3.0:1787508799.620344:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509686272 00000100:00100000:3.0:1787508799.620408:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1050 00000100:00100000:3.0:1787508799.620418:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed92e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509686272:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508799.620489:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed92e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509686272:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 72us (7612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508799.620496:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1050 00000100:00100000:0.0:1787508799.621578:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508799.622889:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508799.623684:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509686784 00000100:00100000:3.0:1787508799.623694:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509686784 00000100:00100000:3.0:1787508799.623755:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2544 00000100:00100000:3.0:1787508799.623766:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2402:x1874324509686784:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508799.623836:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2402:x1874324509686784:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 72us (2264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508799.623844:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2544 00000100:00080000:3.0:1787508799.623870:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508799.634471:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508799.634634:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509686528 00000100:00100000:1.0:1787508799.634644:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509686528 00000100:00100000:1.0:1787508799.634667:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509687296 00000100:00100000:1.0:1787508799.634670:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509687296 00000100:00100000:1.0:1787508799.634728:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2545 00000100:00100000:1.0:1787508799.634738:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2402:x1874324509687296:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508799.634811:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2402:x1874324509687296:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 74us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508799.634818:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2545 00000100:00100000:1.0:1787508799.636607:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509687040 00000100:00100000:1.0:1787508799.636619:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509687040 00000100:00100000:1.0:1787508799.636648:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3204 00000100:00100000:1.0:1787508799.636658:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2402:x1874324509686528:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508799.636724:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2402:x1874324509686528:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 67us (23823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508799.636732:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3204 00000100:00100000:1.0:1787508799.636748:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3205 00000100:00100000:1.0:1787508799.636754:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2402:x1874324509687040:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508799.636780:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2402:x1874324509687040:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 27us (13897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508799.636787:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3205 00000100:00080000:0.0:1787508799.636871:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508799.636876:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787508800.058447:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508800.188032:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787508800.188054:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480249472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787508800.188136:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508800.188418:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480249472 00000100:00100000:0.0:1787508800.188427:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480249472 00000100:00100000:0.0:1787508800.188489:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1769 00000100:00100000:0.0:1787508800.188501:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480249472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787508800.188528:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 156799552 pending 0 free 3881943040 avail 3650420736 00000100:00100000:0.0:1787508800.188578:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480249472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508800.188585:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1769 00000100:00100000:0.0:1787508800.188629:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480249472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787508800.188962:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480249600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787508800.189004:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508800.189552:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480249600 00000100:00100000:2.0:1787508800.189560:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480249600 00000100:00100000:2.0:1787508800.189605:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1770 00000100:00100000:2.0:1787508800.189613:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480249600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787508800.189628:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 156799552 pending 0 free 3881943040 avail 3650420736 00000100:00100000:2.0:1787508800.189672:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480249600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508800.189678:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1770 00000100:00100000:0.0:1787508800.190144:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480249600:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787508800.190472:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787508801.082512:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508801.211336:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480249984:0@lo:400:kworker.0 00000100:00100000:2.0:1787508801.211410:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508801.211472:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480250496:0@lo:400:kworker.0 00000100:00100000:2.0:1787508801.211493:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508801.211515:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874324480251008:0@lo:400:kworker.0 00000100:00100000:2.0:1787508801.211535:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508801.211556:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787508801.211561:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480250112:0@lo:400:kworker.0 00000100:00100000:2.0:1787508801.211583:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508801.211600:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480250624:0@lo:400:kworker.0 00000100:00100000:2.0:1787508801.211619:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508801.211638:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480251136:0@lo:400:kworker.0 00000100:00100000:2.0:1787508801.211655:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508801.211684:0:226134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480249984 00000100:00100000:2.0:1787508801.211698:0:226134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480249984 00000100:00100000:2.0:1787508801.211746:0:226134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480250496 00000100:00100000:2.0:1787508801.211749:0:226134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480250496 00000100:00100000:2.0:1787508801.211767:0:226134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480250112 00000100:00100000:2.0:1787508801.211770:0:226134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480250112 00000100:00100000:2.0:1787508801.211782:0:226134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480250624 00000100:00100000:2.0:1787508801.211784:0:226134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480250624 00000100:00100000:2.0:1787508801.211801:0:226134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2546 00000100:00100000:2.0:1787508801.211809:0:226134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480249984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508801.211860:0:226134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480249984:12345-0@lo:400:kworker.0 Request processed in 51us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508801.211868:0:226134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2546 00000100:00100000:2.0:1787508801.211885:0:226134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2547 00000100:00100000:2.0:1787508801.211892:0:226134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480250496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508801.211921:0:226134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480250496:12345-0@lo:400:kworker.0 Request processed in 31us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508801.211927:0:226134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2547 00000100:00100000:2.0:1787508801.211961:0:226134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2548 00000100:00100000:2.0:1787508801.211969:0:226134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480250112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508801.211997:0:226134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480250112:12345-0@lo:400:kworker.0 Request processed in 30us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508801.212004:0:226134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2548 00000100:00100000:2.0:1787508801.212016:0:226134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2549 00000100:00100000:2.0:1787508801.212022:0:226134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc621f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480250624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508801.212048:0:226134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc621f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480250624:12345-0@lo:400:kworker.0 Request processed in 27us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508801.212054:0:226134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2549 00000100:00100000:2.0:1787508801.212102:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480250112:0@lo:400:kworker.0 00000100:00100000:2.0:1787508801.212113:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480250624:0@lo:400:kworker.0 00000100:00100000:2.0:1787508801.212122:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480249984:0@lo:400:kworker.0 00000100:00100000:2.0:1787508801.212129:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480250496:0@lo:400:kworker.0 00000100:00100000:2.0:1787508801.212158:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480251008 00000100:00100000:2.0:1787508801.212161:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480251008 00000100:00100000:2.0:1787508801.212185:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480251136 00000100:00100000:2.0:1787508801.212189:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480251136 00000100:00100000:2.0:1787508801.212205:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3206 00000100:00100000:2.0:1787508801.212211:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874324480251008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508801.212260:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874324480251008:12345-0@lo:400:kworker.0 Request processed in 47us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508801.212266:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3206 00000100:00100000:2.0:1787508801.212291:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874324480251008:0@lo:400:kworker.0 00000100:00100000:2.0:1787508801.212309:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3207 00000100:00100000:2.0:1787508801.212316:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480251136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508801.212348:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480251136:12345-0@lo:400:kworker.0 Request processed in 33us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508801.212354:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3207 00000100:00100000:2.0:1787508801.212375:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480251136:0@lo:400:kworker.0 00000100:00100000:1.0:1787508801.212560:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090ce781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480249728:0@lo:400:kworker.0 00000100:00100000:1.0:1787508801.212600:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508801.212628:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874324480250240:0@lo:400:kworker.0 00000100:00100000:1.0:1787508801.212647:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508801.212662:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874324480250752:0@lo:400:kworker.0 00000100:00100000:1.0:1787508801.212678:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508801.212691:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874324480251264:0@lo:400:kworker.0 00000100:00100000:1.0:1787508801.212709:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508801.212728:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787508801.212734:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480249856:0@lo:400:kworker.0 00000100:00100000:1.0:1787508801.212757:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508801.212772:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480250368:0@lo:400:kworker.0 00000100:00100000:1.0:1787508801.212789:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508801.212804:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874324480250880:0@lo:400:kworker.0 00000100:00100000:1.0:1787508801.212824:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508801.212848:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480249728 00000100:00100000:1.0:1787508801.212852:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480249728 00000100:00100000:1.0:1787508801.212879:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:1.0:1787508801.212885:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed92d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480249728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508801.212917:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed92d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480249728:12345-0@lo:400:kworker.0 Request processed in 32us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508801.212923:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00100000:1.0:1787508801.212970:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480250240 00000100:00100000:1.0:1787508801.212974:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480250240 00000100:00100000:1.0:1787508801.212988:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480250752 00000100:00100000:1.0:1787508801.212990:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480250752 00000100:00100000:1.0:1787508801.212998:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480251264 00000100:00100000:1.0:1787508801.213001:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480251264 00000100:00100000:1.0:1787508801.213011:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480250880 00000100:00100000:1.0:1787508801.213013:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480250880 00000100:00100000:1.0:1787508801.213026:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3208 00000100:00100000:1.0:1787508801.213031:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874324480250240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508801.213063:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874324480250240:12345-0@lo:400:kworker.0 Request processed in 31us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508801.213069:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3208 00000100:00100000:1.0:1787508801.213081:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3209 00000100:00100000:1.0:1787508801.213087:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874324480250752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508801.213113:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874324480250752:12345-0@lo:400:kworker.0 Request processed in 26us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508801.213118:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3209 00000100:00100000:1.0:1787508801.213129:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3210 00000100:00100000:1.0:1787508801.213206:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874324480251264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508801.213247:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874324480251264:12345-0@lo:400:kworker.0 Request processed in 43us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508801.213252:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3210 00000100:00100000:1.0:1787508801.213264:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3211 00000100:00100000:1.0:1787508801.213269:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874324480250880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508801.213295:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874324480250880:12345-0@lo:400:kworker.0 Request processed in 27us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508801.213301:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3211 00000100:00100000:1.0:1787508801.213318:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480249856 00000100:00100000:1.0:1787508801.213321:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480249856 00000100:00100000:1.0:1787508801.213340:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480250368 00000100:00100000:1.0:1787508801.213343:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480250368 00000100:00100000:1.0:1787508801.213354:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29982 00000100:00100000:1.0:1787508801.213360:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480249856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508801.213387:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480249856:12345-0@lo:400:kworker.0 Request processed in 27us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508801.213392:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29982 00000100:00100000:1.0:1787508801.213403:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29983 00000100:00100000:1.0:1787508801.213408:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480250368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508801.213433:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480250368:12345-0@lo:400:kworker.0 Request processed in 25us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508801.213438:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29983 00000100:00100000:1.0:1787508801.213473:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480249856:0@lo:400:kworker.0 00000100:00100000:1.0:1787508801.213483:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480250368:0@lo:400:kworker.0 00000100:00100000:1.0:1787508801.213490:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874324480250880:0@lo:400:kworker.0 00000100:00100000:1.0:1787508801.213498:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090ce781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480249728:0@lo:400:kworker.0 00000100:00100000:1.0:1787508801.213506:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874324480250240:0@lo:400:kworker.0 00000100:00100000:1.0:1787508801.213514:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874324480250752:0@lo:400:kworker.0 00000100:00100000:1.0:1787508801.213522:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874324480251264:0@lo:400:kworker.0 00000100:00080000:3.0:1787508801.213644:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787508801.213649:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787508801.213652:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508801.541749:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508801.541856:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509687552 00000100:00100000:2.0:1787508801.541867:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509687552 00000100:00100000:2.0:1787508801.541990:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94288 00000100:00100000:2.0:1787508801.542002:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:345624:x1874324509687552:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:2.0:1787508801.542022:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508801.542043:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3638a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaed94 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508801.542151:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f36391 lrc: 3/1,0 mode: --/CR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508801.542179:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f36391 lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x1275:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508801.542196:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f36391 lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x1275:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508801.542208:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1275:0x0]: returning size 16384 00010000:00010000:2.0:1787508801.542333:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3638a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed94 expref: 17 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508801.542352:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f36391 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x1275:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed94 expref: 16 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508801.542361:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1275:0x0].0x0 (ffff9090c96b8800) 00010000:00010000:2.0:1787508801.542364:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787508801.542367:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab600, rc 0) 00000100:00100000:2.0:1787508801.542909:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:345624:x1874324509687552:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 907us (1167us total) trans 12884944271 rc 0/0 00000100:00100000:2.0:1787508801.542917:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94288 00000100:00080000:3.0:1787508801.543097:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787508801.722796:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787508801.722819:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480251520:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787508801.722899:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508801.723449:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480251392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787508801.723484:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508801.723572:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480251520 00000100:00100000:0.0:1787508801.723581:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480251520 00000100:00100000:0.0:1787508801.723630:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480251392 00000100:00100000:0.0:1787508801.723633:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480251392 00000100:00100000:0.0:1787508801.723649:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1771 00000100:00100000:0.0:1787508801.723657:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480251520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787508801.723684:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49603136 pending 0 free 3909767168 avail 3678244864 00000100:00100000:0.0:1787508801.723731:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480251520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508801.723738:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1771 00000100:00100000:0.0:1787508801.723756:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1772 00000100:00100000:0.0:1787508801.723762:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480251392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787508801.723772:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49603136 pending 0 free 3909767168 avail 3678244864 00000100:00100000:0.0:1787508801.723796:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480251392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508801.723801:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1772 00000100:00100000:0.0:1787508801.723851:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480251520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787508801.724175:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480251392:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787508802.106423:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508802.747041:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787508802.747066:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480251648:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787508802.747222:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508802.747333:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480251648 00000100:00100000:1.0:1787508802.747342:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480251648 00000100:00100000:1.0:1787508802.747397:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29984 00000100:00100000:1.0:1787508802.747408:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480251648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787508802.747442:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442721792 avail 1296482304 00000100:00100000:1.0:1787508802.747512:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480251648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508802.747523:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29984 00000100:00100000:2.0:1787508802.747664:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480251648:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787508802.747751:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480251776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787508802.747859:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508802.747967:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480251776 00000100:00100000:3.0:1787508802.747973:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480251776 00000100:00100000:3.0:1787508802.748010:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29985 00000100:00100000:3.0:1787508802.748017:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480251776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787508802.748036:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440645120 avail 1294405632 00000100:00100000:3.0:1787508802.748087:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480251776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508802.748095:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29985 00000100:00100000:1.0:1787508802.752870:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480251776:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787508803.130294:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508803.177651:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508803.177780:0:203732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509687680 00000100:00100000:0.0:1787508803.177794:0:203732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509687680 00002000:00100000:0.0:1787508803.177881:0:203732:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x1531:0x0] (0->1048575) req@ffff9090cf9cb800 x1874324509687680/t0(0) o4->eb35f31c-097f-45a3-8275-bc75f97f89ee@192.168.201.30@tcp:259/0 lens 488/0 e 0 to 0 dl 1787508814 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lockahead_test.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787508803.177894:0:203732:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090cf9cb800 with x1874324509687680 ext(0->1048575) 00002000:00010000:0.0:1787508803.177900:0:203732:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9090cf9cb800 00000100:00100000:0.0:1787508803.177997:0:203732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:0.0:1787508803.178012:0:203732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2402:x1874324509687680:12345-192.168.201.30@tcp:4:lockahead_test.0 00000100:00080000:3.0:1787508803.179075:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787508803.221107:0:203732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2402:x1874324509687680:12345-192.168.201.30@tcp:4:lockahead_test.0 Request processed in 43081us (43452us total) trans 8589941257 rc 0/0 00000100:00100000:0.0:1787508803.221128:0:203732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 55 00002000:00100000:0.0:1787508803.221145:0:203732:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x1531:0x0] (0->1048575) req@ffff9090cf9cb800 x1874324509687680/t8589941257(0) o4->eb35f31c-097f-45a3-8275-bc75f97f89ee@192.168.201.30@tcp:259/0 lens 488/448 e 0 to 0 dl 1787508814 ref 1 fl Complete:/600/0 rc 0/0 job:'lockahead_test.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787508803.221157:0:203732:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090cf9cb800 with x1874324509687680 ext(0->1048575) 00002000:00010000:0.0:1787508803.221165:0:203732:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9090cf9cb800 00000100:00100000:3.0:1787508803.559696:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508803.559886:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509687936 00000100:00100000:1.0:1787508803.559897:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509687936 00000100:00100000:1.0:1787508803.560018:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94289 00000100:00100000:1.0:1787508803.560031:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:345624:x1874324509687936:12345-192.168.201.30@tcp:36:multiop.0 00010000:00010000:1.0:1787508803.560103:0:202227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787508803.560130:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f36391 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x1275:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed94 expref: 16 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508803.560155:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f362b1 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed32 expref: 15 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508803.560170:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1275:0x0].0x0 (ffff9090c96b8800) 00010000:00010000:1.0:1787508803.560175:0:202227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787508803.560214:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3639f lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1275:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508803.560227:0:202227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f36328 lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed63 expref: 11 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508803.560235:0:202227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3639f lrc: 4/0,1 mode: --/PW res: [0x2000013a4:0x1275:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508803.560267:0:202227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f36328 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed63 expref: 11 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508803.560284:0:202227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f36328 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed63 expref: 11 pid: 202228 timeout: 13874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508803.560297:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b61500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:202227:1874324480251904:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508803.560389:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c966ec00 going to sleep for 11 seconds 00000100:00080000:3.0:1787508803.561481:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787508803.570159:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508803.570318:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509688064 00000100:00100000:0.0:1787508803.570327:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509688064 00010000:00010000:0.0:1787508803.570394:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f36328 lrc: 5/0,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed63 expref: 12 pid: 202228 timeout: 13874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508803.570438:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27976 00000100:00100000:0.0:1787508803.570448:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2401:x1874324509688064:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508803.570466:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508803.570473:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f36328 lrc: 5/0,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed63 expref: 12 pid: 202228 timeout: 13874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.570493:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f36328 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed63 expref: 12 pid: 202228 timeout: 13874 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.570514:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1275:0x0].0x0 (ffff9090c96b8800) 00010000:00010000:0.0:1787508803.570519:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3639f lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x1275:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.570529:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3639f lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1275:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.570536:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3639f lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x1275:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.570558:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508803.570612:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:2401:x1874324509688064:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 165us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508803.570619:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27976 00010000:00010000:3.0:1787508803.571622:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f36328 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed63 expref: 11 pid: 202228 timeout: 13874 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508803.571646:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b61500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:202227:1874324480251904:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508803.571679:0:202227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3639f lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1275:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508803.571689:0:202227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3639f lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1275:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508803.571695:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3639f lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1275:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508803.571859:0:202227:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000050fcc5d reply state 00000000ddb0cb74 transno 12884944272 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3639f lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x1275:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508803.571873:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3639f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1275:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508803.571881:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1275:0x0].0x0 (ffff9090c96b8800) 00010000:00010000:3.0:1787508803.571884:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787508803.571887:0:202227:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787508803.572040:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:345624:x1874324509687936:12345-192.168.201.30@tcp:36:multiop.0 Request processed in 12011us (12352us total) trans 12884944272 rc 0/0 00000100:00100000:3.0:1787508803.572048:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94289 00000100:00080000:1.0:1787508803.572366:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787508803.578068:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508803.578234:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509688192 00000100:00100000:2.0:1787508803.578244:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509688192 00000100:00100000:2.0:1787508803.578305:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94290 00000100:00100000:2.0:1787508803.578316:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:345624:x1874324509688192:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:2.0:1787508803.578341:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508803.578368:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f363a6 lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaed9b expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508803.578437:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f363a6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed9b expref: 17 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508803.578451:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab600/0xb126349c40f363a6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed9b expref: 17 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508803.578472:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1275:0x0].0x0 (ffff9090c96b8800) 00010000:00010000:2.0:1787508803.578475:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787508803.578480:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab600, rc 0) 00000100:00100000:2.0:1787508803.578543:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:345624:x1874324509688192:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 228us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508803.578550:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94290 00000100:00100000:0.0:1787508803.583404:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508803.583513:0:225832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509688320 00000100:00100000:2.0:1787508803.583523:0:225832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509688320 00000100:00100000:2.0:1787508803.583597:0:225832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15094 00000100:00100000:2.0:1787508803.583608:0:225832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2401:x1874324509688320:12345-192.168.201.30@tcp:2:multiop.0 00002000:00010000:2.0:1787508803.583769:0:225832:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x158d:0x0] updating lvb size from disk: 16384 -> 16384 00002000:00010000:2.0:1787508803.583773:0:225832:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x158d:0x0] updating lvb mtime from disk: 1787508790 -> 1787508792 00002000:00010000:2.0:1787508803.583776:0:225832:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x158d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787508803.583778:0:225832:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x158d:0x0] updating lvb ctime from disk: 1787508790 -> 1787508804 00002000:00010000:2.0:1787508803.583780:0:225832:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x158d:0x0] updating lvb blocks from disk: 24 -> 24 00000100:00100000:2.0:1787508803.584015:0:225832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:2401:x1874324509688320:12345-192.168.201.30@tcp:2:multiop.0 Request processed in 407us (618us total) trans 8589940567 rc 0/0 00000100:00100000:2.0:1787508803.584024:0:225832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15094 00000100:00080000:1.0:1787508803.584264:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508803.589348:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508803.589442:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509688576 00000100:00100000:1.0:1787508803.589453:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509688576 00000100:00100000:1.0:1787508803.589510:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15504 00000100:00100000:1.0:1787508803.589520:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:345624:x1874324509688576:12345-192.168.201.30@tcp:35:multiop.0 00000100:00100000:1.0:1787508803.589759:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+18:345624:x1874324509688576:12345-192.168.201.30@tcp:35:multiop.0 Request processed in 240us (424us total) trans 12884944273 rc 0/0 00000100:00100000:1.0:1787508803.589767:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15504 00000100:00100000:3.0:1787508803.633819:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508803.634109:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509688704 00000100:00100000:0.0:1787508803.634119:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509688704 00000100:00100000:0.0:1787508803.634190:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94291 00000100:00100000:0.0:1787508803.634201:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+18:345629:x1874324509688704:12345-192.168.201.30@tcp:101:stat.0 00010000:00010000:0.0:1787508803.634226:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508803.634249:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f363ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeda2 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.634326:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f363b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.634467:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f363b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.634480:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f363b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.634496:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f363bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.634503:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f363bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.634510:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f363bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.634605:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f363c2 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.634616:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f363c2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.634623:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f363c2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508803.634662:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1275:0x0]: returning size 16384 00000004:00200000:0.0:1787508803.634667:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508803.634686:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f363c2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.634702:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f363c2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.634711:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f363b4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.634718:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f363b4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.634724:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f363b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.634731:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f363b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.634736:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508803.634740:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f363b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.634745:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f363b4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.634754:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508803.634756:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508803.634758:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f363b4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.635450:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f363b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.635464:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f363bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.635469:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f363bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.635473:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f363bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.635476:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508803.635478:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f363bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.635482:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f363bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.635488:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x27849676 (ffff9090c96b8900) 00010000:00010000:0.0:1787508803.635490:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508803.635492:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f363bb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.635495:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f363bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x27849676 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.635524:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f363ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeda2 expref: 20 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.635533:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4e00/0xb126349c40f363c2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1275:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeda2 expref: 19 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508803.635537:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1275:0x0].0x0 (ffff9090c96b8800) 00010000:00010000:0.0:1787508803.635539:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787508803.635541:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4e00, rc 0) 00000100:00100000:0.0:1787508803.635608:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+19:345629:x1874324509688704:12345-192.168.201.30@tcp:101:stat.0 Request processed in 1410us (1800us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508803.635614:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94291 00010000:00010000:3.0:1787508804.162125:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508804.717598:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508804.717652:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508804.717676:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508804.717695:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508804.717728:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508804.717748:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508804.717764:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508804.717782:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508804.717800:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508804.717826:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509689344 00000100:00100000:3.0:1787508804.717836:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509689344 00000100:00100000:3.0:1787508804.717885:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509689856 00000100:00100000:3.0:1787508804.717889:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509689856 00000100:00100000:3.0:1787508804.717918:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509689216 00000100:00100000:3.0:1787508804.717921:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509689216 00000100:00100000:3.0:1787508804.717968:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509689728 00000100:00100000:3.0:1787508804.717972:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509689728 00000100:00100000:3.0:1787508804.717998:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2550 00000100:00100000:3.0:1787508804.718008:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:2403:x1874324509689344:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508804.718084:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:2403:x1874324509689344:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 78us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508804.718092:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2550 00000100:00100000:3.0:1787508804.718113:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2551 00000100:00100000:3.0:1787508804.718119:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2403:x1874324509689856:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508804.718144:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2403:x1874324509689856:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508804.718150:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2551 00000100:00100000:3.0:1787508804.718176:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2552 00000100:00100000:3.0:1787508804.718183:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509689216:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508804.718208:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509689216:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508804.718214:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2552 00000100:00100000:3.0:1787508804.718227:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2553 00000100:00100000:3.0:1787508804.718234:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2403:x1874324509689728:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508804.718256:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:2403:x1874324509689728:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508804.718261:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2553 00000100:00100000:3.0:1787508804.718281:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509689088 00000100:00100000:3.0:1787508804.718284:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509689088 00000100:00100000:3.0:1787508804.718321:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509689600 00000100:00100000:3.0:1787508804.718324:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509689600 00000100:00100000:3.0:1787508804.718343:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509688960 00000100:00100000:3.0:1787508804.718346:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509688960 00000100:00100000:3.0:1787508804.718362:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509689472 00000100:00100000:3.0:1787508804.718365:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509689472 00000100:00100000:3.0:1787508804.718377:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3212 00000100:00100000:3.0:1787508804.718383:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2403:x1874324509689088:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508804.718412:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2403:x1874324509689088:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 29us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508804.718418:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3212 00000100:00100000:3.0:1787508804.718431:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3213 00000100:00100000:3.0:1787508804.718437:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2403:x1874324509689600:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508804.718461:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2403:x1874324509689600:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508804.718467:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3213 00000100:00100000:3.0:1787508804.718479:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3214 00000100:00100000:3.0:1787508804.718487:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+19:2403:x1874324509688960:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508804.718510:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+19:2403:x1874324509688960:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508804.718516:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3214 00000100:00100000:3.0:1787508804.718527:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3215 00000100:00100000:3.0:1787508804.718533:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2403:x1874324509689472:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508804.718554:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2403:x1874324509689472:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508804.718560:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3215 00000100:00080000:3.0:1787508804.718589:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787508804.718594:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787508804.718596:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787508804.718965:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509688832 00000100:00100000:2.0:1787508804.718970:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509688832 00000100:00100000:2.0:1787508804.719006:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1052 00000100:00100000:2.0:1787508804.719013:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed92d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509688832:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508804.719037:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed92d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509688832:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508804.719043:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1052 00010000:00010000:1.0:1787508805.178426:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508805.306316:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480252032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787508805.306393:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508805.306628:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787508805.306641:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480252160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508805.306674:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508805.306855:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480252032 00000100:00100000:2.0:1787508805.306863:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480252032 00000100:00100000:2.0:1787508805.306931:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480252160 00000100:00100000:2.0:1787508805.306935:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480252160 00000100:00100000:2.0:1787508805.306985:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1773 00000100:00100000:2.0:1787508805.306995:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480252032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787508805.307025:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 156799552 pending 0 free 3881943040 avail 3650420736 00000100:00100000:2.0:1787508805.307072:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480252032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508805.307078:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1773 00000100:00100000:2.0:1787508805.307108:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1774 00000100:00100000:2.0:1787508805.307115:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480252160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787508805.307124:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 156799552 pending 0 free 3881943040 avail 3650420736 00000100:00100000:2.0:1787508805.307162:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480252160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508805.307168:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1774 00000100:00100000:1.0:1787508805.307253:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480252160:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787508805.307330:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508805.307357:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480252032:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787508806.202460:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508806.334909:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480252544:0@lo:400:kworker.0 00000100:00100000:1.0:1787508806.334979:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79de3f65-4bad-42d0-a46f-842a654b33a0:3619:1874324480252288:0@lo:400:kworker.0 00000100:00100000:0.0:1787508806.335008:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508806.335015:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508806.335073:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480252416:0@lo:400:kworker.0 00000100:00100000:3.0:1787508806.335140:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480252672:0@lo:400:kworker.0 00000100:00100000:1.0:1787508806.336570:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480252800:0@lo:400:kworker.0 00000100:00100000:1.0:1787508806.336618:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508806.336647:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874324480253312:0@lo:400:kworker.0 00000100:00100000:1.0:1787508806.336667:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508806.336683:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874324480253824:0@lo:400:kworker.0 00000100:00100000:1.0:1787508806.336701:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508806.336744:0:230130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480252544 00000100:00100000:1.0:1787508806.336751:0:230130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480252544 00000100:00100000:1.0:1787508806.336804:0:230130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2554 00000100:00100000:1.0:1787508806.336814:0:230130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480252544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508806.336864:0:230130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480252544:12345-0@lo:400:kworker.0 Request processed in 52us (1856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508806.336870:0:230130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2554 00000100:00100000:1.0:1787508806.336891:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480252288 00000100:00100000:1.0:1787508806.336895:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480252288 00000100:00100000:1.0:1787508806.336919:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:1.0:1787508806.336925:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed92ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3619:x1874324480252288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508806.336986:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed92ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3619:x1874324480252288:12345-0@lo:400:kworker.0 Request processed in 62us (1970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508806.336992:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:1.0:1787508806.337016:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480252800 00000100:00100000:1.0:1787508806.337019:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480252800 00000100:00100000:1.0:1787508806.337040:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480253312 00000100:00100000:1.0:1787508806.337042:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480253312 00000100:00100000:1.0:1787508806.338365:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480253824 00000100:00100000:1.0:1787508806.338375:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480253824 00000100:00100000:1.0:1787508806.338410:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3216 00000100:00100000:1.0:1787508806.338420:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480252800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508806.338476:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480252800:12345-0@lo:400:kworker.0 Request processed in 59us (1859us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508806.338482:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3216 00000100:00100000:1.0:1787508806.338497:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3217 00000100:00100000:1.0:1787508806.338502:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874324480253312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508806.338525:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874324480253312:12345-0@lo:400:kworker.0 Request processed in 23us (1857us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508806.338531:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3217 00000100:00100000:1.0:1787508806.338540:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3218 00000100:00100000:1.0:1787508806.338546:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874324480253824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508806.338572:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874324480253824:12345-0@lo:400:kworker.0 Request processed in 27us (1870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508806.338577:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3218 00000100:00080000:1.0:1787508806.338607:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787508806.338612:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508806.338657:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79de3f65-4bad-42d0-a46f-842a654b33a0:3619:1874324480252288:0@lo:400:kworker.0 00000100:00100000:1.0:1787508806.338671:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480252800:0@lo:400:kworker.0 00000100:00100000:1.0:1787508806.338680:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874324480253312:0@lo:400:kworker.0 00000100:00100000:1.0:1787508806.338688:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874324480253824:0@lo:400:kworker.0 00000100:00100000:1.0:1787508806.345157:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480252544:0@lo:400:kworker.0 00000100:00100000:1.0:1787508806.345175:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480253056:0@lo:400:kworker.0 00000100:00100000:1.0:1787508806.345247:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508806.345301:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874324480253568:0@lo:400:kworker.0 00000100:00100000:1.0:1787508806.345329:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508806.347712:0:226134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480253056 00000100:00100000:0.0:1787508806.347730:0:226134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480253056 00000100:00100000:1.0:1787508806.347816:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480253568 00000100:00100000:1.0:1787508806.347821:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480253568 00000100:00100000:0.0:1787508806.347828:0:226134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2555 00000100:00100000:0.0:1787508806.347837:0:226134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480253056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508806.347855:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3219 00000100:00100000:1.0:1787508806.347860:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874324480253568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508806.348273:0:226134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480253056:12345-0@lo:400:kworker.0 Request processed in 436us (3026us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508806.348282:0:226134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2555 00000100:00080000:0.0:1787508806.348308:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508806.348312:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787508806.348343:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480253056:0@lo:400:kworker.0 00000100:00100000:1.0:1787508806.348920:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874324480253568:12345-0@lo:400:kworker.0 Request processed in 1055us (3586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508806.348937:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3219 00000100:00100000:2.0:1787508806.349159:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508806.349204:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480252928:0@lo:400:kworker.0 00000100:00100000:2.0:1787508806.349237:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508806.349259:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874324480253440:0@lo:400:kworker.0 00000100:00100000:2.0:1787508806.349282:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508806.349325:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480252416 00000100:00100000:2.0:1787508806.349331:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480252416 00000100:00100000:0.0:1787508806.349352:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874324480253568:0@lo:400:kworker.0 00000100:00100000:2.0:1787508806.349363:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480252928 00000100:00100000:2.0:1787508806.349365:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480252928 00000100:00100000:2.0:1787508806.349382:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29986 00000100:00100000:2.0:1787508806.349388:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480252416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508806.349395:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29987 00000100:00100000:0.0:1787508806.349402:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480252928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508806.349503:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc623100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480252416:12345-0@lo:400:kworker.0 Request processed in 114us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508806.349510:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29986 00000100:00100000:2.0:1787508806.349594:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480253440 00000100:00100000:2.0:1787508806.349599:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480253440 00000100:00100000:2.0:1787508806.349640:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3220 00000100:00100000:2.0:1787508806.349647:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874324480253440:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787508806.350101:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787508806.360734:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480252928:12345-0@lo:400:kworker.0 Request processed in 11319us (11482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508806.360750:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29987 00000100:00100000:1.0:1787508806.362232:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508806.362298:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480253184:0@lo:400:kworker.0 00000100:00100000:1.0:1787508806.362339:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508806.362367:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480253696:0@lo:400:kworker.0 00000100:00100000:1.0:1787508806.362392:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508806.362435:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480253696 00000100:00100000:1.0:1787508806.362443:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480253696 00000100:00100000:1.0:1787508806.362496:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3221 00000100:00100000:1.0:1787508806.362505:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480253696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508806.362554:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480253696:12345-0@lo:400:kworker.0 Request processed in 50us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508806.362561:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3221 00000100:00080000:1.0:1787508806.362581:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787508806.362606:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480253696:0@lo:400:kworker.0 00000100:00100000:2.0:1787508806.365987:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874324480253440:12345-0@lo:400:kworker.0 Request processed in 16329us (16692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508806.366003:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3220 00000100:00100000:2.0:1787508806.366610:0:203996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480252672 00000100:00100000:2.0:1787508806.366620:0:203996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480252672 00000100:00100000:2.0:1787508806.366721:0:203996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480253184 00000100:00100000:2.0:1787508806.366726:0:203996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480253184 00000100:00100000:3.0:1787508806.367864:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480252416:0@lo:400:kworker.0 00000100:00100000:1.0:1787508806.375686:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556 00000100:00100000:1.0:1787508806.375711:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480252672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508806.375843:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480252672:12345-0@lo:400:kworker.0 Request processed in 144us (13615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508806.375851:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556 00000100:00100000:1.0:1787508806.376021:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2557 00000100:00100000:1.0:1787508806.376030:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480253184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508806.376068:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480253184:12345-0@lo:400:kworker.0 Request processed in 40us (13728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508806.376074:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2557 00000100:00100000:1.0:1787508806.376128:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480252672:0@lo:400:kworker.0 00000100:00100000:1.0:1787508806.376155:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480253184:0@lo:400:kworker.0 00000100:00100000:1.0:1787508806.376197:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480252928:0@lo:400:kworker.0 00000100:00100000:1.0:1787508806.376208:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874324480253440:0@lo:400:kworker.0 00000100:00100000:0.0:1787508806.843703:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480253952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787508806.843782:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508806.843841:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480253952 00000100:00100000:0.0:1787508806.843848:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480253952 00000100:00100000:0.0:1787508806.843905:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1775 00000100:00100000:0.0:1787508806.843914:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480253952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787508806.843962:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 56967744 pending 1073152 free 3908718592 avail 3677196288 00000100:00100000:0.0:1787508806.844008:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480253952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508806.844015:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1775 00000100:00100000:0.0:1787508806.844081:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480253952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787508806.857815:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787508806.857842:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480254080:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787508806.857936:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508806.859047:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480254080 00000100:00100000:0.0:1787508806.859059:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480254080 00000001:00080000:2.0:1787508806.859074:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944273 is committed 00000100:00100000:0.0:1787508806.859111:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1776 00000100:00100000:0.0:1787508806.859135:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480254080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787508806.859161:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 56967744 pending 1073152 free 3908718592 avail 3677196288 00000100:00100000:0.0:1787508806.859247:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480254080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508806.859255:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1776 00010000:00010000:3.0:1787508806.859491:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3639f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x1275:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508806.859504:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3639f lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x1275:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508806.859512:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3639f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1275:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508806.859520:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508806.859525:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3639f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x1275:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508806.859532:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3639f lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x1275:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508806.859549:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1275:0x0].0x0 (ffff9090c96b8800) 00010000:00010000:3.0:1787508806.859552:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787508806.859558:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3639f lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x1275:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508806.859564:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f3639f lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x1275:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508806.861059:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480254080:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787508807.229422:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508807.869479:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787508807.869505:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480254208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787508807.869576:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508807.869805:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787508807.869817:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480254336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787508807.869849:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508807.870008:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480254208 00000100:00100000:3.0:1787508807.870033:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480254208 00000100:00100000:3.0:1787508807.870088:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480254336 00000100:00100000:3.0:1787508807.870091:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480254336 00000100:00100000:3.0:1787508807.870124:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29988 00000100:00100000:3.0:1787508807.870134:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480254208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787508807.870167:0:202232:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442721792 avail 1296482304 00000100:00100000:3.0:1787508807.870213:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480254208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508807.870220:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29988 00000100:00100000:3.0:1787508807.870241:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29989 00000100:00100000:3.0:1787508807.870248:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480254336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787508807.870266:0:202232:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440645120 avail 1294405632 00000100:00100000:3.0:1787508807.870304:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc623b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480254336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508807.870310:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29989 00000100:00100000:3.0:1787508807.870355:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480254336:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787508807.870674:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0218a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480254208:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787508808.250549:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787508808.899637:0:203722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589941257 is committed 00000001:00080000:2.0:1787508808.900345:0:204539:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589940567 is committed 00010000:00010000:1.0:1787508809.274275:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508809.839080:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508809.839128:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508809.839159:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508809.839167:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509689984 00000100:00100000:1.0:1787508809.839177:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509689984 00000100:00100000:3.0:1787508809.839182:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508809.839199:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508809.839216:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508809.839230:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508809.839230:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1054 00000100:00100000:1.0:1787508809.839240:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed92cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509689984:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508809.839246:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508809.839266:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508809.839290:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509690496 00000100:00100000:3.0:1787508809.839294:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509690496 00000100:00100000:1.0:1787508809.839323:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed92cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509689984:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 84us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508809.839329:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509691008 00000100:00100000:3.0:1787508809.839331:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509691008 00000100:00100000:1.0:1787508809.839331:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1054 00000100:00100000:3.0:1787508809.839347:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509690368 00000100:00100000:3.0:1787508809.839350:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509690368 00000100:00100000:1.0:1787508809.839362:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509690240 00000100:00100000:1.0:1787508809.839365:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509690240 00000100:00100000:3.0:1787508809.839366:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509690880 00000100:00100000:3.0:1787508809.839368:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509690880 00000100:00100000:3.0:1787508809.839387:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2558 00000100:00100000:3.0:1787508809.839394:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2402:x1874324509690496:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508809.839400:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509690752 00000100:00100000:1.0:1787508809.839403:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509690752 00000100:00100000:1.0:1787508809.839420:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509690112 00000100:00100000:1.0:1787508809.839423:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509690112 00000100:00100000:3.0:1787508809.839436:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2402:x1874324509690496:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 32us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508809.839439:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509690624 00000100:00100000:1.0:1787508809.839441:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509690624 00000100:00100000:3.0:1787508809.839444:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2558 00000100:00100000:1.0:1787508809.839456:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3222 00000100:00100000:3.0:1787508809.839460:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2559 00000100:00100000:1.0:1787508809.839461:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2402:x1874324509690240:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508809.839466:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2402:x1874324509691008:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508809.839489:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2402:x1874324509691008:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508809.839489:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2402:x1874324509690240:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 27us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508809.839495:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2559 00000100:00100000:1.0:1787508809.839495:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3222 00000100:00100000:3.0:1787508809.839506:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2560 00000100:00100000:1.0:1787508809.839506:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3223 00000100:00100000:3.0:1787508809.839512:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509690368:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508809.839512:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2402:x1874324509690752:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508809.839534:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2402:x1874324509690752:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508809.839540:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3223 00000100:00100000:3.0:1787508809.839547:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509690368:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 35us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508809.839551:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3224 00000100:00100000:3.0:1787508809.839553:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2560 00000100:00100000:1.0:1787508809.839557:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:2402:x1874324509690112:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508809.839562:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2561 00000100:00100000:3.0:1787508809.839567:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2402:x1874324509690880:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508809.839579:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:2402:x1874324509690112:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508809.839584:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2402:x1874324509690880:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 18us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508809.839586:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3224 00000100:00100000:3.0:1787508809.839590:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2561 00000100:00100000:1.0:1787508809.839596:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3225 00000100:00100000:1.0:1787508809.839602:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2402:x1874324509690624:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508809.839623:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2402:x1874324509690624:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508809.839628:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3225 00000100:00080000:1.0:1787508809.839656:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787508809.839661:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787508809.839664:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787508809.839665:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787508810.298349:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508810.427966:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787508810.427997:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480254464:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787508810.428080:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508810.428134:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480254592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508810.428155:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508810.428187:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480254464 00000100:00100000:1.0:1787508810.428194:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480254464 00000100:00100000:1.0:1787508810.428242:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480254592 00000100:00100000:1.0:1787508810.428246:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480254592 00000100:00100000:1.0:1787508810.428263:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1777 00000100:00100000:1.0:1787508810.428270:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480254464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787508810.428298:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 156799552 pending 0 free 3881943040 avail 3650420736 00000100:00100000:1.0:1787508810.428341:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480254464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508810.428348:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1777 00000100:00100000:1.0:1787508810.428364:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1778 00000100:00100000:1.0:1787508810.428369:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480254592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787508810.428378:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 156799552 pending 0 free 3881943040 avail 3650420736 00000100:00100000:1.0:1787508810.428400:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0218700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480254592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 30us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508810.428405:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1778 00000100:00080000:1.0:1787508810.428423:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508810.428455:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480254592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508810.428466:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480254464:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787508811.328989:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508811.451267:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480254720:0@lo:400:kworker.0 00000100:00100000:0.0:1787508811.451351:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508811.451405:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480255232:0@lo:400:kworker.0 00000100:00100000:0.0:1787508811.451433:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508811.451452:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480255744:0@lo:400:kworker.0 00000100:00100000:0.0:1787508811.451472:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508811.451487:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480256256:0@lo:400:kworker.0 00000100:00100000:0.0:1787508811.451504:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508811.451528:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787508811.451534:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480254848:0@lo:400:kworker.0 00000100:00100000:0.0:1787508811.451556:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508811.451574:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480255360:0@lo:400:kworker.0 00000100:00100000:0.0:1787508811.451591:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508811.451604:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874324480255872:0@lo:400:kworker.0 00000100:00100000:0.0:1787508811.451620:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508811.451646:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480254976:0@lo:400:kworker.0 00000100:00100000:0.0:1787508811.451670:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508811.451687:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480255488:0@lo:400:kworker.0 00000100:00100000:0.0:1787508811.451705:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508811.451721:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480256000:0@lo:400:kworker.0 00000100:00100000:0.0:1787508811.451738:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508811.451755:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787508811.451760:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480255104:0@lo:400:kworker.0 00000100:00100000:0.0:1787508811.451778:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508811.452188:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480254848 00000100:00100000:2.0:1787508811.452199:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480254848 00000100:00100000:2.0:1787508811.452245:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480255360 00000100:00100000:2.0:1787508811.452248:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480255360 00000100:00100000:2.0:1787508811.452271:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29990 00000100:00100000:2.0:1787508811.452280:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6390e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480254848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508811.452340:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6390e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480254848:12345-0@lo:400:kworker.0 Request processed in 61us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508811.452348:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29990 00000100:00100000:2.0:1787508811.452365:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29991 00000100:00100000:2.0:1787508811.452371:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6393480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480255360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508811.452397:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6393480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480255360:12345-0@lo:400:kworker.0 Request processed in 26us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508811.452403:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29991 00000100:00100000:2.0:1787508811.452420:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480254976 00000100:00100000:2.0:1787508811.452423:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480254976 00000100:00100000:2.0:1787508811.452455:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480255488 00000100:00100000:2.0:1787508811.452458:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480255488 00000100:00100000:2.0:1787508811.452475:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480255104 00000100:00100000:2.0:1787508811.452478:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480255104 00000100:00100000:2.0:1787508811.452495:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562 00000100:00100000:2.0:1787508811.452501:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6392300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480254976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508811.452532:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6392300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480254976:12345-0@lo:400:kworker.0 Request processed in 32us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508811.452540:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562 00000100:00100000:2.0:1787508811.452551:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563 00000100:00100000:2.0:1787508811.452557:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6392d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480255488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508811.452581:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6392d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480255488:12345-0@lo:400:kworker.0 Request processed in 25us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508811.452587:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563 00000100:00100000:2.0:1787508811.452597:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2564 00000100:00100000:2.0:1787508811.452602:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6390700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480255104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508811.452626:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6390700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480255104:12345-0@lo:400:kworker.0 Request processed in 24us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508811.452632:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2564 00000100:00080000:2.0:1787508811.452656:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787508811.452692:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480254848:0@lo:400:kworker.0 00000100:00100000:2.0:1787508811.452701:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480255360:0@lo:400:kworker.0 00000100:00100000:2.0:1787508811.453331:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480255232 00000100:00100000:2.0:1787508811.453337:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480255232 00000100:00100000:2.0:1787508811.453369:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480255744 00000100:00100000:2.0:1787508811.453372:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480255744 00000100:00100000:2.0:1787508811.453386:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480256256 00000100:00100000:2.0:1787508811.453389:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480256256 00000100:00100000:2.0:1787508811.453404:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480255872 00000100:00100000:2.0:1787508811.453407:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480255872 00000100:00100000:2.0:1787508811.453418:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480256000 00000100:00100000:2.0:1787508811.453420:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480256000 00000100:00100000:2.0:1787508811.453440:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3226 00000100:00100000:2.0:1787508811.453447:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6390000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480255232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508811.453495:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6390000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480255232:12345-0@lo:400:kworker.0 Request processed in 49us (2061us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508811.453503:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3226 00000100:00100000:2.0:1787508811.453516:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3227 00000100:00100000:2.0:1787508811.453521:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6391c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480255744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508811.453549:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6391c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480255744:12345-0@lo:400:kworker.0 Request processed in 27us (2075us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508811.453554:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3227 00000100:00100000:2.0:1787508811.453565:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3228 00000100:00100000:2.0:1787508811.453571:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6391500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480256256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508811.453598:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6391500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480256256:12345-0@lo:400:kworker.0 Request processed in 27us (2092us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508811.453603:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3228 00000100:00100000:2.0:1787508811.453614:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3229 00000100:00100000:2.0:1787508811.453619:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6391180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874324480255872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508811.453643:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6391180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874324480255872:12345-0@lo:400:kworker.0 Request processed in 24us (2022us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508811.453650:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3229 00000100:00100000:2.0:1787508811.453660:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3230 00000100:00100000:2.0:1787508811.453665:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6390380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480256000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508811.453689:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6390380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480256000:12345-0@lo:400:kworker.0 Request processed in 24us (1950us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508811.453695:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3230 00000100:00100000:2.0:1787508811.453719:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480254720 00000100:00100000:2.0:1787508811.453723:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480254720 00000100:00100000:2.0:1787508811.453748:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:2.0:1787508811.453754:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed92d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480254720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508811.455345:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed92d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480254720:12345-0@lo:400:kworker.0 Request processed in 1585us (3987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508811.455358:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00080000:2.0:1787508811.455409:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787508811.455415:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787508811.455447:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874324480255872:0@lo:400:kworker.0 00000100:00100000:2.0:1787508811.455458:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480254720:0@lo:400:kworker.0 00000100:00100000:2.0:1787508811.455470:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480255232:0@lo:400:kworker.0 00000100:00100000:2.0:1787508811.455480:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480255744:0@lo:400:kworker.0 00000100:00100000:2.0:1787508811.455491:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480256256:0@lo:400:kworker.0 00000100:00100000:0.0:1787508811.455931:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480255616:0@lo:400:kworker.0 00000100:00100000:0.0:1787508811.456106:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508811.456143:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480256128:0@lo:400:kworker.0 00000100:00100000:0.0:1787508811.456165:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508811.456249:0:226134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480255616 00000100:00100000:2.0:1787508811.456256:0:226134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480255616 00000100:00100000:2.0:1787508811.456296:0:226134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2565 00000100:00100000:2.0:1787508811.456304:0:226134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6392a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480255616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508811.456348:0:226134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6392a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480255616:12345-0@lo:400:kworker.0 Request processed in 45us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508811.456355:0:226134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2565 00000100:00100000:0.0:1787508811.456417:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480254976:0@lo:400:kworker.0 00000100:00100000:0.0:1787508811.456430:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480255488:0@lo:400:kworker.0 00000100:00100000:0.0:1787508811.456441:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480256000:0@lo:400:kworker.0 00000100:00100000:0.0:1787508811.456462:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480255104:0@lo:400:kworker.0 00000100:00100000:0.0:1787508811.456471:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480255616:0@lo:400:kworker.0 00000100:00100000:1.0:1787508811.460186:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480256128 00000100:00100000:1.0:1787508811.460199:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480256128 00000100:00100000:1.0:1787508811.460274:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3231 00000100:00100000:1.0:1787508811.460284:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6391f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480256128:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787508811.460306:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787508811.460382:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6391f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480256128:12345-0@lo:400:kworker.0 Request processed in 99us (4215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508811.460390:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3231 00000100:00100000:2.0:1787508811.460586:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480256128:0@lo:400:kworker.0 00000100:00100000:3.0:1787508811.963319:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787508811.963343:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6391880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480256384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787508811.963413:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508811.963648:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480256384 00000100:00100000:3.0:1787508811.963657:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480256384 00000100:00100000:3.0:1787508811.963714:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1779 00000100:00100000:3.0:1787508811.963725:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480256384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787508811.964103:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 55894592 pending 0 free 3908718592 avail 3677196288 00000100:00100000:3.0:1787508811.964160:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480256384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 437us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508811.964168:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1779 00000100:00100000:3.0:1787508811.964224:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6391880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480256384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787508811.964277:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787508811.964293:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6393100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480256512:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787508811.964335:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508811.966594:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480256512 00000100:00100000:3.0:1787508811.966608:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480256512 00000100:00100000:3.0:1787508811.966680:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1780 00000100:00100000:3.0:1787508811.966692:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6390a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480256512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787508811.966720:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 55894592 pending 0 free 3908718592 avail 3677196288 00000100:00100000:3.0:1787508811.966813:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6390a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480256512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (2480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508811.966821:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1780 00000100:00100000:0.0:1787508811.969159:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6393100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480256512:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787508812.346180:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508812.986368:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480256640:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787508812.986758:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480256768:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787508812.986824:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508812.987133:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480256768 00000100:00100000:2.0:1787508812.987141:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480256768 00000100:00100000:2.0:1787508812.987202:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29992 00000100:00100000:2.0:1787508812.987211:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480256768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787508812.987243:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442721792 avail 1296482304 00000100:00100000:0.0:1787508812.987584:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508812.992188:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480256640 00000100:00100000:1.0:1787508812.992206:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480256640 00000100:00100000:1.0:1787508812.992300:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29993 00000100:00100000:1.0:1787508812.992311:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6393100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480256640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787508812.992352:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440645120 avail 1294405632 00000100:00100000:1.0:1787508812.992458:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6393100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480256640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 150us (4875us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508812.992465:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29993 00000100:00100000:1.0:1787508812.992537:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480256640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787508812.994175:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480256768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6956us (7341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508812.994187:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29992 00000100:00100000:3.0:1787508812.996650:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480256768:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787508813.370281:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787508814.219678:0:235594:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 105: Glimpse and lock cancel race ======== 14:13:33 (1787508813) 00000100:00100000:0.0:1787508814.292063:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508814.292164:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509691136 00000100:00100000:3.0:1787508814.292176:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509691136 00000100:00080000:0.0:1787508814.292224:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787508814.292255:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94292 00000100:00100000:3.0:1787508814.292267:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6393800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:346087:x1874324509691136:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1787508814.292288:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508814.292310:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f363c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeda9 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.292373:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f363d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.292386:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f363d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.292398:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f363d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.292413:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f363d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.292419:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f363d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.292426:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f363d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.292480:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f363d0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.292486:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f363d0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.292492:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f363d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.292497:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f363d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.292502:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508814.292506:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f363d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.292512:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f363d0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.292522:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508814.292525:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508814.292529:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f363d0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.292534:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f363d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.292543:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f363d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.292548:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f363d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.292553:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f363d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.292557:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fe00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508814.292559:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f363d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.292564:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f363d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.292569:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaaf14dc5 (ffff9090d6c69c00) 00010000:00010000:3.0:1787508814.292571:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508814.292573:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f363d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.292578:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f363d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.292605:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f363c9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeda9 expref: 16 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.292615:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508814.292617:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508814.292620:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f363c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeda9 expref: 16 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.292629:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ec00, rc 0) 00000100:00100000:3.0:1787508814.292691:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6393800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:346087:x1874324509691136:12345-192.168.201.30@tcp:101:bash.0 Request processed in 426us (638us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508814.292699:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94292 00000100:00100000:3.0:1787508814.302446:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508814.302533:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509691264 00000100:00100000:0.0:1787508814.302543:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509691264 00000100:00100000:0.0:1787508814.302643:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94293 00000100:00100000:0.0:1787508814.302655:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:346233:x1874324509691264:12345-192.168.201.30@tcp:41:stat.0 00000004:00000024:0.0:1787508814.302716:0:203348:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 7790661632 avail 7327617024 00000100:00100000:0.0:1787508814.302791:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:346233:x1874324509691264:12345-192.168.201.30@tcp:41:stat.0 Request processed in 138us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508814.302800:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94293 00000100:00100000:2.0:1787508814.347128:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508814.347201:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509691520 00000100:00100000:3.0:1787508814.347211:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509691520 00000100:00100000:3.0:1787508814.347283:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94294 00000100:00100000:3.0:1787508814.347294:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:346239:x1874324509691520:12345-192.168.201.30@tcp:36:lfs.0 00000100:00100000:3.0:1787508814.347407:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480256896:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508814.347459:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508814.347489:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c6b58900 going to sleep for 11 seconds 00000100:00100000:3.0:1787508814.347513:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480256896 00000100:00100000:3.0:1787508814.347517:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480256896 00000100:00100000:3.0:1787508814.347545:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29994 00000100:00100000:3.0:1787508814.347552:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:205405:x1874324480256896:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508814.347620:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:205405:x1874324480256896:12345-0@lo:1000:mdt00_004.0 Request processed in 67us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508814.347626:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29994 00000100:00100000:3.0:1787508814.347672:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480256896:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508814.347713:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480257024:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508814.347736:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508814.347752:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c6b58900 going to sleep for 11 seconds 00000100:00100000:3.0:1787508814.347764:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480257024 00000100:00100000:3.0:1787508814.347768:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480257024 00000100:00100000:3.0:1787508814.347789:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29995 00000100:00100000:3.0:1787508814.347796:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:205405:x1874324480257024:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787508814.347976:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:205405:x1874324480257024:12345-0@lo:1000:mdt00_004.0 Request processed in 179us (238us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787508814.347983:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29995 00000100:00100000:3.0:1787508814.348021:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480257024:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1787508814.348064:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8ec00/0xb126349c40f363de lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.348075:0:205405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8ec00/0xb126349c40f363de lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.348084:0:205405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8ec00/0xb126349c40f363de lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508814.348095:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480257152:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1787508814.348119:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508814.348135:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c6b58540 going to sleep for 11 seconds 00000100:00100000:3.0:1787508814.348147:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480257152 00000100:00100000:3.0:1787508814.348150:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480257152 00000100:00100000:3.0:1787508814.348172:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29996 00000100:00100000:3.0:1787508814.348178:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:205405:x1874324480257152:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1787508814.348187:0:225829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508814.348201:0:225829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f363e5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f363de expref: -99 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.348225:0:225829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36383 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed8d expref: 14 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.348234:0:225829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f363e5 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f363de expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.348257:0:225829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36383 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed8d expref: 14 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.348271:0:225829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36383 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed8d expref: 14 pid: 202227 timeout: 13885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508814.348282:0:225829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999fb80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480257280:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508814.348335:0:225829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c6b58900 going to sleep for 11 seconds 00000100:00080000:2.0:1787508814.348590:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787508814.353173:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508814.353204:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509691648 00000100:00100000:3.0:1787508814.353213:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509691648 00010000:00010000:3.0:1787508814.353251:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36383 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed8d expref: 15 pid: 202227 timeout: 13885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508814.353286:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27977 00000100:00100000:3.0:1787508814.353296:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:2403:x1874324509691648:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508814.353311:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508814.353317:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36383 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed8d expref: 15 pid: 202227 timeout: 13885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.353333:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36383 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed8d expref: 15 pid: 202227 timeout: 13885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.353356:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508814.353363:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f363e5 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f363de expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.353376:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f363e5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xb126349c40f363de expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.353386:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f363e5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xb126349c40f363de expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.353423:0:205406:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f363e5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f363de expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508814.353438:0:205406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:205406:1874324480257408:0@lo:105: 00000100:00100000:3.0:1787508814.353484:0:205406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508814.353518:0:205406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c6b58600 going to sleep for 11 seconds 00000100:00100000:3.0:1787508814.353533:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480257408 00000100:00100000:3.0:1787508814.353537:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480257408 00000100:00100000:3.0:1787508814.353566:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18209 00000100:00100000:3.0:1787508814.353574:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:205406:x1874324480257408:12345-0@lo:105: 00010000:00010000:3.0:1787508814.353584:0:202210:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8ec00/0xb126349c40f363de lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f363e5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.353598:0:202210:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8ec00/0xb126349c40f363de lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f363e5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.353607:0:202210:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8ec00/0xb126349c40f363de lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f363e5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.353615:0:202210:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8ec00/0xb126349c40f363de lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f363e5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.353623:0:202210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8ec00/0xb126349c40f363de lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xb126349c40f363e5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.353632:0:202210:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8ec00/0xb126349c40f363de lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xb126349c40f363e5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.353646:0:202210:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9090e4c8ec00) 00000100:00100000:3.0:1787508814.353679:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:205406:x1874324480257408:12345-0@lo:105: Request processed in 106us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508814.353686:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18209 00000100:00100000:3.0:1787508814.353727:0:205406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:205406:1874324480257408:0@lo:105: 00010000:00010000:3.0:1787508814.353742:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508814.353780:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:2403:x1874324509691648:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 485us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508814.353787:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27977 00010000:00010000:0.0:1787508814.353874:0:225829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36383 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed8d expref: 14 pid: 202227 timeout: 13885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508814.353889:0:225829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999fb80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000_UUID:225829:1874324480257280:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508814.353907:0:225829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f363e5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f363de expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.353916:0:225829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508814.353918:0:225829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508814.353921:0:225829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fe00, rc 0) 00000100:00100000:0.0:1787508814.354001:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:205405:x1874324480257152:12345-0@lo:101:mdt00_004.0 Request processed in 5813us (5871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508814.354008:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29996 00000100:00100000:3.0:1787508814.354155:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480257152:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1787508814.354172:0:205405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8ec00/0xb126349c40f363de lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f363e5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787508814.354190:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1787508814.354220:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f363ec lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.354227:0:205405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f363ec lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.354236:0:205405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f363ec lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508814.354252:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480257536:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1787508814.354279:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508814.354306:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c6b58540 going to sleep for 11 seconds 00000100:00100000:0.0:1787508814.354352:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480257536 00000100:00100000:0.0:1787508814.354357:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480257536 00000100:00100000:0.0:1787508814.354395:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29997 00000100:00100000:0.0:1787508814.354402:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:205405:x1874324480257536:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1787508814.354417:0:202232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508814.354431:0:202232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f363f3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f363ec expref: -99 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.354449:0:202232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f363f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f363ec expref: 8 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.354461:0:202232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f363f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f363ec expref: 8 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.354468:0:202232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaaf14dc5 (ffff9090c96b8100) 00010000:00010000:0.0:1787508814.354470:0:202232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508814.354473:0:202232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4600, rc 0) 00000100:00100000:0.0:1787508814.354504:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480257536:12345-0@lo:101:mdt00_004.0 Request processed in 103us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508814.354511:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29997 00000100:00100000:0.0:1787508814.354537:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480257536:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1787508814.354548:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f363ec lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f363f3 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.354557:0:205405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f363ec lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f363f3 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787508814.354568:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1787508814.354599:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6392680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480257664:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508814.354625:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508814.354642:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c8a7db40 going to sleep for 11 seconds 00000100:00100000:0.0:1787508814.354656:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480257664 00000100:00100000:0.0:1787508814.354659:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480257664 00000100:00100000:0.0:1787508814.354683:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29998 00000100:00100000:0.0:1787508814.354689:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6391880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480257664:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508814.354746:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6391880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480257664:12345-0@lo:1000:mdt00_004.0 Request processed in 57us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508814.354753:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29998 00000100:00100000:0.0:1787508814.354779:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6392680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480257664:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508814.354814:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d6392680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480257792:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508814.354837:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508814.354979:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c8a7db40 going to sleep for 11 seconds 00000100:00100000:0.0:1787508814.363801:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480257792 00000100:00100000:0.0:1787508814.363818:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480257792 00000100:00100000:0.0:1787508814.363901:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29999 00000100:00100000:0.0:1787508814.363914:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480257792:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508814.364110:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480257792:12345-0@lo:1000:mdt00_004.0 Request processed in 198us (9270us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787508814.364118:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29999 00000100:00100000:0.0:1787508814.366584:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d6392680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480257792:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508814.366715:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480257920:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508814.366780:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508814.366820:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c8a7db40 going to sleep for 11 seconds 00000100:00100000:0.0:1787508814.366845:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480257920 00000100:00100000:0.0:1787508814.366852:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480257920 00000100:00100000:0.0:1787508814.366899:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30000 00000100:00100000:0.0:1787508814.366909:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6392680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480257920:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508814.368086:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6392680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480257920:12345-0@lo:1000:mdt00_004.0 Request processed in 1173us (1301us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787508814.368100:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30000 00000100:00100000:0.0:1787508814.368151:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480257920:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508814.368223:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480258048:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508814.368258:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508814.368278:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c8a7db40 going to sleep for 11 seconds 00000100:00100000:0.0:1787508814.368296:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480258048 00000100:00100000:0.0:1787508814.368302:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480258048 00000100:00100000:0.0:1787508814.368334:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30001 00000100:00100000:0.0:1787508814.368341:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480258048:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508814.368399:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480258048:12345-0@lo:1000:mdt00_004.0 Request processed in 58us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508814.368409:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30001 00000100:00100000:0.0:1787508814.368436:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480258048:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508814.368475:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed432a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480258176:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508814.368497:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508814.368512:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c8a7db40 going to sleep for 11 seconds 00000100:00100000:0.0:1787508814.368523:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480258176 00000100:00100000:0.0:1787508814.368527:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480258176 00000100:00100000:0.0:1787508814.368548:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30002 00000100:00100000:0.0:1787508814.368554:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480258176:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508814.368612:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480258176:12345-0@lo:1000:mdt00_004.0 Request processed in 58us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508814.368619:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30002 00000100:00100000:0.0:1787508814.368644:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed432a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480258176:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508814.368680:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed432a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480258304:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508814.368702:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508814.368717:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c8a7db40 going to sleep for 11 seconds 00000100:00100000:0.0:1787508814.368728:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480258304 00000100:00100000:0.0:1787508814.368731:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480258304 00000100:00100000:0.0:1787508814.368753:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30003 00000100:00100000:0.0:1787508814.368759:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480258304:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787508814.368804:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:205405:x1874324480258304:12345-0@lo:1000:mdt00_004.0 Request processed in 45us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508814.368810:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30003 00000100:00100000:0.0:1787508814.368835:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed432a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480258304:0@lo:1000:mdt00_004.0 00000040:00080000:1.0:1787508814.389592:0:205405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000bd1:0xf:0x0].60, 2168 off98072 00000040:00080000:1.0:1787508814.389689:0:205405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000013a2:0x5:0x0].604, 2368 off768632 00000004:00080000:1.0:1787508814.389696:0:205405:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090cd200f00 with version 13635 00000004:00080000:0.0:1787508814.390159:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13635 rpc_version 13635 00000020:00100000:0.0:1787508814.390201:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787508814.390211:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091ed432a00 x1874324480258560/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787508814.390234:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed432a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480258560:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787508814.390307:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508814.390345:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c8a7d000 going to sleep for 11 seconds 00000100:00100000:1.0:1787508814.390413:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480258560 00000100:00100000:1.0:1787508814.390420:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480258560 00000100:00100000:1.0:1787508814.390470:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30004 00000100:00100000:1.0:1787508814.390478:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:202961:x1874324480258560:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787508814.393278:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:202961:x1874324480258560:12345-0@lo:1000:osp_up0-1.0 Request processed in 2794us (2965us total) trans 12884944274 rc 0/0 00000100:00100000:1.0:1787508814.393292:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30004 00000100:00100000:2.0:1787508814.396215:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed432a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480258560:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1787508814.399106:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f363fa lrc: 3/0,1 mode: --/PW res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.399125:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f363fa lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.399137:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f363fa lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.399157:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f36401 lrc: 3/0,1 mode: --/PW res: [0x240000bd1:0x297:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.399165:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f36401 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x297:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.399170:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f36401 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x297:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.399204:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a000/0xb126349c40f36408 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.399211:0:205405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a000/0xb126349c40f36408 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.399221:0:205405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a000/0xb126349c40f36408 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508814.399245:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d021a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480258688:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1787508814.399308:0:205405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508814.399353:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480258688 00000100:00100000:1.0:1787508814.399361:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480258688 00000100:00100000:1.0:1787508814.399413:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30005 00000100:00100000:1.0:1787508814.399422:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:205405:x1874324480258688:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1787508814.399440:0:225829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508814.399456:0:225829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3640f lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb126349c40f36408 expref: -99 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.399476:0:225829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3640f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xb126349c40f36408 expref: 10 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.399485:0:225829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3640f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f36408 expref: 10 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.399493:0:225829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28d:0x0].0x0 (ffff9090d171f100) 00010000:00010000:1.0:1787508814.399495:0:225829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508814.399499:0:225829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ac00, rc 0) 00000100:00100000:1.0:1787508814.399529:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:205405:x1874324480258688:12345-0@lo:101:mdt00_004.0 Request processed in 109us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508814.399536:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30005 00000100:00100000:1.0:1787508814.399557:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cd2000c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508814.399577:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d021a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:205405:1874324480258688:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1787508814.399590:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a000/0xb126349c40f36408 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3640f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.399600:0:205405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a000/0xb126349c40f36408 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f3640f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508814.399619:0:205405:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4e64e97 reply state 0000000093a0a8ce transno 8589962081 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f36401 lrc: 3/0,1 mode: PW/PW res: [0x240000bd1:0x297:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.399631:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f36401 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x297:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.399637:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x297:0x0].0x0 (ffff9090d171f600) 00010000:00010000:1.0:1787508814.399639:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787508814.399642:0:205405:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787508814.399647:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a000/0xb126349c40f36408 lrc: 4/0,1 mode: PW/PW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3640f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.399653:0:205405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a000/0xb126349c40f36408 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f3640f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787508814.399662:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x2000013a2:0x28d:0x0] 00000004:00010000:1.0:1787508814.399668:0:205405:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4e64e97 reply state 0000000093a0a8ce transno 8589962081 ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f363fa lrc: 3/0,1 mode: PW/PW res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.399676:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f363fa lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.399681:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13dd:0x0].0x0 (ffff9090d171fd00) 00010000:00010000:1.0:1787508814.399683:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787508814.399684:0:205405:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1787508814.399689:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13dd:0x0]: returning size 4096 00000004:00080000:1.0:1787508814.399698:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787508814.399706:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8ec00/0xb126349c40f363de lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xb126349c40f363e5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.399713:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8ec00/0xb126349c40f363de lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f363e5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.399723:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8ec00/0xb126349c40f363de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xb126349c40f363e5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.399746:0:205405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787508814.399750:0:205405:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787508814.399755:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f363ec lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f363f3 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.399761:0:205405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f363ec lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xb126349c40f363f3 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508814.399828:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:346239:x1874324509691520:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 52535us (52710us total) trans 8589962081 rc 0/0 00000100:00100000:1.0:1787508814.399836:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94294 00010000:00010000:3.0:1787508814.399936:0:204785:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787508814.399962:0:204785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8ec00/0xb126349c40f363de lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xb126349c40f363e5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.399972:0:204785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ec00 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:3.0:1787508814.399977:0:204785:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8ec00/0xb126349c40f363de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xb126349c40f363e5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508814.399985:0:204785:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8ec00/0xb126349c40f363de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xb126349c40f363e5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.400023:0:204785:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8ec00/0xb126349c40f363de lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f363e5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.400035:0:204785:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787508814.400056:0:204785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8ec00/0xb126349c40f363de lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f363e5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.400064:0:204785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8ec00/0xb126349c40f363de lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xb126349c40f363e5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.400078:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508814.400079:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508814.400081:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508814.400089:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787508814.400100:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480258816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787508814.400137:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508814.400863:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480258816 00000100:00100000:1.0:1787508814.400871:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480258816 00000100:00100000:1.0:1787508814.401021:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9839 00000100:00100000:1.0:1787508814.401031:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+10:3618:x1874324480258816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508814.401043:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508814.401062:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f363e5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xb126349c40f363de expref: 10 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.401075:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508814.401078:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508814.401134:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3618:x1874324480258816:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508814.401144:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9839 00000100:00100000:1.0:1787508814.401186:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480258816:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508814.403233:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508814.411162:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508814.411227:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509691776 00000100:00100000:0.0:1787508814.411238:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509691776 00000100:00100000:0.0:1787508814.411300:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94295 00000100:00100000:0.0:1787508814.411311:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:346087:x1874324509691776:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1787508814.411333:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508814.411354:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f36416 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaedb0 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.411417:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3641d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.411473:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3641d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.411484:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3641d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508814.411564:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787508814.411568:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508814.411589:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3641d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.411619:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f36416 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaedb0 expref: 16 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.411636:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3641d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaedb0 expref: 15 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.411644:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508814.411647:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508814.411651:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5e00, rc 0) 00000100:00100000:0.0:1787508814.411720:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:346087:x1874324509691776:12345-192.168.201.30@tcp:101:bash.0 Request processed in 410us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508814.411727:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94295 00000100:00100000:1.0:1787508814.413867:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508814.413984:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509691904 00000100:00100000:3.0:1787508814.414007:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509691904 00000100:00100000:2.0:1787508814.414151:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94296 00000100:00100000:2.0:1787508814.414163:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+15:346087:x1874324509691904:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1787508814.414181:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508814.414199:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f36424 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaedb7 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508814.414262:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3642b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508814.414274:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3642b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508814.414285:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3642b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508814.414296:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f36432 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508814.414309:0:209004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f363f3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f363ec expref: 8 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508814.414316:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f36432 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508814.414349:0:209004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f363f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f363ec expref: 8 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508814.414364:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc620000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480258944:0@lo:104: 00000100:00100000:2.0:1787508814.414410:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508814.414454:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1e75300 going to sleep for 11 seconds 00000100:00100000:1.0:1787508814.414540:0:229386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480258944 00000100:00100000:1.0:1787508814.414546:0:229386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480258944 00000100:00100000:1.0:1787508814.414582:0:229386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18210 00000100:00100000:1.0:1787508814.414591:0:229386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc623480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:209004:x1874324480258944:12345-0@lo:104: 00010000:00010000:1.0:1787508814.414605:0:229386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f363ec lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f363f3 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.414669:0:229386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787508814.414676:0:229386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc623480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:209004:x1874324480258944:12345-0@lo:104: Request processed in 87us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508814.414687:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc620000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480258944:0@lo:104: 00000100:00100000:1.0:1787508814.414687:0:229386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18210 00010000:00010000:3.0:1787508814.414760:0:226765:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787508814.414768:0:226765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f363ec lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f363f3 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.414777:0:226765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:2.0:1787508814.414782:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f36432 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.414784:0:226765:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f363ec lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f363f3 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508814.414804:0:226765:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f363ec lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f363f3 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.414832:0:226765:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f363ec lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f363f3 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.414839:0:226765:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787508814.414875:0:226765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f363ec lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f363f3 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.414883:0:226765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090e4c8e600/0xb126349c40f363ec lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f363f3 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.414902:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508814.414903:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508814.414905:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508814.414972:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787508814.414986:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480259072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508814.415030:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508814.415113:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480259072 00000100:00100000:3.0:1787508814.415118:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480259072 00010000:00010000:3.0:1787508814.415137:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f363f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f363ec expref: 9 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508814.415167:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27978 00000100:00100000:3.0:1787508814.415173:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0218380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3617:x1874324480259072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787508814.415184:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:2.0:1787508814.418623:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944274 is committed 00010000:00010000:3.0:1787508814.418909:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f363f3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f363ec expref: 8 pid: 202232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.418932:0:202211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaaf14dc5 (ffff9090c96b8100) 00010000:00010000:3.0:1787508814.419054:0:202211:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f36432 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.419066:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f36432 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.419078:0:202211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f36432 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508814.419216:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508814.419304:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0218380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:3617:x1874324480259072:12345-0@lo:103:ldlm_bl.0 Request processed in 4128us (4270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508814.419315:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27978 00000100:00100000:1.0:1787508814.419378:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480259072:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787508814.419414:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f36432 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.419424:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f36432 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508814.419551:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed431880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:209004:1874324480259200:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787508814.419595:0:209004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508814.419670:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c8a7dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787508814.419719:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480259200 00000100:00100000:2.0:1787508814.419729:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480259200 00000100:00100000:2.0:1787508814.419774:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30006 00000100:00100000:2.0:1787508814.419783:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:209004:x1874324480259200:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787508814.419903:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:209004:x1874324480259200:12345-0@lo:1000:mdt00_005.0 Request processed in 121us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508814.419914:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30006 00000100:00100000:0.0:1787508814.420202:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed431880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:209004:1874324480259200:0@lo:1000:mdt00_005.0 00010000:00010000:0.0:1787508814.420249:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f36439 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.420262:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f36439 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.420276:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f36439 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508814.420300:0:209004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f36439 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.420314:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3642b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.420321:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3642b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.420327:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3642b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.420333:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3642b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.420338:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508814.420342:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3642b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.420348:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3642b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.420359:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508814.420362:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508814.420367:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3642b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.420374:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3642b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.420388:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f36432 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.420394:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f36432 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.420398:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f36432 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.420403:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aae00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508814.420406:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f36432 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.420412:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f36432 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.420420:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaaf14dc5 (ffff9090c96b8100) 00010000:00010000:0.0:1787508814.420422:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508814.420425:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f36432 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.420432:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f36432 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.420473:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f36424 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaedb7 expref: 17 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.420487:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5200/0xb126349c40f36439 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaedb7 expref: 16 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.420500:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13dd:0x0].0x0 (ffff9090c96b8000) 00010000:00010000:0.0:1787508814.420502:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508814.420505:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5200, rc 0) 00000100:00100000:0.0:1787508814.420563:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:346087:x1874324509691904:12345-192.168.201.30@tcp:101:bash.0 Request processed in 6403us (6704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508814.420571:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94296 00000100:00100000:2.0:1787508814.424374:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508814.425490:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509692032 00000100:00100000:0.0:1787508814.425502:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509692032 00000100:00100000:0.0:1787508814.425576:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94297 00000100:00100000:0.0:1787508814.425588:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:346087:x1874324509692032:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1787508814.425610:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508814.425630:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4000/0xb126349c40f36440 lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaedbe expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.425691:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5a00/0xb126349c40f36447 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.425704:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5a00/0xb126349c40f36447 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.425715:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5a00/0xb126349c40f36447 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508814.425820:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13dd:0x0]: returning size 4096 00000004:00200000:0.0:1787508814.425826:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508814.425867:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4000/0xb126349c40f36440 lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaedbe expref: 12 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.425892:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5a00/0xb126349c40f36447 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaedbe expref: 11 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.425901:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13dd:0x0].0x0 (ffff9090d171fd00) 00010000:00010000:0.0:1787508814.425904:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1787508814.425907:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5a00, rc 0) 00000100:00100000:0.0:1787508814.426036:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:346087:x1874324509692032:12345-192.168.201.30@tcp:101:bash.0 Request processed in 450us (1673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508814.426044:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94297 00000100:00100000:3.0:1787508814.428751:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508814.429172:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509692160 00000100:00100000:1.0:1787508814.429279:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509692160 00000100:00100000:1.0:1787508814.429345:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94298 00000100:00100000:1.0:1787508814.429356:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:346087:x1874324509692160:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:1.0:1787508814.429377:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508814.429398:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f3644e lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x297:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaedc5 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.429689:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f36455 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x297:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.429706:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f36455 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x297:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.429719:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f36455 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x297:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508814.430032:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x297:0x0]: returning size 4096 00000004:00200000:1.0:1787508814.430039:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787508814.430079:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247b200/0xb126349c40f3644e lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x297:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaedc5 expref: 13 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.430097:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a200/0xb126349c40f36455 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x297:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaedc5 expref: 12 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.430106:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x297:0x0].0x0 (ffff9090d171f600) 00010000:00010000:1.0:1787508814.430109:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508814.430113:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a200, rc 0) 00000100:00100000:1.0:1787508814.431036:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:346087:x1874324509692160:12345-192.168.201.30@tcp:101:bash.0 Request processed in 1674us (2298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508814.431047:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94298 00000100:00100000:1.0:1787508814.438352:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508814.438708:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509692288 00000100:00100000:0.0:1787508814.438719:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509692288 00000100:00100000:0.0:1787508814.438785:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94299 00000100:00100000:0.0:1787508814.438797:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+16:346087:x1874324509692288:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1787508814.438818:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508814.438840:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f3645c lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaedcc expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.438915:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f36463 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.438931:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3640f lrc: 2/0,0 mode: PW/PW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xb126349c40f36408 expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.438940:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f36463 lrc: 4/1,0 mode: --/PR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.439031:0:202228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3640f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xb126349c40f36408 expref: 6 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508814.439048:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed431880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480259328:0@lo:104: 00000100:00100000:0.0:1787508814.439112:0:202228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508814.439157:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c8a7df00 going to sleep for 11 seconds 00000100:00100000:3.0:1787508814.439313:0:202210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480259328 00000100:00100000:3.0:1787508814.439318:0:202210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480259328 00000100:00100000:3.0:1787508814.439403:0:202210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18211 00000100:00100000:3.0:1787508814.439412:0:202210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed433480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:202228:x1874324480259328:12345-0@lo:104: 00010000:00010000:3.0:1787508814.439426:0:202210:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a000/0xb126349c40f36408 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f3640f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.439500:0:202210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787508814.439507:0:202210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed433480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:202228:x1874324480259328:12345-0@lo:104: Request processed in 97us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508814.439515:0:202210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18211 00000100:00100000:1.0:1787508814.439581:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed431880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480259328:0@lo:104: 00010000:00010000:1.0:1787508814.439601:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f36463 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508814.439643:0:202214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787508814.439651:0:202214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a000/0xb126349c40f36408 lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xb126349c40f3640f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508814.439660:0:202214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a000 already unused, calling callback (ffffffffc190eee0) 00010000:00010000:2.0:1787508814.439665:0:202214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a000/0xb126349c40f36408 lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xb126349c40f3640f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508814.439674:0:202214:0:(mdt_handler.c:3973:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a000/0xb126349c40f36408 lrc: 4/0,0 mode: PW/PW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xb126349c40f3640f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508814.439776:0:202214:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a000/0xb126349c40f36408 lrc: 2/0,0 mode: --/PW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3640f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508814.439785:0:202214:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787508814.439839:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cc621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480259456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787508814.439878:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787508814.439928:0:202214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a000/0xb126349c40f36408 lrc: 1/0,0 mode: --/PW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3640f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508814.439937:0:202214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9090d247a000/0xb126349c40f36408 lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xb126349c40f3640f expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508814.439979:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508814.439980:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508814.439982:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508814.441086:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480259456 00000100:00100000:1.0:1787508814.441309:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480259456 00010000:00010000:1.0:1787508814.441349:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3640f lrc: 3/0,0 mode: PW/PW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xb126349c40f36408 expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508814.441422:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27979 00000100:00100000:1.0:1787508814.441434:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+7:3617:x1874324480259456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508814.441449:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508814.445294:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f3640f lrc: 0/0,0 mode: --/PW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xb126349c40f36408 expref: 7 pid: 225829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.445320:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28d:0x0].0x0 (ffff9090d171f100) 00010000:00010000:3.0:1787508814.445326:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f36463 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.445336:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f36463 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.445344:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f36463 lrc: 4/1,0 mode: PR/PR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.445426:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508814.445515:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480259456:12345-0@lo:103:ldlm_bl.0 Request processed in 4081us (5633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508814.445525:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27979 00000100:00100000:0.0:1787508814.445544:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cc621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480259456:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787508814.448068:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f36463 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.448087:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f36463 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508814.448159:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a2:0x28d:0x0]: returning size 4096 00000004:00200000:1.0:1787508814.448165:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787508814.449066:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f3645c lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaedcc expref: 18 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.449096:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f36463 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaedcc expref: 17 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508814.449106:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28d:0x0].0x0 (ffff9090d171f100) 00010000:00010000:1.0:1787508814.449108:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787508814.449113:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5600, rc 0) 00000100:00100000:1.0:1787508814.449292:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:346087:x1874324509692288:12345-192.168.201.30@tcp:101:bash.0 Request processed in 10496us (10949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508814.449303:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94299 00000100:00100000:2.0:1787508814.454221:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508814.454391:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509692544 00000100:00100000:0.0:1787508814.454402:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509692544 00000100:00100000:0.0:1787508814.454477:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94300 00000100:00100000:0.0:1787508814.454487:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:346087:x1874324509692544:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1787508814.454507:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508814.454510:0:209004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787508814.454537:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f36463 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaedcc expref: 17 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.454555:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28d:0x0].0x0 (ffff9090d171f100) 00010000:00010000:0.0:1787508814.454566:0:209004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508814.454581:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f3646a lrc: 2/0,0 mode: --/CW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaedd3 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.454722:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f36471 lrc: 3/0,1 mode: --/CW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.454736:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f36471 lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.454747:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f36471 lrc: 3/0,1 mode: CW/CW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.454818:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f36478 lrc: 3/0,1 mode: --/PW res: [0x2000013a2:0x28d:0x0].0xea02679a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.454826:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f36478 lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x28d:0x0].0xea02679a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.454833:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f36478 lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x28d:0x0].0xea02679a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508814.455091:0:202251:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:202251:1874324480259584:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787508814.455152:0:202251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508814.455196:0:202251:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cd200480 going to sleep for 11 seconds 00000100:00100000:2.0:1787508814.455331:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480259584 00000100:00100000:2.0:1787508814.455338:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480259584 00000100:00100000:2.0:1787508814.455397:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15095 00000100:00100000:2.0:1787508814.455405:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:202251:x1874324480259584:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787508814.455437:0:203727:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 5442 00000100:00080000:3.0:1787508814.455611:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787508814.456336:0:209004:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x1532:0x0], index 0: 0 00010000:00010000:0.0:1787508814.456511:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f3647f lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1276:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.456524:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f3647f lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1276:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.456534:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f3647f lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1276:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.456573:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f36471 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.456579:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f36471 lrc: 4/0,1 mode: CW/CW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.456586:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f36471 lrc: 3/0,0 mode: CW/CW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.456593:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f36471 lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.456603:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5c00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508814.456607:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f36471 lrc: 4/0,0 mode: CW/CW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.456613:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f36471 lrc: 5/0,0 mode: CW/CW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.456623:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28d:0x0].0x0 (ffff9090c96b8100) 00010000:00010000:0.0:1787508814.456626:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508814.456630:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f36471 lrc: 3/0,0 mode: --/CW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.456637:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5c00/0xb126349c40f36471 lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508814.456651:0:209004:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a1601dec reply state 00000000eef9c61c transno 12884944275 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f36478 lrc: 3/0,1 mode: PW/PW res: [0x2000013a2:0x28d:0x0].0xea02679a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.456661:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f36478 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x28d:0x0].0xea02679a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.456668:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28d:0x0].0xea02679a (ffff9090c96b8e00) 00010000:00010000:0.0:1787508814.456670:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787508814.456673:0:209004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787508814.456712:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f3646a lrc: 0/0,0 mode: --/CW res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaedd3 expref: 19 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.456733:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4200/0xb126349c40f3647f lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1276:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaedd3 expref: 18 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508814.456746:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1276:0x0].0x0 (ffff9090c96b8400) 00010000:00010000:0.0:1787508814.456748:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787508814.456751:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4200, rc 0) 00000100:00100000:0.0:1787508814.456821:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+19:346087:x1874324509692544:12345-192.168.201.30@tcp:101:bash.0 Request processed in 2335us (2610us total) trans 12884944275 rc 0/0 00000100:00100000:0.0:1787508814.456829:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94300 00000100:00100000:0.0:1787508814.461093:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:202251:x1874324480259584:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5682us (5933us total) trans 8589941258 rc 0/0 00000100:00100000:0.0:1787508814.461107:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15095 00000100:00100000:1.0:1787508814.461256:0:202251:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:202251:1874324480259584:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787508814.461267:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000004:00080000:1.0:1787508814.461276:0:202251:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1532:0x0]-[0x280000401:0x1561:0x0] 00000100:00100000:3.0:1787508814.461568:0:225835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509692672 00000100:00100000:3.0:1787508814.461575:0:225835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509692672 00000100:00100000:3.0:1787508814.461641:0:225835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15096 00000100:00100000:3.0:1787508814.461652:0:225835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:346087:x1874324509692672:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1787508814.461667:0:225835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508814.461688:0:225835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070ec765d/0xb126349c40f3648d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1532:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaedda expref: -99 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787508814.461713:0:225835:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1532:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787508814.461732:0:225835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1532:0x0].0x0 since=13785s v=(0 0) 00010000:00010000:3.0:1787508814.461749:0:225835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1532:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787508814.461759:0:225835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070ec765d/0xb126349c40f3648d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1532:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaedda expref: 7 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.461776:0:225835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000070ec765d/0xb126349c40f3648d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1532:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaedda expref: 7 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508814.461790:0:225835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ec00, rc 0) 00000100:00100000:3.0:1787508814.461844:0:225835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:346087:x1874324509692672:12345-192.168.201.30@tcp:101:bash.0 Request processed in 193us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508814.461851:0:225835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15096 00000100:00080000:2.0:1787508814.462013:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508814.468635:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508814.472371:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509692928 00000100:00100000:0.0:1787508814.472387:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509692928 00000100:00100000:1.0:1787508814.472547:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15505 00000100:00100000:1.0:1787508814.472561:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fdb9d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+19:346087:x1874324509692928:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:1.0:1787508814.473075:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fdb9d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:346087:x1874324509692928:12345-192.168.201.30@tcp:35:bash.0 Request processed in 515us (4450us total) trans 12884944276 rc 0/0 00000100:00100000:1.0:1787508814.473084:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15505 00000100:00100000:1.0:1787508814.951936:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508814.952043:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508814.952076:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508814.952101:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508814.952116:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508814.952136:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508814.952152:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508814.952169:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508814.952187:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508814.952228:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509693568 00000100:00100000:1.0:1787508814.952238:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509693568 00000100:00100000:1.0:1787508814.952303:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509694080 00000100:00100000:1.0:1787508814.952307:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509694080 00000100:00100000:1.0:1787508814.952326:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509693440 00000100:00100000:1.0:1787508814.952329:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509693440 00000100:00100000:1.0:1787508814.952355:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509693952 00000100:00100000:1.0:1787508814.952358:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509693952 00000100:00100000:1.0:1787508814.952381:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2566 00000100:00100000:1.0:1787508814.952391:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2400:x1874324509693568:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508814.952466:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2400:x1874324509693568:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 76us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508814.952473:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2566 00000100:00100000:1.0:1787508814.952490:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2567 00000100:00100000:1.0:1787508814.952496:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2400:x1874324509694080:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508814.952538:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2400:x1874324509694080:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508814.952545:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2567 00000100:00100000:1.0:1787508814.952558:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2568 00000100:00100000:1.0:1787508814.952565:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2400:x1874324509693440:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508814.952589:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2400:x1874324509693440:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508814.952595:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2568 00000100:00100000:1.0:1787508814.952606:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2569 00000100:00100000:1.0:1787508814.952612:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2400:x1874324509693952:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508814.952636:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2400:x1874324509693952:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508814.952646:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2569 00000100:00100000:1.0:1787508814.952681:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509693312 00000100:00100000:1.0:1787508814.952684:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509693312 00000100:00100000:1.0:1787508814.952709:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509693824 00000100:00100000:1.0:1787508814.952712:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509693824 00000100:00100000:1.0:1787508814.952729:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509693184 00000100:00100000:1.0:1787508814.952732:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509693184 00000100:00100000:1.0:1787508814.952746:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509693696 00000100:00100000:1.0:1787508814.952748:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509693696 00000100:00100000:1.0:1787508814.952763:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3232 00000100:00100000:1.0:1787508814.952769:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:2400:x1874324509693312:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508814.952796:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:2400:x1874324509693312:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 28us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508814.952803:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3232 00000100:00100000:1.0:1787508814.952814:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3233 00000100:00100000:1.0:1787508814.952820:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2400:x1874324509693824:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508814.952842:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:2400:x1874324509693824:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508814.952848:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3233 00000100:00100000:1.0:1787508814.952860:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3234 00000100:00100000:1.0:1787508814.952866:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:2400:x1874324509693184:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508814.952895:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:2400:x1874324509693184:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 29us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508814.952901:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3234 00000100:00100000:1.0:1787508814.952913:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3235 00000100:00100000:1.0:1787508814.952920:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2400:x1874324509693696:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508814.952969:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2400:x1874324509693696:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 49us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508814.952975:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3235 00000100:00100000:2.0:1787508814.954218:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509693056 00000100:00100000:2.0:1787508814.954229:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509693056 00000100:00100000:2.0:1787508814.954291:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1056 00000100:00100000:2.0:1787508814.954301:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed92e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2400:x1874324509693056:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508814.954372:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed92e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2400:x1874324509693056:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 73us (2448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508814.954379:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1056 00000100:00080000:2.0:1787508814.954412:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787508814.954417:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787508814.954420:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787508814.954424:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787508815.418202:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508815.546252:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787508815.546282:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480259712:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787508815.546364:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508815.546598:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480259840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787508815.546626:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508815.546751:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480259712 00000100:00100000:1.0:1787508815.546760:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480259712 00000100:00100000:1.0:1787508815.546820:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480259840 00000100:00100000:1.0:1787508815.546823:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480259840 00000100:00100000:1.0:1787508815.546840:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1781 00000100:00100000:1.0:1787508815.546849:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed431880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480259712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787508815.546879:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 156799552 pending 0 free 3881943040 avail 3650420736 00000100:00100000:1.0:1787508815.546962:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed431880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480259712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508815.546969:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1781 00000100:00100000:1.0:1787508815.546994:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1782 00000100:00100000:1.0:1787508815.547001:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480259840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787508815.547011:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 156799552 pending 0 free 3881943040 avail 3650420736 00000100:00100000:1.0:1787508815.547038:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480259840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508815.547055:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1782 00000100:00100000:1.0:1787508815.547103:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480259840:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787508815.547114:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508815.547117:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480259712:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787508815.550629:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508815.550746:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509694208 00000100:00100000:2.0:1787508815.550755:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509694208 00000100:00100000:2.0:1787508815.550817:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94301 00000100:00100000:2.0:1787508815.550828:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:346250:x1874324509694208:12345-192.168.201.30@tcp:101:stat.0 00010000:00010000:2.0:1787508815.550850:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508815.550872:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f36494 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaede1 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508815.551130:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f3649b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508815.551150:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f3649b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508815.551162:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f3649b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508815.551212:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508815.551216:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508815.551235:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f3649b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508815.551260:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab800/0xb126349c40f36494 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaede1 expref: 13 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508815.551277:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f3649b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaede1 expref: 12 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508815.551286:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508815.551289:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508815.551293:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab400, rc 0) 00000100:00100000:2.0:1787508815.551356:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:346250:x1874324509694208:12345-192.168.201.30@tcp:101:stat.0 Request processed in 530us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508815.551363:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94301 00000100:00100000:3.0:1787508815.563738:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508815.563903:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509694336 00000100:00100000:1.0:1787508815.563915:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509694336 00000100:00100000:1.0:1787508815.564038:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94302 00000100:00100000:1.0:1787508815.564049:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+12:346250:x1874324509694336:12345-192.168.201.30@tcp:101:stat.0 00010000:00010000:1.0:1787508815.564070:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508815.564092:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f364a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaede8 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508815.564156:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f364a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508815.564170:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f364a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508815.564180:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f364a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508815.564195:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f364b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508815.564202:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f364b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508815.564209:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f364b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508815.564274:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f364b7 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508815.564284:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f364b7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508815.564291:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f364b7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508815.564316:0:205405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f364b7 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508815.564331:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f364a9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508815.564336:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f364a9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508815.564342:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f364a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508815.564348:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f364a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508815.564354:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508815.564359:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f364a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508815.564367:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f364a9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508815.564379:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508815.564382:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508815.564386:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f364a9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508815.564393:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f364a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508815.564407:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f364b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508815.564413:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f364b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508815.564419:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f364b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508815.564424:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508815.564427:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f364b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508815.564433:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f364b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508815.564440:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xaaf14dc5 (ffff9090d171f500) 00010000:00010000:1.0:1787508815.564443:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508815.564446:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f364b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508815.564452:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f364b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xaaf14dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508815.564483:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f364a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaede8 expref: 14 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508815.564498:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a000/0xb126349c40f364b7 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaede8 expref: 13 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508815.564505:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13dd:0x0].0x0 (ffff9090c96b8000) 00010000:00010000:1.0:1787508815.564508:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787508815.564511:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a000, rc 0) 00000100:00100000:1.0:1787508815.564574:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:346250:x1874324509694336:12345-192.168.201.30@tcp:101:stat.0 Request processed in 527us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508815.564581:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94302 00000100:00100000:1.0:1787508815.569040:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508815.569125:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509694464 00000100:00100000:2.0:1787508815.569135:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509694464 00000100:00100000:2.0:1787508815.569200:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94303 00000100:00100000:2.0:1787508815.569211:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+9:346250:x1874324509694464:12345-192.168.201.30@tcp:101:stat.0 00010000:00010000:2.0:1787508815.569231:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508815.569253:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa400/0xb126349c40f364be lrc: 2/0,0 mode: --/CR res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaedef expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508815.569319:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab800/0xb126349c40f364c5 lrc: 3/1,0 mode: --/PR res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508815.569334:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab800/0xb126349c40f364c5 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508815.569346:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab800/0xb126349c40f364c5 lrc: 3/1,0 mode: PR/PR res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508815.569448:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd0:0x13dd:0x0]: returning size 4096 00000004:00200000:2.0:1787508815.569453:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787508815.569490:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2aa400/0xb126349c40f364be lrc: 0/0,0 mode: --/CR res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaedef expref: 11 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508815.569507:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090cd2ab800/0xb126349c40f364c5 lrc: 3/0,0 mode: PR/PR res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaedef expref: 10 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508815.569515:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13dd:0x0].0x0 (ffff9090d171fd00) 00010000:00010000:2.0:1787508815.569518:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1787508815.569521:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab800, rc 0) 00000100:00100000:2.0:1787508815.569583:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:346250:x1874324509694464:12345-192.168.201.30@tcp:101:stat.0 Request processed in 374us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508815.569588:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94303 00000100:00100000:2.0:1787508815.574349:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508815.574434:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509694592 00000100:00100000:0.0:1787508815.574443:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509694592 00000100:00100000:0.0:1787508815.574511:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94304 00000100:00100000:0.0:1787508815.574522:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+10:346250:x1874324509694592:12345-192.168.201.30@tcp:101:stat.0 00010000:00010000:0.0:1787508815.574542:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508815.574563:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f364cc lrc: 2/0,0 mode: --/CR res: [0x240000bd1:0x297:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaedf6 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508815.574624:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f364d3 lrc: 3/1,0 mode: --/PR res: [0x240000bd1:0x297:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508815.574639:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f364d3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x297:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508815.574650:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f364d3 lrc: 3/1,0 mode: PR/PR res: [0x240000bd1:0x297:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508815.574697:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000bd1:0x297:0x0]: returning size 4096 00000004:00200000:0.0:1787508815.574703:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787508815.574749:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e4400/0xb126349c40f364cc lrc: 0/0,0 mode: --/CR res: [0x240000bd1:0x297:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaedf6 expref: 12 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508815.574768:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9090c96e5c00/0xb126349c40f364d3 lrc: 3/0,0 mode: PR/PR res: [0x240000bd1:0x297:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaedf6 expref: 11 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508815.574777:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x297:0x0].0x0 (ffff9090d171f600) 00010000:00010000:0.0:1787508815.574780:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787508815.574784:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5c00, rc 0) 00000100:00100000:0.0:1787508815.574849:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:346250:x1874324509694592:12345-192.168.201.30@tcp:101:stat.0 Request processed in 328us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508815.574857:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94304 00000100:00100000:3.0:1787508815.585208:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508815.585523:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509694720 00000100:00100000:2.0:1787508815.585533:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509694720 00000100:00100000:2.0:1787508815.585594:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94305 00000100:00100000:2.0:1787508815.585605:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+13:346250:x1874324509694720:12345-192.168.201.30@tcp:101:stat.0 00010000:00010000:2.0:1787508815.585624:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508815.585646:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f364da lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaedfd expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508815.585703:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f364e1 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508815.585717:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f364e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508815.585737:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f364e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508815.585784:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a2:0x28d:0x0]: returning size 4096 00000004:00200000:2.0:1787508815.585788:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787508815.585821:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f364da lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaedfd expref: 15 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508815.585838:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abe00/0xb126349c40f364e1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaedfd expref: 14 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508815.585846:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28d:0x0].0x0 (ffff9091c816f900) 00010000:00010000:2.0:1787508815.585849:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787508815.585852:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abe00, rc 0) 00000100:00100000:2.0:1787508815.585919:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:346250:x1874324509694720:12345-192.168.201.30@tcp:101:stat.0 Request processed in 315us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508815.585925:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94305 00000100:00100000:2.0:1787508815.588928:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508815.589085:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509694848 00000100:00100000:3.0:1787508815.589095:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509694848 00000100:00100000:3.0:1787508815.589152:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94306 00000100:00100000:3.0:1787508815.589161:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:346250:x1874324509694848:12345-192.168.201.30@tcp:101:stat.0 00010000:00010000:3.0:1787508815.589181:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508815.589199:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f364e8 lrc: 2/0,0 mode: --/CR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaee04 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508815.589255:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f364ef lrc: 3/1,0 mode: --/CR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508815.589266:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f364ef lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508815.589274:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f364ef lrc: 3/1,0 mode: CR/CR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508815.589281:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f364f6 lrc: 3/1,0 mode: --/PR res: [0x2000013a2:0x28d:0x0].0xea02679a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508815.589286:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f364f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28d:0x0].0xea02679a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508815.589290:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f364f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28d:0x0].0xea02679a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508815.589364:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f364fd lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1276:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508815.589373:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f364fd lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1276:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508815.589380:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f364fd lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1276:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508815.589413:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1276:0x0]: returning size 5 00000004:00200000:3.0:1787508815.589416:0:202226:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508815.589430:0:202226:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f364fd lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1276:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508815.589439:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f364fd lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1276:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508815.589445:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f364ef lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508815.589450:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f364ef lrc: 4/1,0 mode: CR/CR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508815.589453:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f364ef lrc: 3/0,0 mode: CR/CR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508815.589458:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f364ef lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508815.589461:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ee00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508815.589464:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f364ef lrc: 4/0,0 mode: CR/CR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508815.589469:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f364ef lrc: 5/0,0 mode: CR/CR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508815.589477:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28d:0x0].0x0 (ffff9091c816f900) 00010000:00010000:3.0:1787508815.589479:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508815.589482:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f364ef lrc: 3/0,0 mode: --/CR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508815.589486:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f364ef lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508815.589496:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f364f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a2:0x28d:0x0].0xea02679a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508815.589499:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f364f6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a2:0x28d:0x0].0xea02679a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508815.589502:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f364f6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x28d:0x0].0xea02679a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508815.589505:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508815.589507:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f364f6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a2:0x28d:0x0].0xea02679a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508815.589510:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f364f6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a2:0x28d:0x0].0xea02679a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508815.589513:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28d:0x0].0xea02679a (ffff9090c96b8e00) 00010000:00010000:3.0:1787508815.589515:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508815.589516:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f364f6 lrc: 2/0,0 mode: --/PR res: [0x2000013a2:0x28d:0x0].0xea02679a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508815.589519:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f364f6 lrc: 0/0,0 mode: --/PR res: [0x2000013a2:0x28d:0x0].0xea02679a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508815.589536:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f364e8 lrc: 0/0,0 mode: --/CR res: [0x2000013a2:0x28d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee04 expref: 16 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508815.589548:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e200/0xb126349c40f364fd lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1276:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee04 expref: 15 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508815.589555:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1276:0x0].0x0 (ffff9090c96b8400) 00010000:00010000:3.0:1787508815.589557:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787508815.589559:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e200, rc 0) 00000100:00100000:3.0:1787508815.589627:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:346250:x1874324509694848:12345-192.168.201.30@tcp:101:stat.0 Request processed in 466us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508815.589634:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94306 00000100:00100000:3.0:1787508815.594333:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508815.594435:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509694976 00000100:00100000:2.0:1787508815.594446:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509694976 00000100:00100000:2.0:1787508815.594554:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15097 00000100:00100000:2.0:1787508815.594565:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2401:x1874324509694976:12345-192.168.201.30@tcp:101:stat.0 00010000:00010000:2.0:1787508815.594586:0:225831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508815.594604:0:225831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f28d907f/0xb126349c40f36504 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1532:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaee0b expref: -99 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508815.594664:0:225831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:225831:1874324480259968:192.168.201.30@tcp:106: 00000100:00100000:2.0:1787508815.594764:0:225831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d4534780 going to sleep for 11 seconds 00002000:00010000:2.0:1787508815.596567:0:225831:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000401:0x1532:0x0] updating lvb size: 0 -> 5 00002000:00010000:2.0:1787508815.596575:0:225831:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000401:0x1532:0x0] updating lvb mtime: 0 -> 1787508815 00002000:00010000:2.0:1787508815.596578:0:225831:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0x1532:0x0] updating lvb atime: 0 -> 1787508815 00002000:00010000:2.0:1787508815.596580:0:225831:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000401:0x1532:0x0] updating lvb ctime: 0 -> 1787508815 00002000:00010000:2.0:1787508815.596582:0:225831:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x280000401:0x1532:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:2.0:1787508815.596604:0:225831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:225831:1874324480259968:192.168.201.30@tcp:106: 00010000:00010000:2.0:1787508815.596640:0:225831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f28d907f/0xb126349c40f36504 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1532:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee0b expref: 9 pid: 225831 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508815.596662:0:225831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f28d907f/0xb126349c40f36504 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1532:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee0b expref: 9 pid: 225831 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508815.596675:0:225831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa400, rc 0) 00000100:00100000:2.0:1787508815.596727:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2401:x1874324509694976:12345-192.168.201.30@tcp:101:stat.0 Request processed in 2163us (2402us total) trans 0 rc 301/301 00000100:00100000:2.0:1787508815.596736:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15097 00010000:00010000:1.0:1787508816.444989:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508816.570499:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480260352:0@lo:400:kworker.0 00000100:00100000:3.0:1787508816.570589:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508816.570674:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480260224:0@lo:400:kworker.0 00000100:00100000:1.0:1787508816.570720:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508816.570750:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787508816.570756:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79de3f65-4bad-42d0-a46f-842a654b33a0:3617:1874324480260096:0@lo:400:kworker.0 00000100:00100000:1.0:1787508816.570787:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508816.571420:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c993e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480260480:0@lo:400:kworker.0 00000100:00100000:1.0:1787508816.571453:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508816.572039:0:230130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480260352 00000100:00100000:2.0:1787508816.572050:0:230130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480260352 00000100:00100000:2.0:1787508816.572122:0:230130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480260480 00000100:00100000:2.0:1787508816.572126:0:230130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480260480 00000100:00100000:2.0:1787508816.572150:0:230130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2570 00000100:00100000:2.0:1787508816.572158:0:230130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+6:3618:x1874324480260352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508816.572266:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2571 00000100:00100000:1.0:1787508816.572276:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480260480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508816.572314:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480260480:12345-0@lo:400:kworker.0 Request processed in 40us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508816.572321:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2571 00000100:00080000:1.0:1787508816.572344:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508816.572373:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c993e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480260480:0@lo:400:kworker.0 00000100:00100000:1.0:1787508816.572416:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480260096 00000100:00100000:1.0:1787508816.572419:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480260096 00000100:00100000:1.0:1787508816.572445:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:1.0:1787508816.572451:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed92c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3617:x1874324480260096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508816.572485:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed92c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3617:x1874324480260096:12345-0@lo:400:kworker.0 Request processed in 34us (1697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508816.572494:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00100000:1.0:1787508816.572533:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79de3f65-4bad-42d0-a46f-842a654b33a0:3617:1874324480260096:0@lo:400:kworker.0 00000100:00100000:1.0:1787508816.572588:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480260224 00000100:00100000:1.0:1787508816.572593:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480260224 00000100:00100000:1.0:1787508816.572624:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30007 00000100:00100000:1.0:1787508816.572630:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480260224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508816.572669:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480260224:12345-0@lo:400:kworker.0 Request processed in 39us (1948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508816.572675:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30007 00000100:00100000:1.0:1787508816.572700:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480260224:0@lo:400:kworker.0 00000100:00100000:0.0:1787508816.574147:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c993e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480260992:0@lo:400:kworker.0 00000100:00100000:0.0:1787508816.574575:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508816.574612:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874324480261504:0@lo:400:kworker.0 00000100:00100000:0.0:1787508816.574640:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508816.574663:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787508816.574669:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c993c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480260864:0@lo:400:kworker.0 00000100:00100000:0.0:1787508816.574692:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508816.574845:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480261376:0@lo:400:kworker.0 00000100:00100000:0.0:1787508816.574869:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508816.574904:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480260992 00000100:00100000:0.0:1787508816.574911:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480260992 00000100:00100000:0.0:1787508816.574988:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480260864 00000100:00100000:0.0:1787508816.574992:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480260864 00000100:00100000:0.0:1787508816.575039:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2572 00000100:00100000:0.0:1787508816.575047:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480260992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508816.575388:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480260992:12345-0@lo:400:kworker.0 Request processed in 341us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508816.575397:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2572 00000100:00100000:0.0:1787508816.575413:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2573 00000100:00100000:0.0:1787508816.575420:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480260864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508816.575448:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480260864:12345-0@lo:400:kworker.0 Request processed in 29us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508816.575453:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2573 00000100:00080000:0.0:1787508816.575476:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787508816.575503:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c993c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480260864:0@lo:400:kworker.0 00000100:00100000:0.0:1787508816.575513:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c993e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480260992:0@lo:400:kworker.0 00000100:00100000:0.0:1787508816.575535:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c993ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480260736:0@lo:400:kworker.0 00000100:00100000:0.0:1787508816.575630:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508816.575649:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874324480261248:0@lo:400:kworker.0 00000100:00100000:0.0:1787508816.575672:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508816.575694:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787508816.575700:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c993df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874324480260608:0@lo:400:kworker.0 00000100:00100000:0.0:1787508816.575800:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508816.575821:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480261120:0@lo:400:kworker.0 00000100:00100000:0.0:1787508816.575841:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508816.575859:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480261632:0@lo:400:kworker.0 00000100:00100000:0.0:1787508816.575879:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508816.575907:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480261504 00000100:00100000:0.0:1787508816.575911:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480261504 00000100:00100000:0.0:1787508816.575981:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480261376 00000100:00100000:0.0:1787508816.575986:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480261376 00000100:00100000:0.0:1787508816.576000:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480261248 00000100:00100000:0.0:1787508816.576003:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480261248 00000100:00100000:0.0:1787508816.576015:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480260608 00000100:00100000:0.0:1787508816.576017:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480260608 00000100:00100000:0.0:1787508816.576039:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480261120 00000100:00100000:0.0:1787508816.576042:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480261120 00000100:00100000:0.0:1787508816.576051:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480261632 00000100:00100000:0.0:1787508816.576053:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480261632 00000100:00100000:0.0:1787508816.576066:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3236 00000100:00100000:0.0:1787508816.576072:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874324480261504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508816.576206:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480260736 00000100:00100000:1.0:1787508816.576211:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480260736 00000100:00100000:1.0:1787508816.576241:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30008 00000100:00100000:1.0:1787508816.576247:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480260736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508816.576291:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480260736:12345-0@lo:400:kworker.0 Request processed in 44us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508816.576297:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30008 00000100:00100000:1.0:1787508816.576337:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3237 00000100:00100000:1.0:1787508816.576345:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480261376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508816.576378:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480261376:12345-0@lo:400:kworker.0 Request processed in 34us (1508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508816.576385:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3237 00000100:00100000:1.0:1787508816.576398:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3238 00000100:00100000:1.0:1787508816.576404:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874324480261248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508816.576432:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874324480261248:12345-0@lo:400:kworker.0 Request processed in 28us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508816.576438:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3238 00000100:00100000:1.0:1787508816.576448:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3239 00000100:00100000:1.0:1787508816.576454:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874324480260608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508816.576477:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874324480260608:12345-0@lo:400:kworker.0 Request processed in 23us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508816.576482:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3239 00000100:00100000:1.0:1787508816.576492:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3240 00000100:00100000:1.0:1787508816.576498:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480261120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508816.576521:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480261120:12345-0@lo:400:kworker.0 Request processed in 23us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508816.576527:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3240 00000100:00100000:1.0:1787508816.576836:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3241 00000100:00100000:1.0:1787508816.576845:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480261632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508816.576877:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480261632:12345-0@lo:400:kworker.0 Request processed in 35us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508816.576884:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3241 00000100:00080000:1.0:1787508816.576927:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787508816.576931:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787508816.576987:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c993df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874324480260608:0@lo:400:kworker.0 00000100:00100000:1.0:1787508816.576997:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480261120:0@lo:400:kworker.0 00000100:00100000:1.0:1787508816.577006:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480261632:0@lo:400:kworker.0 00000100:00100000:1.0:1787508816.577014:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944274 gen 2 00000004:00080000:1.0:1787508816.577019:0:3617:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944274 committed transno 12884944274 00000100:00100000:1.0:1787508816.577044:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c993ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480260736:0@lo:400:kworker.0 00000100:00100000:1.0:1787508816.577055:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874324480261248:0@lo:400:kworker.0 00000100:00100000:1.0:1787508816.577106:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480261376:0@lo:400:kworker.0 00000100:00100000:0.0:1787508816.577486:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874324480261504:12345-0@lo:400:kworker.0 Request processed in 1413us (2844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508816.577494:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3236 00000100:00100000:2.0:1787508816.577598:0:230130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+6:3618:x1874324480260352:12345-0@lo:400:kworker.0 Request processed in 5439us (7008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508816.577606:0:230130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2570 00000100:00100000:1.0:1787508816.577746:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874324480261504:0@lo:400:kworker.0 00000100:00100000:3.0:1787508816.577886:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480260352:0@lo:400:kworker.0 00000100:00100000:1.0:1787508817.082985:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787508817.083007:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480261760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787508817.083080:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508817.083129:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480261760 00000100:00100000:1.0:1787508817.083136:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480261760 00000100:00100000:1.0:1787508817.083183:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1783 00000100:00100000:1.0:1787508817.083194:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1874324480261760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787508817.083229:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 55893696 pending 0 free 3908718592 avail 3677196288 00000100:00100000:1.0:1787508817.083276:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1874324480261760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508817.083284:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1783 00000100:00100000:1.0:1787508817.083328:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480261760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787508817.083587:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787508817.083598:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480261888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787508817.083629:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508817.085370:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480261888 00000100:00100000:3.0:1787508817.085383:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480261888 00000100:00100000:3.0:1787508817.085446:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1784 00000100:00100000:3.0:1787508817.085457:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480261888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787508817.085480:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 55893696 pending 0 free 3908718592 avail 3677196288 00000100:00100000:3.0:1787508817.085569:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480261888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (1939us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508817.085577:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1784 00000100:00100000:0.0:1787508817.085708:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480261888:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787508817.466489:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508818.106197:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787508818.106218:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480262016:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787508818.106286:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508818.106333:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480262016 00000100:00100000:1.0:1787508818.106339:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480262016 00000100:00100000:1.0:1787508818.106386:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30009 00000100:00100000:1.0:1787508818.106395:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480262016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787508818.106431:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442709504 avail 1296470016 00000100:00100000:1.0:1787508818.106476:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480262016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508818.106483:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30009 00000100:00100000:3.0:1787508818.106784:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787508818.106794:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480262144:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787508818.106825:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508818.106871:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480262144 00000100:00100000:3.0:1787508818.106875:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480262144 00000100:00100000:3.0:1787508818.106902:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30010 00000100:00100000:3.0:1787508818.106908:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480262144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787508818.106936:0:202232:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440636928 avail 1294397440 00000100:00100000:3.0:1787508818.106992:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480262144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508818.106999:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30010 00000100:00100000:3.0:1787508818.107038:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480262144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787508818.107362:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480262016:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787508818.492435:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508819.050786:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508819.050838:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508819.050921:0:225835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509695232 00000100:00100000:1.0:1787508819.050931:0:225835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509695232 00000100:00100000:3.0:1787508819.050990:0:205404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509695104 00000100:00100000:3.0:1787508819.050995:0:205404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509695104 00002000:00100000:3.0:1787508819.051049:0:205404:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x1532:0x0] (0->4) req@ffff9090d2d3ed80 x1874324509695104/t0(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:275/0 lens 496/0 e 0 to 0 dl 1787508830 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1787508819.051060:0:225835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15098 00002000:00100000:3.0:1787508819.051062:0:205404:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090d2d3ed80 with x1874324509695104 ext(0->4) 00002000:00010000:3.0:1787508819.051069:0:205404:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9090d2d3ed80 00000100:00100000:1.0:1787508819.051075:0:225835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2402:x1874324509695232:12345-192.168.201.30@tcp:16:kworker.0 00000100:00100000:3.0:1787508819.051092:0:205404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00100000:3.0:1787508819.051100:0:205404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2402:x1874324509695104:12345-192.168.201.30@tcp:4:bash.0 00000100:00100000:1.0:1787508819.051173:0:225835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2402:x1874324509695232:12345-192.168.201.30@tcp:16:kworker.0 Request processed in 102us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508819.051181:0:225835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15098 00000100:00080000:0.0:1787508819.051237:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787508819.054571:0:205404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:2402:x1874324509695104:12345-192.168.201.30@tcp:4:bash.0 Request processed in 3462us (3785us total) trans 8589941259 rc 0/0 00000100:00100000:3.0:1787508819.054584:0:205404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 56 00002000:00100000:3.0:1787508819.054595:0:205404:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x1532:0x0] (0->4) req@ffff9090d2d3ed80 x1874324509695104/t8589941259(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:275/0 lens 496/448 e 0 to 0 dl 1787508830 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787508819.054606:0:205404:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090d2d3ed80 with x1874324509695104 ext(0->4) 00002000:00010000:3.0:1787508819.054612:0:205404:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9090d2d3ed80 00010000:00010000:3.0:1787508819.514597:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508820.074374:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508820.074428:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508820.074465:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508820.074501:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508820.074514:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509695616 00000100:00100000:2.0:1787508820.074522:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508820.074526:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509695616 00000100:00100000:2.0:1787508820.074545:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508820.074549:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509695872 00000100:00100000:0.0:1787508820.074556:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509695872 00000100:00100000:2.0:1787508820.074589:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508820.074592:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509696128 00000100:00100000:3.0:1787508820.074597:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509696128 00000100:00100000:0.0:1787508820.074599:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509696384 00000100:00100000:0.0:1787508820.074604:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509696384 00000100:00100000:2.0:1787508820.074624:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508820.074626:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509695488 00000100:00100000:3.0:1787508820.074631:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509695488 00000100:00100000:0.0:1787508820.074638:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509695744 00000100:00100000:0.0:1787508820.074644:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509695744 00000100:00100000:2.0:1787508820.074662:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508820.074663:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509696000 00000100:00100000:3.0:1787508820.074668:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509696000 00000100:00100000:0.0:1787508820.074675:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509696256 00000100:00100000:0.0:1787508820.074680:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509696256 00000100:00100000:3.0:1787508820.074696:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3242 00000100:00080000:2.0:1787508820.074705:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787508820.074709:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:2400:x1874324509695616:12345-192.168.201.30@tcp:400:kworker.0 00000100:00080000:2.0:1787508820.074712:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787508820.074718:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2574 00000100:00080000:2.0:1787508820.074719:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787508820.074724:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787508820.074732:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2400:x1874324509695872:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508820.074754:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3243 00000100:00100000:2.0:1787508820.074765:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2400:x1874324509696128:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508820.074788:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:2400:x1874324509695616:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 82us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508820.074796:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3242 00000100:00100000:1.0:1787508820.074826:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509695360 00000100:00100000:1.0:1787508820.074832:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509695360 00000100:00100000:3.0:1787508820.074833:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3244 00000100:00100000:3.0:1787508820.074844:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:2400:x1874324509695488:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508820.074877:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1058 00000100:00100000:1.0:1787508820.074886:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed92f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2400:x1874324509695360:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508820.081457:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:2400:x1874324509695488:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 6602us (6898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508820.081457:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2400:x1874324509695872:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 6716us (6977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508820.081483:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3244 00000100:00100000:0.0:1787508820.081484:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2574 00000100:00100000:3.0:1787508820.081540:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3245 00000100:00100000:0.0:1787508820.081540:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2575 00000100:00100000:3.0:1787508820.081560:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2400:x1874324509696000:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508820.081561:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2400:x1874324509696384:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508820.081618:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2400:x1874324509696000:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 67us (6997us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508820.081626:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3245 00000100:00100000:0.0:1787508820.081785:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2400:x1874324509696384:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 232us (7262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508820.081793:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2575 00000100:00100000:0.0:1787508820.081809:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2576 00000100:00100000:0.0:1787508820.081817:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:2400:x1874324509695744:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508820.081844:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:2400:x1874324509695744:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 29us (7256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508820.081850:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2576 00000100:00100000:0.0:1787508820.081861:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2577 00000100:00100000:0.0:1787508820.081869:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2400:x1874324509696256:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508820.081907:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2400:x1874324509696256:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (7233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508820.081915:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2577 00000100:00100000:1.0:1787508820.086487:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed92f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2400:x1874324509695360:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 11589us (12111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508820.086504:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1058 00000100:00100000:2.0:1787508820.086740:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2400:x1874324509696128:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 11974us (12236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508820.086752:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3243 00000001:00080000:0.0:1787508820.159790:0:203722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589941259 is committed 00000001:00080000:0.0:1787508820.159809:0:203722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589941258 is committed 00000001:00080000:2.0:1787508820.160040:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944276 is committed 00010000:00010000:1.0:1787508820.160210:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f36478 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a2:0x28d:0x0].0xea02679a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508820.160222:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f36478 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a2:0x28d:0x0].0xea02679a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508820.160231:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f36478 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x28d:0x0].0xea02679a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508820.160237:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508820.160241:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f36478 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a2:0x28d:0x0].0xea02679a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508820.160248:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f36478 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a2:0x28d:0x0].0xea02679a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508820.160267:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a2:0x28d:0x0].0xea02679a (ffff9090c96b8e00) 00010000:00010000:1.0:1787508820.160270:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508820.160274:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f36478 lrc: 2/0,0 mode: --/TXN res: [0x2000013a2:0x28d:0x0].0xea02679a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508820.160279:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f36478 lrc: 0/0,0 mode: --/TXN res: [0x2000013a2:0x28d:0x0].0xea02679a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787508820.161595:0:202955:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589962081 is committed 00000020:00080000:0.0:1787508820.161608:0:202955:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9090cd2006c0 refcount 2 committed 0 result 0 batchid 4294998395 00000020:00080000:0.0:1787508820.161613:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090ced0ff00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9090cd200f00 00000020:00080000:0.0:1787508820.161616:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x2000013a2:0x5:0x0].604 00000020:00080000:0.0:1787508820.161619:0:202955:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9090ced0fd00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9090d312ae00 00000020:00080000:0.0:1787508820.161622:0:202955:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000bd1:0xf:0x0].60 00000020:00080000:1.0:1787508820.161706:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4294998395 committed batchid 4294998394 00000020:00080000:1.0:1787508820.161774:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998394 00010000:00010000:3.0:1787508820.162267:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f363fa lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508820.162279:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f363fa lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508820.162286:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f363fa lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508820.162291:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508820.162295:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f363fa lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508820.162302:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f363fa lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508820.162320:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd0:0x13dd:0x0].0x0 (ffff9090d171fd00) 00010000:00010000:3.0:1787508820.162324:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508820.162328:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f363fa lrc: 2/0,0 mode: --/TXN res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508820.162334:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a800/0xb126349c40f363fa lrc: 0/0,0 mode: --/TXN res: [0x240000bd0:0x13dd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508820.162349:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f36401 lrc: 3/0,1 mode: TXN/TXN res: [0x240000bd1:0x297:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508820.162355:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f36401 lrc: 2/0,0 mode: TXN/TXN res: [0x240000bd1:0x297:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508820.162360:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f36401 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x297:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508820.162364:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508820.162367:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f36401 lrc: 3/0,0 mode: TXN/TXN res: [0x240000bd1:0x297:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508820.162372:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f36401 lrc: 4/0,0 mode: TXN/TXN res: [0x240000bd1:0x297:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508820.162380:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000bd1:0x297:0x0].0x0 (ffff9090d171f600) 00010000:00010000:3.0:1787508820.162382:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508820.162385:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f36401 lrc: 2/0,0 mode: --/TXN res: [0x240000bd1:0x297:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508820.162389:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9090d247a400/0xb126349c40f36401 lrc: 0/0,0 mode: --/TXN res: [0x240000bd1:0x297:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508820.540617:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508820.666448:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787508820.666472:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480262272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787508820.666544:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508820.666618:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480262272 00000100:00100000:1.0:1787508820.666626:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480262272 00000100:00100000:1.0:1787508820.666683:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1785 00000100:00100000:1.0:1787508820.666692:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480262272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787508820.666727:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 156799552 pending 0 free 3881943040 avail 3650420736 00000100:00100000:1.0:1787508820.666772:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480262272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508820.666778:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1785 00000100:00080000:1.0:1787508820.666798:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787508820.666961:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480262400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787508820.666993:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508820.667030:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480262400 00000100:00100000:2.0:1787508820.667034:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480262400 00000100:00100000:1.0:1787508820.667118:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480262272:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787508820.671341:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787508820.671465:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1786 00000100:00100000:2.0:1787508820.671480:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480262400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787508820.671509:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 156799552 pending 0 free 3881943040 avail 3650420736 00000100:00100000:2.0:1787508820.671604:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480262400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (4610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508820.671612:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1786 00000100:00100000:1.0:1787508820.671712:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480262400:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787508821.562228:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508821.690326:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79de3f65-4bad-42d0-a46f-842a654b33a0:3619:1874324480262528:0@lo:400:kworker.0 00000100:00100000:3.0:1787508821.690364:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480262784:0@lo:400:kworker.0 00000100:00100000:1.0:1787508821.690465:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480262912:0@lo:400:kworker.0 00000100:00100000:0.0:1787508821.690537:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480262656:0@lo:400:kworker.0 00000100:00100000:3.0:1787508821.694496:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508821.694553:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508821.694587:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480263296:0@lo:400:kworker.0 00000100:00100000:1.0:1787508821.694588:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480263424:0@lo:400:kworker.0 00000100:00100000:3.0:1787508821.694636:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508821.694673:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480262784 00000100:00100000:3.0:1787508821.694678:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874324480263808:0@lo:400:kworker.0 00000100:00100000:1.0:1787508821.694681:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480262784 00000100:00100000:3.0:1787508821.694707:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508821.694746:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480262912 00000100:00100000:1.0:1787508821.694749:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480262912 00000100:00100000:3.0:1787508821.694750:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480263808 00000100:00100000:3.0:1787508821.694756:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480263808 00000100:00100000:1.0:1787508821.694773:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480263296 00000100:00100000:1.0:1787508821.694778:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480263296 00000100:00100000:3.0:1787508821.694795:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3246 00000100:00100000:3.0:1787508821.694805:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874324480263808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508821.694827:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578 00000100:00100000:1.0:1787508821.694837:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480262784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508821.694861:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874324480263808:12345-0@lo:400:kworker.0 Request processed in 56us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508821.694879:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3246 00000100:00100000:1.0:1787508821.694905:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480262784:12345-0@lo:400:kworker.0 Request processed in 70us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508821.694915:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578 00000100:00100000:3.0:1787508821.694928:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589941258 gen 2 00000100:00100000:1.0:1787508821.694933:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579 00000100:00100000:1.0:1787508821.694964:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480262912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508821.694967:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480262784:0@lo:400:kworker.0 00000100:00100000:3.0:1787508821.694995:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874324480263808:0@lo:400:kworker.0 00000100:00100000:1.0:1787508821.695020:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480262912:12345-0@lo:400:kworker.0 Request processed in 78us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508821.695027:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579 00000100:00100000:1.0:1787508821.695047:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2580 00000100:00100000:1.0:1787508821.695054:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480263296:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787508821.695083:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787508821.695088:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508821.695707:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480263296:12345-0@lo:400:kworker.0 Request processed in 653us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508821.695716:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2580 00000100:00100000:1.0:1787508821.695743:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508821.695774:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480263936:0@lo:400:kworker.0 00000100:00100000:1.0:1787508821.695960:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508821.696172:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508821.696488:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480263040:0@lo:400:kworker.0 00000100:00100000:3.0:1787508821.697615:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480263296:0@lo:400:kworker.0 00000100:00100000:3.0:1787508821.697668:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480262528 00000100:00100000:3.0:1787508821.697674:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480262528 00000100:00100000:3.0:1787508821.697716:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:3.0:1787508821.697724:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d980b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3619:x1874324480262528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508821.697782:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d980b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3619:x1874324480262528:12345-0@lo:400:kworker.0 Request processed in 58us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508821.697789:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:3.0:1787508821.697846:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480263424 00000100:00100000:3.0:1787508821.697850:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480263424 00000100:00100000:0.0:1787508821.697891:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508821.697893:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2581 00000100:00100000:3.0:1787508821.697902:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480263424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508821.697927:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480263168:0@lo:400:kworker.0 00000100:00100000:3.0:1787508821.697962:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480263424:12345-0@lo:400:kworker.0 Request processed in 41us (2197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508821.697970:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2581 00000100:00100000:0.0:1787508821.697978:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508821.698001:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874324480263680:0@lo:400:kworker.0 00000100:00100000:3.0:1787508821.698020:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480262656 00000100:00100000:3.0:1787508821.698025:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480262656 00000100:00100000:3.0:1787508821.698051:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480263168 00000100:00100000:3.0:1787508821.698054:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480263168 00000100:00100000:3.0:1787508821.698074:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30011 00000100:00100000:3.0:1787508821.698082:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480262656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508821.698122:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480262656:12345-0@lo:400:kworker.0 Request processed in 40us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508821.698128:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30011 00000100:00100000:0.0:1787508821.698143:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30012 00000100:00100000:0.0:1787508821.698154:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480263168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508821.698214:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480263168:12345-0@lo:400:kworker.0 Request processed in 63us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508821.698220:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30012 00000100:00100000:3.0:1787508821.698336:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480263936 00000100:00100000:3.0:1787508821.698341:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480263936 00000100:00100000:3.0:1787508821.698384:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3247 00000100:00100000:3.0:1787508821.698390:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480263936:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787508821.698459:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508821.698520:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508821.698624:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480262912:0@lo:400:kworker.0 00000100:00100000:1.0:1787508821.698636:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480263424:0@lo:400:kworker.0 00000100:00100000:1.0:1787508821.698649:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787508821.698656:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480263552:0@lo:400:kworker.0 00000100:00100000:2.0:1787508821.698748:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480262656:0@lo:400:kworker.0 00000100:00100000:2.0:1787508821.698759:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480263168:0@lo:400:kworker.0 00000100:00100000:0.0:1787508821.698793:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480263936:12345-0@lo:400:kworker.0 Request processed in 401us (2852us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508821.698800:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3247 00000100:00100000:0.0:1787508821.698813:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480263680 00000100:00100000:0.0:1787508821.698816:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480263680 00000100:00100000:0.0:1787508821.698847:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3248 00000100:00100000:0.0:1787508821.698853:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874324480263680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508821.698902:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508821.698907:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874324480263680:12345-0@lo:400:kworker.0 Request processed in 52us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508821.698914:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3248 00000100:00100000:0.0:1787508821.698928:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480263040 00000100:00100000:0.0:1787508821.698931:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480263040 00000100:00100000:0.0:1787508821.699054:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3249 00000100:00100000:0.0:1787508821.699063:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480263040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508821.699071:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508821.699183:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874324480263680:0@lo:400:kworker.0 00000100:00100000:2.0:1787508821.699303:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480263552 00000100:00100000:2.0:1787508821.699308:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480263552 00000100:00100000:2.0:1787508821.699335:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3250 00000100:00100000:2.0:1787508821.699341:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480263552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508821.699477:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480263040:12345-0@lo:400:kworker.0 Request processed in 415us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508821.699485:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3249 00000100:00100000:1.0:1787508821.699494:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480264064:0@lo:400:kworker.0 00000100:00080000:0.0:1787508821.699511:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787508821.699594:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79de3f65-4bad-42d0-a46f-842a654b33a0:3619:1874324480262528:0@lo:400:kworker.0 00000100:00100000:0.0:1787508821.699649:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480263040:0@lo:400:kworker.0 00000100:00100000:2.0:1787508821.699676:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480263552:12345-0@lo:400:kworker.0 Request processed in 332us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508821.699684:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3250 00000100:00100000:1.0:1787508821.699726:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508821.699763:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480263936:0@lo:400:kworker.0 00000100:00100000:1.0:1787508821.699778:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480263552:0@lo:400:kworker.0 00000100:00100000:3.0:1787508821.699889:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480264064 00000100:00100000:3.0:1787508821.699893:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480264064 00000100:00080000:0.0:1787508821.700161:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787508821.700597:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3251 00000100:00100000:2.0:1787508821.700608:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480264064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508821.700748:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480264064:12345-0@lo:400:kworker.0 Request processed in 143us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508821.700755:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3251 00000100:00100000:1.0:1787508821.700882:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480264064:0@lo:400:kworker.0 00000100:00100000:0.0:1787508822.202668:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787508822.202695:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480264192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787508822.202771:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508822.203302:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480264320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787508822.203336:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508822.203897:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480264192 00000100:00100000:1.0:1787508822.203906:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480264192 00000100:00100000:1.0:1787508822.203988:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480264320 00000100:00100000:1.0:1787508822.203992:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480264320 00000100:00100000:1.0:1787508822.204009:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1787 00000100:00100000:1.0:1787508822.204017:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480264192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787508822.204046:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 64302784 pending 0 free 3908714496 avail 3677192192 00000100:00100000:0.0:1787508822.204227:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1788 00000100:00100000:0.0:1787508822.204238:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480264320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787508822.204250:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 64302784 pending 0 free 3908714496 avail 3677192192 00000100:00100000:0.0:1787508822.212555:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480264320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 8309us (9206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508822.212575:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1788 00000100:00100000:3.0:1787508822.212846:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480264320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787508822.213222:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480264192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9203us (10448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508822.213231:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1787 00000100:00100000:3.0:1787508822.213306:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480264192:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787508822.586138:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508823.226168:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480264448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787508823.226260:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508823.226331:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480264448 00000100:00100000:3.0:1787508823.226341:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480264448 00000100:00100000:0.0:1787508823.226352:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480264576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787508823.226389:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508823.236782:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480264576 00000100:00100000:3.0:1787508823.236799:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480264576 00000100:00100000:3.0:1787508823.236866:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30013 00000100:00100000:3.0:1787508823.236877:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480264448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787508823.236971:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440636928 avail 1294397440 00000100:00100000:3.0:1787508823.237082:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480264448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 206us (10821us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508823.237090:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30013 00000100:00100000:3.0:1787508823.237143:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480264448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787508823.237174:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30014 00000100:00100000:3.0:1787508823.237181:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480264576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787508823.237202:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442709504 avail 1296470016 00000100:00100000:3.0:1787508823.237241:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480264576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (10852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508823.237247:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30014 00000100:00100000:3.0:1787508823.237279:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480264576:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787508823.613060:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508824.634161:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508824.636176:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508824.636251:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509696512 00000100:00100000:3.0:1787508824.636261:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509696512 00000100:00100000:3.0:1787508824.636337:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9840 00000100:00100000:3.0:1787508824.636348:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:288110:x1874324509696512:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508824.636363:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00002000:00010000:3.0:1787508824.636385:0:202213:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x1532:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:3.0:1787508824.636409:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070ec765d/0xb126349c40f3648d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1532:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaedda expref: 7 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508824.636444:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb12f5b6/0xb126349c40f3544f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x152e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae862 expref: 6 pid: 225837 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508824.636455:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508824.636506:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:288110:x1874324509696512:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 159us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508824.636514:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9840 00000100:00080000:0.0:1787508824.636753:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508824.656596:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508824.662874:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509696640 00000100:00100000:2.0:1787508824.662886:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509696640 00000100:00100000:2.0:1787508824.662978:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9841 00000100:00100000:2.0:1787508824.662989:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde18c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:288292:x1874324509696640:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508824.663004:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787508824.663041:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa96315d/0xb126349c40f3595e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x158c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaea14 expref: 7 pid: 225832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508824.663073:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac8d89c8/0xb126349c40f35591 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xe0c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae8c4 expref: 6 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508824.663086:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508824.663150:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde18c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:288292:x1874324509696640:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 163us (6563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508824.663161:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9841 00000100:00080000:2.0:1787508824.663214:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508825.194082:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508825.194132:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508825.194252:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509696768 00000100:00100000:2.0:1787508825.194263:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509696768 00000100:00100000:0.0:1787508825.194272:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509696896 00000100:00100000:0.0:1787508825.194279:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509696896 00000100:00100000:2.0:1787508825.194318:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1060 00000100:00100000:2.0:1787508825.194330:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d980a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509696768:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508825.194344:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3252 00000100:00100000:0.0:1787508825.194356:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:2402:x1874324509696896:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508825.194409:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d980a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509696768:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 80us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508825.194419:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1060 00000100:00100000:0.0:1787508825.194419:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:2402:x1874324509696896:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 64us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508825.194431:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3252 00000100:00080000:3.0:1787508825.194769:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508825.196083:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508825.196126:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508825.196219:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509697152 00000100:00100000:1.0:1787508825.196227:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509697152 00000100:00100000:1.0:1787508825.196276:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2582 00000100:00100000:1.0:1787508825.196285:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2402:x1874324509697152:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508825.196346:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2402:x1874324509697152:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 62us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508825.196354:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2582 00000100:00100000:0.0:1787508825.196768:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509697024 00000100:00100000:0.0:1787508825.196773:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509697024 00000100:00100000:0.0:1787508825.196840:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3253 00000100:00100000:0.0:1787508825.196849:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2402:x1874324509697024:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508825.196889:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2402:x1874324509697024:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 42us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508825.196896:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3253 00000100:00080000:3.0:1787508825.197014:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787508825.198653:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508825.198692:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508825.198723:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508825.198751:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508825.198771:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508825.198973:0:225835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509697664 00000100:00100000:1.0:1787508825.198983:0:225835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509697664 00000100:00100000:1.0:1787508825.199027:0:225835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509697280 00000100:00100000:1.0:1787508825.199030:0:225835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509697280 00000100:00100000:1.0:1787508825.199060:0:225835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509697792 00000100:00100000:1.0:1787508825.199063:0:225835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509697792 00000100:00100000:1.0:1787508825.199085:0:225835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2583 00000100:00100000:1.0:1787508825.199094:0:225835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2403:x1874324509697664:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508825.199149:0:225835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:2403:x1874324509697664:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 55us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508825.199157:0:225835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2583 00000100:00100000:0.0:1787508825.199554:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509697408 00000100:00100000:0.0:1787508825.199559:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509697408 00000100:00100000:0.0:1787508825.199599:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509697536 00000100:00100000:0.0:1787508825.199602:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509697536 00000100:00100000:0.0:1787508825.199627:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3254 00000100:00100000:0.0:1787508825.199635:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2403:x1874324509697408:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508825.199669:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2403:x1874324509697408:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 34us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508825.199675:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3254 00000100:00100000:0.0:1787508825.199689:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3255 00000100:00100000:0.0:1787508825.199695:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2403:x1874324509697536:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508825.199790:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2403:x1874324509697536:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 93us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508825.199798:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3255 00000100:00100000:0.0:1787508825.199828:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2584 00000100:00100000:0.0:1787508825.199835:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2403:x1874324509697280:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508825.199862:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2403:x1874324509697280:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 28us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508825.199867:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2584 00000100:00100000:0.0:1787508825.199880:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2585 00000100:00100000:0.0:1787508825.199886:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509697792:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508825.199908:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509697792:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508825.199914:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2585 00000100:00080000:3.0:1787508825.200527:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787508825.200532:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787508825.200535:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787508825.200538:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787508825.664726:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508825.788255:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480264832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787508825.788348:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508825.788531:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480264832 00000100:00100000:2.0:1787508825.788539:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480264832 00000100:00100000:2.0:1787508825.788611:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1789 00000100:00100000:2.0:1787508825.788621:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480264832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787508825.788650:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 156799552 pending 0 free 3881943040 avail 3650420736 00000100:00100000:2.0:1787508825.788715:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480264832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508825.788723:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1789 00000100:00100000:2.0:1787508825.788773:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480264832:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787508825.788975:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508825.790637:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480264704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787508825.790713:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508825.790925:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480264704 00000100:00100000:1.0:1787508825.790977:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480264704 00000100:00100000:1.0:1787508825.791054:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1790 00000100:00100000:1.0:1787508825.791063:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480264704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787508825.791087:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 156799552 pending 0 free 3881943040 avail 3650420736 00000100:00100000:1.0:1787508825.791131:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480264704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508825.791139:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1790 00000100:00080000:3.0:1787508825.791261:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508825.791300:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480264704:0@lo:13:osp-pre-1-1.0 00000020:00080000:1.0:1787508825.800549:0:202955:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 4294998395 batchid updated 00000020:00080000:3.0:1787508825.800650:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998395 00000004:00080000:3.0:1787508825.800792:0:202975:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9090c6b58f00 with version 13636 00000020:00080000:3.0:1787508825.800872:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4294998395 cancel update log [0x2000013a2:0x5:0x0].604: rc = 0 00000020:00080000:3.0:1787508825.800997:0:202975:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4294998395 cancel update log [0x240000bd1:0xf:0x0].60: rc = 0 00000020:00080000:3.0:1787508825.801007:0:202975:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4294998395 00000004:00080000:2.0:1787508825.804273:0:202961:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9090cbe42240 version 13636 rpc_version 13636 00000020:00100000:2.0:1787508825.804326:0:202961:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787508825.804398:0:202961:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9091ffc0e680 x1874324480265088/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787508825.804425:0:202961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffc0e680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480265088:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787508825.804498:0:202961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508825.804605:0:202961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d35bf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508825.807076:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480265088 00000100:00100000:3.0:1787508825.807091:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480265088 00000100:00100000:3.0:1787508825.807226:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30015 00000100:00100000:3.0:1787508825.807237:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:202961:x1874324480265088:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787508825.807479:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:202961:x1874324480265088:12345-0@lo:1000:osp_up0-1.0 Request processed in 243us (2981us total) trans 12884944277 rc 0/0 00000100:00100000:3.0:1787508825.807487:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30015 00000100:00100000:2.0:1787508825.807596:0:202961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffc0e680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:202961:1874324480265088:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1787508826.682278:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508826.810499:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480265344:0@lo:400:kworker.0 00000100:00100000:0.0:1787508826.810579:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508826.810642:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480265856:0@lo:400:kworker.0 00000100:00100000:0.0:1787508826.810665:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508826.810681:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480266368:0@lo:400:kworker.0 00000100:00100000:0.0:1787508826.810706:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508826.810738:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1787508826.810744:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79de3f65-4bad-42d0-a46f-842a654b33a0:3619:1874324480265216:0@lo:400:kworker.0 00000100:00100000:0.0:1787508826.810774:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508826.810807:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480265728:0@lo:400:kworker.0 00000100:00100000:0.0:1787508826.810829:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508826.810844:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874324480266240:0@lo:400:kworker.0 00000100:00100000:0.0:1787508826.810860:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508826.810873:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874324480266752:0@lo:400:kworker.0 00000100:00100000:0.0:1787508826.810892:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508826.810926:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480265344 00000100:00100000:0.0:1787508826.810969:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480265344 00000100:00100000:0.0:1787508826.811013:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480265856 00000100:00100000:0.0:1787508826.811017:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480265856 00000100:00100000:0.0:1787508826.811035:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30016 00000100:00100000:0.0:1787508826.811043:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480265344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508826.811101:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480265344:12345-0@lo:400:kworker.0 Request processed in 58us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508826.811109:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30016 00000100:00100000:0.0:1787508826.811129:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30017 00000100:00100000:0.0:1787508826.811135:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3619:x1874324480265856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508826.811166:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3619:x1874324480265856:12345-0@lo:400:kworker.0 Request processed in 31us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508826.811172:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30017 00000100:00100000:0.0:1787508826.811190:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480266368 00000100:00100000:0.0:1787508826.811194:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480266368 00000100:00100000:0.0:1787508826.811220:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480265728 00000100:00100000:0.0:1787508826.811223:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480265728 00000100:00100000:0.0:1787508826.811239:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480266240 00000100:00100000:0.0:1787508826.811241:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480266240 00000100:00100000:0.0:1787508826.811253:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480266752 00000100:00100000:0.0:1787508826.811255:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480266752 00000100:00100000:0.0:1787508826.811268:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3256 00000100:00100000:0.0:1787508826.811273:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480266368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508826.811303:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480266368:12345-0@lo:400:kworker.0 Request processed in 29us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508826.811309:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3256 00000100:00100000:0.0:1787508826.811320:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3257 00000100:00100000:0.0:1787508826.811327:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480265728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508826.811351:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480265728:12345-0@lo:400:kworker.0 Request processed in 25us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508826.811357:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3257 00000100:00100000:0.0:1787508826.811367:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3258 00000100:00100000:0.0:1787508826.811372:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874324480266240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508826.811502:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3259 00000100:00100000:1.0:1787508826.811511:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874324480266752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508826.811544:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874324480266752:12345-0@lo:400:kworker.0 Request processed in 35us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508826.811550:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3259 00000100:00100000:1.0:1787508826.811575:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480265472:0@lo:400:kworker.0 00000100:00100000:1.0:1787508826.811604:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508826.811624:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480265984:0@lo:400:kworker.0 00000100:00100000:1.0:1787508826.811643:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508826.811658:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480266496:0@lo:400:kworker.0 00000100:00100000:1.0:1787508826.811678:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508826.811694:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787508826.811700:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480265600:0@lo:400:kworker.0 00000100:00100000:1.0:1787508826.811721:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508826.811737:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480266112:0@lo:400:kworker.0 00000100:00100000:1.0:1787508826.811757:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508826.811771:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480266624:0@lo:400:kworker.0 00000100:00100000:1.0:1787508826.811804:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508826.811825:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480265472 00000100:00100000:1.0:1787508826.811829:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480265472 00000100:00100000:1.0:1787508826.811853:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480265984 00000100:00100000:1.0:1787508826.811856:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480265984 00000100:00100000:1.0:1787508826.811869:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480265600 00000100:00100000:1.0:1787508826.811872:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480265600 00000100:00100000:1.0:1787508826.811884:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480266112 00000100:00100000:1.0:1787508826.811886:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480266112 00000100:00100000:1.0:1787508826.811901:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2586 00000100:00100000:1.0:1787508826.811905:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480265472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508826.811936:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480265472:12345-0@lo:400:kworker.0 Request processed in 30us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508826.811965:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2586 00000100:00100000:1.0:1787508826.811978:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2587 00000100:00100000:1.0:1787508826.811984:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480265984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508826.812010:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480265984:12345-0@lo:400:kworker.0 Request processed in 26us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508826.812016:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2587 00000100:00100000:1.0:1787508826.812026:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2588 00000100:00100000:1.0:1787508826.812031:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480265600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508826.812058:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480265600:12345-0@lo:400:kworker.0 Request processed in 26us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508826.812064:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2588 00000100:00100000:1.0:1787508826.812074:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2589 00000100:00100000:1.0:1787508826.812079:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480266112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508826.812106:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480266112:12345-0@lo:400:kworker.0 Request processed in 27us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508826.812115:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2589 00000100:00100000:1.0:1787508826.812132:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480266496 00000100:00100000:1.0:1787508826.812135:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480266496 00000100:00100000:1.0:1787508826.812152:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480266624 00000100:00100000:1.0:1787508826.812155:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480266624 00000100:00100000:1.0:1787508826.812167:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3260 00000100:00100000:1.0:1787508826.812172:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480266496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508826.812201:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480266496:12345-0@lo:400:kworker.0 Request processed in 28us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508826.812207:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3260 00000100:00100000:1.0:1787508826.812217:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3261 00000100:00100000:1.0:1787508826.812223:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480266624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508826.812245:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480266624:12345-0@lo:400:kworker.0 Request processed in 23us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508826.812251:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3261 00000100:00100000:1.0:1787508826.812282:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480265600:0@lo:400:kworker.0 00000100:00100000:1.0:1787508826.812292:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480266112:0@lo:400:kworker.0 00000100:00100000:1.0:1787508826.812301:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480266624:0@lo:400:kworker.0 00000100:00100000:1.0:1787508826.812309:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480265472:0@lo:400:kworker.0 00000100:00100000:1.0:1787508826.812317:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480265984:0@lo:400:kworker.0 00000100:00100000:1.0:1787508826.812324:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480266496:0@lo:400:kworker.0 00000100:00100000:3.0:1787508826.812818:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480265216 00000100:00100000:3.0:1787508826.812824:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480265216 00000100:00100000:3.0:1787508826.812854:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:3.0:1787508826.812860:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d980b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3619:x1874324480265216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508826.812922:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480265728:0@lo:400:kworker.0 00000100:00100000:0.0:1787508826.812977:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874324480266240:12345-0@lo:400:kworker.0 Request processed in 1603us (2114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508826.812985:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3258 00000100:00080000:0.0:1787508826.813025:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787508826.813030:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508826.813032:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787508826.816044:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874324480266240:0@lo:400:kworker.0 00000100:00100000:1.0:1787508826.816070:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874324480266752:0@lo:400:kworker.0 00000100:00100000:1.0:1787508826.816084:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480265344:0@lo:400:kworker.0 00000100:00100000:1.0:1787508826.816095:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480265856:0@lo:400:kworker.0 00000100:00100000:1.0:1787508826.816105:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480266368:0@lo:400:kworker.0 00000100:00100000:3.0:1787508826.816225:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d980b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3619:x1874324480265216:12345-0@lo:400:kworker.0 Request processed in 3362us (5447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508826.816237:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:1.0:1787508826.818550:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79de3f65-4bad-42d0-a46f-842a654b33a0:3619:1874324480265216:0@lo:400:kworker.0 00000100:00100000:0.0:1787508827.322781:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480266880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787508827.322865:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508827.323278:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787508827.323290:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480267008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787508827.323323:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508827.323469:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480266880 00000100:00100000:3.0:1787508827.323478:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480266880 00000100:00100000:3.0:1787508827.323531:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480267008 00000100:00100000:3.0:1787508827.323534:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480267008 00000100:00100000:3.0:1787508827.323552:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1791 00000100:00100000:3.0:1787508827.323561:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480266880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787508827.323590:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 64302784 pending 0 free 3908714496 avail 3677192192 00000100:00100000:2.0:1787508827.323695:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1792 00000100:00100000:2.0:1787508827.323705:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480267008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787508827.323716:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 64302784 pending 0 free 3908714496 avail 3677192192 00000100:00100000:3.0:1787508827.323718:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480266880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 158us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508827.323725:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1791 00000100:00100000:2.0:1787508827.323747:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480267008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508827.323752:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1792 00000100:00100000:3.0:1787508827.323786:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480266880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787508827.323788:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480267008:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787508827.708045:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508828.356091:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480267264:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787508828.356144:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480267136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787508828.356176:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508828.356208:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508828.356331:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480267264 00000100:00100000:1.0:1787508828.356340:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480267264 00000100:00100000:1.0:1787508828.356402:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480267136 00000100:00100000:1.0:1787508828.356406:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480267136 00000100:00100000:1.0:1787508828.356435:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30018 00000100:00100000:1.0:1787508828.356444:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480267264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787508828.356483:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442709504 avail 1296470016 00000100:00100000:1.0:1787508828.356529:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480267264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508828.356535:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30018 00000100:00100000:1.0:1787508828.356551:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30019 00000100:00100000:1.0:1787508828.356556:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3617:x1874324480267136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787508828.356572:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440636928 avail 1294397440 00000100:00100000:1.0:1787508828.356604:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3617:x1874324480267136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508828.356610:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30019 00000100:00100000:3.0:1787508828.356629:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480267264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787508828.356633:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480267136:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787508828.730185:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508829.579468:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508829.579597:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509697920 00000100:00100000:3.0:1787508829.579609:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509697920 00000100:00100000:3.0:1787508829.579707:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9842 00000100:00100000:3.0:1787508829.579720:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:288263:x1874324509697920:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508829.579766:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787508829.579810:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7a8fae3/0xb126349c40f36352 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x158d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed78 expref: 8 pid: 208928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508829.579857:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd6e743c/0xb126349c40f35177 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x158b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae790 expref: 7 pid: 203726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508829.579881:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d5c36ef/0xb126349c40f350e4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x158a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1044480->1048575) gid 0 flags: 0x44801000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae758 expref: 6 pid: 225841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508829.579895:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508829.580007:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:288263:x1874324509697920:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 290us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508829.580015:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9842 00000100:00080000:0.0:1787508829.580247:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508829.753057:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508829.753264:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509698048 00000100:00100000:0.0:1787508829.753276:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509698048 00000100:00100000:0.0:1787508829.753377:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9843 00000100:00100000:0.0:1787508829.753390:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+8:287589:x1874324509698048:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508829.753406:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00002000:00010000:0.0:1787508829.753426:0:202213:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x1531:0x0] updating lvb blocks from disk: 1 -> 2048 00010000:00010000:0.0:1787508829.753452:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012917839/0xb126349c40f36264 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1531:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801020000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed0f expref: 8 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508829.753475:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000650db6b/0xb126349c40f3626b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1531:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801020000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaed16 expref: 7 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508829.753505:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c8021ba/0xb126349c40f351af lrc: 0/0,0 mode: --/PR res: [0x280000401:0x152d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaae7a5 expref: 6 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508829.753519:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508829.753580:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:287589:x1874324509698048:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 193us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508829.753588:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9843 00000100:00080000:3.0:1787508829.754022:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787508829.754351:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508830.314046:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508830.314086:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508830.314122:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508830.314138:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508830.314152:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508830.314165:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508830.314179:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508830.314217:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508830.314243:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509698432 00000100:00100000:2.0:1787508830.314253:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509698432 00000100:00100000:2.0:1787508830.314309:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509698944 00000100:00100000:2.0:1787508830.314312:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509698944 00000100:00100000:2.0:1787508830.314329:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509698304 00000100:00100000:2.0:1787508830.314332:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509698304 00000100:00100000:2.0:1787508830.314352:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509698816 00000100:00100000:2.0:1787508830.314355:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509698816 00000100:00100000:2.0:1787508830.314376:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3262 00000100:00100000:2.0:1787508830.314386:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2401:x1874324509698432:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508830.314471:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2401:x1874324509698432:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 86us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508830.314478:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3262 00000100:00100000:2.0:1787508830.314496:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3263 00000100:00100000:2.0:1787508830.314502:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2401:x1874324509698944:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508830.314523:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2401:x1874324509698944:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508830.314529:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3263 00000100:00100000:2.0:1787508830.314539:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3264 00000100:00100000:2.0:1787508830.314544:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:2401:x1874324509698304:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508830.314564:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:2401:x1874324509698304:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 20us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508830.314573:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3264 00000100:00100000:2.0:1787508830.314585:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3265 00000100:00100000:2.0:1787508830.314591:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2401:x1874324509698816:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508830.314611:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2401:x1874324509698816:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508830.314617:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3265 00000100:00100000:1.0:1787508830.314805:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509698688 00000100:00100000:1.0:1787508830.314810:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509698688 00000100:00100000:1.0:1787508830.314850:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509698560 00000100:00100000:1.0:1787508830.314853:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509698560 00000100:00100000:1.0:1787508830.314878:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509699072 00000100:00100000:1.0:1787508830.314881:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509699072 00000100:00100000:1.0:1787508830.314901:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2590 00000100:00100000:1.0:1787508830.314908:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2401:x1874324509698688:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508830.314936:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2401:x1874324509698688:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 29us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508830.314973:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2590 00000100:00100000:1.0:1787508830.314985:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2591 00000100:00100000:1.0:1787508830.314990:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2401:x1874324509698560:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508830.315009:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2401:x1874324509698560:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 20us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508830.315014:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2591 00000100:00100000:1.0:1787508830.315023:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2592 00000100:00100000:1.0:1787508830.315030:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9aca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2401:x1874324509699072:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508830.315046:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9aca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2401:x1874324509699072:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 18us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508830.315052:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2592 00000100:00100000:3.0:1787508830.315542:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509698176 00000100:00100000:3.0:1787508830.315548:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509698176 00000100:00100000:3.0:1787508830.315589:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1062 00000100:00100000:3.0:1787508830.315596:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d980b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2401:x1874324509698176:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508830.315628:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d980b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2401:x1874324509698176:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 32us (1592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508830.315634:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1062 00000100:00080000:3.0:1787508830.315674:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787508830.315678:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787508830.315681:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787508830.315683:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787508830.778042:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508830.907542:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787508830.907567:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480267392:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787508830.907650:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508830.907771:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480267392 00000100:00100000:0.0:1787508830.907779:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480267392 00000100:00100000:0.0:1787508830.907851:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1793 00000100:00100000:0.0:1787508830.907861:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f2ada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480267392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787508830.907889:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 156799552 pending 0 free 3881943040 avail 3650420736 00000100:00100000:0.0:1787508830.907938:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f2ada050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480267392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508830.907975:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1793 00000100:00080000:3.0:1787508830.908683:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508830.908730:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480267392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787508830.909449:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480267520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508830.909495:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508830.909579:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480267520 00000100:00100000:3.0:1787508830.909585:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480267520 00000100:00100000:3.0:1787508830.909646:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1794 00000100:00100000:3.0:1787508830.909654:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480267520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787508830.909670:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 156799552 pending 0 free 3881943040 avail 3650420736 00000100:00100000:3.0:1787508830.909705:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480267520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508830.909724:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1794 00000100:00100000:1.0:1787508830.909858:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480267520:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787508830.910102:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787508831.802978:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508831.930382:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480267776:0@lo:400:kworker.0 00000100:00100000:1.0:1787508831.930550:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480268032:0@lo:400:kworker.0 00000100:00100000:1.0:1787508831.930588:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508831.930641:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480268544:0@lo:400:kworker.0 00000100:00100000:1.0:1787508831.930663:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508831.930700:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480269056:0@lo:400:kworker.0 00000100:00100000:1.0:1787508831.930725:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508831.930748:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1787508831.930753:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480267648:0@lo:400:kworker.0 00000100:00100000:1.0:1787508831.930782:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508831.930804:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874324480268160:0@lo:400:kworker.0 00000100:00100000:1.0:1787508831.930826:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508831.930841:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874324480268672:0@lo:400:kworker.0 00000100:00100000:1.0:1787508831.930861:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508831.930875:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874324480269184:0@lo:400:kworker.0 00000100:00100000:1.0:1787508831.930894:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508831.930923:0:203728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480268032 00000100:00100000:1.0:1787508831.930930:0:203728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480268032 00000100:00100000:1.0:1787508831.930999:0:203728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480268544 00000100:00100000:1.0:1787508831.931003:0:203728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480268544 00000100:00100000:1.0:1787508831.931025:0:203728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2593 00000100:00100000:1.0:1787508831.931033:0:203728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480268032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508831.931084:0:203728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480268032:12345-0@lo:400:kworker.0 Request processed in 51us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508831.931091:0:203728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2593 00000100:00100000:1.0:1787508831.931108:0:203728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594 00000100:00100000:1.0:1787508831.931115:0:203728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480268544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508831.931148:0:203728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480268544:12345-0@lo:400:kworker.0 Request processed in 34us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508831.931153:0:203728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594 00000100:00100000:1.0:1787508831.931171:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480267648 00000100:00100000:1.0:1787508831.931175:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480267648 00000100:00100000:1.0:1787508831.931200:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:1.0:1787508831.931207:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d980bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480267648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508831.931237:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d980bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480267648:12345-0@lo:400:kworker.0 Request processed in 31us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508831.931243:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00100000:1.0:1787508831.931292:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480267648:0@lo:400:kworker.0 00000100:00100000:1.0:1787508831.931308:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480268032:0@lo:400:kworker.0 00000100:00100000:1.0:1787508831.931317:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480268544:0@lo:400:kworker.0 00000100:00100000:2.0:1787508831.931415:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480267904:0@lo:400:kworker.0 00000100:00100000:2.0:1787508831.931447:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508831.931489:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480268416:0@lo:400:kworker.0 00000100:00100000:2.0:1787508831.931513:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508831.931532:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480268928:0@lo:400:kworker.0 00000100:00100000:2.0:1787508831.931556:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508831.931587:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480269056 00000100:00100000:2.0:1787508831.931591:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480269056 00000100:00100000:2.0:1787508831.931628:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480268160 00000100:00100000:2.0:1787508831.931631:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480268160 00000100:00100000:2.0:1787508831.931648:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480268672 00000100:00100000:2.0:1787508831.931651:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480268672 00000100:00100000:2.0:1787508831.931662:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480269184 00000100:00100000:2.0:1787508831.931664:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480269184 00000100:00100000:2.0:1787508831.931677:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480268928 00000100:00100000:2.0:1787508831.931680:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480268928 00000100:00100000:2.0:1787508831.931710:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3266 00000100:00100000:2.0:1787508831.931717:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480269056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508831.931758:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480269056:12345-0@lo:400:kworker.0 Request processed in 41us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508831.931767:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3266 00000100:00100000:2.0:1787508831.931785:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3267 00000100:00100000:2.0:1787508831.931791:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874324480268160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508831.931816:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874324480268160:12345-0@lo:400:kworker.0 Request processed in 27us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508831.931822:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3267 00000100:00100000:2.0:1787508831.931834:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3268 00000100:00100000:2.0:1787508831.931840:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874324480268672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508831.931866:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874324480268672:12345-0@lo:400:kworker.0 Request processed in 26us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508831.931872:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3268 00000100:00100000:2.0:1787508831.931883:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3269 00000100:00100000:2.0:1787508831.931889:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874324480269184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508831.931917:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874324480269184:12345-0@lo:400:kworker.0 Request processed in 28us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508831.931923:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3269 00000100:00100000:2.0:1787508831.931936:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3270 00000100:00100000:2.0:1787508831.931968:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480268928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508831.932001:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480268928:12345-0@lo:400:kworker.0 Request processed in 35us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508831.932007:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3270 00000100:00100000:2.0:1787508831.932031:0:225835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480267904 00000100:00100000:2.0:1787508831.932035:0:225835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480267904 00000100:00100000:2.0:1787508831.932058:0:225835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480268416 00000100:00100000:2.0:1787508831.932061:0:225835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480268416 00000100:00100000:2.0:1787508831.932083:0:225835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595 00000100:00100000:2.0:1787508831.932089:0:225835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480267904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508831.932116:0:225835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480267904:12345-0@lo:400:kworker.0 Request processed in 28us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508831.932122:0:225835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595 00000100:00100000:2.0:1787508831.932132:0:225835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2596 00000100:00100000:2.0:1787508831.932136:0:225835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480268416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508831.932156:0:225835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480268416:12345-0@lo:400:kworker.0 Request processed in 20us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508831.932161:0:225835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2596 00000100:00080000:2.0:1787508831.932177:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787508831.932181:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787508831.932183:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508831.932216:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480267904:0@lo:400:kworker.0 00000100:00100000:2.0:1787508831.932226:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480268416:0@lo:400:kworker.0 00000100:00100000:2.0:1787508831.932234:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480268928:0@lo:400:kworker.0 00000100:00100000:2.0:1787508831.932264:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874324480268160:0@lo:400:kworker.0 00000100:00100000:2.0:1787508831.932274:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874324480268672:0@lo:400:kworker.0 00000100:00100000:2.0:1787508831.932284:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874324480269184:0@lo:400:kworker.0 00000100:00100000:2.0:1787508831.932292:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480269056:0@lo:400:kworker.0 00000100:00100000:0.0:1787508831.932507:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508831.932548:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480268288:0@lo:400:kworker.0 00000100:00100000:0.0:1787508831.932582:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508831.932618:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874324480268800:0@lo:400:kworker.0 00000100:00100000:0.0:1787508831.932642:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508831.932676:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480268800 00000100:00100000:0.0:1787508831.932681:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480268800 00000100:00100000:0.0:1787508831.932729:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3271 00000100:00100000:0.0:1787508831.932736:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874324480268800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508831.932772:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874324480268800:12345-0@lo:400:kworker.0 Request processed in 37us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508831.932778:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3271 00000100:00100000:0.0:1787508831.932800:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480267776 00000100:00100000:0.0:1787508831.932803:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480267776 00000100:00100000:0.0:1787508831.932825:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480268288 00000100:00100000:0.0:1787508831.932828:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480268288 00000100:00100000:0.0:1787508831.932843:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30020 00000100:00100000:0.0:1787508831.932849:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480267776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508831.932881:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480267776:12345-0@lo:400:kworker.0 Request processed in 32us (2421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508831.932888:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30020 00000100:00100000:0.0:1787508831.932900:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30021 00000100:00100000:0.0:1787508831.932906:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3618:x1874324480268288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508831.932933:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3618:x1874324480268288:12345-0@lo:400:kworker.0 Request processed in 28us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508831.932960:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30021 00000100:00100000:0.0:1787508831.932989:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480267776:0@lo:400:kworker.0 00000100:00100000:0.0:1787508831.932999:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480268288:0@lo:400:kworker.0 00000100:00100000:0.0:1787508831.933007:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874324480268800:0@lo:400:kworker.0 00000100:00080000:2.0:1787508831.933550:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1787508831.963033:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944277 is committed 00000100:00100000:0.0:1787508832.442259:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480269312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787508832.442341:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508832.442602:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787508832.442613:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480269440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787508832.442640:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508832.442825:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480269312 00000100:00100000:3.0:1787508832.442833:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480269312 00000100:00100000:3.0:1787508832.442899:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480269440 00000100:00100000:3.0:1787508832.442902:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480269440 00000100:00100000:3.0:1787508832.442923:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1795 00000100:00100000:3.0:1787508832.442931:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480269312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787508832.442974:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 64302784 pending 0 free 3908714496 avail 3677192192 00000100:00100000:3.0:1787508832.443035:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480269312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508832.443042:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1795 00000100:00100000:2.0:1787508832.443127:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480269312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787508832.443173:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1796 00000100:00100000:3.0:1787508832.443182:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480269440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787508832.443194:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 64302784 pending 0 free 3908714496 avail 3677192192 00000100:00100000:3.0:1787508832.443232:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480269440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508832.443238:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1796 00000100:00100000:2.0:1787508832.443352:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480269440:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787508832.826835:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508833.466320:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787508833.466346:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480269568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787508833.466422:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508833.466757:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480269568 00000100:00100000:3.0:1787508833.466765:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480269568 00000100:00100000:3.0:1787508833.466819:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30022 00000100:00100000:3.0:1787508833.466826:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480269568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787508833.466857:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442709504 avail 1296470016 00000100:00100000:3.0:1787508833.466906:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480269568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508833.466910:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30022 00000100:00100000:2.0:1787508833.466984:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480269568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787508833.479238:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787508833.479263:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480269696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787508833.479334:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508833.479386:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480269696 00000100:00100000:3.0:1787508833.479394:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480269696 00000100:00100000:3.0:1787508833.479443:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30023 00000100:00100000:3.0:1787508833.479452:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480269696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787508833.479486:0:202232:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440636928 avail 1294397440 00000100:00100000:3.0:1787508833.479533:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480269696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508833.479540:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30023 00000100:00100000:3.0:1787508833.479597:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 12884944277 gen 2 00000004:00080000:3.0:1787508833.479603:0:3616:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884944277 committed transno 12884944277 00000100:00100000:3.0:1787508833.479635:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480269696:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787508833.850204:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508834.875883:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508835.450341:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508835.450403:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508835.450431:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508835.450453:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508835.450471:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508835.450495:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508835.450513:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508835.450532:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508835.450571:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508835.450602:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509699456 00000100:00100000:2.0:1787508835.450612:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509699456 00000100:00100000:2.0:1787508835.450687:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509699968 00000100:00100000:2.0:1787508835.450691:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509699968 00000100:00100000:2.0:1787508835.450708:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509699328 00000100:00100000:2.0:1787508835.450711:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509699328 00000100:00100000:2.0:1787508835.450727:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509699840 00000100:00100000:2.0:1787508835.450729:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509699840 00000100:00100000:2.0:1787508835.450743:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3272 00000100:00100000:2.0:1787508835.450753:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2401:x1874324509699456:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508835.450830:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2401:x1874324509699456:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 78us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508835.450838:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3272 00000100:00100000:2.0:1787508835.450855:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3273 00000100:00100000:2.0:1787508835.450861:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2401:x1874324509699968:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508835.450887:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2401:x1874324509699968:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508835.450892:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3273 00000100:00100000:2.0:1787508835.450905:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3274 00000100:00100000:2.0:1787508835.450910:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:2401:x1874324509699328:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508835.450933:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:2401:x1874324509699328:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508835.450962:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3274 00000100:00100000:2.0:1787508835.450974:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3275 00000100:00100000:2.0:1787508835.450981:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2401:x1874324509699840:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508835.451001:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2401:x1874324509699840:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508835.451006:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3275 00000100:00100000:2.0:1787508835.451024:0:225838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509699712 00000100:00100000:2.0:1787508835.451027:0:225838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509699712 00000100:00100000:2.0:1787508835.451051:0:225838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509700224 00000100:00100000:2.0:1787508835.451054:0:225838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509700224 00000100:00100000:2.0:1787508835.451067:0:225838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509699584 00000100:00100000:2.0:1787508835.451069:0:225838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509699584 00000100:00100000:2.0:1787508835.451085:0:225838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509700096 00000100:00100000:2.0:1787508835.451087:0:225838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509700096 00000100:00100000:2.0:1787508835.451104:0:225838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2597 00000100:00100000:2.0:1787508835.451109:0:225838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2401:x1874324509699712:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508835.451134:0:225838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2401:x1874324509699712:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508835.451143:0:225838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2597 00000100:00100000:2.0:1787508835.451152:0:225838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2598 00000100:00100000:2.0:1787508835.451157:0:225838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2401:x1874324509700224:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508835.451178:0:225838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2401:x1874324509700224:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508835.451183:0:225838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2598 00000100:00100000:2.0:1787508835.451192:0:225838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2599 00000100:00100000:2.0:1787508835.451197:0:225838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2401:x1874324509699584:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508835.451215:0:225838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2401:x1874324509699584:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 19us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508835.451220:0:225838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2599 00000100:00100000:2.0:1787508835.451229:0:225838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2600 00000100:00100000:2.0:1787508835.451233:0:225838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2401:x1874324509700096:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508835.451248:0:225838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2401:x1874324509700096:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 15us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508835.451252:0:225838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2600 00000100:00080000:2.0:1787508835.451284:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787508835.451287:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787508835.451290:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787508835.451291:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787508835.451852:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509699200 00000100:00100000:3.0:1787508835.451858:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509699200 00000100:00100000:3.0:1787508835.451904:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1064 00000100:00100000:3.0:1787508835.451911:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2401:x1874324509699200:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508835.451966:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2401:x1874324509699200:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 56us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508835.451973:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1064 00010000:00010000:3.0:1787508835.898188:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508836.026281:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787508836.026308:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480269824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787508836.026382:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508836.026503:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480269824 00000100:00100000:1.0:1787508836.026512:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480269824 00000100:00100000:1.0:1787508836.026577:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1797 00000100:00100000:1.0:1787508836.026589:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480269824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787508836.026647:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 156799552 pending 0 free 3881943040 avail 3650420736 00000100:00080000:2.0:1787508836.026649:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508836.026705:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480269824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508836.026713:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1797 00000100:00100000:2.0:1787508836.026796:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480269824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787508836.028813:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480269952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787508836.028893:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508836.029137:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480269952 00000100:00100000:0.0:1787508836.029147:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480269952 00000100:00100000:0.0:1787508836.029210:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1798 00000100:00100000:0.0:1787508836.029218:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480269952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787508836.029239:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 156799552 pending 0 free 3881943040 avail 3650420736 00000100:00100000:0.0:1787508836.029291:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480269952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508836.029298:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1798 00000100:00100000:3.0:1787508836.029387:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480269952:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787508836.029448:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787508836.922580:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508837.059219:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480270208:0@lo:400:kworker.0 00000100:00100000:3.0:1787508837.059290:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508837.059345:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480270720:0@lo:400:kworker.0 00000100:00100000:3.0:1787508837.059368:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508837.059386:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874324480271232:0@lo:400:kworker.0 00000100:00100000:3.0:1787508837.059410:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508837.059441:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1787508837.059447:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79de3f65-4bad-42d0-a46f-842a654b33a0:3617:1874324480270080:0@lo:400:kworker.0 00000100:00100000:3.0:1787508837.059476:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508837.059496:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874324480270592:0@lo:400:kworker.0 00000100:00100000:3.0:1787508837.059517:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508837.059533:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480271104:0@lo:400:kworker.0 00000100:00100000:3.0:1787508837.059551:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508837.059567:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480271616:0@lo:400:kworker.0 00000100:00100000:3.0:1787508837.059585:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508837.059625:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480270336:0@lo:400:kworker.0 00000100:00100000:3.0:1787508837.059650:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508837.059665:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480270848:0@lo:400:kworker.0 00000100:00100000:3.0:1787508837.059684:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508837.059699:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874324480271360:0@lo:400:kworker.0 00000100:00100000:3.0:1787508837.059718:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508837.059735:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787508837.059741:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480270464:0@lo:400:kworker.0 00000100:00100000:3.0:1787508837.059760:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508837.059777:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480270976:0@lo:400:kworker.0 00000100:00100000:3.0:1787508837.059797:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508837.059814:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480271488:0@lo:400:kworker.0 00000100:00100000:3.0:1787508837.059833:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508837.059865:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480270208 00000100:00100000:3.0:1787508837.059872:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480270208 00000100:00100000:3.0:1787508837.059911:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480270720 00000100:00100000:3.0:1787508837.059914:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480270720 00000100:00100000:2.0:1787508837.060353:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480270336 00000100:00100000:2.0:1787508837.060359:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480270336 00000100:00100000:2.0:1787508837.060396:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480270848 00000100:00100000:2.0:1787508837.060400:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480270848 00000100:00100000:2.0:1787508837.060417:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480270464 00000100:00100000:2.0:1787508837.060420:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480270464 00000100:00100000:2.0:1787508837.060437:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480270976 00000100:00100000:2.0:1787508837.060440:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480270976 00000100:00100000:2.0:1787508837.060457:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601 00000100:00100000:2.0:1787508837.060467:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480270336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508837.060531:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480270336:12345-0@lo:400:kworker.0 Request processed in 66us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508837.060539:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601 00000100:00100000:2.0:1787508837.060557:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2602 00000100:00100000:2.0:1787508837.060562:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480270848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508837.060589:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480270848:12345-0@lo:400:kworker.0 Request processed in 27us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508837.060595:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2602 00000100:00100000:2.0:1787508837.060618:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2603 00000100:00100000:2.0:1787508837.060624:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480270464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508837.060651:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480270464:12345-0@lo:400:kworker.0 Request processed in 27us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508837.060657:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2603 00000100:00100000:2.0:1787508837.060668:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2604 00000100:00100000:2.0:1787508837.060674:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480270976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508837.060699:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480270976:12345-0@lo:400:kworker.0 Request processed in 26us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508837.060705:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2604 00000100:00100000:2.0:1787508837.060724:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480271232 00000100:00100000:2.0:1787508837.060727:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480271232 00000100:00100000:2.0:1787508837.060751:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480270592 00000100:00100000:2.0:1787508837.060753:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480270592 00000100:00100000:2.0:1787508837.060763:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480271104 00000100:00100000:2.0:1787508837.060765:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480271104 00000100:00100000:2.0:1787508837.060773:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480271616 00000100:00100000:2.0:1787508837.060776:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480271616 00000100:00100000:2.0:1787508837.060785:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480271360 00000100:00100000:2.0:1787508837.060787:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480271360 00000100:00100000:2.0:1787508837.060797:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480271488 00000100:00100000:2.0:1787508837.060799:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480271488 00000100:00100000:2.0:1787508837.060812:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3276 00000100:00100000:2.0:1787508837.060818:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874324480271232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508837.060853:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874324480271232:12345-0@lo:400:kworker.0 Request processed in 35us (1441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508837.060859:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3276 00000100:00100000:2.0:1787508837.060872:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3277 00000100:00100000:2.0:1787508837.060877:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874324480270592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508837.060904:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874324480270592:12345-0@lo:400:kworker.0 Request processed in 27us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508837.060909:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3277 00000100:00100000:2.0:1787508837.060919:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3278 00000100:00100000:2.0:1787508837.060924:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480271104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508837.060997:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480271104:12345-0@lo:400:kworker.0 Request processed in 72us (1444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508837.061003:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3278 00000100:00100000:2.0:1787508837.061014:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3279 00000100:00100000:2.0:1787508837.061019:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480271616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508837.061043:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480271616:12345-0@lo:400:kworker.0 Request processed in 24us (1457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508837.061049:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3279 00000100:00100000:2.0:1787508837.061060:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3280 00000100:00100000:2.0:1787508837.061065:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874324480271360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508837.061089:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874324480271360:12345-0@lo:400:kworker.0 Request processed in 24us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508837.061094:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3280 00000100:00100000:2.0:1787508837.061105:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3281 00000100:00100000:2.0:1787508837.061110:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480271488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508837.061137:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480271488:12345-0@lo:400:kworker.0 Request processed in 28us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508837.061142:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3281 00000100:00100000:2.0:1787508837.061167:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480270080 00000100:00100000:2.0:1787508837.061170:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480270080 00000100:00100000:2.0:1787508837.061194:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:2.0:1787508837.061200:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3617:x1874324480270080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508837.061240:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3617:x1874324480270080:12345-0@lo:400:kworker.0 Request processed in 41us (1763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508837.061246:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:2.0:1787508837.061281:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30024 00000100:00100000:2.0:1787508837.061288:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480270208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508837.061318:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480270208:12345-0@lo:400:kworker.0 Request processed in 31us (2030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508837.061323:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30024 00000100:00100000:2.0:1787508837.061339:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30025 00000100:00100000:2.0:1787508837.061344:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480270720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508837.061364:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480270720:12345-0@lo:400:kworker.0 Request processed in 20us (1996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508837.061369:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30025 00000100:00080000:2.0:1787508837.061382:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787508837.061385:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787508837.061388:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787508837.061466:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480270464:0@lo:400:kworker.0 00000100:00100000:2.0:1787508837.061477:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480270976:0@lo:400:kworker.0 00000100:00100000:2.0:1787508837.061485:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480271488:0@lo:400:kworker.0 00000100:00100000:2.0:1787508837.061495:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480270336:0@lo:400:kworker.0 00000100:00100000:2.0:1787508837.061503:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480270848:0@lo:400:kworker.0 00000100:00100000:2.0:1787508837.061511:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874324480271360:0@lo:400:kworker.0 00000100:00100000:2.0:1787508837.061560:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79de3f65-4bad-42d0-a46f-842a654b33a0:3617:1874324480270080:0@lo:400:kworker.0 00000100:00100000:2.0:1787508837.061569:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874324480270592:0@lo:400:kworker.0 00000100:00100000:2.0:1787508837.061577:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480271104:0@lo:400:kworker.0 00000100:00100000:2.0:1787508837.061586:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480271616:0@lo:400:kworker.0 00000100:00100000:2.0:1787508837.061596:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480270208:0@lo:400:kworker.0 00000100:00100000:2.0:1787508837.061620:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480270720:0@lo:400:kworker.0 00000100:00100000:2.0:1787508837.061629:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874324480271232:0@lo:400:kworker.0 00000001:02000400:1.0:1787508837.342612:0:235813:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 106a: Verify the btime via statx() ======= 14:13:56 (1787508836) 00000100:00100000:2.0:1787508837.562238:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480271744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787508837.562308:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508837.562416:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480271744 00000100:00100000:0.0:1787508837.562425:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480271744 00000100:00100000:0.0:1787508837.562483:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1799 00000100:00100000:0.0:1787508837.562493:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480271744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787508837.562533:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 64302784 pending 0 free 3908714496 avail 3677192192 00000100:00100000:3.0:1787508837.562776:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787508837.562791:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480271872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787508837.562821:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508837.562900:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480271872 00000100:00100000:1.0:1787508837.562905:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480271872 00000100:00100000:1.0:1787508837.562957:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1800 00000100:00100000:1.0:1787508837.562966:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480271872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787508837.562977:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 64302784 pending 0 free 3908714496 avail 3677192192 00000100:00100000:1.0:1787508837.563012:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480271872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508837.563019:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1800 00000100:00100000:3.0:1787508837.563102:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480271872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787508837.563820:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480271744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1326us (1509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508837.563828:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480271744:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787508837.563828:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1799 00000100:00100000:2.0:1787508837.578857:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508837.578979:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509700480 00000100:00100000:0.0:1787508837.578990:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509700480 00000100:00100000:0.0:1787508837.579076:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94307 00000100:00100000:0.0:1787508837.579089:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+17:346826:x1874324509700480:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1787508837.579110:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508837.579114:0:203348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787508837.579143:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f3641d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaedb0 expref: 17 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508837.579165:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508837.579170:0:203348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508837.579185:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f3650b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaee12 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508837.579302:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f36512 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508837.579315:0:203348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f3649b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaede1 expref: 14 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508837.579323:0:203348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f36512 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508837.579360:0:203348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f3649b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaede1 expref: 14 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508837.579374:0:203348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f3649b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaede1 expref: 14 pid: 202227 timeout: 13908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508837.579386:0:203348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:203348:1874324480272000:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508837.579467:0:203348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d306c0c0 going to sleep for 11 seconds 00000100:00080000:2.0:1787508837.580093:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787508837.581635:0:203348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:203348:1874324480272000:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508837.581662:0:203348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f36512 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508837.586478:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508837.586729:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509700608 00000100:00100000:0.0:1787508837.586739:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509700608 00010000:00010000:0.0:1787508837.586797:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f3649b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaede1 expref: 15 pid: 202227 timeout: 13908 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508837.586831:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27980 00000100:00100000:0.0:1787508837.586841:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2400:x1874324509700608:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508837.586855:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508837.586861:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f3649b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaede1 expref: 15 pid: 202227 timeout: 13908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508837.586875:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f3649b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaede1 expref: 15 pid: 202227 timeout: 13908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508837.586900:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f3649b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaede1 expref: 15 pid: 202227 timeout: 13908 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508837.586917:0:202212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508837.586922:0:202212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f36512 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508837.586931:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f36512 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787508837.587022:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787508837.587051:0:202212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f36512 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508837.587116:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508837.587166:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2400:x1874324509700608:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 325us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508837.587173:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27980 00010000:00010000:2.0:1787508837.587322:0:203348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f36512 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508837.587330:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f36512 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508837.587352:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f36519 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508837.587361:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f36519 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508837.587368:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f36519 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787508837.592207:0:203348:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x158e:0x0], index 1: 0 00010000:00010000:2.0:1787508837.592448:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f36520 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1277:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508837.592774:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f36520 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1277:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508837.592788:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f36520 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1277:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508837.592832:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f36512 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508837.592840:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f36512 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508837.592846:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f36512 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508837.592852:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f36512 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508837.592858:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508837.592861:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f36512 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508837.592868:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f36512 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508837.592881:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508837.592883:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508837.592888:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f36512 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508837.592894:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f36512 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508837.592910:0:203348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000087e84565 reply state 00000000744c105e transno 12884944278 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f36519 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508837.592921:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f36519 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508837.592928:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf4f22e50 (ffff9090e33ffd00) 00010000:00010000:2.0:1787508837.592930:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787508837.592933:0:203348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787508837.593286:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f3650b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee12 expref: 19 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508837.593304:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aae00/0xb126349c40f36520 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1277:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee12 expref: 18 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508837.593311:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1277:0x0].0x0 (ffff9090e33ff800) 00010000:00010000:2.0:1787508837.593314:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787508837.593316:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aae00, rc 0) 00000100:00100000:2.0:1787508837.593620:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+19:346826:x1874324509700480:12345-192.168.201.30@tcp:101:dd.0 Request processed in 14532us (14771us total) trans 12884944278 rc 0/0 00000100:00100000:2.0:1787508837.593629:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94307 00000100:00100000:2.0:1787508837.599373:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508837.599481:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509700736 00000100:00100000:1.0:1787508837.599491:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509700736 00000100:00100000:1.0:1787508837.604291:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15099 00000100:00100000:1.0:1787508837.604313:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:346826:x1874324509700736:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:1.0:1787508837.604332:0:225841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508837.604355:0:225841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000510098cd/0xb126349c40f3652e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x158e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaee19 expref: -99 pid: 225841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787508837.604382:0:225841:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x158e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787508837.604404:0:225841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x158e:0x0].0x0 since=13808s v=(0 0) 00010000:00010000:1.0:1787508837.604409:0:225841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x158e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787508837.604418:0:225841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000510098cd/0xb126349c40f3652e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x158e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee19 expref: 6 pid: 225841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508837.604436:0:225841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000510098cd/0xb126349c40f3652e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x158e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee19 expref: 6 pid: 225841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508837.604450:0:225841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a400, rc 0) 00000100:00100000:1.0:1787508837.604524:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:346826:x1874324509700736:12345-192.168.201.30@tcp:101:dd.0 Request processed in 219us (5160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508837.604535:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15099 00000100:00080000:2.0:1787508837.606654:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508837.614011:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508837.614292:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509700992 00000100:00100000:2.0:1787508837.614303:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509700992 00000100:00100000:2.0:1787508837.614363:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15506 00000100:00100000:2.0:1787508837.614374:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+19:346826:x1874324509700992:12345-192.168.201.30@tcp:35:dd.0 00000100:00100000:2.0:1787508837.614966:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:346826:x1874324509700992:12345-192.168.201.30@tcp:35:dd.0 Request processed in 564us (940us total) trans 12884944279 rc 0/0 00000100:00100000:2.0:1787508837.614977:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15506 00000100:00100000:0.0:1787508837.650172:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508837.650379:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509701120 00000100:00100000:2.0:1787508837.650387:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509701120 00000100:00100000:2.0:1787508837.650448:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94308 00000100:00100000:2.0:1787508837.650456:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:346831:x1874324509701120:12345-192.168.201.30@tcp:101:statx.0 00010000:00010000:2.0:1787508837.650486:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508837.650503:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f36535 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaee20 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508837.650563:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3653c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508837.650578:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3653c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508837.650588:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3653c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508837.650644:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508837.650649:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508837.650687:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3653c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508837.650706:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f36535 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee20 expref: 22 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508837.650719:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3653c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee20 expref: 21 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508837.650725:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508837.650727:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508837.650729:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa800, rc 0) 00000100:00100000:2.0:1787508837.650780:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+21:346831:x1874324509701120:12345-192.168.201.30@tcp:101:statx.0 Request processed in 325us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508837.650784:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94308 00010000:00010000:3.0:1787508837.948353:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508838.588081:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787508838.588115:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480272128:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787508838.588186:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508838.588235:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480272128 00000100:00100000:0.0:1787508838.588242:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480272128 00000100:00100000:0.0:1787508838.588286:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30026 00000100:00100000:0.0:1787508838.588294:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480272128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787508838.588325:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442709504 avail 1296470016 00000100:00100000:0.0:1787508838.588371:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480272128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508838.588379:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30026 00000100:00100000:0.0:1787508838.588425:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480272128:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787508838.603474:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787508838.603502:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480272256:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787508838.603592:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508838.603637:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480272256 00000100:00100000:1.0:1787508838.603647:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480272256 00000100:00100000:1.0:1787508838.604139:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30027 00000100:00100000:1.0:1787508838.604154:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480272256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787508838.604195:0:202232:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440636928 avail 1294397440 00000100:00100000:1.0:1787508838.604259:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480272256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508838.604267:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30027 00000100:00100000:0.0:1787508838.607099:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480272256:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787508838.970172:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508839.528760:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508839.528824:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508839.528975:0:203733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509701248 00000100:00100000:1.0:1787508839.528986:0:203733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509701248 00000100:00100000:2.0:1787508839.529034:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509701376 00000100:00100000:2.0:1787508839.529038:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509701376 00002000:00100000:1.0:1787508839.529051:0:203733:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x158e:0x0] (0->1023) req@ffff9091ffb3a680 x1874324509701248/t0(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:295/0 lens 1512/0 e 0 to 0 dl 1787508850 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787508839.529061:0:203733:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091ffb3a680 with x1874324509701248 ext(0->1023) 00002000:00010000:1.0:1787508839.529067:0:203733:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9091ffb3a680 00000100:00100000:2.0:1787508839.529080:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15100 00000100:00100000:1.0:1787508839.529081:0:203733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:1.0:1787508839.529089:0:203733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2401:x1874324509701248:12345-192.168.201.30@tcp:4:dd.0 00000100:00100000:2.0:1787508839.529090:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2401:x1874324509701376:12345-192.168.201.30@tcp:16:kworker.0 00000100:00100000:2.0:1787508839.529185:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2401:x1874324509701376:12345-192.168.201.30@tcp:16:kworker.0 Request processed in 96us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508839.529191:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15100 00000100:00080000:3.0:1787508839.529840:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508839.530291:0:203733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2401:x1874324509701248:12345-192.168.201.30@tcp:4:dd.0 Request processed in 1189us (1527us total) trans 8589940568 rc 0/0 00000100:00100000:1.0:1787508839.530308:0:203733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 57 00002000:00100000:1.0:1787508839.530323:0:203733:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x158e:0x0] (0->1023) req@ffff9091ffb3a680 x1874324509701248/t8589940568(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:295/0 lens 1512/448 e 0 to 0 dl 1787508850 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787508839.530335:0:203733:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091ffb3a680 with x1874324509701248 ext(0->1023) 00002000:00010000:1.0:1787508839.530342:0:203733:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9091ffb3a680 00010000:00010000:1.0:1787508840.001167:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508840.559142:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508840.559194:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508840.559223:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508840.559260:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508840.559284:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508840.559305:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508840.559329:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508840.559349:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508840.559392:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508840.559430:0:225838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509702016 00000100:00100000:0.0:1787508840.559444:0:225838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509702016 00000100:00100000:0.0:1787508840.559511:0:225838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509702528 00000100:00100000:0.0:1787508840.559515:0:225838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509702528 00000100:00100000:0.0:1787508840.559582:0:225838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509701888 00000100:00100000:0.0:1787508840.559586:0:225838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509701888 00000100:00100000:0.0:1787508840.559608:0:225838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509702400 00000100:00100000:0.0:1787508840.559610:0:225838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509702400 00000100:00100000:0.0:1787508840.559637:0:225838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2605 00000100:00100000:0.0:1787508840.559649:0:225838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2403:x1874324509702016:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508840.559748:0:225838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2403:x1874324509702016:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 100us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508840.559756:0:225838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2605 00000100:00100000:0.0:1787508840.559775:0:225838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2606 00000100:00100000:0.0:1787508840.559781:0:225838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509702528:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508840.559808:0:225838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509702528:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 27us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508840.559815:0:225838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2606 00000100:00100000:0.0:1787508840.559826:0:225838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2607 00000100:00100000:0.0:1787508840.559832:0:225838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2403:x1874324509701888:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508840.559856:0:225838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2403:x1874324509701888:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508840.559861:0:225838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2607 00000100:00100000:0.0:1787508840.559872:0:225838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2608 00000100:00100000:0.0:1787508840.559878:0:225838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509702400:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508840.559899:0:225838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509702400:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508840.559905:0:225838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2608 00000100:00100000:0.0:1787508840.559925:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509701760 00000100:00100000:0.0:1787508840.559930:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509701760 00000100:00100000:0.0:1787508840.559991:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509702272 00000100:00100000:0.0:1787508840.559995:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509702272 00000100:00100000:0.0:1787508840.560013:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509701632 00000100:00100000:0.0:1787508840.560016:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509701632 00000100:00100000:0.0:1787508840.560034:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509702144 00000100:00100000:0.0:1787508840.560037:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509702144 00000100:00100000:0.0:1787508840.560051:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3282 00000100:00100000:0.0:1787508840.560058:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2403:x1874324509701760:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508840.560091:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2403:x1874324509701760:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 35us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508840.560099:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3282 00000100:00100000:0.0:1787508840.560111:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3283 00000100:00100000:0.0:1787508840.560117:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2403:x1874324509702272:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508840.560140:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2403:x1874324509702272:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508840.560146:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3283 00000100:00100000:0.0:1787508840.560157:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3284 00000100:00100000:0.0:1787508840.560163:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+21:2403:x1874324509701632:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508840.560186:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+21:2403:x1874324509701632:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508840.560193:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3284 00000100:00100000:0.0:1787508840.560203:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3285 00000100:00100000:0.0:1787508840.560208:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2403:x1874324509702144:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508840.560232:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2403:x1874324509702144:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508840.560239:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3285 00000100:00080000:0.0:1787508840.560283:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787508840.560288:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508840.560291:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787508840.560294:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508840.561997:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509701504 00000100:00100000:1.0:1787508840.562013:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509701504 00000100:00100000:1.0:1787508840.562088:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1066 00000100:00100000:1.0:1787508840.562099:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d980ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509701504:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508840.562180:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d980ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509701504:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 83us (3052us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508840.562188:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1066 00010000:00010000:1.0:1787508841.020406:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508841.146272:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480272384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508841.146367:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508841.146549:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480272384 00000100:00100000:0.0:1787508841.146558:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480272384 00000100:00100000:0.0:1787508841.146638:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1801 00000100:00100000:0.0:1787508841.146651:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480272384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787508841.146690:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 165237312 pending 28672 free 3881938944 avail 3650416640 00000100:00100000:0.0:1787508841.146744:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480272384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508841.146752:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1801 00000100:00080000:1.0:1787508841.146870:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508841.146913:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480272384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787508841.147457:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787508841.147472:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480272512:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787508841.147509:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508841.147639:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480272512 00000100:00100000:1.0:1787508841.147645:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480272512 00000100:00100000:1.0:1787508841.147698:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1802 00000100:00100000:1.0:1787508841.147706:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480272512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787508841.147718:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 165237312 pending 28672 free 3881938944 avail 3650416640 00000100:00100000:1.0:1787508841.147760:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480272512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508841.147768:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1802 00000100:00100000:3.0:1787508841.147871:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480272512:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787508841.147921:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787508842.044157:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508842.172559:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480273024:0@lo:400:kworker.0 00000100:00100000:0.0:1787508842.172635:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508842.172691:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480273536:0@lo:400:kworker.0 00000100:00100000:0.0:1787508842.172716:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508842.172728:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480272768:0@lo:400:kworker.0 00000100:00100000:0.0:1787508842.172740:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480274048:0@lo:400:kworker.0 00000100:00100000:1.0:1787508842.172759:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508842.172760:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508842.172779:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480273280:0@lo:400:kworker.0 00000100:00100000:0.0:1787508842.172784:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1787508842.172789:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480272640:0@lo:400:kworker.0 00000100:00100000:1.0:1787508842.172800:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508842.172819:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874324480273792:0@lo:400:kworker.0 00000100:00100000:0.0:1787508842.172828:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508842.173962:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480272640 00000100:00100000:3.0:1787508842.173973:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480272640 00000100:00100000:3.0:1787508842.174032:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:3.0:1787508842.174042:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480272640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508842.174243:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480273152:0@lo:400:kworker.0 00000100:00100000:0.0:1787508842.174295:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508842.174317:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480273664:0@lo:400:kworker.0 00000100:00100000:0.0:1787508842.174339:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508842.174357:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480274176:0@lo:400:kworker.0 00000100:00100000:0.0:1787508842.174379:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508842.174407:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480274048 00000100:00100000:0.0:1787508842.174411:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480274048 00000100:00100000:0.0:1787508842.174449:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480273152 00000100:00100000:0.0:1787508842.174452:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480273152 00000100:00100000:0.0:1787508842.174470:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480273664 00000100:00100000:0.0:1787508842.174472:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480273664 00000100:00100000:0.0:1787508842.174491:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480274176 00000100:00100000:0.0:1787508842.174494:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480274176 00000100:00100000:0.0:1787508842.174522:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3286 00000100:00100000:0.0:1787508842.174530:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480274048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508842.174582:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480274048:12345-0@lo:400:kworker.0 Request processed in 53us (1822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508842.174589:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3286 00000100:00100000:0.0:1787508842.174607:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3287 00000100:00100000:0.0:1787508842.174613:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480273152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508842.174640:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480273152:12345-0@lo:400:kworker.0 Request processed in 27us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508842.174646:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3287 00000100:00100000:0.0:1787508842.174657:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3288 00000100:00100000:0.0:1787508842.174662:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c993ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480273664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508842.174686:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c993ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480273664:12345-0@lo:400:kworker.0 Request processed in 24us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508842.174692:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3288 00000100:00100000:0.0:1787508842.174703:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3289 00000100:00100000:0.0:1787508842.174710:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480274176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508842.174733:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480274176:12345-0@lo:400:kworker.0 Request processed in 25us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508842.174739:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3289 00000100:00080000:0.0:1787508842.174761:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508842.174766:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787508842.176638:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508842.176701:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787508842.176712:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480272896:0@lo:400:kworker.0 00000100:00100000:1.0:1787508842.176770:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508842.176792:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480273408:0@lo:400:kworker.0 00000100:00100000:1.0:1787508842.176814:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508842.176846:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480273920:0@lo:400:kworker.0 00000100:00100000:1.0:1787508842.176877:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508842.177562:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480272768 00000100:00100000:1.0:1787508842.177571:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480272768 00000100:00100000:1.0:1787508842.177630:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480273280 00000100:00100000:1.0:1787508842.177633:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480273280 00000100:00100000:1.0:1787508842.177657:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30028 00000100:00100000:1.0:1787508842.177666:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480272768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508842.177734:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480272768:12345-0@lo:400:kworker.0 Request processed in 69us (4973us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508842.177742:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30028 00000100:00100000:1.0:1787508842.177758:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30029 00000100:00100000:1.0:1787508842.177764:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480273280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508842.177791:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480273280:12345-0@lo:400:kworker.0 Request processed in 28us (4991us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508842.177797:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30029 00000100:00100000:1.0:1787508842.177823:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480273792 00000100:00100000:1.0:1787508842.177828:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480273792 00000100:00100000:1.0:1787508842.178569:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480273920 00000100:00100000:1.0:1787508842.178576:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480273920 00000100:00100000:1.0:1787508842.178618:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3290 00000100:00100000:1.0:1787508842.178626:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874324480273792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508842.178675:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874324480273792:12345-0@lo:400:kworker.0 Request processed in 50us (2044us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508842.178681:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3290 00000100:00100000:1.0:1787508842.178695:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3291 00000100:00100000:1.0:1787508842.178701:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480273920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508842.178727:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480273920:12345-0@lo:400:kworker.0 Request processed in 27us (1850us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508842.178732:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3291 00000100:00100000:1.0:1787508842.178754:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480273024 00000100:00100000:1.0:1787508842.178758:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480273024 00000100:00100000:1.0:1787508842.178791:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480273536 00000100:00100000:1.0:1787508842.178794:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480273536 00000100:00100000:1.0:1787508842.178810:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480272896 00000100:00100000:1.0:1787508842.178813:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480272896 00000100:00100000:1.0:1787508842.178829:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480273408 00000100:00100000:2.0:1787508842.178917:0:225835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2609 00000100:00100000:2.0:1787508842.178928:0:225835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480273024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508842.178992:0:225835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480273024:12345-0@lo:400:kworker.0 Request processed in 67us (6357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508842.178999:0:225835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2609 00000100:00100000:2.0:1787508842.179014:0:225835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2610 00000100:00100000:2.0:1787508842.179021:0:225835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480273536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508842.179051:0:225835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480273536:12345-0@lo:400:kworker.0 Request processed in 31us (6335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508842.179058:0:225835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2610 00000100:00100000:2.0:1787508842.179069:0:225835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2611 00000100:00100000:2.0:1787508842.179075:0:225835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480272896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508842.179105:0:225835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480272896:12345-0@lo:400:kworker.0 Request processed in 31us (2336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508842.179111:0:225835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2611 00000100:00100000:1.0:1787508842.179217:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480273408 00000100:00100000:1.0:1787508842.179252:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2612 00000100:00100000:1.0:1787508842.179387:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480273408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508842.179578:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480273408:12345-0@lo:400:kworker.0 Request processed in 168us (2610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508842.179584:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2612 00000100:00100000:1.0:1787508842.179644:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480272896:0@lo:400:kworker.0 00000100:00100000:1.0:1787508842.179657:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480273408:0@lo:400:kworker.0 00000100:00100000:1.0:1787508842.179668:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480273920:0@lo:400:kworker.0 00000100:00100000:1.0:1787508842.179684:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480272768:0@lo:400:kworker.0 00000100:00100000:1.0:1787508842.179696:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480273280:0@lo:400:kworker.0 00000100:00100000:1.0:1787508842.179707:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874324480273792:0@lo:400:kworker.0 00000100:00100000:0.0:1787508842.186613:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480273152:0@lo:400:kworker.0 00000100:00080000:0.0:1787508842.186633:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787508842.186642:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508842.186645:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787508842.186686:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480273664:0@lo:400:kworker.0 00000100:00100000:0.0:1787508842.186700:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480274176:0@lo:400:kworker.0 00000100:00100000:0.0:1787508842.186711:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480273024:0@lo:400:kworker.0 00000100:00100000:0.0:1787508842.186721:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480273536:0@lo:400:kworker.0 00000100:00100000:0.0:1787508842.186732:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480274048:0@lo:400:kworker.0 00000100:00100000:2.0:1787508842.190352:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480272640:12345-0@lo:400:kworker.0 Request processed in 16303us (17514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508842.190368:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:0.0:1787508842.190501:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480272640:0@lo:400:kworker.0 00000100:00100000:3.0:1787508842.682609:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787508842.682635:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480274304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787508842.682708:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508842.682817:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480274304 00000100:00100000:0.0:1787508842.682827:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480274304 00000100:00100000:0.0:1787508842.682900:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1803 00000100:00100000:0.0:1787508842.682910:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480274304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787508842.682986:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 64302784 pending 0 free 3908714496 avail 3677192192 00000100:00100000:0.0:1787508842.683032:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480274304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508842.683040:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1803 00000100:00100000:3.0:1787508842.683152:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480274304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787508842.689441:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480274432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787508842.689907:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508842.690001:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480274432 00000100:00100000:0.0:1787508842.690012:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480274432 00000100:00100000:0.0:1787508842.690076:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1804 00000100:00100000:0.0:1787508842.690087:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480274432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787508842.690122:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 64302784 pending 0 free 3908714496 avail 3677192192 00000100:00100000:0.0:1787508842.690186:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480274432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508842.690194:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1804 00000100:00100000:3.0:1787508842.690921:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480274432:0@lo:13:osp-pre-0-1.0 00000001:00080000:0.0:1787508842.691085:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944279 is committed 00010000:00010000:1.0:1787508842.691214:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f36519 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508842.691226:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f36519 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508842.691234:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f36519 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508842.691239:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508842.691244:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f36519 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508842.691262:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f36519 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508842.691278:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf4f22e50 (ffff9090e33ffd00) 00010000:00010000:1.0:1787508842.691280:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508842.691285:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f36519 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508842.691290:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f36519 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xf4f22e50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508843.066136:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508843.706288:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480274560:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787508843.706388:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508843.706478:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480274560 00000100:00100000:0.0:1787508843.706515:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480274560 00000100:00100000:0.0:1787508843.706587:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30030 00000100:00100000:0.0:1787508843.706598:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480274560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787508843.706643:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442709504 avail 1296470016 00000100:00100000:0.0:1787508843.706696:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480274560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508843.706704:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30030 00000100:00100000:0.0:1787508843.709732:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480274560:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787508843.709774:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787508843.709789:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480274688:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787508843.709870:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508843.710693:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480274688 00000100:00100000:2.0:1787508843.710704:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480274688 00000100:00100000:2.0:1787508843.710789:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30031 00000100:00100000:2.0:1787508843.710801:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480274688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787508843.710848:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440636928 avail 1294397440 00000100:00100000:2.0:1787508843.710933:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480274688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508843.710982:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30031 00000100:00100000:3.0:1787508843.711361:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480274688:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787508844.091471:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787508844.734769:0:204539:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589940568 is committed 00010000:00010000:1.0:1787508845.114212:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508845.673223:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508845.673271:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508845.673307:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508845.673415:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509702656 00000100:00100000:2.0:1787508845.673425:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509702656 00000100:00100000:2.0:1787508845.673493:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1068 00000100:00100000:2.0:1787508845.673517:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509702656:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508845.673610:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509702656:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 96us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508845.673618:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1068 00000100:00100000:0.0:1787508845.674008:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509702912 00000100:00100000:0.0:1787508845.674013:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509702912 00000100:00100000:0.0:1787508845.674064:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3292 00000100:00100000:0.0:1787508845.674072:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2402:x1874324509702912:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508845.674111:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2402:x1874324509702912:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 40us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508845.674118:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3292 00000100:00080000:2.0:1787508845.674567:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787508845.674896:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508845.674955:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508845.675106:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509703424 00000100:00100000:2.0:1787508845.675113:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509703424 00000100:00100000:2.0:1787508845.675165:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3293 00000100:00100000:2.0:1787508845.675173:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2402:x1874324509703424:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508845.675217:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2402:x1874324509703424:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 45us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508845.675223:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3293 00000100:00080000:0.0:1787508845.675681:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787508845.684936:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508845.684986:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508845.687081:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509703168 00000100:00100000:3.0:1787508845.687098:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509703168 00000100:00100000:3.0:1787508845.687181:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509703680 00000100:00100000:3.0:1787508845.687185:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509703680 00000100:00100000:3.0:1787508845.687215:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2613 00000100:00100000:3.0:1787508845.687225:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509703168:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508845.687301:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509703168:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 77us (13992us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508845.687309:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2613 00000100:00100000:3.0:1787508845.687329:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2614 00000100:00100000:3.0:1787508845.687335:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509703680:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508845.687357:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509703680:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (12416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508845.687375:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2614 00000100:00080000:3.0:1787508845.687401:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508845.698140:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508845.698170:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508845.698475:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509702784 00000100:00100000:2.0:1787508845.698485:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509702784 00000100:00100000:2.0:1787508845.698565:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509703296 00000100:00100000:2.0:1787508845.698568:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509703296 00000100:00100000:2.0:1787508845.698800:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3294 00000100:00100000:2.0:1787508845.698811:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+18:2402:x1874324509702784:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508845.698883:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+18:2402:x1874324509702784:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 74us (13961us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508845.698890:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3294 00000100:00100000:2.0:1787508845.698907:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3295 00000100:00100000:2.0:1787508845.698913:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2402:x1874324509703296:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508845.698934:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2402:x1874324509703296:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508845.698956:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3295 00000100:00080000:2.0:1787508845.698971:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787508845.699899:0:225838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509703040 00000100:00100000:3.0:1787508845.699907:0:225838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509703040 00000100:00100000:0.0:1787508845.700026:0:225833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509703552 00000100:00100000:0.0:1787508845.700031:0:225833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509703552 00000100:00100000:0.0:1787508845.700116:0:225833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2615 00000100:00100000:0.0:1787508845.700126:0:225833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509703552:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508845.700175:0:225833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509703552:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 52us (2004us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508845.700183:0:225833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2615 00000100:00080000:3.0:1787508845.700269:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508845.700390:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2616 00000100:00100000:1.0:1787508845.700398:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2402:x1874324509703040:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508845.700425:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2402:x1874324509703040:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 28us (15439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508845.700431:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2616 00010000:00010000:3.0:1787508846.160054:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508846.267199:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480274816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787508846.267281:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508846.267469:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480274816 00000100:00100000:1.0:1787508846.267477:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480274816 00000100:00100000:1.0:1787508846.267548:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1805 00000100:00100000:1.0:1787508846.267568:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480274816:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787508846.267658:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1787508846.267710:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 165208640 pending 0 free 3881938944 avail 3650416640 00000100:00100000:1.0:1787508846.268386:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480274816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 817us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508846.268396:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1805 00000100:00100000:3.0:1787508846.271279:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480274816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787508846.286995:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c788e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480274944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787508846.287067:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508846.287089:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480274944 00000100:00100000:1.0:1787508846.287097:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480274944 00000100:00100000:1.0:1787508846.287158:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1806 00000100:00100000:1.0:1787508846.287168:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480274944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787508846.287191:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 165208640 pending 0 free 3881938944 avail 3650416640 00000100:00100000:1.0:1787508846.287239:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480274944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (172us total) trans 0 rc 0/0 00000100:00080000:2.0:1787508846.287991:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508846.288502:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c788e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480274944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787508846.291547:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1806 00000001:02000400:0.0:1787508846.561546:0:236057:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 106b: Glimpse RPCs test for statx ======== 14:14:05 (1787508845) 00000100:00100000:2.0:1787508846.641883:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508846.642080:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509703936 00000100:00100000:3.0:1787508846.642091:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509703936 00000100:00100000:3.0:1787508846.642155:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94309 00000100:00100000:3.0:1787508846.642166:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+18:347416:x1874324509703936:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508846.642188:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508846.642191:0:230618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787508846.642217:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3653c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee20 expref: 18 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.642233:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508846.642238:0:230618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508846.642252:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36543 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaee27 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.642380:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3654a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.642392:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3654a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.642401:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3654a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.642416:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36551 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x375764fc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.642423:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36551 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.642428:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36551 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.642871:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f36558 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1278:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.642881:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f36558 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1278:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.642889:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f36558 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1278:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508846.642897:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1278:0x0]: returning size 0 00010000:00010000:3.0:1787508846.642922:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3654a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.642930:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3654a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.642936:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3654a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.642972:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3654a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.642978:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508846.642982:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3654a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.642990:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3654a lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.643000:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508846.643002:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508846.643006:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3654a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.643012:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3654a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508846.643024:0:230618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e896085d reply state 000000000f99dd47 transno 12884944280 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36551 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.643035:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36551 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.643041:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x375764fc (ffff9090cc088500) 00010000:00010000:3.0:1787508846.643044:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508846.643046:0:230618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787508846.643072:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36543 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee27 expref: 20 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.643085:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f36558 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1278:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee27 expref: 19 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.643091:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1278:0x0].0x0 (ffff9090cc088300) 00010000:00010000:3.0:1787508846.643093:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787508846.643096:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ec00, rc 0) 00000100:00100000:3.0:1787508846.643161:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:347416:x1874324509703936:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 996us (1290us total) trans 12884944280 rc 0/0 00000100:00100000:3.0:1787508846.643170:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94309 00000100:00100000:2.0:1787508846.662899:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508846.663034:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509704192 00000100:00100000:1.0:1787508846.663045:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509704192 00000100:00100000:1.0:1787508846.663111:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94310 00000100:00100000:1.0:1787508846.663124:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:347416:x1874324509704192:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508846.663153:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508846.663176:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f36566 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaee2e expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508846.663300:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f3656d lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x1278:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508846.663316:0:202228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f36558 lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x1278:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee27 expref: 21 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508846.663326:0:202228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f3656d lrc: 4/0,1 mode: --/EX res: [0x2000013a4:0x1278:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508846.663359:0:202228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f36558 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1278:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee27 expref: 21 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508846.663375:0:202228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f36558 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1278:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee27 expref: 21 pid: 230618 timeout: 13917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508846.663389:0:202228:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480275072:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508846.663482:0:202228:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d5569840 going to sleep for 11 seconds 00000100:00100000:3.0:1787508846.674398:0:202228:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:202228:1874324480275072:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508846.674429:0:202228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f3656d lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x1278:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508846.679313:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508846.679362:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509704320 00000100:00100000:3.0:1787508846.679381:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509704320 00010000:00010000:3.0:1787508846.679425:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f36558 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1278:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee27 expref: 22 pid: 230618 timeout: 13917 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508846.679479:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27981 00000100:00100000:3.0:1787508846.679492:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+22:2400:x1874324509704320:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508846.679507:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508846.679514:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f36558 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x1278:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee27 expref: 22 pid: 230618 timeout: 13917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.679530:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f36558 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1278:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee27 expref: 22 pid: 230618 timeout: 13917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.679608:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f36558 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1278:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee27 expref: 22 pid: 230618 timeout: 13917 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.679624:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1278:0x0].0x0 (ffff9090cc088300) 00010000:00010000:3.0:1787508846.679629:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f3656d lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x1278:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.679639:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f3656d lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1278:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.679646:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f3656d lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x1278:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.679676:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508846.679733:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+21:2400:x1874324509704320:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 244us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508846.679741:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27981 00010000:00010000:3.0:1787508846.679858:0:202228:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f3656d lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1278:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.680035:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f3656d lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1278:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508846.680053:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1278:0x0]: returning size 0 00000004:00080000:3.0:1787508846.680201:0:202228:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x1533:0x0], index 0: 0 00010000:00010000:3.0:1787508846.680302:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f3656d lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x1278:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.680310:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f3656d lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x1278:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.680316:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f3656d lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1278:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.680322:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ba00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508846.680326:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f3656d lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x1278:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.680333:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f3656d lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x1278:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.680343:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1278:0x0].0x0 (ffff9090cc088300) 00010000:00010000:3.0:1787508846.680346:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787508846.680350:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f3656d lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x1278:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.680356:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f3656d lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x1278:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.680418:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f36566 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee2e expref: 21 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.680428:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508846.680430:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787508846.680444:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f36566 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee2e expref: 21 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.680460:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247bc00, rc 0) 00000100:00100000:3.0:1787508846.680504:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:347416:x1874324509704192:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 17383us (17614us total) trans 12884944281 rc 301/301 00000100:00100000:3.0:1787508846.680512:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94310 00000100:00100000:0.0:1787508846.696023:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508846.698835:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509704576 00000100:00100000:3.0:1787508846.698851:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509704576 00000100:00100000:3.0:1787508846.699333:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15507 00000100:00100000:3.0:1787508846.699357:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+20:347416:x1874324509704576:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1787508846.699836:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+21:347416:x1874324509704576:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 490us (3819us total) trans 12884944282 rc 0/0 00000100:00100000:3.0:1787508846.699844:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15507 00000100:00100000:2.0:1787508846.711595:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508846.712490:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509704704 00000100:00100000:3.0:1787508846.712502:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509704704 00000100:00100000:3.0:1787508846.712728:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94311 00000100:00100000:3.0:1787508846.712739:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+21:347416:x1874324509704704:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508846.712766:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508846.712791:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f3657b lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x1278:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaee35 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.712854:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f3657b lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x1278:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee35 expref: 22 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.712870:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ec00/0xb126349c40f3657b lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x1278:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee35 expref: 22 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.712909:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1278:0x0].0x0 (ffff9090cc088f00) 00010000:00010000:3.0:1787508846.712913:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787508846.712917:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ec00, rc 0) 00000100:00100000:3.0:1787508846.713007:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+22:347416:x1874324509704704:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 270us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508846.713014:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94311 00000100:00100000:3.0:1787508846.721421:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508846.726753:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509704960 00000100:00100000:0.0:1787508846.726772:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509704960 00000100:00100000:0.0:1787508846.726838:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15508 00000100:00100000:0.0:1787508846.726850:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+22:347416:x1874324509704960:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1787508846.727121:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+23:347416:x1874324509704960:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 271us (5707us total) trans 12884944283 rc 0/0 00000100:00100000:0.0:1787508846.727130:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15508 00000100:00100000:0.0:1787508846.759322:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508846.759408:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509705088 00000100:00100000:1.0:1787508846.759419:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509705088 00000100:00100000:1.0:1787508846.759483:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94312 00000100:00100000:1.0:1787508846.759494:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+23:347425:x1874324509705088:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:1.0:1787508846.759522:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508846.759543:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f36582 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaee3c expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508846.759619:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f36589 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508846.759633:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f36589 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508846.759644:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f36589 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508846.759693:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508846.759697:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508846.759716:0:209004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f36589 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508846.759742:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f36582 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee3c expref: 25 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508846.759759:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f36589 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee3c expref: 24 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508846.759767:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508846.759770:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508846.759774:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ae00, rc 0) 00000100:00100000:1.0:1787508846.759835:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+24:347425:x1874324509705088:12345-192.168.201.30@tcp:101:dd.0 Request processed in 342us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508846.759842:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94312 00000100:00100000:0.0:1787508846.781033:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508846.781266:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509705344 00000100:00100000:3.0:1787508846.781277:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509705344 00000100:00100000:3.0:1787508846.781341:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94313 00000100:00100000:3.0:1787508846.781429:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+24:347425:x1874324509705344:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:3.0:1787508846.781462:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508846.781466:0:202227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787508846.781493:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f36589 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee3c expref: 24 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.781510:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508846.781515:0:202227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508846.781528:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36590 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaee43 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.781658:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f36597 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.781670:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f36597 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.781683:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f36597 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.781693:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3659e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x375764fc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.781700:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3659e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.781707:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3659e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.781758:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f365a5 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1278:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.781767:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f365a5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1278:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.781773:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f365a5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1278:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508846.781781:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x1278:0x0]: returning size 0 00010000:00010000:3.0:1787508846.781853:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f36597 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.781861:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f36597 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.781867:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f36597 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.781874:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f36597 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.781880:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508846.781884:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f36597 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.781890:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f36597 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.781899:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508846.781901:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508846.781905:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f36597 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.781910:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f36597 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.781920:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3659e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.781927:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3659e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.781932:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3659e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.781937:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508846.784322:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3659e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.784338:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3659e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.784517:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x375764fc (ffff9090cc088500) 00010000:00010000:3.0:1787508846.784521:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508846.784525:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3659e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.784532:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3659e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.784591:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36590 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee43 expref: 26 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.784606:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8f400/0xb126349c40f365a5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1278:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee43 expref: 25 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.784614:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1278:0x0].0x0 (ffff9090cc088f00) 00010000:00010000:3.0:1787508846.784617:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787508846.784620:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8f400, rc 0) 00000100:00100000:3.0:1787508846.784753:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+25:347425:x1874324509705344:12345-192.168.201.30@tcp:101:dd.0 Request processed in 3326us (3726us total) trans 12884944284 rc 0/0 00000100:00100000:3.0:1787508846.784761:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94313 00000100:00100000:3.0:1787508846.798285:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508846.798359:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509705472 00000100:00100000:1.0:1787508846.798369:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509705472 00000100:00100000:1.0:1787508846.798428:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94314 00000100:00100000:1.0:1787508846.798448:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+25:347425:x1874324509705472:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:1.0:1787508846.798472:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508846.798491:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f365b3 lrc: 2/0,0 mode: --/PR res: [0x2000013a4:0x1278:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaee4a expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508846.798525:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f365ba lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x1278:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508846.798538:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f365ba lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1278:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508846.798548:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f365ba lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x1278:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508846.798654:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f365b3 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x1278:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee4a expref: 27 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508846.798671:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b600/0xb126349c40f365ba lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x1278:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee4a expref: 26 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508846.798680:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x1278:0x0].0x0 (ffff9090cc088f00) 00010000:00010000:1.0:1787508846.798683:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787508846.798687:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b600, rc 0) 00000100:00100000:1.0:1787508846.798749:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+26:347425:x1874324509705472:12345-192.168.201.30@tcp:101:dd.0 Request processed in 304us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508846.798757:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94314 00000100:00100000:1.0:1787508846.809168:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508846.811098:0:226134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509705600 00000100:00100000:2.0:1787508846.811109:0:226134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509705600 00000100:00100000:2.0:1787508846.811170:0:226134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15101 00000100:00100000:2.0:1787508846.811180:0:226134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:347425:x1874324509705600:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:2.0:1787508846.811198:0:226134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508846.811218:0:226134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec6f75dc/0xb126349c40f365c1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1533:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaee51 expref: -99 pid: 226134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787508846.811252:0:226134:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1533:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787508846.811271:0:226134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1533:0x0].0x0 since=13817s v=(0 0) 00010000:00010000:2.0:1787508846.811276:0:226134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1533:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787508846.811285:0:226134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec6f75dc/0xb126349c40f365c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1533:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee51 expref: 6 pid: 226134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508846.811302:0:226134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ec6f75dc/0xb126349c40f365c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1533:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee51 expref: 6 pid: 226134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508846.811314:0:226134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aba00, rc 0) 00000100:00100000:2.0:1787508846.811374:0:226134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:347425:x1874324509705600:12345-192.168.201.30@tcp:101:dd.0 Request processed in 196us (2216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508846.811381:0:226134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15101 00000100:00100000:2.0:1787508846.820023:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508846.820072:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509705856 00000100:00100000:3.0:1787508846.820082:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509705856 00000100:00100000:3.0:1787508846.820142:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15509 00000100:00100000:3.0:1787508846.820154:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+26:347425:x1874324509705856:12345-192.168.201.30@tcp:35:dd.0 00000100:00100000:3.0:1787508846.820461:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+27:347425:x1874324509705856:12345-192.168.201.30@tcp:35:dd.0 Request processed in 308us (446us total) trans 12884944285 rc 0/0 00000100:00100000:3.0:1787508846.820472:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15509 00000100:00100000:3.0:1787508846.840256:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508846.840367:0:203731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509705984 00000100:00100000:0.0:1787508846.840378:0:203731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509705984 00002000:00100000:0.0:1787508846.840445:0:203731:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x1533:0x0] (0->1023) req@ffff9090e4c84700 x1874324509705984/t0(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:302/0 lens 1512/0 e 0 to 0 dl 1787508857 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787508846.840457:0:203731:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090e4c84700 with x1874324509705984 ext(0->1023) 00002000:00010000:0.0:1787508846.840463:0:203731:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9090e4c84700 00000100:00100000:0.0:1787508846.840497:0:203731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00100000:0.0:1787508846.840508:0:203731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509705984:12345-192.168.201.30@tcp:4:dd.0 00000100:00100000:2.0:1787508846.841101:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508846.843461:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509706112 00000100:00100000:0.0:1787508846.843476:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509706112 00000100:00100000:0.0:1787508846.843550:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9844 00000100:00100000:0.0:1787508846.843560:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:288292:x1874324509706112:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508846.843577:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787508846.843597:0:202211:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x158e:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1787508846.843600:0:202211:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x158e:0x0] updating lvb mtime from disk: 0 -> 1787508838 00002000:00010000:0.0:1787508846.843602:0:202211:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x158e:0x0] updating lvb ctime from disk: 0 -> 1787508838 00002000:00010000:0.0:1787508846.843604:0:202211:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x158e:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787508846.843629:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000510098cd/0xb126349c40f3652e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x158e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee19 expref: 6 pid: 225841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508846.843656:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508846.843720:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:288292:x1874324509706112:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 161us (2621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508846.843728:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9844 00000100:00100000:2.0:1787508846.847886:0:203731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2403:x1874324509705984:12345-192.168.201.30@tcp:4:dd.0 Request processed in 7366us (7625us total) trans 8589941260 rc 0/0 00000100:00100000:2.0:1787508846.847901:0:203731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 58 00002000:00100000:2.0:1787508846.847916:0:203731:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x1533:0x0] (0->1023) req@ffff9090e4c84700 x1874324509705984/t8589941260(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:302/0 lens 1512/448 e 0 to 0 dl 1787508857 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787508846.847926:0:203731:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090e4c84700 with x1874324509705984 ext(0->1023) 00002000:00010000:2.0:1787508846.847932:0:203731:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9090e4c84700 00000100:00100000:2.0:1787508846.853215:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508846.856496:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509706240 00000100:00100000:3.0:1787508846.856513:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509706240 00000100:00100000:3.0:1787508846.856607:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9845 00000100:00100000:3.0:1787508846.856619:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:287589:x1874324509706240:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508846.856637:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787508846.856659:0:205406:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x1533:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1787508846.856663:0:205406:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x1533:0x0] updating lvb mtime from disk: 0 -> 1787508847 00002000:00010000:3.0:1787508846.856665:0:205406:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x1533:0x0] updating lvb ctime from disk: 0 -> 1787508847 00002000:00010000:3.0:1787508846.856667:0:205406:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x1533:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1787508846.856692:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec6f75dc/0xb126349c40f365c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1533:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee51 expref: 8 pid: 226134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.856721:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508846.856784:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:287589:x1874324509706240:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 167us (3579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508846.856792:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9845 00000100:00100000:2.0:1787508846.930913:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508846.931085:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509706368 00000100:00100000:3.0:1787508846.931096:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509706368 00000100:00100000:3.0:1787508846.931166:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94315 00000100:00100000:3.0:1787508846.931186:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+27:347437:x1874324509706368:12345-192.168.201.30@tcp:101:statx.0 00010000:00010000:3.0:1787508846.931216:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508846.931237:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f365c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaee58 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.931309:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f365cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.931324:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f365cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.931336:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f365cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508846.931396:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508846.931400:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508846.931423:0:203348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f365cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.931457:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f365c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee58 expref: 29 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.931476:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f365cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee58 expref: 28 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508846.931485:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508846.931487:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508846.931491:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e600, rc 0) 00000100:00100000:3.0:1787508846.931604:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+28:347437:x1874324509706368:12345-192.168.201.30@tcp:101:statx.0 Request processed in 427us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508846.931611:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94315 00000100:00100000:0.0:1787508846.936114:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508846.936568:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509706496 00000100:00100000:2.0:1787508846.936578:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509706496 00000100:00100000:1.0:1787508846.936770:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15102 00000100:00100000:1.0:1787508846.936795:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2401:x1874324509706496:12345-192.168.201.30@tcp:101:statx.0 00010000:00010000:1.0:1787508846.936815:0:225842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508846.936841:0:225842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000510098cd/0xb126349c40f365d6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1533:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaee5f expref: -99 pid: 225842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787508846.936870:0:225842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1533:0x0] initial LVB size: 1024, mtime: 0x6a8b386f, atime: 0x0, ctime: 0x6a8b386f, blocks: 0x8 00010000:00010000:1.0:1787508846.936891:0:225842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1533:0x0].0x0 since=13817s v=(0 0) 00010000:00010000:1.0:1787508846.936895:0:225842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1533:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787508846.936906:0:225842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000510098cd/0xb126349c40f365d6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1533:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee5f expref: 8 pid: 225842 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508846.936923:0:225842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000510098cd/0xb126349c40f365d6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1533:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee5f expref: 8 pid: 225842 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508846.936967:0:225842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a400, rc 0) 00000100:00100000:1.0:1787508846.937031:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2401:x1874324509706496:12345-192.168.201.30@tcp:101:statx.0 Request processed in 250us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508846.937038:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15102 00000100:00100000:2.0:1787508847.003475:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508847.003594:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509706624 00000100:00100000:1.0:1787508847.003604:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509706624 00000100:00100000:1.0:1787508847.003686:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9846 00000100:00100000:1.0:1787508847.003697:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:287588:x1874324509706624:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508847.003714:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508847.003757:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000510098cd/0xb126349c40f365d6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1533:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee5f expref: 8 pid: 225842 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508847.003792:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508847.003857:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:287588:x1874324509706624:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 161us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508847.003865:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9846 00000100:00080000:2.0:1787508847.003963:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787508847.162137:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508847.292234:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4c85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480275200:0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.292317:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508847.292369:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480275712:0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.292397:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508847.292421:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480276224:0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.292455:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508847.292472:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480276736:0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.292490:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508847.292509:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787508847.292514:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4c84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480275328:0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.292534:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508847.292548:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4c86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480275840:0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.292578:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508847.292592:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874324480276352:0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.292610:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508847.292632:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4c84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480275584:0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.292655:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508847.292670:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4c87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480276096:0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.292688:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508847.292701:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480276608:0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.292718:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508847.292733:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787508847.292738:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4c87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480275456:0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.292757:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508847.292770:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4c87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480275968:0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.292808:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508847.292827:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874324480276480:0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.292847:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508847.292884:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480275712 00000100:00100000:0.0:1787508847.292891:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480275712 00000100:00100000:0.0:1787508847.292935:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480276224 00000100:00100000:0.0:1787508847.292966:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480276224 00000100:00100000:0.0:1787508847.292982:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480276736 00000100:00100000:0.0:1787508847.292985:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480276736 00000100:00100000:0.0:1787508847.293004:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480276352 00000100:00100000:0.0:1787508847.293007:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480276352 00000100:00100000:0.0:1787508847.293018:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480276608 00000100:00100000:0.0:1787508847.293021:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480276608 00000100:00100000:0.0:1787508847.293032:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480276480 00000100:00100000:0.0:1787508847.293035:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480276480 00000100:00100000:0.0:1787508847.293048:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3296 00000100:00100000:0.0:1787508847.293057:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480275712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.293111:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480275712:12345-0@lo:400:kworker.0 Request processed in 55us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508847.293118:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3296 00000100:00100000:0.0:1787508847.293135:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3297 00000100:00100000:0.0:1787508847.293141:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480276224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.293166:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480276224:12345-0@lo:400:kworker.0 Request processed in 25us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508847.293172:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3297 00000100:00100000:0.0:1787508847.293182:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3298 00000100:00100000:0.0:1787508847.293187:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480276736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.293211:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480276736:12345-0@lo:400:kworker.0 Request processed in 24us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508847.293217:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3298 00000100:00100000:0.0:1787508847.293227:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3299 00000100:00100000:0.0:1787508847.293232:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874324480276352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.293257:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874324480276352:12345-0@lo:400:kworker.0 Request processed in 25us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508847.293262:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3299 00000100:00100000:0.0:1787508847.293281:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3300 00000100:00100000:0.0:1787508847.293287:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480276608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.293317:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480276608:12345-0@lo:400:kworker.0 Request processed in 30us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508847.293323:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3300 00000100:00100000:0.0:1787508847.293338:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3301 00000100:00100000:0.0:1787508847.293345:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874324480276480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.293370:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874324480276480:12345-0@lo:400:kworker.0 Request processed in 26us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508847.293376:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3301 00000100:00100000:0.0:1787508847.293395:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480275328 00000100:00100000:0.0:1787508847.293399:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480275328 00000100:00100000:0.0:1787508847.293420:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480275840 00000100:00100000:0.0:1787508847.293435:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480275840 00000100:00100000:0.0:1787508847.293456:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30032 00000100:00100000:0.0:1787508847.293462:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480275328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.293495:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480275328:12345-0@lo:400:kworker.0 Request processed in 33us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508847.293500:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30032 00000100:00100000:0.0:1787508847.293512:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30033 00000100:00100000:0.0:1787508847.293517:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480275840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.293544:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480275840:12345-0@lo:400:kworker.0 Request processed in 27us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508847.293549:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30033 00000100:00100000:0.0:1787508847.293569:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480275584 00000100:00100000:0.0:1787508847.293573:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480275584 00000100:00100000:0.0:1787508847.293593:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480276096 00000100:00100000:0.0:1787508847.293595:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480276096 00000100:00100000:0.0:1787508847.293608:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480275456 00000100:00100000:0.0:1787508847.293611:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480275456 00000100:00100000:0.0:1787508847.293627:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480275968 00000100:00100000:0.0:1787508847.293629:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480275968 00000100:00100000:0.0:1787508847.293645:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2617 00000100:00100000:0.0:1787508847.293652:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480275584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.293682:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480275584:12345-0@lo:400:kworker.0 Request processed in 31us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508847.293689:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2617 00000100:00100000:0.0:1787508847.293701:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2618 00000100:00100000:0.0:1787508847.293706:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480276096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.293732:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480276096:12345-0@lo:400:kworker.0 Request processed in 26us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508847.293737:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2618 00000100:00100000:0.0:1787508847.293748:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2619 00000100:00100000:0.0:1787508847.293755:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480275456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.293781:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480275456:12345-0@lo:400:kworker.0 Request processed in 27us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508847.293786:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2619 00000100:00100000:0.0:1787508847.293796:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2620 00000100:00100000:0.0:1787508847.293802:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480275968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.293826:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed435880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480275968:12345-0@lo:400:kworker.0 Request processed in 25us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508847.293831:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2620 00000100:00100000:0.0:1787508847.293875:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4c87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480275456:0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.293886:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4c87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480275968:0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.293896:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874324480276480:0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.293904:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4c84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480275584:0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.293913:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4c87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480276096:0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.293922:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480276608:0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.293983:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4c84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480275328:0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.293994:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4c86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480275840:0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.294003:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874324480276352:0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.294012:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480275712:0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.294022:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480276224:0@lo:400:kworker.0 00000100:00100000:0.0:1787508847.294032:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480276736:0@lo:400:kworker.0 00000100:00100000:3.0:1787508847.294461:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480275200 00000100:00100000:3.0:1787508847.294467:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480275200 00000100:00100000:3.0:1787508847.294508:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:3.0:1787508847.294516:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d980a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480275200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508847.294574:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d980a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480275200:12345-0@lo:400:kworker.0 Request processed in 59us (2257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508847.294580:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:3.0:1787508847.294621:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4c85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480275200:0@lo:400:kworker.0 00000100:00080000:2.0:1787508847.295213:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787508847.295219:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787508847.295221:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787508847.510437:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508847.510549:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509706752 00000100:00100000:3.0:1787508847.510562:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509706752 00000100:00100000:3.0:1787508847.510651:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15103 00000100:00100000:3.0:1787508847.510664:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2402:x1874324509706752:12345-192.168.201.30@tcp:101:statx.0 00010000:00010000:3.0:1787508847.510689:0:225841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508847.510714:0:225841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091c6a84b/0xb126349c40f365dd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1533:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaee66 expref: -99 pid: 225841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787508847.510746:0:225841:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1533:0x0] initial LVB size: 1024, mtime: 0x6a8b386f, atime: 0x0, ctime: 0x6a8b386f, blocks: 0x8 00010000:00010000:3.0:1787508847.510773:0:225841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1533:0x0].0x0 since=13818s v=(0 0) 00010000:00010000:3.0:1787508847.510779:0:225841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1533:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787508847.510791:0:225841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091c6a84b/0xb126349c40f365dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1533:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee66 expref: 8 pid: 225841 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508847.510812:0:225841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000091c6a84b/0xb126349c40f365dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1533:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee66 expref: 8 pid: 225841 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508847.510829:0:225841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ee00, rc 0) 00000100:00100000:3.0:1787508847.510915:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2402:x1874324509706752:12345-192.168.201.30@tcp:101:statx.0 Request processed in 253us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508847.510923:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15103 00000100:00100000:0.0:1787508847.636318:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508847.636602:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509706880 00000100:00100000:2.0:1787508847.636616:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509706880 00000100:00100000:2.0:1787508847.636700:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9847 00000100:00100000:2.0:1787508847.636713:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:288263:x1874324509706880:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508847.636735:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508847.636789:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091c6a84b/0xb126349c40f365dd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1533:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee66 expref: 8 pid: 225841 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508847.636832:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508847.636910:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:288263:x1874324509706880:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 199us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508847.636919:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9847 00000100:00100000:0.0:1787508847.802276:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787508847.802307:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480276864:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787508847.802856:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508847.802980:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480276864 00000100:00100000:1.0:1787508847.802991:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480276864 00000100:00100000:1.0:1787508847.803062:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1807 00000100:00100000:1.0:1787508847.803074:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480276864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787508847.803103:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 72740544 pending 28672 free 3908714496 avail 3677192192 00000100:00100000:1.0:1787508847.803179:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480276864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508847.803187:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1807 00000100:00100000:1.0:1787508847.803241:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480276864:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787508847.803364:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480276992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787508847.803431:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508847.803618:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480276992 00000100:00100000:1.0:1787508847.803623:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480276992 00000100:00100000:1.0:1787508847.803656:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1808 00000100:00100000:1.0:1787508847.803668:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480276992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787508847.803680:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 72740544 pending 28672 free 3908714496 avail 3677192192 00000100:00100000:1.0:1787508847.803713:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480276992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508847.803723:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1808 00000100:00100000:1.0:1787508847.803753:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480276992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787508847.804298:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508847.804548:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509707008 00000100:00100000:3.0:1787508847.804554:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509707008 00000100:00100000:3.0:1787508847.804596:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15104 00000100:00100000:3.0:1787508847.804604:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2401:x1874324509707008:12345-192.168.201.30@tcp:101:statx.0 00010000:00010000:3.0:1787508847.804617:0:225837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508847.804641:0:225837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc4d2917/0xb126349c40f365e4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1533:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaee6d expref: -99 pid: 225837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787508847.804672:0:225837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1533:0x0] initial LVB size: 1024, mtime: 0x6a8b386f, atime: 0x0, ctime: 0x6a8b386f, blocks: 0x8 00010000:00010000:3.0:1787508847.804691:0:225837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1533:0x0].0x0 since=13818s v=(0 0) 00010000:00010000:3.0:1787508847.804696:0:225837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1533:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787508847.804708:0:225837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc4d2917/0xb126349c40f365e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1533:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee6d expref: 8 pid: 225837 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508847.804726:0:225837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cc4d2917/0xb126349c40f365e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1533:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee6d expref: 8 pid: 225837 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508847.804741:0:225837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e400, rc 0) 00000100:00100000:3.0:1787508847.804796:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2401:x1874324509707008:12345-192.168.201.30@tcp:101:statx.0 Request processed in 193us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508847.804803:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15104 00000100:00100000:0.0:1787508847.913398:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508847.913617:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509707136 00000100:00100000:3.0:1787508847.913631:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509707136 00000100:00100000:3.0:1787508847.913721:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9848 00000100:00100000:3.0:1787508847.913733:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:288292:x1874324509707136:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508847.913756:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508847.913810:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc4d2917/0xb126349c40f365e4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1533:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee6d expref: 8 pid: 225837 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508847.913844:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508847.913926:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:288292:x1874324509707136:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 193us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508847.913934:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9848 00000100:00100000:0.0:1787508848.032783:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508848.033191:0:225833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509707264 00000100:00100000:2.0:1787508848.033205:0:225833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509707264 00000100:00100000:2.0:1787508848.033284:0:225833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15105 00000100:00100000:2.0:1787508848.033296:0:225833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2403:x1874324509707264:12345-192.168.201.30@tcp:101:statx.0 00010000:00010000:2.0:1787508848.033319:0:225833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508848.033348:0:225833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec6f75dc/0xb126349c40f365eb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1533:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaee74 expref: -99 pid: 225833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787508848.033405:0:225833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1533:0x0] initial LVB size: 1024, mtime: 0x6a8b386f, atime: 0x0, ctime: 0x6a8b386f, blocks: 0x8 00010000:00010000:2.0:1787508848.033465:0:225833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1533:0x0].0x0 since=13819s v=(0 0) 00010000:00010000:2.0:1787508848.033471:0:225833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1533:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787508848.033483:0:225833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec6f75dc/0xb126349c40f365eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1533:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee74 expref: 8 pid: 225833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508848.033506:0:225833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ec6f75dc/0xb126349c40f365eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1533:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee74 expref: 8 pid: 225833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508848.033529:0:225833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aba00, rc 0) 00000100:00100000:2.0:1787508848.033613:0:225833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2403:x1874324509707264:12345-192.168.201.30@tcp:101:statx.0 Request processed in 318us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508848.033621:0:225833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15105 00010000:00010000:1.0:1787508848.186394:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508848.826980:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787508848.827014:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480277120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787508848.827240:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508848.827714:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480277120 00000100:00100000:0.0:1787508848.827726:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480277120 00000100:00100000:0.0:1787508848.827801:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30034 00000100:00100000:0.0:1787508848.827813:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480277120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787508848.827863:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440636928 avail 1294397440 00000100:00100000:0.0:1787508848.827962:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480277120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508848.827971:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30034 00000100:00100000:2.0:1787508848.828244:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480277120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787508848.828649:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787508848.828665:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480277248:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787508848.828714:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508848.828829:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480277248 00000100:00100000:0.0:1787508848.828835:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480277248 00000100:00100000:0.0:1787508848.828871:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30035 00000100:00100000:0.0:1787508848.828879:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480277248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787508848.828906:0:202232:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442709504 avail 1296470016 00000100:00100000:0.0:1787508848.828964:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480277248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508848.828971:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30035 00000100:00100000:2.0:1787508848.831925:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480277248:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787508849.213990:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787508850.235142:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508850.793791:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508850.793844:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508850.793975:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508850.794009:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508850.794056:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509707904 00000100:00100000:3.0:1787508850.794066:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509707904 00000100:00100000:3.0:1787508850.794143:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2621 00000100:00100000:3.0:1787508850.794156:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2402:x1874324509707904:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508850.794230:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2402:x1874324509707904:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 78us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508850.794238:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2621 00000100:00080000:3.0:1787508850.794268:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508850.795351:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509707392 00000100:00100000:1.0:1787508850.795361:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509707392 00000100:00100000:1.0:1787508850.795425:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1070 00000100:00100000:1.0:1787508850.795434:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509707392:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508850.795481:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509707392:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 49us (1713us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508850.795488:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1070 00000100:00100000:2.0:1787508850.806717:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508850.806757:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508850.806826:0:226134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509708416 00000100:00100000:3.0:1787508850.806837:0:226134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509708416 00000100:00100000:3.0:1787508850.806906:0:226134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2622 00000100:00100000:3.0:1787508850.806917:0:226134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509708416:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508850.807009:0:226134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509708416:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 94us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508850.807017:0:226134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2622 00000100:00080000:3.0:1787508850.807159:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508850.814029:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509707648 00000100:00100000:0.0:1787508850.814046:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509707648 00000100:00100000:0.0:1787508850.814141:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509708160 00000100:00100000:0.0:1787508850.814145:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509708160 00000100:00100000:0.0:1787508850.814175:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3302 00000100:00100000:0.0:1787508850.814185:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2402:x1874324509707648:12345-192.168.201.30@tcp:400:kworker.0 00000100:00080000:3.0:1787508850.814517:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787508850.814556:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3303 00000100:00100000:3.0:1787508850.814566:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2402:x1874324509708160:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508850.814600:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2402:x1874324509708160:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 37us (20589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508850.814607:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3303 00000100:00100000:0.0:1787508850.814669:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2402:x1874324509707648:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 485us (20824us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508850.814677:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3302 00000100:00100000:2.0:1787508850.818101:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508850.818271:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509707520 00000100:00100000:3.0:1787508850.818293:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509707520 00000100:00100000:3.0:1787508850.818382:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3304 00000100:00100000:3.0:1787508850.818393:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+28:2402:x1874324509707520:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508850.818466:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+28:2402:x1874324509707520:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 76us (11709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508850.818473:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3304 00000100:00100000:2.0:1787508850.820134:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508850.820178:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508850.820207:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509708032 00000100:00100000:2.0:1787508850.820216:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509708032 00000100:00100000:2.0:1787508850.820259:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3305 00000100:00100000:2.0:1787508850.820268:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2402:x1874324509708032:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508850.820338:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2402:x1874324509708032:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 71us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508850.820346:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3305 00000100:00100000:2.0:1787508850.820376:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509707776 00000100:00100000:2.0:1787508850.820380:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509707776 00000100:00100000:2.0:1787508850.820402:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509708288 00000100:00100000:2.0:1787508850.820404:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509708288 00000100:00100000:2.0:1787508850.820421:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2623 00000100:00100000:2.0:1787508850.820427:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2402:x1874324509707776:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508850.820451:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2402:x1874324509707776:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (2360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508850.820456:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2623 00000100:00100000:2.0:1787508850.820465:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2624 00000100:00100000:2.0:1787508850.820470:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509708288:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508850.820488:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509708288:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 18us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508850.820493:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2624 00000100:00080000:0.0:1787508850.823071:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787508850.823083:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787508851.261227:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508851.387836:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4c84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480277376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787508851.387912:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508851.388659:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787508851.388674:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d1cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480277504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787508851.388713:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508851.388747:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480277376 00000100:00100000:2.0:1787508851.388754:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480277376 00000100:00100000:2.0:1787508851.388809:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480277504 00000100:00100000:2.0:1787508851.388812:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480277504 00000100:00100000:2.0:1787508851.388831:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1809 00000100:00100000:2.0:1787508851.388839:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480277376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787508851.388874:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 165208640 pending 0 free 3881938944 avail 3650416640 00000100:00100000:2.0:1787508851.388920:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480277376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508851.388927:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1809 00000100:00100000:2.0:1787508851.388970:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1810 00000100:00100000:2.0:1787508851.388977:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480277504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787508851.388987:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 165208640 pending 0 free 3881938944 avail 3650416640 00000100:00100000:2.0:1787508851.389015:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480277504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508851.389021:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1810 00000100:00080000:2.0:1787508851.389035:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787508851.389069:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d1cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480277504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787508851.389097:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4c84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480277376:0@lo:13:osp-pre-1-1.0 00000001:00080000:1.0:1787508851.916382:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944285 is committed 00010000:00010000:2.0:1787508851.916601:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36551 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508851.916626:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36551 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508851.916636:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36551 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508851.916644:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508851.916651:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36551 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508851.916665:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36551 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508851.916696:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x375764fc (ffff9090cc088500) 00010000:00010000:2.0:1787508851.916700:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508851.916709:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36551 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508851.916716:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36551 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x375764fc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508852.283444:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508852.410386:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480277888:0@lo:400:kworker.0 00000100:00100000:1.0:1787508852.410504:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508852.410577:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480278400:0@lo:400:kworker.0 00000100:00100000:2.0:1787508852.410869:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79de3f65-4bad-42d0-a46f-842a654b33a0:3617:1874324480277632:0@lo:400:kworker.0 00000100:00100000:2.0:1787508852.410913:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508852.410979:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874324480278144:0@lo:400:kworker.0 00000100:00100000:2.0:1787508852.411019:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508852.411048:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480278656:0@lo:400:kworker.0 00000100:00100000:2.0:1787508852.411072:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508852.411089:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480279168:0@lo:400:kworker.0 00000100:00100000:2.0:1787508852.411112:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508852.411136:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787508852.411142:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cdea1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480278016:0@lo:400:kworker.0 00000100:00100000:2.0:1787508852.411177:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480277632 00000100:00100000:2.0:1787508852.411185:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480277632 00000100:00100000:2.0:1787508852.411241:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:2.0:1787508852.411251:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3617:x1874324480277632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508852.411310:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3617:x1874324480277632:12345-0@lo:400:kworker.0 Request processed in 60us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508852.411318:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00100000:3.0:1787508852.411452:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480278144 00000100:00100000:3.0:1787508852.411457:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480278144 00000100:00100000:3.0:1787508852.411488:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480278656 00000100:00100000:3.0:1787508852.411491:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480278656 00000100:00100000:3.0:1787508852.411508:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480279168 00000100:00100000:3.0:1787508852.411510:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480279168 00000100:00100000:3.0:1787508852.411540:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3306 00000100:00100000:3.0:1787508852.411547:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874324480278144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508852.411590:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874324480278144:12345-0@lo:400:kworker.0 Request processed in 45us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508852.411596:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3306 00000100:00100000:3.0:1787508852.411684:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3307 00000100:00100000:3.0:1787508852.411690:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480278656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508852.411717:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480278656:12345-0@lo:400:kworker.0 Request processed in 28us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508852.411723:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3307 00000100:00100000:3.0:1787508852.411733:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3308 00000100:00100000:3.0:1787508852.411738:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480279168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508852.411760:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480279168:12345-0@lo:400:kworker.0 Request processed in 22us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508852.411765:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3308 00000100:00080000:3.0:1787508852.411791:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787508852.411863:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480277760:0@lo:400:kworker.0 00000100:00100000:0.0:1787508852.411902:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508852.411963:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c9680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480278272:0@lo:400:kworker.0 00000100:00100000:0.0:1787508852.411988:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508852.412009:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874324480278784:0@lo:400:kworker.0 00000100:00100000:0.0:1787508852.412032:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508852.412068:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480278784 00000100:00100000:0.0:1787508852.412072:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480278784 00000100:00100000:0.0:1787508852.412103:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3309 00000100:00100000:0.0:1787508852.412109:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874324480278784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508852.412145:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1874324480278784:12345-0@lo:400:kworker.0 Request processed in 37us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508852.412152:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3309 00000100:00100000:0.0:1787508852.412173:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480277760 00000100:00100000:0.0:1787508852.412177:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480277760 00000100:00100000:0.0:1787508852.412203:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480278272 00000100:00100000:0.0:1787508852.412205:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480278272 00000100:00100000:0.0:1787508852.412224:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30036 00000100:00100000:0.0:1787508852.412230:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480277760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508852.412263:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480277760:12345-0@lo:400:kworker.0 Request processed in 34us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508852.412269:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30036 00000100:00100000:0.0:1787508852.412280:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30037 00000100:00100000:0.0:1787508852.412286:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480278272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508852.412313:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480278272:12345-0@lo:400:kworker.0 Request processed in 27us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508852.412319:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30037 00000100:00100000:0.0:1787508852.412387:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480277760:0@lo:400:kworker.0 00000100:00100000:0.0:1787508852.412398:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480278272:0@lo:400:kworker.0 00000100:00100000:0.0:1787508852.412408:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3618:1874324480278784:0@lo:400:kworker.0 00000100:00080000:3.0:1787508852.412514:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787508852.413042:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508852.413088:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480278912:0@lo:400:kworker.0 00000100:00100000:1.0:1787508852.413126:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508852.413167:0:225835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480277888 00000100:00100000:1.0:1787508852.413173:0:225835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480277888 00000100:00100000:1.0:1787508852.413213:0:225835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480278400 00000100:00100000:1.0:1787508852.413217:0:225835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480278400 00000100:00100000:1.0:1787508852.413240:0:225835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2625 00000100:00100000:1.0:1787508852.413247:0:225835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480277888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508852.413290:0:225835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480277888:12345-0@lo:400:kworker.0 Request processed in 43us (2786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508852.413297:0:225835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2625 00000100:00100000:1.0:1787508852.413532:0:225835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2626 00000100:00100000:1.0:1787508852.413539:0:225835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480278400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508852.413571:0:225835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480278400:12345-0@lo:400:kworker.0 Request processed in 33us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508852.413578:0:225835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2626 00000100:00100000:1.0:1787508852.413598:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480278912 00000100:00080000:3.0:1787508852.413926:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787508852.413958:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508852.413999:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480278528:0@lo:400:kworker.0 00000100:00100000:3.0:1787508852.414043:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508852.414065:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091dabbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480279040:0@lo:400:kworker.0 00000100:00100000:3.0:1787508852.414090:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508852.414123:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79de3f65-4bad-42d0-a46f-842a654b33a0:3617:1874324480277632:0@lo:400:kworker.0 00000100:00100000:3.0:1787508852.414140:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c9680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874324480278144:0@lo:400:kworker.0 00000100:00100000:3.0:1787508852.414152:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480278656:0@lo:400:kworker.0 00000100:00100000:3.0:1787508852.414167:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480279168:0@lo:400:kworker.0 00000100:00100000:3.0:1787508852.414206:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480279040 00000100:00100000:3.0:1787508852.414211:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480279040 00000100:00100000:3.0:1787508852.414253:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3310 00000100:00100000:3.0:1787508852.414260:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480279040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508852.414300:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480279040:12345-0@lo:400:kworker.0 Request processed in 40us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508852.414311:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3310 00000100:00080000:3.0:1787508852.414348:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787508852.414368:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480279040:0@lo:400:kworker.0 00000100:00100000:0.0:1787508852.414475:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480278016 00000100:00100000:0.0:1787508852.414480:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480278016 00000100:00100000:0.0:1787508852.414512:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480278528 00000100:00100000:0.0:1787508852.414515:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480278528 00000100:00100000:0.0:1787508852.414538:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2627 00000100:00100000:0.0:1787508852.414545:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480278016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508852.414590:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480278016:12345-0@lo:400:kworker.0 Request processed in 45us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508852.414596:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2627 00000100:00100000:0.0:1787508852.414691:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2628 00000100:00100000:0.0:1787508852.414697:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480278528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508852.414724:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480278528:12345-0@lo:400:kworker.0 Request processed in 27us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508852.414729:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2628 00000100:00100000:3.0:1787508852.414852:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cdea1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480278016:0@lo:400:kworker.0 00000100:00100000:3.0:1787508852.414863:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480278528:0@lo:400:kworker.0 00000100:00100000:1.0:1787508852.414927:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480278912 00000100:00100000:1.0:1787508852.416711:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3311 00000100:00100000:1.0:1787508852.416728:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480278912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508852.416828:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480278912:12345-0@lo:400:kworker.0 Request processed in 104us (3700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508852.416836:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3311 00000100:00100000:1.0:1787508852.416910:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480277888:0@lo:400:kworker.0 00000100:00100000:1.0:1787508852.416925:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480278400:0@lo:400:kworker.0 00000100:00100000:1.0:1787508852.416936:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091dabbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480278912:0@lo:400:kworker.0 00000100:00080000:3.0:1787508852.417294:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787508852.923611:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787508852.923646:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480279296:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787508852.923741:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508852.923850:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480279296 00000100:00100000:3.0:1787508852.923862:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480279296 00000100:00100000:3.0:1787508852.923934:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1811 00000100:00100000:3.0:1787508852.923964:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480279296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787508852.924005:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 72740544 pending 28672 free 3908710400 avail 3677188096 00000100:00100000:3.0:1787508852.924065:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480279296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508852.924075:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1811 00000100:00100000:3.0:1787508852.924135:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480279296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787508852.925930:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787508852.925981:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480279424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787508852.926055:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508852.926208:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480279424 00000100:00100000:0.0:1787508852.926218:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480279424 00000100:00100000:0.0:1787508852.926278:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1812 00000100:00100000:0.0:1787508852.926289:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d1cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480279424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787508852.926391:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 72740544 pending 28672 free 3908710400 avail 3677188096 00000100:00100000:0.0:1787508852.926459:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d1cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480279424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 171us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508852.926467:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1812 00000100:00100000:2.0:1787508852.926672:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480279424:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1787508852.941641:0:203722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589941260 is committed 00010000:00010000:1.0:1787508853.307934:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508853.953875:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480279552:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787508853.956064:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508853.956135:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787508853.956151:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480279680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787508853.956213:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508853.956271:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480279552 00000100:00100000:2.0:1787508853.956282:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480279552 00000100:00100000:2.0:1787508853.956379:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480279680 00000100:00100000:2.0:1787508853.956383:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480279680 00000100:00100000:1.0:1787508853.958211:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30038 00000100:00100000:1.0:1787508853.958239:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480279552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787508853.958301:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442709504 avail 1296470016 00000100:00100000:2.0:1787508853.959634:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30039 00000100:00100000:2.0:1787508853.959643:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480279680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787508853.959672:0:202232:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440636928 avail 1294397440 00000100:00100000:2.0:1787508853.960754:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480279680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1105us (4533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508853.960764:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30039 00000100:00100000:2.0:1787508853.960833:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480279680:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787508853.973722:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480279552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 15477us (17650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508853.973743:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30038 00000100:00100000:3.0:1787508853.974127:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480279552:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787508854.335443:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787508855.354817:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508855.940457:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508855.940504:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508855.940617:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508855.940713:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509708672 00000100:00100000:1.0:1787508855.940735:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509708672 00000100:00100000:1.0:1787508855.940801:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509708800 00000100:00100000:1.0:1787508855.940804:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509708800 00000100:00100000:1.0:1787508855.940837:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3312 00000100:00100000:1.0:1787508855.940848:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+21:2402:x1874324509708672:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508855.940921:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+21:2402:x1874324509708672:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 76us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508855.940929:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3312 00000100:00100000:1.0:1787508855.940977:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3313 00000100:00100000:1.0:1787508855.940984:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2403:x1874324509708800:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508855.941008:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2403:x1874324509708800:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508855.941014:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3313 00000100:00080000:0.0:1787508855.941526:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508855.941532:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787508855.941592:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509708544 00000100:00100000:3.0:1787508855.941608:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509708544 00000100:00100000:3.0:1787508855.941653:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1072 00000100:00100000:3.0:1787508855.941662:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d980a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509708544:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508855.941707:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d980a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509708544:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 47us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508855.941722:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1072 00000100:00100000:0.0:1787508855.962703:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508855.962762:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508855.962806:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508855.963045:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509709184 00000100:00100000:1.0:1787508855.963061:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509709184 00000100:00100000:1.0:1787508855.963164:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3314 00000100:00100000:1.0:1787508855.963177:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2402:x1874324509709184:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508855.963285:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2402:x1874324509709184:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 102us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508855.963294:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3314 00000100:00080000:0.0:1787508855.964733:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508855.964928:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509708928 00000100:00100000:2.0:1787508855.964963:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509708928 00000100:00100000:2.0:1787508855.965040:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509709056 00000100:00100000:2.0:1787508855.965044:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509709056 00000100:00100000:2.0:1787508855.965085:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2629 00000100:00100000:2.0:1787508855.965095:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509708928:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508855.965158:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509708928:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 65us (2471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508855.965165:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2629 00000100:00100000:2.0:1787508855.965181:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2630 00000100:00100000:2.0:1787508855.965187:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2403:x1874324509709056:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508855.965212:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2403:x1874324509709056:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (2450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508855.965218:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2630 00000100:00080000:0.0:1787508855.966362:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787508855.966370:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787508855.968062:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508855.968119:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508855.968146:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508855.968998:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509709312 00000100:00100000:3.0:1787508855.969009:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509709312 00000100:00100000:3.0:1787508855.969075:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3315 00000100:00100000:3.0:1787508855.969085:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2403:x1874324509709312:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508855.969168:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2403:x1874324509709312:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 84us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508855.969176:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3315 00000100:00100000:3.0:1787508855.969205:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509709440 00000100:00100000:3.0:1787508855.969209:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509709440 00000100:00080000:0.0:1787508855.969343:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787508855.969348:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787508855.970339:0:225833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509709568 00000100:00100000:1.0:1787508855.970357:0:225833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509709568 00000100:00100000:1.0:1787508855.970413:0:225833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2631 00000100:00100000:1.0:1787508855.970421:0:225833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509709568:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508855.970466:0:225833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509709568:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 46us (2319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508855.970472:0:225833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2631 00000100:00080000:0.0:1787508855.970775:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508855.975911:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2632 00000100:00100000:3.0:1787508855.975933:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509709440:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508855.976034:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509709440:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 111us (7913us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508855.976042:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2632 00010000:00010000:0.0:1787508856.379736:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508856.506787:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480279808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787508856.506880:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508856.507079:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480279808 00000100:00100000:2.0:1787508856.507088:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480279808 00000100:00100000:2.0:1787508856.507149:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1813 00000100:00100000:2.0:1787508856.507159:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480279808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787508856.507199:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 165208640 pending 0 free 3881938944 avail 3650416640 00000100:00100000:2.0:1787508856.507248:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480279808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508856.507255:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1813 00000100:00080000:3.0:1787508856.507694:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508856.507733:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480279808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787508856.507961:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787508856.507971:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480279936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787508856.508005:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508856.508581:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480279936 00000100:00100000:2.0:1787508856.508590:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480279936 00000100:00100000:2.0:1787508856.508647:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1814 00000100:00100000:2.0:1787508856.508654:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480279936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787508856.508669:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 165208640 pending 0 free 3881938944 avail 3650416640 00000100:00100000:2.0:1787508856.508720:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480279936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508856.508729:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1814 00000100:00080000:3.0:1787508856.508926:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508856.508978:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480279936:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787508857.414685:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508857.531859:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480280320:0@lo:400:kworker.0 00000100:00100000:2.0:1787508857.531982:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508857.532045:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480280832:0@lo:400:kworker.0 00000100:00100000:2.0:1787508857.532070:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508857.532095:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874324480281344:0@lo:400:kworker.0 00000100:00100000:2.0:1787508857.532123:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508857.532154:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787508857.532173:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480280448:0@lo:400:kworker.0 00000100:00100000:2.0:1787508857.532198:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508857.532228:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480280960:0@lo:400:kworker.0 00000100:00100000:2.0:1787508857.532262:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508857.532281:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480281472:0@lo:400:kworker.0 00000100:00100000:2.0:1787508857.532302:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508857.532343:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480280320 00000100:00100000:2.0:1787508857.532354:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480280320 00000100:00100000:2.0:1787508857.532419:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480280832 00000100:00100000:2.0:1787508857.532423:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480280832 00000100:00100000:2.0:1787508857.532564:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480280448 00000100:00100000:2.0:1787508857.532568:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480280448 00000100:00100000:2.0:1787508857.532588:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480280960 00000100:00100000:2.0:1787508857.532591:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480280960 00000100:00100000:2.0:1787508857.532611:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2633 00000100:00100000:2.0:1787508857.532622:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480280320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508857.532689:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc620a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480280320:12345-0@lo:400:kworker.0 Request processed in 69us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508857.532700:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2633 00000100:00100000:2.0:1787508857.532718:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2634 00000100:00100000:2.0:1787508857.532723:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480280832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508857.532747:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480280832:12345-0@lo:400:kworker.0 Request processed in 25us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508857.532752:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2634 00000100:00100000:2.0:1787508857.532761:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2635 00000100:00100000:2.0:1787508857.532766:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480280448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508857.532785:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480280448:12345-0@lo:400:kworker.0 Request processed in 20us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508857.532791:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2635 00000100:00100000:2.0:1787508857.532798:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2636 00000100:00100000:2.0:1787508857.532803:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480280960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508857.532821:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480280960:12345-0@lo:400:kworker.0 Request processed in 18us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508857.532826:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2636 00000100:00100000:2.0:1787508857.532848:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480281344 00000100:00100000:2.0:1787508857.532851:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480281344 00000100:00100000:2.0:1787508857.532875:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480281472 00000100:00100000:2.0:1787508857.532878:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480281472 00000100:00100000:2.0:1787508857.532895:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3316 00000100:00100000:2.0:1787508857.532901:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874324480281344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508857.532927:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1874324480281344:12345-0@lo:400:kworker.0 Request processed in 26us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508857.532933:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3316 00000100:00100000:2.0:1787508857.532971:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3317 00000100:00100000:2.0:1787508857.532977:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480281472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508857.533002:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480281472:12345-0@lo:400:kworker.0 Request processed in 26us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508857.533008:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3317 00000100:00080000:2.0:1787508857.533035:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787508857.533038:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787508857.533041:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787508857.533086:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480280448:0@lo:400:kworker.0 00000100:00100000:2.0:1787508857.533095:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480280960:0@lo:400:kworker.0 00000100:00100000:2.0:1787508857.533103:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480281472:0@lo:400:kworker.0 00000100:00100000:2.0:1787508857.533112:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480280320:0@lo:400:kworker.0 00000100:00100000:2.0:1787508857.533120:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480280832:0@lo:400:kworker.0 00000100:00100000:2.0:1787508857.533128:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3618:1874324480281344:0@lo:400:kworker.0 00000100:00100000:1.0:1787508857.533418:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480280192:0@lo:400:kworker.0 00000100:00100000:1.0:1787508857.533465:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508857.533496:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480280704:0@lo:400:kworker.0 00000100:00100000:1.0:1787508857.533516:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508857.533529:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874324480281216:0@lo:400:kworker.0 00000100:00100000:1.0:1787508857.533547:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508857.533566:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1787508857.533572:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79de3f65-4bad-42d0-a46f-842a654b33a0:3617:1874324480280064:0@lo:400:kworker.0 00000100:00100000:1.0:1787508857.533598:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508857.533621:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874324480280576:0@lo:400:kworker.0 00000100:00100000:1.0:1787508857.533638:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508857.533653:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480281088:0@lo:400:kworker.0 00000100:00100000:1.0:1787508857.533671:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508857.533684:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480281600:0@lo:400:kworker.0 00000100:00100000:1.0:1787508857.533700:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508857.533721:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480281216 00000100:00100000:1.0:1787508857.533725:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480281216 00000100:00100000:1.0:1787508857.533752:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480280576 00000100:00100000:1.0:1787508857.533755:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480280576 00000100:00100000:1.0:1787508857.533767:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480281088 00000100:00100000:1.0:1787508857.533769:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480281088 00000100:00100000:1.0:1787508857.533779:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480281600 00000100:00100000:1.0:1787508857.533781:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480281600 00000100:00100000:1.0:1787508857.533794:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3318 00000100:00100000:1.0:1787508857.533800:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874324480281216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508857.533833:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874324480281216:12345-0@lo:400:kworker.0 Request processed in 33us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508857.533838:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3318 00000100:00100000:1.0:1787508857.533849:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3319 00000100:00100000:1.0:1787508857.533855:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874324480280576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508857.533875:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874324480280576:12345-0@lo:400:kworker.0 Request processed in 21us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508857.533880:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3319 00000100:00100000:1.0:1787508857.533888:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3320 00000100:00100000:1.0:1787508857.533893:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480281088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508857.533912:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480281088:12345-0@lo:400:kworker.0 Request processed in 19us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508857.533917:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3320 00000100:00100000:1.0:1787508857.533926:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3321 00000100:00100000:1.0:1787508857.533930:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480281600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508857.533973:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480281600:12345-0@lo:400:kworker.0 Request processed in 43us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508857.533982:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3321 00000100:00100000:1.0:1787508857.534012:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874324480280576:0@lo:400:kworker.0 00000100:00100000:1.0:1787508857.534020:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480281088:0@lo:400:kworker.0 00000100:00100000:1.0:1787508857.534028:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480281600:0@lo:400:kworker.0 00000100:00100000:1.0:1787508857.534036:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874324480281216:0@lo:400:kworker.0 00000100:00100000:0.0:1787508857.534268:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480280192 00000100:00100000:0.0:1787508857.534274:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480280192 00000100:00100000:0.0:1787508857.534306:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480280704 00000100:00100000:0.0:1787508857.534309:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480280704 00000100:00100000:0.0:1787508857.534325:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30040 00000100:00100000:0.0:1787508857.534331:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480280192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508857.534377:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480280192:12345-0@lo:400:kworker.0 Request processed in 46us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508857.534383:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30040 00000100:00100000:0.0:1787508857.534405:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30041 00000100:00100000:0.0:1787508857.534411:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480280704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508857.534443:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480280704:12345-0@lo:400:kworker.0 Request processed in 24us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508857.534449:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30041 00000100:00100000:0.0:1787508857.534479:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480280192:0@lo:400:kworker.0 00000100:00100000:0.0:1787508857.534490:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480280704:0@lo:400:kworker.0 00000100:00100000:2.0:1787508857.534840:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480280064 00000100:00100000:2.0:1787508857.534846:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480280064 00000100:00100000:2.0:1787508857.534878:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:2.0:1787508857.534885:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d9809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3617:x1874324480280064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508857.534926:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d9809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3617:x1874324480280064:12345-0@lo:400:kworker.0 Request processed in 42us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508857.534932:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00080000:2.0:1787508857.534994:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787508857.534998:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787508857.535533:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79de3f65-4bad-42d0-a46f-842a654b33a0:3617:1874324480280064:0@lo:400:kworker.0 00000001:02000400:2.0:1787508858.015699:0:236252:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 106c: Verify statx attributes mask ======= 14:14:15 (1787508855) 00000100:00100000:2.0:1787508858.045781:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480281728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787508858.045886:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508858.046282:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480281728 00000100:00100000:0.0:1787508858.046294:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480281728 00000100:00100000:0.0:1787508858.046508:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1815 00000100:00100000:0.0:1787508858.046520:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480281728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787508858.046562:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 72711872 pending 0 free 3908710400 avail 3677188096 00000100:00100000:0.0:1787508858.046624:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480281728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508858.046632:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1815 00000100:00100000:3.0:1787508858.049818:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787508858.049859:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c999e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480281856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787508858.049982:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508858.050045:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480281856 00000100:00100000:3.0:1787508858.050055:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480281856 00000100:00100000:3.0:1787508858.050117:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1816 00000100:00100000:3.0:1787508858.050127:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480281856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787508858.050171:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 72711872 pending 0 free 3908710400 avail 3677188096 00000100:00100000:3.0:1787508858.050225:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480281856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508858.050232:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1816 00000100:00100000:3.0:1787508858.050317:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480281856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787508858.050361:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c999c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480281728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787508858.149720:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508858.152083:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509709824 00000100:00100000:3.0:1787508858.152103:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509709824 00000100:00100000:3.0:1787508858.152443:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94316 00000100:00100000:3.0:1787508858.153074:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+21:348088:x1874324509709824:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:3.0:1787508858.153103:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508858.153107:0:230618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787508858.153145:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f365cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee58 expref: 21 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.156231:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508858.156248:0:230618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508858.156550:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f365f2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaee7b expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.156731:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f365f9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.156748:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f365f9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.156762:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f365f9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.156782:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f36600 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.156789:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f36600 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.156796:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f36600 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787508858.158927:0:230618:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x158f:0x0], index 1: 0 00010000:00010000:3.0:1787508858.159232:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36607 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787508858.160179:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787508858.160690:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36607 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.160704:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36607 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.160773:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f365f9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.160781:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f365f9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.160787:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f365f9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.160795:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f365f9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.160801:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ee00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508858.160807:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f365f9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.160815:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f365f9 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.160830:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508858.160834:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508858.160840:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f365f9 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.160848:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f365f9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508858.160865:0:230618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cfdd2c57 reply state 00000000834f52fd transno 12884944286 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f36600 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.160878:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f36600 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.160883:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdfa31bdb (ffff9090cc088b00) 00010000:00010000:3.0:1787508858.160886:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508858.160889:0:230618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787508858.162087:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f365f2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee7b expref: 23 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.162130:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36607 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee7b expref: 22 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.162140:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090cc088600) 00010000:00010000:3.0:1787508858.162142:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787508858.162146:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e000, rc 0) 00000100:00100000:3.0:1787508858.163341:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+23:348088:x1874324509709824:12345-192.168.201.30@tcp:101:touch.0 Request processed in 10268us (13628us total) trans 12884944286 rc 0/0 00000100:00100000:3.0:1787508858.163353:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94316 00000100:00100000:2.0:1787508858.173677:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508858.174988:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509710080 00000100:00100000:1.0:1787508858.175008:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509710080 00000100:00100000:1.0:1787508858.175086:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94317 00000100:00100000:1.0:1787508858.175097:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+23:348088:x1874324509710080:12345-192.168.201.30@tcp:36:touch.0 00010000:00010000:1.0:1787508858.175191:0:209004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508858.175227:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36607 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee7b expref: 23 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508858.175263:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090cc088600) 00010000:00010000:1.0:1787508858.175624:0:209004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787508858.175706:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f36615 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x127a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508858.175723:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f36615 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508858.175735:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f36615 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508858.175882:0:209004:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3625167 reply state 00000000a66c3acb transno 12884944287 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f36615 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508858.175901:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f36615 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508858.175908:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:1.0:1787508858.175912:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787508858.175915:0:209004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787508858.176551:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+24:348088:x1874324509710080:12345-192.168.201.30@tcp:36:touch.0 Request processed in 1449us (2884us total) trans 12884944287 rc 0/0 00000100:00100000:1.0:1787508858.176562:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94317 00000100:00100000:2.0:1787508858.179966:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508858.180160:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509710208 00000100:00100000:3.0:1787508858.180174:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509710208 00000100:00100000:3.0:1787508858.180249:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94318 00000100:00100000:3.0:1787508858.180261:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+24:348088:x1874324509710208:12345-192.168.201.30@tcp:101:touch.0 00010000:00010000:3.0:1787508858.180307:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508858.180336:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f3661c lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaee82 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.180413:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f3661c lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee82 expref: 25 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.180430:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fe00/0xb126349c40f3661c lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee82 expref: 25 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.180603:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:3.0:1787508858.180608:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787508858.180613:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fe00, rc 0) 00000100:00100000:3.0:1787508858.180686:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+25:348088:x1874324509710208:12345-192.168.201.30@tcp:101:touch.0 Request processed in 426us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508858.180694:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94318 00000100:00100000:2.0:1787508858.203086:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508858.203288:0:203728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509710336 00000100:00100000:3.0:1787508858.203301:0:203728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509710336 00000100:00100000:3.0:1787508858.203406:0:203728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15106 00000100:00100000:3.0:1787508858.203421:0:203728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+5:2400:x1874324509710336:12345-192.168.201.30@tcp:2:touch.0 00000100:00100000:3.0:1787508858.203755:0:203728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2400:x1874324509710336:12345-192.168.201.30@tcp:2:touch.0 Request processed in 337us (682us total) trans 8589940569 rc 0/0 00000100:00100000:3.0:1787508858.203765:0:203728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15106 00000100:00080000:2.0:1787508858.204654:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787508858.213869:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508858.216077:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509710592 00000100:00100000:3.0:1787508858.216096:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509710592 00000100:00100000:3.0:1787508858.216187:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15510 00000100:00100000:3.0:1787508858.216201:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+25:348088:x1874324509710592:12345-192.168.201.30@tcp:35:touch.0 00000100:00100000:3.0:1787508858.216646:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+26:348088:x1874324509710592:12345-192.168.201.30@tcp:35:touch.0 Request processed in 445us (2784us total) trans 12884944288 rc 0/0 00000100:00100000:3.0:1787508858.216656:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15510 00000100:00100000:1.0:1787508858.258862:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508858.258989:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509710720 00000100:00100000:3.0:1787508858.259002:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509710720 00000100:00100000:3.0:1787508858.259076:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94319 00000100:00100000:3.0:1787508858.259088:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffc0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+26:348089:x1874324509710720:12345-192.168.201.30@tcp:101:statx.0 00010000:00010000:3.0:1787508858.259125:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508858.259153:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36623 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaee89 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.259254:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3662a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.259272:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3662a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.259286:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3662a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508858.259347:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:3.0:1787508858.259351:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508858.259377:0:203348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3662a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.259405:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36623 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee89 expref: 28 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.259424:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3662a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee89 expref: 27 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.259433:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508858.259436:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787508858.259440:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ee00, rc 0) 00000100:00100000:3.0:1787508858.261379:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffc0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+27:348089:x1874324509710720:12345-192.168.201.30@tcp:101:statx.0 Request processed in 2278us (2518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508858.261394:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94319 00000100:00100000:2.0:1787508858.270590:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508858.270738:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509710848 00000100:00100000:3.0:1787508858.270751:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509710848 00000100:00100000:3.0:1787508858.270829:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94320 00000100:00100000:3.0:1787508858.270841:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+27:348089:x1874324509710848:12345-192.168.201.30@tcp:101:statx.0 00010000:00010000:3.0:1787508858.270870:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508858.270898:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f36631 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaee90 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.271014:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36638 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.271033:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36638 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.271046:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36638 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.271059:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3663f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.271067:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3663f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.271074:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3663f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.271204:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36646 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.271214:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36646 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.271222:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36646 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508858.271287:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x127a:0x0]: returning size 0 00000004:00200000:3.0:1787508858.271293:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508858.271318:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36646 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.271332:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36646 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.271344:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36638 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.271351:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36638 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.271358:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36638 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.271365:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36638 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.271372:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508858.271378:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36638 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.271387:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36638 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.271401:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508858.271404:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508858.271410:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36638 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.271421:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36638 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.271435:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3663f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.271441:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3663f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.271459:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3663f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.271465:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508858.271468:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3663f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.271474:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3663f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.271483:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdfa31bdb (ffff9090cc088b00) 00010000:00010000:3.0:1787508858.271485:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508858.271489:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3663f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.271494:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3663f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.271523:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f36631 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee90 expref: 29 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.271543:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36646 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee90 expref: 28 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.271551:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:3.0:1787508858.271554:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787508858.271556:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d6245e00, rc 0) 00000100:00100000:3.0:1787508858.271639:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+28:348089:x1874324509710848:12345-192.168.201.30@tcp:101:statx.0 Request processed in 799us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508858.271647:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94320 00000100:00100000:1.0:1787508858.308837:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508858.309025:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509710976 00000100:00100000:3.0:1787508858.309039:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509710976 00000100:00100000:3.0:1787508858.309116:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15107 00000100:00100000:3.0:1787508858.309131:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2401:x1874324509710976:12345-192.168.201.30@tcp:101:chattr.0 00010000:00010000:3.0:1787508858.309156:0:203727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508858.309196:0:203727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e81ff5b5/0xb126349c40f3664d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x158f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaee97 expref: -99 pid: 203727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787508858.309245:0:203727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x158f:0x0] initial LVB size: 0, mtime: 0x6a8b387a, atime: 0x6a8b387a, ctime: 0x6a8b387a, blocks: 0x0 00010000:00010000:3.0:1787508858.309289:0:203727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x158f:0x0].0x0 since=13829s v=(0 0) 00010000:00010000:3.0:1787508858.309295:0:203727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x158f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787508858.309307:0:203727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e81ff5b5/0xb126349c40f3664d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x158f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee97 expref: 7 pid: 203727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.309332:0:203727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e81ff5b5/0xb126349c40f3664d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x158f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee97 expref: 7 pid: 203727 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.309355:0:203727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d6245000, rc 0) 00000100:00100000:3.0:1787508858.309432:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2401:x1874324509710976:12345-192.168.201.30@tcp:101:chattr.0 Request processed in 304us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508858.309441:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15107 00000100:00100000:0.0:1787508858.319716:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508858.319805:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509711232 00000100:00100000:2.0:1787508858.319819:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509711232 00000100:00100000:2.0:1787508858.319899:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94321 00000100:00100000:2.0:1787508858.319911:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+28:348090:x1874324509711232:12345-192.168.201.30@tcp:101:chattr.0 00010000:00010000:2.0:1787508858.319971:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508858.320001:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f36654 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaee9e expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.320159:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3665b lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.320189:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3665b lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.320205:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3665b lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508858.320218:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x127a:0x0]: returning size 0 00010000:00010000:2.0:1787508858.320754:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f36654 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee9e expref: 31 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.320788:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3665b lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee9e expref: 30 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.320800:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:2.0:1787508858.320803:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787508858.320808:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2abc00, rc 0) 00000100:00100000:2.0:1787508858.320898:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+30:348090:x1874324509711232:12345-192.168.201.30@tcp:101:chattr.0 Request processed in 989us (1197us total) trans 12884944289 rc 0/0 00000100:00100000:2.0:1787508858.320907:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94321 00000100:00100000:3.0:1787508858.334783:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508858.334897:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509711360 00000100:00100000:0.0:1787508858.334911:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509711360 00000100:00100000:0.0:1787508858.335017:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15511 00000100:00100000:0.0:1787508858.335030:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fdb9e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+30:348090:x1874324509711360:12345-192.168.201.30@tcp:33:chattr.0 00000100:00100000:0.0:1787508858.335270:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fdb9e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+30:348090:x1874324509711360:12345-192.168.201.30@tcp:33:chattr.0 Request processed in 243us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508858.335279:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15511 00000100:00100000:0.0:1787508858.341204:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508858.341282:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508858.341851:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509711744 00000100:00100000:1.0:1787508858.341868:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509711744 00000100:00100000:1.0:1787508858.341990:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9849 00000100:00100000:1.0:1787508858.342003:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+30:2402:x1874324509711744:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508858.342024:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508858.342055:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3665b lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee9e expref: 30 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508858.342078:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:1.0:1787508858.342084:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508858.342156:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+29:2402:x1874324509711744:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 154us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508858.342178:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9849 00000100:00100000:3.0:1787508858.347855:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509711616 00000100:00100000:3.0:1787508858.347880:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509711616 00000100:00100000:3.0:1787508858.348012:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15512 00000100:00100000:3.0:1787508858.348025:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+29:348090:x1874324509711616:12345-192.168.201.30@tcp:35:chattr.0 00000100:00100000:3.0:1787508858.348375:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+30:348090:x1874324509711616:12345-192.168.201.30@tcp:35:chattr.0 Request processed in 352us (7182us total) trans 12884944290 rc 0/0 00000100:00100000:3.0:1787508858.348384:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15512 00000100:00100000:0.0:1787508858.356082:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508858.356200:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509712000 00000100:00100000:1.0:1787508858.356214:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509712000 00000100:00100000:1.0:1787508858.356303:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94322 00000100:00100000:1.0:1787508858.356314:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+30:348090:x1874324509712000:12345-192.168.201.30@tcp:101:chattr.0 00010000:00010000:1.0:1787508858.356345:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508858.356370:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f36669 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeea5 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508858.356523:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f36670 lrc: 3/1,0 mode: --/CR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508858.356542:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f36670 lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x127a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508858.356555:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f36670 lrc: 3/1,0 mode: CR/CR res: [0x2000013a4:0x127a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508858.356569:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x127a:0x0]: returning size 0 00010000:00010000:1.0:1787508858.356710:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f36669 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeea5 expref: 33 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508858.356729:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a400/0xb126349c40f36670 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x127a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeea5 expref: 32 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508858.356739:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:1.0:1787508858.356742:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787508858.356747:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a400, rc 0) 00000100:00100000:1.0:1787508858.356831:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+32:348090:x1874324509712000:12345-192.168.201.30@tcp:101:chattr.0 Request processed in 518us (763us total) trans 12884944291 rc 0/0 00000100:00100000:1.0:1787508858.356838:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94322 00000100:00100000:1.0:1787508858.371101:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508858.371249:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509712256 00000100:00100000:3.0:1787508858.371262:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509712256 00000100:00100000:3.0:1787508858.371336:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94323 00000100:00100000:3.0:1787508858.371348:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+32:348090:x1874324509712256:12345-192.168.201.30@tcp:36:chattr.0 00010000:00010000:3.0:1787508858.371439:0:203348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508858.371475:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36646 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee90 expref: 32 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.371496:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:3.0:1787508858.371501:0:203348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508858.371710:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3667e lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x127a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.371733:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3667e lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.371746:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3667e lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508858.371928:0:203348:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001bfb7bfe reply state 000000009f1cd653 transno 12884944292 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3667e lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.371969:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3667e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.371976:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:3.0:1787508858.371979:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508858.371982:0:203348:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787508858.372117:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+33:348090:x1874324509712256:12345-192.168.201.30@tcp:36:chattr.0 Request processed in 771us (1031us total) trans 12884944292 rc 0/0 00000100:00100000:3.0:1787508858.372126:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94323 00000100:00100000:2.0:1787508858.383383:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508858.386356:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509712384 00000100:00100000:0.0:1787508858.386376:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509712384 00000100:00100000:0.0:1787508858.386455:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15108 00000100:00100000:0.0:1787508858.386468:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2400:x1874324509712384:12345-192.168.201.30@tcp:2:chattr.0 00002000:00010000:0.0:1787508858.386689:0:203726:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787508858.386693:0:203726:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb mtime from disk: 1787508858 -> 1787508858 00002000:00010000:0.0:1787508858.386696:0:203726:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb atime from disk: 1787508858 -> 1787508858 00002000:00010000:0.0:1787508858.386699:0:203726:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb ctime from disk: 1787508858 -> 1787508858 00002000:00010000:0.0:1787508858.386701:0:203726:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787508858.386792:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2400:x1874324509712384:12345-192.168.201.30@tcp:2:chattr.0 Request processed in 325us (8158us total) trans 8589940570 rc 0/0 00000100:00100000:0.0:1787508858.386803:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15108 00010000:00010000:0.0:1787508858.435842:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508858.468669:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508858.470636:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509712512 00000100:00100000:3.0:1787508858.470655:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509712512 00000100:00100000:3.0:1787508858.470738:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94324 00000100:00100000:3.0:1787508858.470751:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+33:348091:x1874324509712512:12345-192.168.201.30@tcp:101:statx.0 00010000:00010000:3.0:1787508858.470785:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508858.470813:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36685 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeeac expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.470898:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3668c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.470921:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3668c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.470934:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3668c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.472528:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36693 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.472553:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36693 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.472565:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36693 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.472700:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f3669a lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.472711:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f3669a lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.472718:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f3669a lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508858.472779:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x127a:0x0]: returning size 0 00000004:00200000:3.0:1787508858.472784:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508858.472815:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f3669a lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.472828:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f3669a lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.472844:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3668c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.472851:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3668c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.472857:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3668c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.472863:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3668c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.472870:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508858.472874:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3668c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.472883:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3668c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.472897:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508858.472901:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508858.472906:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3668c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.472912:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3668c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.472925:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36693 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.472932:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36693 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.472957:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36693 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.472963:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508858.472966:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36693 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.475439:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36693 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.476164:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdfa31bdb (ffff9090cc088b00) 00010000:00010000:3.0:1787508858.476167:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508858.476175:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36693 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.476184:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36693 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.476600:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36685 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeeac expref: 35 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.476618:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f3669a lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeeac expref: 34 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.476627:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:3.0:1787508858.476630:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787508858.476633:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d6245e00, rc 0) 00000100:00100000:3.0:1787508858.476745:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+34:348091:x1874324509712512:12345-192.168.201.30@tcp:101:statx.0 Request processed in 5994us (8090us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508858.476760:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94324 00000100:00100000:0.0:1787508858.541992:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508858.542168:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509712640 00000100:00100000:3.0:1787508858.542181:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509712640 00000100:00100000:3.0:1787508858.542278:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15513 00000100:00100000:3.0:1787508858.542291:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+34:348092:x1874324509712640:12345-192.168.201.30@tcp:33:chattr.0 00000100:00100000:3.0:1787508858.542539:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+34:348092:x1874324509712640:12345-192.168.201.30@tcp:33:chattr.0 Request processed in 249us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508858.542547:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15513 00000100:00100000:2.0:1787508858.556245:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508858.558138:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509712896 00000100:00100000:0.0:1787508858.558159:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509712896 00000100:00100000:0.0:1787508858.558274:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94325 00000100:00100000:0.0:1787508858.558289:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+34:348092:x1874324509712896:12345-192.168.201.30@tcp:36:chattr.0 00010000:00010000:0.0:1787508858.558376:0:202226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508858.558418:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f3669a lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeeac expref: 34 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.558558:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:0.0:1787508858.558566:0:202226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508858.558602:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f366a1 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x127a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.558619:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f366a1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.558630:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f366a1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787508858.558811:0:202226:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e3cf085 reply state 0000000085ec2fe2 transno 12884944293 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f366a1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.558826:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f366a1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.558834:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:0.0:1787508858.558837:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787508858.558839:0:202226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787508858.561101:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+35:348092:x1874324509712896:12345-192.168.201.30@tcp:36:chattr.0 Request processed in 2798us (4869us total) trans 12884944293 rc 0/0 00000100:00100000:0.0:1787508858.561117:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94325 00000100:00100000:2.0:1787508858.570654:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508858.570767:0:225837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509713024 00000100:00100000:3.0:1787508858.570780:0:225837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509713024 00000100:00100000:3.0:1787508858.570853:0:225837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15109 00000100:00100000:3.0:1787508858.570865:0:225837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2400:x1874324509713024:12345-192.168.201.30@tcp:2:chattr.0 00002000:00010000:3.0:1787508858.571114:0:225837:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787508858.571119:0:225837:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb mtime from disk: 1787508858 -> 1787508858 00002000:00010000:3.0:1787508858.571122:0:225837:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb atime from disk: 1787508858 -> 1787508858 00002000:00010000:3.0:1787508858.571125:0:225837:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb ctime from disk: 1787508858 -> 1787508858 00002000:00010000:3.0:1787508858.571127:0:225837:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787508858.571204:0:225837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:2400:x1874324509713024:12345-192.168.201.30@tcp:2:chattr.0 Request processed in 340us (565us total) trans 8589940571 rc 0/0 00000100:00100000:3.0:1787508858.571212:0:225837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15109 00000100:00100000:3.0:1787508858.596886:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508858.607178:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509713152 00000100:00100000:0.0:1787508858.607199:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509713152 00000100:00100000:2.0:1787508858.607567:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94326 00000100:00100000:2.0:1787508858.607581:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+35:348093:x1874324509713152:12345-192.168.201.30@tcp:101:statx.0 00010000:00010000:2.0:1787508858.607616:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508858.607644:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f366a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeeb3 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.607730:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f366af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.607747:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f366af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.607760:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f366af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.607773:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f366b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.607780:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f366b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.607786:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f366b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.607911:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f366bd lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.607922:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f366bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.607930:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f366bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508858.608007:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x127a:0x0]: returning size 0 00000004:00200000:2.0:1787508858.608012:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508858.608037:0:205405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f366bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.608049:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f366bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.608060:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f366af lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.608067:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f366af lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.608078:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f366af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.608086:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f366af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.608093:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508858.608098:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f366af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.608107:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f366af lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.608121:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508858.608125:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508858.608131:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f366af lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.608139:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f366af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.608157:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f366b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.608164:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f366b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.608171:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f366b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.608177:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508858.608181:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f366b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.608188:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f366b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.608195:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdfa31bdb (ffff9090cc088b00) 00010000:00010000:2.0:1787508858.608199:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508858.608201:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f366b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.608208:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f366b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.608247:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f366a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeeb3 expref: 37 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.608263:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f366bd lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeeb3 expref: 36 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.608284:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:2.0:1787508858.608287:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787508858.608289:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa800, rc 0) 00000100:00100000:2.0:1787508858.608386:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+36:348093:x1874324509713152:12345-192.168.201.30@tcp:101:statx.0 Request processed in 806us (11514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508858.608394:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94326 00000100:00100000:2.0:1787508858.667681:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508858.667994:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509713280 00000100:00100000:3.0:1787508858.668007:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509713280 00000100:00100000:3.0:1787508858.668087:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15514 00000100:00100000:3.0:1787508858.668101:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+36:348094:x1874324509713280:12345-192.168.201.30@tcp:33:chattr.0 00000100:00100000:2.0:1787508858.668894:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+36:348094:x1874324509713280:12345-192.168.201.30@tcp:33:chattr.0 Request processed in 789us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508858.668910:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15514 00000100:00100000:1.0:1787508858.684296:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508858.684466:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509713536 00000100:00100000:3.0:1787508858.684481:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509713536 00000100:00100000:3.0:1787508858.684564:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94327 00000100:00100000:3.0:1787508858.684576:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+36:348094:x1874324509713536:12345-192.168.201.30@tcp:36:chattr.0 00010000:00010000:3.0:1787508858.684652:0:230618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508858.684688:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f366bd lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeeb3 expref: 36 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.684715:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:3.0:1787508858.684721:0:230618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508858.684754:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6244000/0xb126349c40f366c4 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x127a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.684771:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6244000/0xb126349c40f366c4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.684781:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6244000/0xb126349c40f366c4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508858.685046:0:230618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e201e39 reply state 00000000e790750e transno 12884944294 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6244000/0xb126349c40f366c4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.685061:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6244000/0xb126349c40f366c4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.685068:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:3.0:1787508858.685071:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508858.685074:0:230618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787508858.685570:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+37:348094:x1874324509713536:12345-192.168.201.30@tcp:36:chattr.0 Request processed in 991us (1287us total) trans 12884944294 rc 0/0 00000100:00100000:3.0:1787508858.685579:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94327 00000100:00100000:0.0:1787508858.697277:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508858.697483:0:225838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509713664 00000100:00100000:1.0:1787508858.697498:0:225838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509713664 00000100:00100000:1.0:1787508858.697622:0:225838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15110 00000100:00100000:1.0:1787508858.697636:0:225838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:2401:x1874324509713664:12345-192.168.201.30@tcp:2:chattr.0 00002000:00010000:1.0:1787508858.697842:0:225838:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787508858.697847:0:225838:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb mtime from disk: 1787508858 -> 1787508858 00002000:00010000:1.0:1787508858.697850:0:225838:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb atime from disk: 1787508858 -> 1787508858 00002000:00010000:1.0:1787508858.697852:0:225838:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb ctime from disk: 1787508858 -> 1787508858 00002000:00010000:1.0:1787508858.697854:0:225838:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787508858.697937:0:225838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2401:x1874324509713664:12345-192.168.201.30@tcp:2:chattr.0 Request processed in 303us (674us total) trans 8589940572 rc 0/0 00000100:00100000:1.0:1787508858.697991:0:225838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15110 00000100:00100000:2.0:1787508858.717573:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508858.718077:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509713792 00000100:00100000:3.0:1787508858.718092:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509713792 00000100:00100000:3.0:1787508858.718259:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94328 00000100:00100000:3.0:1787508858.718272:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+37:348095:x1874324509713792:12345-192.168.201.30@tcp:101:statx.0 00010000:00010000:3.0:1787508858.718308:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508858.718339:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f366cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeeba expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.718442:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f366d2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.718462:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f366d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.718476:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f366d2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.718490:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f366d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.718498:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f366d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.718505:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f366d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.718619:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f366e0 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.718634:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f366e0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.718641:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f366e0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508858.718691:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x127a:0x0]: returning size 0 00000004:00200000:3.0:1787508858.718697:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508858.718722:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f366e0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.718734:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f366e0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.718744:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f366d2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.718751:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f366d2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.718757:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f366d2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.718764:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f366d2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.718770:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508858.718774:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f366d2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.719288:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f366d2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.719306:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508858.719309:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508858.719315:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f366d2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.719322:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f366d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.719340:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f366d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.719346:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f366d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.719352:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f366d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.719357:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508858.719360:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f366d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.719366:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f366d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.719374:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdfa31bdb (ffff9090cc088b00) 00010000:00010000:3.0:1787508858.719377:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508858.719380:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f366d9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.719483:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f366d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.719529:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f366cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeeba expref: 39 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.719548:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f366e0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeeba expref: 38 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.719558:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:3.0:1787508858.719561:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787508858.719564:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fc00, rc 0) 00000100:00100000:2.0:1787508858.720677:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+38:348095:x1874324509713792:12345-192.168.201.30@tcp:101:statx.0 Request processed in 2398us (3110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508858.720690:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94328 00000100:00100000:2.0:1787508858.748052:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508858.751728:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509713920 00000100:00100000:3.0:1787508858.751753:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509713920 00000100:00100000:3.0:1787508858.751871:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15515 00000100:00100000:3.0:1787508858.751885:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+38:348096:x1874324509713920:12345-192.168.201.30@tcp:33:chattr.0 00000100:00100000:3.0:1787508858.752576:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+38:348096:x1874324509713920:12345-192.168.201.30@tcp:33:chattr.0 Request processed in 690us (4536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508858.752586:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15515 00000100:00100000:0.0:1787508858.760728:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508858.760903:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509714176 00000100:00100000:1.0:1787508858.760913:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509714176 00000100:00100000:1.0:1787508858.761055:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94329 00000100:00100000:1.0:1787508858.761067:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+38:348096:x1874324509714176:12345-192.168.201.30@tcp:36:chattr.0 00010000:00010000:1.0:1787508858.761121:0:202227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508858.761260:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f366e0 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeeba expref: 38 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508858.761279:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:1.0:1787508858.761284:0:202227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787508858.761308:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f366e7 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x127a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508858.761319:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f366e7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508858.761326:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f366e7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508858.761443:0:202227:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017acddee reply state 00000000fee354cc transno 12884944295 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f366e7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508858.761451:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f366e7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508858.761455:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:1.0:1787508858.761456:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787508858.761459:0:202227:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787508858.761570:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+39:348096:x1874324509714176:12345-192.168.201.30@tcp:36:chattr.0 Request processed in 506us (856us total) trans 12884944295 rc 0/0 00000100:00100000:1.0:1787508858.761575:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94329 00000100:00100000:2.0:1787508858.764438:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508858.764539:0:225843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509714304 00000100:00100000:0.0:1787508858.764549:0:225843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509714304 00000100:00100000:0.0:1787508858.764653:0:225843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15111 00000100:00100000:0.0:1787508858.764663:0:225843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2401:x1874324509714304:12345-192.168.201.30@tcp:2:chattr.0 00002000:00010000:0.0:1787508858.764797:0:225843:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787508858.764802:0:225843:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb mtime from disk: 1787508858 -> 1787508858 00002000:00010000:0.0:1787508858.764804:0:225843:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb atime from disk: 1787508858 -> 1787508858 00002000:00010000:0.0:1787508858.764807:0:225843:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb ctime from disk: 1787508858 -> 1787508858 00002000:00010000:0.0:1787508858.764809:0:225843:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787508858.764869:0:225843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:2401:x1874324509714304:12345-192.168.201.30@tcp:2:chattr.0 Request processed in 208us (439us total) trans 8589940573 rc 0/0 00000100:00100000:0.0:1787508858.764881:0:225843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15111 00000100:00100000:2.0:1787508858.806529:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508858.806908:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509714432 00000100:00100000:3.0:1787508858.806920:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509714432 00000100:00100000:3.0:1787508858.807027:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94330 00000100:00100000:3.0:1787508858.807045:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+39:348097:x1874324509714432:12345-192.168.201.30@tcp:101:statx.0 00010000:00010000:3.0:1787508858.807070:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508858.807091:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f366ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeec1 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.807184:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f366f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.807196:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f366f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.807206:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f366f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.807217:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f366fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.807223:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f366fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.807239:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f366fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.807322:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36703 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.807330:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36703 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.807336:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36703 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508858.807372:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x127a:0x0]: returning size 0 00000004:00200000:3.0:1787508858.807377:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508858.807395:0:203348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36703 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.807405:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36703 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.807416:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f366f5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.807422:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f366f5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.807427:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f366f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.807433:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f366f5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.807439:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508858.807443:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f366f5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.807450:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f366f5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.807461:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508858.807463:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508858.807467:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f366f5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.807473:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f366f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.807484:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f366fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.807489:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f366fc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.807494:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f366fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.807499:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8fc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508858.807501:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f366fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.807506:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f366fc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.807512:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdfa31bdb (ffff9090cc088b00) 00010000:00010000:3.0:1787508858.807513:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508858.807516:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f366fc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.807520:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f366fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.807539:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f366ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeec1 expref: 41 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.807551:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36703 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeec1 expref: 40 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.807557:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:3.0:1787508858.807559:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787508858.807561:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d6245e00, rc 0) 00000100:00100000:3.0:1787508858.807632:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+40:348097:x1874324509714432:12345-192.168.201.30@tcp:101:statx.0 Request processed in 596us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508858.807643:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94330 00000100:00100000:2.0:1787508858.828051:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508858.828346:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509714560 00000100:00100000:1.0:1787508858.828358:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509714560 00000100:00100000:1.0:1787508858.828430:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15516 00000100:00100000:1.0:1787508858.828441:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fdb9ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+40:348098:x1874324509714560:12345-192.168.201.30@tcp:33:chattr.0 00000100:00100000:1.0:1787508858.828638:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fdb9ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+40:348098:x1874324509714560:12345-192.168.201.30@tcp:33:chattr.0 Request processed in 197us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508858.828646:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15516 00000100:00100000:1.0:1787508858.833411:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508858.833595:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509714816 00000100:00100000:3.0:1787508858.833607:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509714816 00000100:00100000:3.0:1787508858.833672:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94331 00000100:00100000:3.0:1787508858.833683:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+40:348098:x1874324509714816:12345-192.168.201.30@tcp:36:chattr.0 00010000:00010000:3.0:1787508858.833745:0:230618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508858.833775:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f36703 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeec1 expref: 40 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.833807:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:3.0:1787508858.833820:0:230618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508858.833843:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3670a lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x127a:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.833858:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3670a lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.833867:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3670a lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508858.834405:0:230618:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c4652c9 reply state 0000000016c354cc transno 12884944296 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3670a lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.834420:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3670a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508858.834428:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:3.0:1787508858.834431:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508858.834435:0:230618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787508858.834603:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+41:348098:x1874324509714816:12345-192.168.201.30@tcp:36:chattr.0 Request processed in 920us (1199us total) trans 12884944296 rc 0/0 00000100:00100000:3.0:1787508858.834611:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94331 00000100:00100000:3.0:1787508858.838634:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508858.838707:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509714944 00000100:00100000:0.0:1787508858.838718:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509714944 00000100:00100000:0.0:1787508858.838773:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15112 00000100:00100000:0.0:1787508858.838783:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:2401:x1874324509714944:12345-192.168.201.30@tcp:2:chattr.0 00002000:00010000:0.0:1787508858.838928:0:225842:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787508858.838932:0:225842:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb mtime from disk: 1787508858 -> 1787508858 00002000:00010000:0.0:1787508858.838934:0:225842:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb atime from disk: 1787508858 -> 1787508858 00002000:00010000:0.0:1787508858.838936:0:225842:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb ctime from disk: 1787508858 -> 1787508858 00002000:00010000:0.0:1787508858.838959:0:225842:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787508858.839484:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:2401:x1874324509714944:12345-192.168.201.30@tcp:2:chattr.0 Request processed in 701us (858us total) trans 8589940574 rc 0/0 00000100:00100000:0.0:1787508858.839492:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15112 00000100:00100000:3.0:1787508858.859555:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508858.859713:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509715072 00000100:00100000:2.0:1787508858.859724:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509715072 00000100:00100000:2.0:1787508858.859804:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94332 00000100:00100000:2.0:1787508858.860479:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+41:348099:x1874324509715072:12345-192.168.201.30@tcp:101:statx.0 00010000:00010000:0.0:1787508858.863202:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508858.863246:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f36711 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeec8 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.863312:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f36718 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.863325:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f36718 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.863336:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f36718 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.863345:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f3671f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.863352:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f3671f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.863358:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f3671f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.863447:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f36726 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.863455:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f36726 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.863461:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f36726 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508858.863497:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x127a:0x0]: returning size 0 00000004:00200000:0.0:1787508858.863501:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508858.863520:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f36726 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.863528:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f36726 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.863537:0:202228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f36718 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.863544:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f36718 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.863550:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f36718 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.863561:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f36718 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.863567:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508858.863571:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f36718 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.863578:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f36718 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.863588:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508858.863591:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508858.863595:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f36718 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.863601:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f36718 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.863614:0:202228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f3671f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.863620:0:202228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f3671f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.863625:0:202228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f3671f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.863630:0:202228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508858.863633:0:202228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f3671f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.863643:0:202228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f3671f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.863650:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdfa31bdb (ffff9090cc088b00) 00010000:00010000:0.0:1787508858.863652:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508858.863655:0:202228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f3671f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.863660:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f3671f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.863685:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f36711 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeec8 expref: 43 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.863698:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f36726 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeec8 expref: 42 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508858.863706:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:0.0:1787508858.863708:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787508858.863710:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5600, rc 0) 00000100:00100000:0.0:1787508858.864691:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+42:348099:x1874324509715072:12345-192.168.201.30@tcp:101:statx.0 Request processed in 4872us (5138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508858.864703:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94332 00000100:00100000:2.0:1787508858.881134:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508858.881212:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509715200 00000100:00100000:3.0:1787508858.881220:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509715200 00000100:00100000:3.0:1787508858.881353:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15517 00000100:00100000:3.0:1787508858.881364:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+42:348100:x1874324509715200:12345-192.168.201.30@tcp:33:chattr.0 00000100:00100000:3.0:1787508858.881545:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+42:348100:x1874324509715200:12345-192.168.201.30@tcp:33:chattr.0 Request processed in 183us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508858.881553:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15517 00000100:00100000:1.0:1787508858.884436:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508858.884548:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509715456 00000100:00100000:2.0:1787508858.884557:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509715456 00000100:00100000:2.0:1787508858.884607:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94333 00000100:00100000:2.0:1787508858.884614:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+42:348100:x1874324509715456:12345-192.168.201.30@tcp:36:chattr.0 00010000:00010000:2.0:1787508858.884659:0:202227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508858.884681:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f36726 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeec8 expref: 42 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.884695:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:2.0:1787508858.884698:0:202227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508858.884718:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3672d lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x127a:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.884729:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3672d lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.884736:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3672d lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508858.884875:0:202227:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001acc5a1a reply state 00000000fea7f3c7 transno 12884944297 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3672d lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.884884:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3672d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.884888:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:2.0:1787508858.884890:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787508858.884892:0:202227:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787508858.885015:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+43:348100:x1874324509715456:12345-192.168.201.30@tcp:36:chattr.0 Request processed in 400us (590us total) trans 12884944297 rc 0/0 00000100:00100000:2.0:1787508858.885023:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94333 00000100:00100000:0.0:1787508858.887609:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508858.887919:0:225832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509715584 00000100:00100000:2.0:1787508858.887929:0:225832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509715584 00000100:00100000:2.0:1787508858.888271:0:225832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15113 00000100:00100000:2.0:1787508858.888282:0:225832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:2400:x1874324509715584:12345-192.168.201.30@tcp:2:chattr.0 00002000:00010000:2.0:1787508858.888425:0:225832:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787508858.888429:0:225832:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb mtime from disk: 1787508858 -> 1787508858 00002000:00010000:2.0:1787508858.888432:0:225832:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb atime from disk: 1787508858 -> 1787508858 00002000:00010000:2.0:1787508858.888434:0:225832:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb ctime from disk: 1787508858 -> 1787508858 00002000:00010000:2.0:1787508858.888437:0:225832:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x158f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787508858.888504:0:225832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:2400:x1874324509715584:12345-192.168.201.30@tcp:2:chattr.0 Request processed in 222us (903us total) trans 8589940575 rc 0/0 00000100:00100000:2.0:1787508858.888512:0:225832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15113 00000100:00100000:0.0:1787508858.908609:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508858.909021:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509715712 00000100:00100000:2.0:1787508858.909032:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509715712 00000100:00100000:2.0:1787508858.909103:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94334 00000100:00100000:2.0:1787508858.909113:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+43:348101:x1874324509715712:12345-192.168.201.30@tcp:101:statx.0 00010000:00010000:2.0:1787508858.909136:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508858.909157:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f36734 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeecf expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.909220:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3673b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.909246:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3673b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.909258:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3673b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.909270:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f36742 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.909275:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f36742 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.909279:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f36742 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.909349:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f36749 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.909358:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f36749 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.909362:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f36749 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508858.909393:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x127a:0x0]: returning size 0 00000004:00200000:2.0:1787508858.909396:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508858.909412:0:209004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f36749 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.909418:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f36749 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.909425:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3673b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.909429:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3673b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.909433:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3673b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.909437:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3673b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.909441:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508858.909444:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3673b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.909448:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3673b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.909458:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508858.909459:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508858.909463:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3673b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.909467:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f3673b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.909478:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f36742 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.909481:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f36742 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.909485:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f36742 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.909488:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2abc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508858.909490:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f36742 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.909493:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f36742 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.909496:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdfa31bdb (ffff9090cc088b00) 00010000:00010000:2.0:1787508858.909497:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508858.909499:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f36742 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.909502:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f36742 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.909522:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f36734 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeecf expref: 45 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.909530:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab400/0xb126349c40f36749 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127a:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeecf expref: 44 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508858.909535:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:2.0:1787508858.909536:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787508858.909538:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2ab400, rc 0) 00000100:00100000:2.0:1787508858.909598:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+44:348101:x1874324509715712:12345-192.168.201.30@tcp:101:statx.0 Request processed in 487us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508858.909603:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94334 00000100:00100000:0.0:1787508859.066382:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787508859.066408:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480281984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787508859.066483:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508859.066677:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480281984 00000100:00100000:2.0:1787508859.066686:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480281984 00000100:00100000:2.0:1787508859.066741:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30042 00000100:00100000:2.0:1787508859.066750:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480281984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787508859.066785:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440636928 avail 1294397440 00000100:00100000:2.0:1787508859.066851:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480281984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508859.066857:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30042 00000100:00100000:2.0:1787508859.066899:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480281984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787508859.067648:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787508859.067659:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480282112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787508859.067694:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508859.068838:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480282112 00000100:00100000:2.0:1787508859.068850:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480282112 00000100:00100000:2.0:1787508859.068908:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30043 00000100:00100000:2.0:1787508859.068917:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480282112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787508859.068982:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442709504 avail 1296470016 00000100:00100000:2.0:1787508859.069064:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480282112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 147us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508859.069071:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30043 00000100:00100000:2.0:1787508859.075114:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480282112:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787508859.450193:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508860.476760:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508861.044765:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508861.044816:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508861.044851:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508861.044877:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508861.044898:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508861.044916:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508861.044933:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508861.044989:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508861.045011:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508861.045052:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509716096 00000100:00100000:1.0:1787508861.045061:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509716096 00000100:00100000:1.0:1787508861.045128:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509716608 00000100:00100000:1.0:1787508861.045132:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509716608 00000100:00100000:1.0:1787508861.045155:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509715968 00000100:00100000:1.0:1787508861.045158:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509715968 00000100:00100000:1.0:1787508861.045175:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509716480 00000100:00100000:1.0:1787508861.045178:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509716480 00000100:00100000:1.0:1787508861.045225:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3322 00000100:00100000:1.0:1787508861.045237:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2400:x1874324509716096:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508861.045307:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2400:x1874324509716096:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 73us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508861.045315:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3322 00000100:00100000:1.0:1787508861.045331:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3323 00000100:00100000:1.0:1787508861.045338:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6390a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2400:x1874324509716608:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508861.045361:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6390a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2400:x1874324509716608:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508861.045368:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3323 00000100:00100000:1.0:1787508861.045380:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3324 00000100:00100000:1.0:1787508861.045386:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6392d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+44:2400:x1874324509715968:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508861.045411:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6392d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+44:2400:x1874324509715968:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508861.045418:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3324 00000100:00100000:1.0:1787508861.045429:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3325 00000100:00100000:1.0:1787508861.045435:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6392a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2400:x1874324509716480:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508861.045457:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6392a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2400:x1874324509716480:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508861.045463:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3325 00000100:00100000:1.0:1787508861.045480:0:230130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509716352 00000100:00100000:1.0:1787508861.045484:0:230130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509716352 00000100:00100000:1.0:1787508861.045506:0:230130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509716864 00000100:00100000:1.0:1787508861.045508:0:230130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509716864 00000100:00100000:1.0:1787508861.045526:0:230130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509716224 00000100:00100000:1.0:1787508861.045529:0:230130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509716224 00000100:00100000:1.0:1787508861.045543:0:230130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509716736 00000100:00100000:1.0:1787508861.045546:0:230130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509716736 00000100:00100000:1.0:1787508861.045565:0:230130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2637 00000100:00100000:1.0:1787508861.045572:0:230130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:2400:x1874324509716352:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508861.045812:0:203728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2638 00000100:00100000:3.0:1787508861.045821:0:203728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6392300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509716864:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508861.045867:0:230130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:2400:x1874324509716352:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 294us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508861.045874:0:230130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2637 00000100:00100000:1.0:1787508861.045887:0:230130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2639 00000100:00100000:1.0:1787508861.045894:0:230130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6390700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2400:x1874324509716224:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508861.045979:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509715840 00000100:00100000:2.0:1787508861.045984:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509715840 00000100:00100000:2.0:1787508861.046027:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1074 00000100:00100000:2.0:1787508861.046035:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fccc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2400:x1874324509715840:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508861.046126:0:225835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2640 00000100:00100000:0.0:1787508861.046136:0:225835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509716736:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508861.048635:0:203728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6392300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509716864:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 2804us (3724us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508861.048650:0:203728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2638 00000100:00080000:3.0:1787508861.048713:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787508861.048718:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787508861.048721:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787508861.048724:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787508861.063434:0:230130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6390700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2400:x1874324509716224:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 17527us (18487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508861.063450:0:230130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2639 00000100:00100000:2.0:1787508861.066515:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fccc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2400:x1874324509715840:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 20469us (21749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508861.066531:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1074 00000100:00100000:3.0:1787508861.081822:0:225835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509716736:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 35673us (36793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508861.081840:0:225835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2640 00010000:00010000:1.0:1787508861.498380:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508861.626400:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787508861.626423:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480282240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508861.626494:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508861.626685:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480282240 00000100:00100000:2.0:1787508861.626694:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480282240 00000100:00100000:2.0:1787508861.626758:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1817 00000100:00100000:2.0:1787508861.626767:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480282240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787508861.626806:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 165208640 pending 0 free 3881938944 avail 3650416640 00000100:00100000:2.0:1787508861.626851:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480282240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508861.626858:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1817 00000100:00080000:1.0:1787508861.626921:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508861.626987:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480282240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787508861.627406:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480282368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787508861.627442:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508861.627562:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480282368 00000100:00100000:0.0:1787508861.627567:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480282368 00000100:00100000:0.0:1787508861.627615:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1818 00000100:00100000:0.0:1787508861.627622:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480282368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787508861.627635:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 165208640 pending 0 free 3881938944 avail 3650416640 00000100:00100000:0.0:1787508861.627682:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480282368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508861.627688:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1818 00000100:00100000:3.0:1787508861.627763:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480282368:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787508861.627858:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787508862.524852:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508862.650840:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480282880:0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.650962:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508862.651015:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480283392:0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.651039:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508862.651063:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480283904:0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.651419:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508862.651451:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1787508862.651458:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480282496:0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.651487:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508862.651508:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480283008:0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.651533:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508862.651551:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480283520:0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.651570:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508862.651585:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480284032:0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.651604:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508862.651630:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480282624:0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.651656:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508862.651673:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480283136:0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.651692:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508862.651707:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874324480283648:0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.651725:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508862.651745:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787508862.651750:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cf9c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480282752:0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.651770:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508862.651848:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480283264:0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.651869:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508862.651886:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480283776:0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.652029:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508862.652294:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480282880 00000100:00100000:0.0:1787508862.652302:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480282880 00000100:00100000:0.0:1787508862.652345:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480283392 00000100:00100000:0.0:1787508862.652348:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480283392 00000100:00100000:0.0:1787508862.652364:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480282752 00000100:00100000:0.0:1787508862.652367:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480282752 00000100:00100000:0.0:1787508862.652394:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480283264 00000100:00100000:0.0:1787508862.652397:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480283264 00000100:00100000:0.0:1787508862.652421:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2641 00000100:00100000:0.0:1787508862.652429:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480282880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.652483:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480282880:12345-0@lo:400:kworker.0 Request processed in 55us (1543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508862.652490:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2641 00000100:00100000:0.0:1787508862.652505:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2642 00000100:00100000:0.0:1787508862.652511:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480283392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.652540:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480283392:12345-0@lo:400:kworker.0 Request processed in 30us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508862.652546:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2642 00000100:00100000:0.0:1787508862.652556:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2643 00000100:00100000:0.0:1787508862.652562:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480282752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.652594:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480282752:12345-0@lo:400:kworker.0 Request processed in 32us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508862.652600:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2643 00000100:00100000:0.0:1787508862.652611:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2644 00000100:00100000:0.0:1787508862.652617:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480283264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.652659:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480283264:12345-0@lo:400:kworker.0 Request processed in 42us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508862.652665:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2644 00000100:00100000:0.0:1787508862.652685:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480283904 00000100:00100000:0.0:1787508862.652688:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480283904 00000100:00100000:0.0:1787508862.652711:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480283008 00000100:00100000:0.0:1787508862.652714:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480283008 00000100:00100000:0.0:1787508862.652724:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480283520 00000100:00100000:0.0:1787508862.652726:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480283520 00000100:00100000:0.0:1787508862.652736:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480284032 00000100:00100000:0.0:1787508862.652739:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480284032 00000100:00100000:0.0:1787508862.652749:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480283648 00000100:00100000:0.0:1787508862.652751:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480283648 00000100:00100000:0.0:1787508862.652763:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480283776 00000100:00100000:0.0:1787508862.652765:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480283776 00000100:00100000:2.0:1787508862.653147:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480282496 00000100:00100000:2.0:1787508862.653152:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480282496 00000100:00100000:2.0:1787508862.653197:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:2.0:1787508862.653203:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fccc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480282496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508862.653242:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fccc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480282496:12345-0@lo:400:kworker.0 Request processed in 39us (1753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508862.653248:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:2.0:1787508862.653275:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480282624 00000100:00100000:2.0:1787508862.653279:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480282624 00000100:00100000:2.0:1787508862.653301:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480283136 00000100:00100000:2.0:1787508862.653304:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480283136 00000100:00100000:2.0:1787508862.653322:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30044 00000100:00100000:2.0:1787508862.653328:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480282624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508862.653362:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480282624:12345-0@lo:400:kworker.0 Request processed in 34us (1705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508862.653369:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30044 00000100:00100000:2.0:1787508862.653381:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30045 00000100:00100000:2.0:1787508862.653386:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480283136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508862.653414:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480283136:12345-0@lo:400:kworker.0 Request processed in 28us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508862.653420:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30045 00000100:00100000:0.0:1787508862.657565:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3326 00000100:00100000:0.0:1787508862.657594:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480283904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.657691:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480283904:12345-0@lo:400:kworker.0 Request processed in 109us (6272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508862.657699:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3326 00000100:00100000:0.0:1787508862.657730:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3327 00000100:00100000:0.0:1787508862.657737:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480283008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.657765:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480283008:12345-0@lo:400:kworker.0 Request processed in 29us (6232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508862.657770:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3327 00000100:00100000:0.0:1787508862.659251:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3328 00000100:00100000:0.0:1787508862.659266:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480283520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.659328:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480283520:12345-0@lo:400:kworker.0 Request processed in 66us (7757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508862.659334:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3328 00000100:00100000:0.0:1787508862.659352:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3329 00000100:00100000:0.0:1787508862.659358:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480284032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.659384:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480284032:12345-0@lo:400:kworker.0 Request processed in 26us (7779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508862.659389:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3329 00000100:00100000:0.0:1787508862.659399:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3330 00000100:00100000:0.0:1787508862.659405:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874324480283648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.659430:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1874324480283648:12345-0@lo:400:kworker.0 Request processed in 26us (7704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508862.659435:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3330 00000100:00100000:0.0:1787508862.659444:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3331 00000100:00100000:0.0:1787508862.659450:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480283776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.659473:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480283776:12345-0@lo:400:kworker.0 Request processed in 23us (7568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508862.659478:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3331 00000100:00080000:0.0:1787508862.659529:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508862.659535:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787508862.659538:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787508862.659577:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480282496:0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.659592:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480283008:0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.659602:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480283520:0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.659612:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480284032:0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.659623:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480282880:0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.659635:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480283392:0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.659645:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480283904:0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.659693:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480282752:0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.659704:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480283264:0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.659713:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480283776:0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.659726:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cf9c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480282624:0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.659736:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480283136:0@lo:400:kworker.0 00000100:00100000:0.0:1787508862.659745:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3616:1874324480283648:0@lo:400:kworker.0 00000100:00100000:0.0:1787508863.166695:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480284160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787508863.166767:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508863.166813:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787508863.166820:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480284288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787508863.166843:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508863.166881:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480284160 00000100:00100000:0.0:1787508863.166888:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480284160 00000100:00100000:0.0:1787508863.166930:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480284288 00000100:00100000:0.0:1787508863.166933:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480284288 00000100:00100000:0.0:1787508863.169976:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1819 00000100:00100000:0.0:1787508863.169998:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480284160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787508863.170038:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 72711872 pending 0 free 3908710400 avail 3677188096 00000100:00100000:2.0:1787508863.170850:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1820 00000100:00100000:2.0:1787508863.170863:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480284288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787508863.170881:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 72711872 pending 0 free 3908710400 avail 3677188096 00000100:00100000:2.0:1787508863.170996:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480284288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (4150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508863.171004:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1820 00000100:00100000:0.0:1787508863.171199:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480284160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1209us (4431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508863.171207:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1819 00000100:00100000:1.0:1787508863.172235:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480284288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787508863.172254:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480284160:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787508863.548696:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787508863.677515:0:204539:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589940575 is committed 00000001:00080000:0.0:1787508863.681439:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944297 is committed 00010000:00010000:1.0:1787508863.681523:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f36600 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681536:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f36600 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681544:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f36600 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681550:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508863.681555:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f36600 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681563:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f36600 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681579:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdfa31bdb (ffff9090cc088b00) 00010000:00010000:1.0:1787508863.681582:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508863.681586:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f36600 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681596:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f36600 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xdfa31bdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681625:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f36615 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681631:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f36615 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681636:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f36615 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681652:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508863.681655:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f36615 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681661:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f36615 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681669:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:1.0:1787508863.681672:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508863.681675:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f36615 lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681680:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f36615 lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681690:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3667e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681695:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3667e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681701:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3667e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681706:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508863.681709:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3667e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681714:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3667e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681721:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:1.0:1787508863.681723:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508863.681725:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3667e lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681729:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f3667e lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681738:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f366a1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681744:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f366a1 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681748:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f366a1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681753:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508863.681755:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f366a1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681764:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f366a1 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681771:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:1.0:1787508863.681773:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508863.681775:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f366a1 lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681781:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f366a1 lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681789:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6244000/0xb126349c40f366c4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681796:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6244000/0xb126349c40f366c4 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681801:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6244000/0xb126349c40f366c4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681806:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d6244000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508863.681814:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6244000/0xb126349c40f366c4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681819:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6244000/0xb126349c40f366c4 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681827:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:1.0:1787508863.681829:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508863.681831:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6244000/0xb126349c40f366c4 lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681836:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6244000/0xb126349c40f366c4 lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681846:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f366e7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681851:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f366e7 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681857:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f366e7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681862:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508863.681864:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f366e7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681870:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f366e7 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681876:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:1.0:1787508863.681879:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508863.681881:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f366e7 lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681886:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f366e7 lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681895:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3670a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681901:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3670a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681908:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3670a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681913:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508863.681916:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3670a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681921:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3670a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681927:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:1.0:1787508863.681929:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508863.681931:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3670a lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681937:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3670a lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681991:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3672d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.681997:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3672d lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.682002:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3672d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.682008:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508863.682011:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3672d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.682020:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3672d lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.682028:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127a:0x0].0x0 (ffff9090ce78a500) 00010000:00010000:1.0:1787508863.682030:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508863.682033:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3672d lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508863.682037:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f3672d lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x127a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508864.186172:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787508864.186195:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480284416:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787508864.186265:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508864.186317:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480284416 00000100:00100000:2.0:1787508864.186325:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480284416 00000100:00100000:2.0:1787508864.186376:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30046 00000100:00100000:2.0:1787508864.186385:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480284416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787508864.186418:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442709504 avail 1296470016 00000100:00100000:2.0:1787508864.186466:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480284416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508864.186474:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30046 00000100:00100000:2.0:1787508864.186520:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480284416:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787508864.187128:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787508864.187151:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480284544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787508864.187188:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508864.187316:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480284544 00000100:00100000:0.0:1787508864.187322:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480284544 00000100:00100000:0.0:1787508864.187363:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30047 00000100:00100000:0.0:1787508864.187371:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480284544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787508864.187393:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440636928 avail 1294397440 00000100:00100000:0.0:1787508864.187437:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480284544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508864.187445:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30047 00000100:00100000:1.0:1787508864.187681:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480284544:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787508864.572086:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508865.594563:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508866.158410:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508866.158462:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508866.158495:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508866.158530:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508866.158547:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508866.158565:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508866.158581:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508866.158596:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508866.158615:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508866.158705:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509717248 00000100:00100000:0.0:1787508866.158714:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509717248 00000100:00100000:0.0:1787508866.158796:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509717760 00000100:00100000:0.0:1787508866.158801:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509717760 00000100:00100000:0.0:1787508866.158820:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509717120 00000100:00100000:0.0:1787508866.158823:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509717120 00000100:00100000:0.0:1787508866.158841:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509717632 00000100:00100000:0.0:1787508866.158853:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509717632 00000100:00100000:0.0:1787508866.158872:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3332 00000100:00100000:0.0:1787508866.158881:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2403:x1874324509717248:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508866.158986:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2403:x1874324509717248:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 106us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508866.158995:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3332 00000100:00100000:0.0:1787508866.159025:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3333 00000100:00100000:0.0:1787508866.159032:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2403:x1874324509717760:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508866.159058:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2403:x1874324509717760:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 27us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508866.159065:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3333 00000100:00100000:0.0:1787508866.159077:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3334 00000100:00100000:0.0:1787508866.159083:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+24:2403:x1874324509717120:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508866.159119:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+24:2403:x1874324509717120:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 36us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508866.159126:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3334 00000100:00100000:0.0:1787508866.159138:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3335 00000100:00100000:0.0:1787508866.159144:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2403:x1874324509717632:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508866.159165:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:2403:x1874324509717632:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508866.159171:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3335 00000100:00080000:1.0:1787508866.159436:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787508866.159440:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787508866.159888:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509716992 00000100:00100000:2.0:1787508866.159896:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509716992 00000100:00100000:2.0:1787508866.159979:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1076 00000100:00100000:2.0:1787508866.159988:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fccc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509716992:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508866.160046:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fccc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509716992:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 59us (1648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508866.160053:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1076 00000100:00100000:2.0:1787508866.160092:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509717504 00000100:00100000:2.0:1787508866.160110:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509717504 00000100:00100000:2.0:1787508866.160145:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509718016 00000100:00100000:2.0:1787508866.160148:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509718016 00000100:00100000:2.0:1787508866.160163:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509717376 00000100:00100000:2.0:1787508866.160166:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509717376 00000100:00100000:2.0:1787508866.160181:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509717888 00000100:00100000:2.0:1787508866.160183:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509717888 00000100:00100000:2.0:1787508866.160201:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2645 00000100:00100000:2.0:1787508866.160207:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509717504:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508866.160234:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509717504:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 28us (1739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508866.160240:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2645 00000100:00100000:2.0:1787508866.160251:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2646 00000100:00100000:2.0:1787508866.160256:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509718016:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508866.160279:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509718016:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (1731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508866.160284:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2646 00000100:00100000:2.0:1787508866.160295:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2647 00000100:00100000:2.0:1787508866.160300:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509717376:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508866.160322:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509717376:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (1741us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508866.160327:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2647 00000100:00100000:2.0:1787508866.160337:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2648 00000100:00100000:2.0:1787508866.160343:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509717888:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508866.160366:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509717888:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (1750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508866.160372:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2648 00000100:00080000:2.0:1787508866.160390:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787508866.160393:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787508866.618393:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508866.746573:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787508866.746599:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e69da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480284672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787508866.746706:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508866.746804:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480284672 00000100:00100000:0.0:1787508866.746813:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480284672 00000100:00100000:0.0:1787508866.746898:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1821 00000100:00100000:0.0:1787508866.746911:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480284672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787508866.746974:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 165208640 pending 0 free 3881938944 avail 3650416640 00000100:00100000:0.0:1787508866.747035:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480284672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508866.747042:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1821 00000100:00080000:0.0:1787508866.747066:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508866.747117:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e69da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480284672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787508866.752447:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480284800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787508866.752522:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508866.752573:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480284800 00000100:00100000:1.0:1787508866.752589:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480284800 00000100:00100000:1.0:1787508866.752689:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1822 00000100:00100000:1.0:1787508866.752702:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480284800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787508866.752734:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 165208640 pending 0 free 3881938944 avail 3650416640 00000100:00100000:1.0:1787508866.752825:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480284800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508866.752833:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1822 00000100:00080000:0.0:1787508866.752884:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508866.752897:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480284800:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1787508867.562674:0:236448:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 107a: Basic grouplock conflict =========== 14:14:26 (1787508866) 00000100:00100000:1.0:1787508867.619790:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508867.619921:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509718272 00000100:00100000:2.0:1787508867.619935:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509718272 00000100:00100000:2.0:1787508867.620025:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94335 00000100:00100000:2.0:1787508867.620036:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+24:348677:x1874324509718272:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:2.0:1787508867.620061:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508867.620065:0:205405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787508867.620105:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f3662a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaee89 expref: 24 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508867.620123:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508867.620129:0:205405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508867.620144:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f36750 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeed6 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508867.620266:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f36757 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508867.620280:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f36757 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508867.620290:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f36757 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508867.620305:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3675e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7222325d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508867.620311:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3675e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508867.620317:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3675e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787508867.620691:0:205405:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x1534:0x0], index 0: 0 00010000:00010000:2.0:1787508867.620866:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f36765 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508867.620876:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f36765 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508867.620883:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f36765 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508867.620918:0:205405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f36757 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508867.620926:0:205405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f36757 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508867.620932:0:205405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f36757 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508867.620937:0:205405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f36757 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508867.620964:0:205405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508867.620969:0:205405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f36757 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508867.620978:0:205405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f36757 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508867.620988:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508867.620991:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508867.620995:0:205405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f36757 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508867.621002:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f36757 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787508867.621014:0:205405:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2610ced reply state 00000000075b9b62 transno 12884944298 ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3675e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508867.621025:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3675e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508867.621031:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7222325d (ffff9091c816f400) 00010000:00010000:2.0:1787508867.621033:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787508867.621036:0:205405:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787508867.621063:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f36750 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeed6 expref: 26 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508867.621088:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f36765 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeed6 expref: 25 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508867.621095:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127b:0x0].0x0 (ffff9091c816f100) 00010000:00010000:2.0:1787508867.621098:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787508867.621100:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa200, rc 0) 00000100:00100000:2.0:1787508867.621176:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+26:348677:x1874324509718272:12345-192.168.201.30@tcp:101:dd.0 Request processed in 1141us (1397us total) trans 12884944298 rc 0/0 00000100:00100000:2.0:1787508867.621185:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94335 00000100:00100000:1.0:1787508867.640311:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508867.640351:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509718400 00000100:00100000:1.0:1787508867.640361:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509718400 00000100:00100000:1.0:1787508867.640423:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15114 00000100:00100000:1.0:1787508867.640434:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:348677:x1874324509718400:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:1.0:1787508867.640455:0:225840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508867.640493:0:225840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac8d89c8/0xb126349c40f36773 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1534:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeedd expref: -99 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787508867.640522:0:225840:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1534:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787508867.640546:0:225840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1534:0x0].0x0 since=13838s v=(0 0) 00010000:00010000:1.0:1787508867.640551:0:225840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1534:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787508867.640561:0:225840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac8d89c8/0xb126349c40f36773 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1534:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeedd expref: 7 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508867.640580:0:225840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac8d89c8/0xb126349c40f36773 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1534:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeedd expref: 7 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508867.640599:0:225840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ba00, rc 0) 00000100:00100000:1.0:1787508867.640658:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:348677:x1874324509718400:12345-192.168.201.30@tcp:101:dd.0 Request processed in 224us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508867.640666:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15114 00010000:00010000:2.0:1787508867.643100:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508867.770263:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480285184:0@lo:400:kworker.0 00000100:00100000:3.0:1787508867.770338:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508867.770397:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480285696:0@lo:400:kworker.0 00000100:00100000:3.0:1787508867.770419:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508867.770441:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480286208:0@lo:400:kworker.0 00000100:00100000:3.0:1787508867.770466:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508867.770636:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787508867.770643:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480285312:0@lo:400:kworker.0 00000100:00100000:3.0:1787508867.770668:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508867.770684:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480285824:0@lo:400:kworker.0 00000100:00100000:3.0:1787508867.770704:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508867.770719:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480286336:0@lo:400:kworker.0 00000100:00100000:3.0:1787508867.770741:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508867.770774:0:203996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480285184 00000100:00100000:3.0:1787508867.770782:0:203996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480285184 00000100:00100000:3.0:1787508867.770839:0:203996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480285696 00000100:00100000:3.0:1787508867.770843:0:203996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480285696 00000100:00100000:3.0:1787508867.770862:0:203996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480285312 00000100:00100000:3.0:1787508867.770865:0:203996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480285312 00000100:00100000:3.0:1787508867.770879:0:203996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480285824 00000100:00100000:3.0:1787508867.770882:0:203996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480285824 00000100:00100000:3.0:1787508867.770900:0:203996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2649 00000100:00100000:3.0:1787508867.770908:0:203996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480285184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508867.770991:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480285056:0@lo:400:kworker.0 00000100:00100000:2.0:1787508867.771026:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508867.771047:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480285568:0@lo:400:kworker.0 00000100:00100000:2.0:1787508867.771068:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508867.771093:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480286080:0@lo:400:kworker.0 00000100:00100000:2.0:1787508867.771113:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508867.771133:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1787508867.771139:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79de3f65-4bad-42d0-a46f-842a654b33a0:3619:1874324480284928:0@lo:400:kworker.0 00000100:00100000:2.0:1787508867.771168:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508867.771191:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480285440:0@lo:400:kworker.0 00000100:00100000:2.0:1787508867.771212:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508867.771242:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874324480285952:0@lo:400:kworker.0 00000100:00100000:2.0:1787508867.771262:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508867.771277:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874324480286464:0@lo:400:kworker.0 00000100:00100000:2.0:1787508867.771297:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508867.771323:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480285056 00000100:00100000:2.0:1787508867.771327:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480285056 00000100:00100000:2.0:1787508867.771354:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480285568 00000100:00100000:2.0:1787508867.771357:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480285568 00000100:00100000:2.0:1787508867.771376:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30048 00000100:00100000:2.0:1787508867.771383:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480285056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508867.771423:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480285056:12345-0@lo:400:kworker.0 Request processed in 40us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508867.771431:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30048 00000100:00100000:2.0:1787508867.771447:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30049 00000100:00100000:2.0:1787508867.771453:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480285568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508867.771480:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480285568:12345-0@lo:400:kworker.0 Request processed in 27us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508867.771490:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30049 00000100:00100000:2.0:1787508867.771510:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480286208 00000100:00100000:2.0:1787508867.771514:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480286208 00000100:00100000:2.0:1787508867.771537:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480286336 00000100:00100000:2.0:1787508867.771541:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480286336 00000100:00100000:2.0:1787508867.771552:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480286080 00000100:00100000:2.0:1787508867.771554:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480286080 00000100:00100000:2.0:1787508867.771566:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480285440 00000100:00100000:2.0:1787508867.771568:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480285440 00000100:00100000:2.0:1787508867.771576:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480285952 00000100:00100000:2.0:1787508867.771578:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480285952 00000100:00100000:2.0:1787508867.771586:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480286464 00000100:00100000:2.0:1787508867.771588:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480286464 00000100:00100000:2.0:1787508867.771601:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3336 00000100:00100000:2.0:1787508867.771607:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480286208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508867.771716:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3337 00000100:00100000:0.0:1787508867.771725:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480286336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508867.772243:0:203996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480285184:12345-0@lo:400:kworker.0 Request processed in 1333us (1902us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508867.772257:0:203996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2649 00000100:00100000:3.0:1787508867.772279:0:203996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2650 00000100:00100000:3.0:1787508867.772288:0:203996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480285696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508867.775539:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480286208:12345-0@lo:400:kworker.0 Request processed in 3921us (5061us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508867.775556:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3336 00000100:00100000:2.0:1787508867.775598:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3338 00000100:00100000:2.0:1787508867.775613:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480286080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508867.775686:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480286080:12345-0@lo:400:kworker.0 Request processed in 81us (4571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508867.775692:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3338 00000100:00100000:2.0:1787508867.775704:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3339 00000100:00100000:2.0:1787508867.775711:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480285440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508867.775740:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1874324480285440:12345-0@lo:400:kworker.0 Request processed in 30us (4528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508867.775745:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3339 00000100:00100000:2.0:1787508867.775757:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3340 00000100:00100000:2.0:1787508867.775762:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874324480285952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508867.777078:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1874324480285952:12345-0@lo:400:kworker.0 Request processed in 1300us (5800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508867.777088:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3340 00000100:00100000:2.0:1787508867.777118:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3341 00000100:00100000:2.0:1787508867.777129:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874324480286464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508867.777173:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1874324480286464:12345-0@lo:400:kworker.0 Request processed in 48us (5875us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508867.777179:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3341 00000100:00100000:2.0:1787508867.777210:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480284928 00000100:00100000:2.0:1787508867.777328:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480284928 00000100:00100000:2.0:1787508867.777378:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00100000:2.0:1787508867.777385:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fccc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3619:x1874324480284928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508867.777419:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fccc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3619:x1874324480284928:12345-0@lo:400:kworker.0 Request processed in 35us (6250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508867.777425:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00100000:2.0:1787508867.777511:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79de3f65-4bad-42d0-a46f-842a654b33a0:3619:1874324480284928:0@lo:400:kworker.0 00000100:00100000:2.0:1787508867.777528:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3619:1874324480285440:0@lo:400:kworker.0 00000100:00100000:2.0:1787508867.777538:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3619:1874324480285952:0@lo:400:kworker.0 00000100:00100000:2.0:1787508867.777550:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3619:1874324480286464:0@lo:400:kworker.0 00000100:00100000:2.0:1787508867.777561:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480285056:0@lo:400:kworker.0 00000100:00100000:2.0:1787508867.777572:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480285568:0@lo:400:kworker.0 00000100:00100000:2.0:1787508867.777584:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480286080:0@lo:400:kworker.0 00000100:00100000:0.0:1787508867.777702:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480286336:12345-0@lo:400:kworker.0 Request processed in 5977us (6958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508867.777712:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3337 00000100:00100000:0.0:1787508867.777743:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2651 00000100:00100000:0.0:1787508867.777752:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480285312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508867.777792:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480285312:12345-0@lo:400:kworker.0 Request processed in 42us (7123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508867.777798:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2651 00000100:00100000:0.0:1787508867.777826:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2652 00000100:00100000:0.0:1787508867.777834:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480285824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508867.777864:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480285824:12345-0@lo:400:kworker.0 Request processed in 31us (7159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508867.777869:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2652 00000100:00080000:0.0:1787508867.777896:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787508867.777913:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508867.777917:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787508867.779451:0:203996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480285696:12345-0@lo:400:kworker.0 Request processed in 7156us (9021us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508867.779464:0:203996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2650 00000100:00100000:3.0:1787508867.779594:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480285312:0@lo:400:kworker.0 00000100:00100000:3.0:1787508867.779608:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480285824:0@lo:400:kworker.0 00000100:00100000:3.0:1787508867.779619:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480286336:0@lo:400:kworker.0 00000100:00100000:3.0:1787508867.779633:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480285184:0@lo:400:kworker.0 00000100:00100000:3.0:1787508867.779643:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480285696:0@lo:400:kworker.0 00000100:00100000:3.0:1787508867.779652:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480286208:0@lo:400:kworker.0 00000100:00100000:3.0:1787508867.794290:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508867.794494:0:203732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509718528 00000100:00100000:0.0:1787508867.794508:0:203732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509718528 00002000:00100000:0.0:1787508867.794573:0:203732:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x1534:0x0] (0->4194303) req@ffff9091f9b24e00 x1874324509718528/t0(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:323/0 lens 488/0 e 0 to 0 dl 1787508878 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787508867.794584:0:203732:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091f9b24e00 with x1874324509718528 ext(0->4194303) 00002000:00010000:0.0:1787508867.794591:0:203732:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9091f9b24e00 00000100:00100000:0.0:1787508867.794630:0:203732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:0.0:1787508867.794640:0:203732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2401:x1874324509718528:12345-192.168.201.30@tcp:4:dd.0 00000100:00100000:1.0:1787508867.919802:0:203732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:2401:x1874324509718528:12345-192.168.201.30@tcp:4:dd.0 Request processed in 125150us (125511us total) trans 8589941261 rc 0/0 00000100:00100000:1.0:1787508867.919828:0:203732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 59 00002000:00100000:1.0:1787508867.919842:0:203732:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x1534:0x0] (0->4194303) req@ffff9091f9b24e00 x1874324509718528/t8589941261(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:323/0 lens 488/448 e 0 to 0 dl 1787508878 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787508867.919853:0:203732:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091f9b24e00 with x1874324509718528 ext(0->4194303) 00002000:00010000:1.0:1787508867.919859:0:203732:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9091f9b24e00 00000100:00100000:2.0:1787508867.957582:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508867.957694:0:205407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509718656 00000100:00100000:0.0:1787508867.957703:0:205407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509718656 00002000:00100000:0.0:1787508867.957760:0:205407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x1534:0x0] (4194304->8388607) req@ffff9091ffb3ad80 x1874324509718656/t0(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:323/0 lens 488/0 e 0 to 0 dl 1787508878 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787508867.957774:0:205407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091ffb3ad80 with x1874324509718656 ext(4194304->8388607) 00002000:00010000:0.0:1787508867.957781:0:205407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9091ffb3ad80 00000100:00100000:0.0:1787508867.957861:0:205407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:0.0:1787508867.957872:0:205407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:2401:x1874324509718656:12345-192.168.201.30@tcp:4:dd.0 00000100:00100000:3.0:1787508868.002462:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508868.002556:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509718912 00000100:00100000:0.0:1787508868.002566:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509718912 00000100:00100000:0.0:1787508868.002641:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15518 00000100:00100000:0.0:1787508868.002649:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+26:348677:x1874324509718912:12345-192.168.201.30@tcp:35:dd.0 00000100:00100000:0.0:1787508868.002933:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+27:348677:x1874324509718912:12345-192.168.201.30@tcp:35:dd.0 Request processed in 284us (481us total) trans 12884944299 rc 0/0 00000100:00100000:0.0:1787508868.002963:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15518 00000100:00080000:1.0:1787508868.004990:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508868.005782:0:205407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:2401:x1874324509718656:12345-192.168.201.30@tcp:4:dd.0 Request processed in 47903us (48203us total) trans 8589941262 rc 0/0 00000100:00100000:2.0:1787508868.005795:0:205407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 60 00002000:00100000:2.0:1787508868.005809:0:205407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x1534:0x0] (4194304->8388607) req@ffff9091ffb3ad80 x1874324509718656/t8589941262(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:323/0 lens 488/448 e 0 to 0 dl 1787508878 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787508868.006150:0:205407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091ffb3ad80 with x1874324509718656 ext(4194304->8388607) 00002000:00010000:2.0:1787508868.006156:0:205407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9091ffb3ad80 00000100:00100000:3.0:1787508868.019731:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508868.020219:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509719040 00000100:00100000:2.0:1787508868.020229:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509719040 00000100:00100000:2.0:1787508868.020289:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94336 00000100:00100000:2.0:1787508868.020299:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+27:348680:x1874324509719040:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1787508868.020323:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508868.020346:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3677a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeee4 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.020411:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f36781 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.020426:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f36781 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.020439:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f36781 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508868.020483:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508868.020487:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508868.020506:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f36781 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.020531:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2abc00/0xb126349c40f3677a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeee4 expref: 29 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.020549:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f36781 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeee4 expref: 28 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.020558:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508868.020560:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508868.020564:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090cd2aa800, rc 0) 00000100:00100000:2.0:1787508868.020626:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+28:348680:x1874324509719040:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 327us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508868.020633:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94336 00000100:00100000:0.0:1787508868.024191:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508868.024315:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509719168 00000100:00100000:2.0:1787508868.024326:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509719168 00000100:00100000:2.0:1787508868.024434:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94337 00000100:00100000:2.0:1787508868.024445:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+28:348680:x1874324509719168:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:2.0:1787508868.024520:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f36788 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.024536:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f36788 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.024548:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f36788 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.024560:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3678f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.024568:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3678f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.024575:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3678f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.024668:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fade00/0xb126349c40f36796 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.024678:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fade00/0xb126349c40f36796 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.024684:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fade00/0xb126349c40f36796 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508868.024727:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x127b:0x0]: returning size 10485760 00000004:00200000:2.0:1787508868.024732:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508868.024747:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fade00/0xb126349c40f36796 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.024762:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f36788 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.024768:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f36788 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.024775:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f36788 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.024797:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f36788 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.024808:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508868.024820:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f36788 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.024828:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f36788 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.024841:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508868.024844:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508868.024848:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f36788 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.024854:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aac00/0xb126349c40f36788 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.024867:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3678f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.024873:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3678f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.024879:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3678f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.024884:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2ab200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508868.024887:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3678f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.024893:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3678f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.024904:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7222325d (ffff9091c816f400) 00010000:00010000:2.0:1787508868.024906:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508868.024909:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3678f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.024914:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2ab200/0xb126349c40f3678f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.024923:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fade00/0xb126349c40f36796 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.024928:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fade00/0xb126349c40f36796 lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.024932:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fade00/0xb126349c40f36796 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.024936:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d3fade00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508868.024990:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fade00/0xb126349c40f36796 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.024998:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fade00/0xb126349c40f36796 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.025005:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127b:0x0].0x0 (ffff9091c816f100) 00010000:00010000:2.0:1787508868.025007:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508868.025011:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fade00/0xb126349c40f36796 lrc: 2/0,0 mode: --/PR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.025016:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fade00/0xb126349c40f36796 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508868.025099:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+28:348680:x1874324509719168:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 654us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508868.025106:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94337 00000100:00100000:0.0:1787508868.048915:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508868.049000:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509719424 00000100:00100000:2.0:1787508868.049011:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509719424 00000100:00100000:2.0:1787508868.049081:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94338 00000100:00100000:2.0:1787508868.049092:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+28:348682:x1874324509719424:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:2.0:1787508868.049114:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508868.049117:0:205405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787508868.049142:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa800/0xb126349c40f36781 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeee4 expref: 28 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.049160:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508868.049165:0:205405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508868.049177:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fade00/0xb126349c40f3679d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeeeb expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.049303:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fadc00/0xb126349c40f367a4 lrc: 3/0,1 mode: --/CW res: [0x2000013a4:0x127b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.049317:0:205405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f36765 lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeed6 expref: 28 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.049326:0:205405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fadc00/0xb126349c40f367a4 lrc: 4/0,1 mode: --/CW res: [0x2000013a4:0x127b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.049360:0:205405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f36765 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeed6 expref: 28 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.049375:0:205405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f36765 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeed6 expref: 28 pid: 205405 timeout: 13939 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508868.049388:0:205405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb38700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480286592:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508868.049484:0:205405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1967e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787508868.052518:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508868.052599:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509719552 00000100:00100000:3.0:1787508868.052610:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509719552 00010000:00010000:3.0:1787508868.052657:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f36765 lrc: 5/0,0 mode: PR/PR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeed6 expref: 29 pid: 205405 timeout: 13939 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508868.052702:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27982 00000100:00100000:3.0:1787508868.052714:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+29:2400:x1874324509719552:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508868.052731:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508868.052738:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f36765 lrc: 5/0,0 mode: PR/PR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeed6 expref: 29 pid: 205405 timeout: 13939 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508868.052753:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f36765 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeed6 expref: 29 pid: 205405 timeout: 13939 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508868.052792:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127b:0x0].0x0 (ffff9091c816f100) 00010000:00010000:3.0:1787508868.052798:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fadc00/0xb126349c40f367a4 lrc: 3/0,1 mode: --/CW res: [0x2000013a4:0x127b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508868.052808:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fadc00/0xb126349c40f367a4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a4:0x127b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508868.052816:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fadc00/0xb126349c40f367a4 lrc: 4/0,1 mode: CW/CW res: [0x2000013a4:0x127b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508868.052839:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508868.052907:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+29:2400:x1874324509719552:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 195us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508868.052916:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27982 00010000:00010000:2.0:1787508868.053916:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa200/0xb126349c40f36765 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeed6 expref: 28 pid: 205405 timeout: 13939 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508868.053937:0:205405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb38700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:205405:1874324480286592:192.168.201.30@tcp:104: 00010000:00010000:2.0:1787508868.053990:0:205405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fadc00/0xb126349c40f367a4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a4:0x127b:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.054000:0:205405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fadc00/0xb126349c40f367a4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a4:0x127b:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.054006:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fadc00/0xb126349c40f367a4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a4:0x127b:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508868.054028:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x127b:0x0]: returning size 10485760 00010000:00010000:2.0:1787508868.054173:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fade00/0xb126349c40f3679d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeeeb expref: 29 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.054188:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fadc00/0xb126349c40f367a4 lrc: 3/0,0 mode: CW/CW res: [0x2000013a4:0x127b:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeeeb expref: 28 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.054196:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127b:0x0].0x0 (ffff9091c816f100) 00010000:00010000:2.0:1787508868.054199:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787508868.054202:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d3fadc00, rc 0) 00000100:00100000:2.0:1787508868.054243:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+28:348682:x1874324509719424:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 5152us (5338us total) trans 12884944300 rc 0/0 00000100:00100000:2.0:1787508868.054251:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94338 00000100:00100000:1.0:1787508868.058662:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508868.058771:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509719680 00000100:00100000:0.0:1787508868.058794:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509719680 00000100:00100000:0.0:1787508868.058869:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94339 00000100:00100000:0.0:1787508868.058880:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+28:348682:x1874324509719680:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:0.0:1787508868.058907:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508868.058929:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f367b2 lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeef2 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508868.059035:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f367b2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeef2 expref: 29 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508868.059055:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4600/0xb126349c40f367b2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeef2 expref: 29 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508868.059083:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127b:0x0].0x0 (ffff9091c816f100) 00010000:00010000:0.0:1787508868.059086:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787508868.059090:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4600, rc 0) 00000100:00100000:0.0:1787508868.059150:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+29:348682:x1874324509719680:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 272us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508868.059157:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94339 00000100:00100000:0.0:1787508868.062359:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508868.062449:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509719808 00000100:00100000:3.0:1787508868.062460:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509719808 00000100:00100000:3.0:1787508868.062536:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15115 00000100:00100000:3.0:1787508868.062548:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:348682:x1874324509719808:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:3.0:1787508868.062564:0:225831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508868.062583:0:225831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a75ad07c/0xb126349c40f367b9 lrc: 2/0,0 mode: --/GROUP res: [0x280000401:0x1534:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeef9 expref: -99 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508868.062614:0:225831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac8d89c8/0xb126349c40f36773 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1534:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeedd expref: 12 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508868.062624:0:225831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1534:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787508868.062628:0:225831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1534:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787508868.062634:0:225831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a75ad07c/0xb126349c40f367b9 lrc: 4/0,0 mode: --/GROUP res: [0x280000401:0x1534:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 14091995 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeef9 expref: 12 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508868.062670:0:225831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ac8d89c8/0xb126349c40f36773 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1534:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeedd expref: 12 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508868.062686:0:225831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ac8d89c8/0xb126349c40f36773 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1534:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeedd expref: 12 pid: 225840 timeout: 13939 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508868.062700:0:225831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:225831:1874324480286720:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508868.062793:0:225831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d54df480 going to sleep for 11 seconds 00000100:00080000:1.0:1787508868.063343:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787508868.068113:0:225831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:225831:1874324480286720:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508868.068155:0:225831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a75ad07c/0xb126349c40f367b9 lrc: 3/0,0 mode: --/GROUP res: [0x280000401:0x1534:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 14091995 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeef9 expref: 12 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508868.068179:0:225831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fc00, rc 0) 00000100:00100000:3.0:1787508868.068239:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:348682:x1874324509719808:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 5692us (5890us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508868.068249:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15115 00000100:00100000:1.0:1787508868.068457:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508868.068547:0:203731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509719936 00000100:00100000:2.0:1787508868.068555:0:203731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509719936 00002000:00100000:2.0:1787508868.068604:0:203731:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x1534:0x0] (8388608->10485759) req@ffff9090d0877800 x1874324509719936/t0(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:324/0 lens 488/0 e 0 to 0 dl 1787508879 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787508868.068614:0:203731:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090d0877800 with x1874324509719936 ext(8388608->10485759) 00010000:00010000:2.0:1787508868.068621:0:203731:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ac8d89c8/0xb126349c40f36773 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1534:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeedd expref: 12 pid: 225840 timeout: 13939 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.068637:0:203731:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ac8d89c8/0xb126349c40f36773 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1534:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeedd expref: 12 pid: 225840 timeout: 13939 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787508868.068644:0:203731:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9090d0877800 00000100:00100000:2.0:1787508868.068679:0:203731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:2.0:1787508868.068688:0:203731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:2401:x1874324509719936:12345-192.168.201.30@tcp:4:dd.0 00000100:00100000:3.0:1787508868.095122:0:203731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:2401:x1874324509719936:12345-192.168.201.30@tcp:4:dd.0 Request processed in 26422us (26652us total) trans 8589941263 rc 0/0 00000100:00100000:3.0:1787508868.095143:0:203731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00002000:00100000:3.0:1787508868.095157:0:203731:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x1534:0x0] (8388608->10485759) req@ffff9090d0877800 x1874324509719936/t8589941263(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:324/0 lens 488/448 e 0 to 0 dl 1787508879 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787508868.095169:0:203731:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090d0877800 with x1874324509719936 ext(8388608->10485759) 00010000:00010000:3.0:1787508868.095183:0:203731:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ac8d89c8/0xb126349c40f36773 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1534:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeedd expref: 14 pid: 225840 timeout: 13939 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508868.095205:0:203731:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ac8d89c8/0xb126349c40f36773 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1534:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeedd expref: 14 pid: 225840 timeout: 13939 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787508868.095214:0:203731:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9090d0877800 00000100:00100000:2.0:1787508868.104250:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508868.104363:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509720064 00000100:00100000:1.0:1787508868.104372:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509720064 00010000:00010000:1.0:1787508868.104418:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ac8d89c8/0xb126349c40f36773 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1534:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeedd expref: 14 pid: 225840 timeout: 13939 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508868.104467:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27983 00000100:00100000:1.0:1787508868.104478:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:2402:x1874324509720064:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508868.104493:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787508868.104514:0:229383:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x1534:0x0] updating lvb size from disk: 0 -> 10485760 00002000:00010000:1.0:1787508868.104517:0:229383:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x1534:0x0] updating lvb mtime from disk: 0 -> 1787508868 00002000:00010000:1.0:1787508868.104520:0:229383:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x1534:0x0] updating lvb ctime from disk: 0 -> 1787508868 00002000:00010000:1.0:1787508868.104522:0:229383:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x1534:0x0] updating lvb blocks from disk: 0 -> 20480 00010000:00010000:1.0:1787508868.104529:0:229383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ac8d89c8/0xb126349c40f36773 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1534:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeedd expref: 14 pid: 225840 timeout: 13939 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508868.104544:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ac8d89c8/0xb126349c40f36773 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1534:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeedd expref: 14 pid: 225840 timeout: 13939 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508868.104569:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac8d89c8/0xb126349c40f36773 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1534:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeedd expref: 14 pid: 225840 timeout: 13939 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508868.104587:0:229383:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1534:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787508868.104592:0:229383:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1534:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787508868.104599:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a75ad07c/0xb126349c40f367b9 lrc: 2/0,0 mode: GROUP/GROUP res: [0x280000401:0x1534:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 14091995 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeef9 expref: 13 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508868.104609:0:229383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a75ad07c/0xb126349c40f367b9 lrc: 3/0,0 mode: GROUP/GROUP res: [0x280000401:0x1534:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 14091995 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeef9 expref: 13 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508868.104645:0:229383:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a75ad07c/0xb126349c40f367b9 lrc: 3/0,0 mode: GROUP/GROUP res: [0x280000401:0x1534:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 14091995 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeef9 expref: 13 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508868.104656:0:229383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0874380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:229383:1874324480286848:192.168.201.30@tcp:105: 00000100:00100000:1.0:1787508868.104801:0:229383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090cc389840 going to sleep for 11 seconds 00000100:00100000:2.0:1787508868.131804:0:229383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0874380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:229383:1874324480286848:192.168.201.30@tcp:105: 00010000:00010000:2.0:1787508868.131839:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508868.131908:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:2402:x1874324509720064:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 27431us (27670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508868.131921:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27983 00000100:00100000:1.0:1787508868.157826:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508868.159014:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509720192 00000100:00100000:2.0:1787508868.159027:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509720192 00000100:00080000:1.0:1787508868.159102:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508868.159120:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94340 00000100:00100000:2.0:1787508868.159130:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+14:348685:x1874324509720192:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:2.0:1787508868.159152:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508868.159174:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac200/0xb126349c40f367c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaef00 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.159235:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fada00/0xb126349c40f367c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.159247:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fada00/0xb126349c40f367c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.159257:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fada00/0xb126349c40f367c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508868.159305:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508868.159309:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508868.159329:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fada00/0xb126349c40f367c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.159351:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac200/0xb126349c40f367c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef00 expref: 16 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.159369:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fada00/0xb126349c40f367c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef00 expref: 15 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.159377:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508868.159380:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508868.159384:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d3fada00, rc 0) 00000100:00100000:2.0:1787508868.159442:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:348685:x1874324509720192:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 314us (1633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508868.159450:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94340 00000100:00100000:1.0:1787508868.163792:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508868.163917:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509720448 00000100:00100000:2.0:1787508868.163927:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509720448 00000100:00100000:2.0:1787508868.164030:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94341 00000100:00100000:2.0:1787508868.164042:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:348685:x1874324509720448:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:2.0:1787508868.164074:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508868.164077:0:202227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787508868.164109:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fada00/0xb126349c40f367c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef00 expref: 15 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.164130:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508868.164135:0:202227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508868.164149:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad200/0xb126349c40f367ce lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaef07 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.164282:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad800/0xb126349c40f367d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.164292:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad800/0xb126349c40f367d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.164298:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad800/0xb126349c40f367d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.164305:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3facc00/0xb126349c40f367dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.164312:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3facc00/0xb126349c40f367dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.164316:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3facc00/0xb126349c40f367dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.164357:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3faca00/0xb126349c40f367e3 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.164362:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3faca00/0xb126349c40f367e3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.164366:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3faca00/0xb126349c40f367e3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508868.164372:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x127b:0x0]: returning size 10485760 00010000:00010000:2.0:1787508868.164429:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad800/0xb126349c40f367d5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.164434:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad800/0xb126349c40f367d5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.164438:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad800/0xb126349c40f367d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.164441:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad800/0xb126349c40f367d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.164445:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d3fad800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508868.164448:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad800/0xb126349c40f367d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.164455:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad800/0xb126349c40f367d5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.164461:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508868.164463:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508868.164476:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad800/0xb126349c40f367d5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.164480:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad800/0xb126349c40f367d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.164486:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3facc00/0xb126349c40f367dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.164490:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3facc00/0xb126349c40f367dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.164493:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3facc00/0xb126349c40f367dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.164496:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d3facc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508868.164498:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3facc00/0xb126349c40f367dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.164501:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3facc00/0xb126349c40f367dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.164504:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7222325d (ffff9091c816f400) 00010000:00010000:2.0:1787508868.164506:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508868.164507:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3facc00/0xb126349c40f367dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.164511:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3facc00/0xb126349c40f367dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.164534:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad200/0xb126349c40f367ce lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef07 expref: 17 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.164542:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3faca00/0xb126349c40f367e3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef07 expref: 16 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.164546:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127b:0x0].0x0 (ffff9091c816f100) 00010000:00010000:2.0:1787508868.164547:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787508868.164549:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d3faca00, rc 0) 00000100:00100000:2.0:1787508868.164604:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:348685:x1874324509720448:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 564us (822us total) trans 12884944301 rc 0/0 00000100:00100000:2.0:1787508868.164610:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94341 00000100:00100000:1.0:1787508868.193470:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508868.193581:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509720576 00000100:00100000:2.0:1787508868.193592:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509720576 00000100:00100000:2.0:1787508868.193690:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15116 00000100:00100000:2.0:1787508868.193701:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:348685:x1874324509720576:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:2.0:1787508868.193723:0:225836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508868.193742:0:225836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004de2c481/0xb126349c40f367f1 lrc: 2/0,0 mode: --/GROUP res: [0x280000401:0x1534:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaef0e expref: -99 pid: 225836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.193773:0:225836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1534:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787508868.194121:0:225836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1534:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1787508868.194131:0:225836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004de2c481/0xb126349c40f367f1 lrc: 3/0,0 mode: --/GROUP res: [0x280000401:0x1534:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 16022000 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef0e expref: 6 pid: 225836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.194149:0:225836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004de2c481/0xb126349c40f367f1 lrc: 3/0,0 mode: --/GROUP res: [0x280000401:0x1534:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 16022000 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef0e expref: 6 pid: 225836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508868.194164:0:225836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d3fad200, rc 0) 00000100:00080000:1.0:1787508868.194285:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787508868.194853:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:348685:x1874324509720576:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 1151us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508868.194862:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15116 00000100:00100000:2.0:1787508868.283837:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480286976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787508868.283915:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508868.284124:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480286976 00000100:00100000:1.0:1787508868.284133:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480286976 00000100:00100000:1.0:1787508868.284187:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1823 00000100:00100000:1.0:1787508868.284196:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480286976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787508868.284216:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 98025152 pending 10559488 free 3908710400 avail 3677188096 00000100:00100000:1.0:1787508868.284264:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480286976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508868.284271:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1823 00000100:00100000:1.0:1787508868.284311:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480286976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787508868.284497:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787508868.284506:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480287104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787508868.284532:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508868.284623:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480287104 00000100:00100000:2.0:1787508868.284627:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480287104 00000100:00100000:2.0:1787508868.284656:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1824 00000100:00100000:2.0:1787508868.284663:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480287104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787508868.284673:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 98025152 pending 10559488 free 3908710400 avail 3677188096 00000100:00100000:2.0:1787508868.284708:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480287104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508868.284714:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1824 00000100:00100000:3.0:1787508868.284800:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480287104:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787508868.670820:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508869.306238:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787508869.306892:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480287360:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787508869.307007:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508869.307354:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480287360 00000100:00100000:3.0:1787508869.307364:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480287360 00000100:00100000:3.0:1787508869.307429:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30050 00000100:00100000:3.0:1787508869.307439:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480287360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787508869.307482:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442709504 avail 1296470016 00000100:00100000:3.0:1787508869.307542:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480287360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508869.307549:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30050 00000100:00100000:3.0:1787508869.307608:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480287360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787508869.308520:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480287232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787508869.308585:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508869.309033:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480287232 00000100:00100000:2.0:1787508869.309042:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480287232 00000100:00100000:2.0:1787508869.309144:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30051 00000100:00100000:2.0:1787508869.309154:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480287232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787508869.309191:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440636928 avail 1294397440 00000100:00100000:2.0:1787508869.309394:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480287232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 242us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508869.309405:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30051 00000100:00100000:3.0:1787508869.309503:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480287232:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787508869.690361:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508870.365514:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508870.365623:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509720704 00000100:00100000:0.0:1787508870.365634:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509720704 00000100:00100000:0.0:1787508870.365722:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9850 00000100:00100000:0.0:1787508870.365735:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0218380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:2403:x1874324509720704:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508870.365752:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508870.365795:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a75ad07c/0xb126349c40f367b9 lrc: 0/0,0 mode: --/GROUP res: [0x280000401:0x1534:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 14091995 flags: 0x44801000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeef9 expref: 13 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508870.365816:0:202211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1534:0x0].0x0 since=2s v=(2 0) 00010000:00010000:0.0:1787508870.365821:0:202211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1534:0x0].0x0 since=0s v=(0 2) 00010000:00010000:0.0:1787508870.365828:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004de2c481/0xb126349c40f367f1 lrc: 2/0,0 mode: GROUP/GROUP res: [0x280000401:0x1534:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 16022000 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef0e expref: 5 pid: 225836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508870.365843:0:202211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004de2c481/0xb126349c40f367f1 lrc: 3/0,0 mode: GROUP/GROUP res: [0x280000401:0x1534:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 16022000 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef0e expref: 5 pid: 225836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508870.365883:0:202211:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004de2c481/0xb126349c40f367f1 lrc: 3/0,0 mode: GROUP/GROUP res: [0x280000401:0x1534:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 16022000 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef0e expref: 5 pid: 225836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508870.365898:0:202211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b55880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:202211:1874324480287488:192.168.201.30@tcp:105: 00000100:00100000:0.0:1787508870.366047:0:202211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090ce9806c0 going to sleep for 11 seconds 00000100:00080000:1.0:1787508870.366258:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787508870.373272:0:202211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b55880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:202211:1874324480287488:192.168.201.30@tcp:105: 00010000:00010000:2.0:1787508870.373301:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508870.373380:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0218380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:2403:x1874324509720704:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 7647us (7874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508870.373391:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9850 00000100:00100000:1.0:1787508870.374360:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508870.374446:0:203733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509720832 00000100:00100000:2.0:1787508870.374455:0:203733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509720832 00002000:00100000:2.0:1787508870.374520:0:203733:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x1534:0x0] (0->4095) req@ffff9090d021b100 x1874324509720832/t0(0) o3->eb35f31c-097f-45a3-8275-bc75f97f89ee@192.168.201.30@tcp:326/0 lens 488/0 e 0 to 0 dl 1787508881 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787508870.374531:0:203733:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090d021b100 with x1874324509720832 ext(0->4095) 00002000:00010000:2.0:1787508870.374537:0:203733:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9090d021b100 00000100:00100000:2.0:1787508870.374568:0:203733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:2.0:1787508870.374577:0:203733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d021b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2401:x1874324509720832:12345-192.168.201.30@tcp:3:multiop.0 00000100:00100000:2.0:1787508870.374717:0:203733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d021b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2401:x1874324509720832:12345-192.168.201.30@tcp:3:multiop.0 Request processed in 140us (360us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787508870.374725:0:203733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 61 00002000:00100000:2.0:1787508870.374731:0:203733:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x1534:0x0] (0->4095) req@ffff9090d021b100 x1874324509720832/t0(0) o3->eb35f31c-097f-45a3-8275-bc75f97f89ee@192.168.201.30@tcp:326/0 lens 488/4536 e 0 to 0 dl 1787508881 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787508870.374738:0:203733:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090d021b100 with x1874324509720832 ext(0->4095) 00002000:00010000:2.0:1787508870.374742:0:203733:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9090d021b100 00000100:00080000:1.0:1787508870.375153:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508870.378321:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508870.378369:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508870.378456:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509721216 00000100:00100000:0.0:1787508870.378467:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509721216 00000100:00100000:0.0:1787508870.378543:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15519 00000100:00100000:0.0:1787508870.378555:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:348685:x1874324509721216:12345-192.168.201.30@tcp:35:multiop.0 00000100:00100000:0.0:1787508870.378773:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:348685:x1874324509721216:12345-192.168.201.30@tcp:35:multiop.0 Request processed in 220us (403us total) trans 12884944302 rc 0/0 00000100:00100000:0.0:1787508870.378781:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15519 00000100:00080000:1.0:1787508870.379258:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787508870.379438:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509721088 00000100:00100000:3.0:1787508870.379445:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509721088 00000100:00100000:3.0:1787508870.379496:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9851 00000100:00100000:3.0:1787508870.379505:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde18450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509721088:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508870.379518:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508870.379559:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004de2c481/0xb126349c40f367f1 lrc: 0/0,0 mode: --/GROUP res: [0x280000401:0x1534:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 16022000 flags: 0x44801000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef0e expref: 6 pid: 225836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508870.379586:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508870.379630:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde18450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509721088:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 126us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508870.379638:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9851 00010000:00010000:3.0:1787508870.714599:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508871.286561:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508871.286614:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508871.286667:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508871.286698:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508871.286734:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509721600 00000100:00100000:1.0:1787508871.286746:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509721600 00000100:00100000:0.0:1787508871.286921:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509721344 00000100:00100000:0.0:1787508871.286926:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509721344 00000100:00100000:2.0:1787508871.286982:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509722112 00000100:00100000:2.0:1787508871.286988:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509722112 00000100:00100000:0.0:1787508871.287049:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1078 00000100:00100000:2.0:1787508871.287059:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3342 00000100:00100000:0.0:1787508871.287066:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fccc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2401:x1874324509721344:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508871.287074:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2401:x1874324509722112:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508871.287176:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509721856 00000100:00100000:3.0:1787508871.287182:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509721856 00000100:00100000:3.0:1787508871.287217:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2653 00000100:00100000:3.0:1787508871.287225:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2401:x1874324509721856:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508871.287292:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fccc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2401:x1874324509721344:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 231us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508871.287301:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1078 00000100:00100000:2.0:1787508871.287385:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2401:x1874324509722112:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 314us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508871.287395:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3342 00000100:00100000:1.0:1787508871.287434:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3343 00000100:00100000:1.0:1787508871.287444:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d2d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2401:x1874324509721600:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508871.287477:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2401:x1874324509721600:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 33us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508871.294513:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d2d3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2401:x1874324509721856:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 7274us (7830us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508871.294531:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2653 00000100:00080000:3.0:1787508871.294722:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787508871.294728:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787508871.301216:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508871.301285:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508871.301321:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508871.301346:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509722368 00000100:00100000:0.0:1787508871.301357:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509722368 00000100:00100000:0.0:1787508871.301419:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509721728 00000100:00100000:0.0:1787508871.301423:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509721728 00000100:00100000:0.0:1787508871.301450:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2654 00000100:00100000:0.0:1787508871.301462:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2401:x1874324509722368:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508871.301533:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2401:x1874324509722368:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 74us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508871.301541:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2654 00000100:00100000:0.0:1787508871.301557:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2655 00000100:00100000:0.0:1787508871.301564:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:2401:x1874324509721728:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508871.301588:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:2401:x1874324509721728:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508871.301593:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2655 00000100:00080000:0.0:1787508871.301614:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508871.301639:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508871.301684:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508871.301789:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509722240 00000100:00100000:0.0:1787508871.301794:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509722240 00000100:00100000:0.0:1787508871.301820:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2656 00000100:00100000:0.0:1787508871.301827:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2401:x1874324509722240:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508871.301857:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2401:x1874324509722240:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 31us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508871.301864:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2656 00000100:00100000:0.0:1787508871.301902:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509721472 00000100:00100000:0.0:1787508871.301905:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509721472 00000100:00100000:2.0:1787508871.302349:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509721984 00000100:00100000:2.0:1787508871.302355:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509721984 00000100:00100000:2.0:1787508871.302386:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3344 00000100:00100000:2.0:1787508871.302394:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:2401:x1874324509721984:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508871.302431:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:2401:x1874324509721984:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 38us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508871.302438:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3344 00000100:00080000:2.0:1787508871.302465:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787508871.308968:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3343 00000100:00100000:3.0:1787508871.309524:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3345 00000100:00100000:3.0:1787508871.309546:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+29:2401:x1874324509721472:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508871.309647:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+29:2401:x1874324509721472:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 112us (8361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508871.309656:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3345 00010000:00010000:1.0:1787508871.740493:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508871.868563:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787508871.868588:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480287616:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787508871.868671:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508871.869312:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787508871.869324:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480287744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787508871.869362:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508871.886610:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480287616 00000100:00100000:0.0:1787508871.886631:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480287616 00000100:00100000:0.0:1787508871.886719:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480287744 00000100:00100000:0.0:1787508871.886723:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480287744 00000100:00100000:0.0:1787508871.886745:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1825 00000100:00100000:0.0:1787508871.886756:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480287616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787508871.886792:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 165208640 pending 0 free 3881938944 avail 3650416640 00000100:00100000:0.0:1787508871.886909:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480287616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 155us (18237us total) trans 0 rc 0/0 00000100:00080000:1.0:1787508871.887162:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508871.887411:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1825 00000100:00100000:0.0:1787508871.887434:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1826 00000100:00100000:0.0:1787508871.887442:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480287744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787508871.887455:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 165208640 pending 0 free 3881938944 avail 3650416640 00000100:00100000:0.0:1787508871.887502:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480287744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (18140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508871.887509:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1826 00000100:00100000:0.0:1787508871.887567:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480287744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787508871.887630:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480287616:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787508872.762298:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508872.890730:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480288128:0@lo:400:kworker.0 00000100:00100000:1.0:1787508872.890819:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508872.890857:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480288640:0@lo:400:kworker.0 00000100:00100000:1.0:1787508872.890894:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508872.890920:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480289152:0@lo:400:kworker.0 00000100:00100000:1.0:1787508872.890970:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508872.891001:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787508872.891008:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480288000:0@lo:400:kworker.0 00000100:00100000:1.0:1787508872.891033:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508872.891061:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480288512:0@lo:400:kworker.0 00000100:00100000:1.0:1787508872.891083:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508872.891102:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480289024:0@lo:400:kworker.0 00000100:00100000:1.0:1787508872.891121:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508872.891155:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480288128 00000100:00100000:1.0:1787508872.891164:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480288128 00000100:00100000:1.0:1787508872.891217:0:203726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480288640 00000100:00100000:1.0:1787508872.891220:0:203726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480288640 00000100:00100000:1.0:1787508872.891247:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2657 00000100:00100000:1.0:1787508872.891269:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480288128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508872.891321:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480288128:12345-0@lo:400:kworker.0 Request processed in 66us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508872.891329:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2657 00000100:00100000:1.0:1787508872.891343:0:203726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2658 00000100:00100000:1.0:1787508872.891349:0:203726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cd4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480288640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508872.891373:0:203726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cd4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480288640:12345-0@lo:400:kworker.0 Request processed in 24us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508872.891379:0:203726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2658 00000100:00100000:1.0:1787508872.891400:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480288000 00000100:00100000:1.0:1787508872.891403:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480288000 00000100:00100000:1.0:1787508872.891425:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480288512 00000100:00100000:1.0:1787508872.891427:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480288512 00000100:00100000:1.0:1787508872.891443:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30052 00000100:00100000:1.0:1787508872.891449:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cd4a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480288000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508872.891480:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cd4a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480288000:12345-0@lo:400:kworker.0 Request processed in 31us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508872.891485:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30052 00000100:00100000:1.0:1787508872.891496:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30053 00000100:00100000:1.0:1787508872.891502:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cd4a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480288512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508872.891530:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cd4a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480288512:12345-0@lo:400:kworker.0 Request processed in 29us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508872.891538:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30053 00000100:00100000:1.0:1787508872.891555:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480289152 00000100:00100000:1.0:1787508872.891559:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480289152 00000100:00100000:1.0:1787508872.891581:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480289024 00000100:00100000:1.0:1787508872.891584:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480289024 00000100:00100000:1.0:1787508872.891605:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3346 00000100:00100000:1.0:1787508872.891612:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cd4a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480289152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508872.891640:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cd4a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480289152:12345-0@lo:400:kworker.0 Request processed in 30us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508872.891646:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3346 00000100:00100000:1.0:1787508872.891657:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3347 00000100:00100000:1.0:1787508872.891663:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cd4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480289024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508872.891688:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cd4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480289024:12345-0@lo:400:kworker.0 Request processed in 25us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508872.891695:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3347 00000100:00080000:1.0:1787508872.891710:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787508872.891714:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787508872.891717:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508872.891763:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480288000:0@lo:400:kworker.0 00000100:00100000:1.0:1787508872.891777:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480288512:0@lo:400:kworker.0 00000100:00100000:1.0:1787508872.891785:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480289024:0@lo:400:kworker.0 00000100:00100000:1.0:1787508872.891793:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480288128:0@lo:400:kworker.0 00000100:00100000:1.0:1787508872.891802:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480288640:0@lo:400:kworker.0 00000100:00100000:1.0:1787508872.891811:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480289152:0@lo:400:kworker.0 00000100:00100000:3.0:1787508872.891937:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480288256:0@lo:400:kworker.0 00000100:00100000:3.0:1787508872.892015:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508872.892037:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480288768:0@lo:400:kworker.0 00000100:00100000:3.0:1787508872.892059:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508872.892078:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480289280:0@lo:400:kworker.0 00000100:00100000:3.0:1787508872.892099:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508872.892118:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1787508872.892124:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480287872:0@lo:400:kworker.0 00000100:00100000:3.0:1787508872.892153:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508872.892180:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ed435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874324480288384:0@lo:400:kworker.0 00000100:00100000:3.0:1787508872.892201:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508872.892218:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874324480288896:0@lo:400:kworker.0 00000100:00100000:3.0:1787508872.892245:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508872.892260:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874324480289408:0@lo:400:kworker.0 00000100:00100000:3.0:1787508872.892280:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508872.892309:0:225838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480288256 00000100:00100000:3.0:1787508872.892313:0:225838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480288256 00000100:00100000:3.0:1787508872.892336:0:225838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480288768 00000100:00100000:3.0:1787508872.892339:0:225838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480288768 00000100:00100000:3.0:1787508872.892358:0:225838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2659 00000100:00100000:3.0:1787508872.892365:0:225838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480288256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508872.892402:0:225838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480288256:12345-0@lo:400:kworker.0 Request processed in 37us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508872.892408:0:225838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2659 00000100:00100000:3.0:1787508872.892423:0:225838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2660 00000100:00100000:3.0:1787508872.892427:0:225838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480288768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508872.892451:0:225838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480288768:12345-0@lo:400:kworker.0 Request processed in 24us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508872.892456:0:225838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2660 00000100:00100000:3.0:1787508872.892472:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480287872 00000100:00100000:3.0:1787508872.892475:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480287872 00000100:00100000:3.0:1787508872.892495:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:3.0:1787508872.892501:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fccc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480287872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508872.892527:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fccc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480287872:12345-0@lo:400:kworker.0 Request processed in 27us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508872.892533:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00100000:3.0:1787508872.892561:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480289280 00000100:00100000:3.0:1787508872.892564:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480289280 00000100:00100000:3.0:1787508872.892592:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480288384 00000100:00100000:3.0:1787508872.892595:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480288384 00000100:00100000:3.0:1787508872.892604:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480288896 00000100:00100000:3.0:1787508872.892606:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480288896 00000100:00100000:3.0:1787508872.892615:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480289408 00000100:00100000:3.0:1787508872.892617:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480289408 00000100:00100000:3.0:1787508872.892632:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3348 00000100:00100000:3.0:1787508872.892638:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480289280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508872.892666:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1874324480289280:12345-0@lo:400:kworker.0 Request processed in 28us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508872.892671:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3348 00000100:00100000:3.0:1787508872.892683:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3349 00000100:00100000:3.0:1787508872.892688:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874324480288384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508872.892715:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1874324480288384:12345-0@lo:400:kworker.0 Request processed in 27us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508872.892721:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3349 00000100:00100000:3.0:1787508872.892731:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3350 00000100:00100000:3.0:1787508872.892736:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874324480288896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508872.892761:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1874324480288896:12345-0@lo:400:kworker.0 Request processed in 25us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508872.892767:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3350 00000100:00100000:3.0:1787508872.892778:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3351 00000100:00100000:3.0:1787508872.892784:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874324480289408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508872.892808:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1874324480289408:12345-0@lo:400:kworker.0 Request processed in 24us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508872.892813:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3351 00000100:00080000:3.0:1787508872.892832:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787508872.892836:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787508872.892855:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480287872:0@lo:400:kworker.0 00000100:00100000:3.0:1787508872.892866:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3616:1874324480288384:0@lo:400:kworker.0 00000100:00100000:3.0:1787508872.892873:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3616:1874324480288896:0@lo:400:kworker.0 00000100:00100000:3.0:1787508872.892881:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3616:1874324480289408:0@lo:400:kworker.0 00000100:00100000:3.0:1787508872.892888:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ed437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480288256:0@lo:400:kworker.0 00000100:00100000:3.0:1787508872.892897:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480288768:0@lo:400:kworker.0 00000100:00100000:3.0:1787508872.892905:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3616:1874324480289280:0@lo:400:kworker.0 00000001:00080000:2.0:1787508872.895366:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944302 is committed 00000001:00080000:2.0:1787508872.895402:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944300 is committed 00010000:00010000:3.0:1787508872.895476:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3675e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508872.895489:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3675e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508872.895496:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3675e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508872.895502:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090cd2aa400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508872.895507:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3675e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508872.895515:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3675e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508872.895532:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7222325d (ffff9091c816f400) 00010000:00010000:3.0:1787508872.895607:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508872.895613:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3675e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508872.895619:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090cd2aa400/0xb126349c40f3675e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7222325d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508873.404284:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cd4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480289536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787508873.404374:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508873.404683:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787508873.404690:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cd4a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480289664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787508873.404727:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508873.404802:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480289536 00000100:00100000:0.0:1787508873.404816:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480289536 00000100:00100000:0.0:1787508873.404871:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480289664 00000100:00100000:0.0:1787508873.404873:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480289664 00000100:00100000:0.0:1787508873.404888:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1827 00000100:00100000:0.0:1787508873.404897:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cd4a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480289536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787508873.404984:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 98025152 pending 10559488 free 3898224640 avail 3666702336 00000100:00100000:3.0:1787508873.405190:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1828 00000100:00100000:3.0:1787508873.405200:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cd4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480289664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787508873.405210:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 98025152 pending 10559488 free 3898224640 avail 3666702336 00000100:00100000:3.0:1787508873.405266:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cd4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480289664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508873.405271:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1828 00000100:00100000:0.0:1787508873.405424:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cd4a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480289536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 528us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508873.405432:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1827 00000100:00100000:1.0:1787508873.406910:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cd4a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480289664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787508873.406935:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cd4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480289536:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787508873.786316:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787508873.919844:0:203722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589941263 is committed 00000100:00100000:1.0:1787508874.428508:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480289792:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787508874.428587:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508874.430279:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480289792 00000100:00100000:2.0:1787508874.430296:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480289792 00000100:00100000:2.0:1787508874.430361:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30054 00000100:00100000:2.0:1787508874.430372:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cd4a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480289792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787508874.430415:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442709504 avail 1296470016 00000100:00100000:2.0:1787508874.430510:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cd4a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480289792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (1922us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508874.430519:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30054 00000100:00100000:2.0:1787508874.430579:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480289792:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787508874.435323:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6b57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480289920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787508874.435398:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508874.435457:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480289920 00000100:00100000:0.0:1787508874.435465:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480289920 00000100:00100000:0.0:1787508874.435511:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30055 00000100:00100000:0.0:1787508874.435519:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480289920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787508874.435553:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440636928 avail 1294397440 00000100:00100000:0.0:1787508874.435598:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480289920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508874.435605:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30055 00000100:00100000:0.0:1787508874.435654:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6b57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480289920:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787508874.811629:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508875.834248:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508876.398469:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508876.398511:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508876.398544:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508876.398572:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508876.398609:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508876.398628:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508876.398641:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508876.398655:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508876.398671:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508876.398804:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509722496 00000100:00100000:3.0:1787508876.398814:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509722496 00000100:00100000:3.0:1787508876.398880:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1080 00000100:00100000:3.0:1787508876.398890:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fccc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509722496:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508876.399015:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fccc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509722496:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 126us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508876.399034:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1080 00000100:00100000:3.0:1787508876.399072:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509722752 00000100:00100000:3.0:1787508876.399076:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509722752 00000100:00100000:3.0:1787508876.399109:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509723264 00000100:00100000:3.0:1787508876.399113:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509723264 00000100:00100000:3.0:1787508876.399128:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509722624 00000100:00100000:3.0:1787508876.399131:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509722624 00000100:00100000:3.0:1787508876.399147:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509723136 00000100:00100000:3.0:1787508876.399150:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509723136 00000100:00100000:3.0:1787508876.399164:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3352 00000100:00100000:3.0:1787508876.399170:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2402:x1874324509722752:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508876.399200:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2402:x1874324509722752:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 30us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508876.399206:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3352 00000100:00100000:3.0:1787508876.399218:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3353 00000100:00100000:3.0:1787508876.399223:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2402:x1874324509723264:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508876.399243:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2402:x1874324509723264:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508876.399248:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3353 00000100:00100000:3.0:1787508876.399258:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3354 00000100:00100000:3.0:1787508876.399262:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d39fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+25:2402:x1874324509722624:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508876.399281:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d39fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+25:2402:x1874324509722624:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 19us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508876.399287:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3354 00000100:00100000:3.0:1787508876.399297:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3355 00000100:00100000:3.0:1787508876.399303:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d39fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2402:x1874324509723136:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508876.399323:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d39fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:2402:x1874324509723136:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 20us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508876.399328:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3355 00000100:00100000:3.0:1787508876.399346:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509723008 00000100:00100000:3.0:1787508876.399350:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509723008 00000100:00100000:3.0:1787508876.399374:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509723520 00000100:00100000:3.0:1787508876.399376:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509723520 00000100:00100000:3.0:1787508876.399389:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509722880 00000100:00100000:3.0:1787508876.399392:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509722880 00000100:00100000:3.0:1787508876.399406:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509723392 00000100:00100000:3.0:1787508876.399409:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509723392 00000100:00100000:3.0:1787508876.399425:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2661 00000100:00100000:3.0:1787508876.399431:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509723008:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508876.399455:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509723008:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508876.399461:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2661 00000100:00100000:3.0:1787508876.399472:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2662 00000100:00100000:3.0:1787508876.399479:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d39f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509723520:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508876.399501:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d39f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509723520:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508876.399506:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2662 00000100:00100000:3.0:1787508876.399516:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2663 00000100:00100000:3.0:1787508876.399521:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d39fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509722880:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508876.399541:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d39fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509722880:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508876.399546:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2663 00000100:00100000:3.0:1787508876.399556:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2664 00000100:00100000:3.0:1787508876.399562:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d39fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509723392:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508876.399578:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d39fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509723392:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 17us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508876.399585:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2664 00000100:00080000:3.0:1787508876.399755:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787508876.399759:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787508876.399761:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787508876.399763:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787508876.858464:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508876.986436:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787508876.986462:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d39faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480290048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787508876.986531:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508876.986809:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480290048 00000100:00100000:0.0:1787508876.986818:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480290048 00000100:00100000:0.0:1787508876.986889:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1829 00000100:00100000:0.0:1787508876.986898:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480290048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787508876.986937:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 165208640 pending 0 free 3881938944 avail 3650416640 00000100:00100000:0.0:1787508876.987010:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480290048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508876.987017:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1829 00000100:00080000:2.0:1787508876.987173:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787508876.987272:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d39faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480290048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787508876.987522:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787508876.987532:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480290176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508876.987562:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508876.987992:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480290176 00000100:00100000:0.0:1787508876.987998:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480290176 00000100:00100000:0.0:1787508876.988058:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1830 00000100:00100000:0.0:1787508876.988066:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cd4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480290176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787508876.988082:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 165208640 pending 0 free 3881938944 avail 3650416640 00000100:00080000:2.0:1787508876.988289:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508876.988387:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cd4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480290176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 321us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508876.988395:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1830 00000100:00100000:1.0:1787508876.989985:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480290176:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787508877.883635:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787508877.905841:0:236643:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 107b: Grouplock is added to the head of waiting list ========================================================== 14:14:36 (1787508876) 00000100:00100000:0.0:1787508877.994293:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508877.994438:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509723648 00000100:00100000:2.0:1787508877.994448:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509723648 00000100:00100000:2.0:1787508877.994509:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94342 00000100:00100000:2.0:1787508877.994519:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d39fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+25:349264:x1874324509723648:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:2.0:1787508877.994551:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508877.994571:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac600/0xb126349c40f367f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaef15 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508877.994630:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad000/0xb126349c40f367ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508877.994644:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad000/0xb126349c40f367ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508877.994656:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad000/0xb126349c40f367ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508877.994706:0:203348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508877.994710:0:203348:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508877.994727:0:203348:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad000/0xb126349c40f367ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508877.994749:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac600/0xb126349c40f367f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef15 expref: 27 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508877.994769:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad000/0xb126349c40f367ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef15 expref: 26 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508877.994777:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508877.994780:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508877.994784:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d3fad000, rc 0) 00000100:00100000:2.0:1787508877.994835:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d39fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+26:349264:x1874324509723648:12345-192.168.201.30@tcp:101:dd.0 Request processed in 318us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508877.994842:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94342 00000100:00100000:3.0:1787508878.001082:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508878.001127:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509723904 00000100:00100000:3.0:1787508878.001137:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509723904 00000100:00100000:3.0:1787508878.001200:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94343 00000100:00100000:3.0:1787508878.001213:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+26:349264:x1874324509723904:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:3.0:1787508878.001796:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508878.001801:0:202226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787508878.001832:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad000/0xb126349c40f367ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef15 expref: 26 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.001853:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508878.001859:0:202226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787508878.001874:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36806 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaef1c expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.002046:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3680d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.002060:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3680d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.002069:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3680d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.002086:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36814 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.002094:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36814 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.002100:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36814 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787508878.002481:0:202226:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1590:0x0], index 1: 0 00010000:00010000:3.0:1787508878.004329:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3681b lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.004349:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3681b lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.004361:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3681b lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.004399:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3680d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.004406:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3680d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.004412:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3680d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.004419:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3680d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.004425:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508878.004429:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3680d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.004436:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3680d lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.004447:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508878.004450:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508878.004454:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3680d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.004460:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3680d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787508878.004472:0:202226:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000757b6ee2 reply state 000000007de35e28 transno 12884944303 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36814 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.004484:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36814 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.004490:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe75d78b6 (ffff9090cc088a00) 00010000:00010000:3.0:1787508878.004492:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787508878.004495:0:202226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787508878.004531:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f36806 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef1c expref: 28 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.005431:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3681b lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef1c expref: 27 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.005441:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127c:0x0].0x0 (ffff9090cc088e00) 00010000:00010000:3.0:1787508878.005444:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787508878.005448:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e800, rc 0) 00000100:00100000:3.0:1787508878.005532:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+28:349264:x1874324509723904:12345-192.168.201.30@tcp:101:dd.0 Request processed in 4321us (4460us total) trans 12884944303 rc 0/0 00000100:00100000:3.0:1787508878.005929:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94343 00000100:00100000:2.0:1787508878.013888:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d39f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480290304:0@lo:400:kworker.0 00000100:00100000:2.0:1787508878.013999:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508878.014071:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480290304 00000100:00100000:2.0:1787508878.014079:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480290304 00000100:00100000:2.0:1787508878.014129:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:2.0:1787508878.014138:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fccc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480290304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508878.014190:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fccc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3616:x1874324480290304:12345-0@lo:400:kworker.0 Request processed in 53us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508878.014197:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:2.0:1787508878.014250:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d39f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:79de3f65-4bad-42d0-a46f-842a654b33a0:3616:1874324480290304:0@lo:400:kworker.0 00000100:00100000:0.0:1787508878.014418:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d39f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480290432:0@lo:400:kworker.0 00000100:00100000:0.0:1787508878.014471:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508878.014497:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d39f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480290944:0@lo:400:kworker.0 00000100:00100000:0.0:1787508878.014519:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508878.015908:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d39fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874324480291456:0@lo:400:kworker.0 00000100:00100000:0.0:1787508878.015989:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508878.016029:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787508878.016040:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d39f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874324480290816:0@lo:400:kworker.0 00000100:00100000:0.0:1787508878.016066:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508878.016082:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d39fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480291328:0@lo:400:kworker.0 00000100:00100000:0.0:1787508878.016102:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508878.016122:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d39faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480291840:0@lo:400:kworker.0 00000100:00100000:0.0:1787508878.016142:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508878.016176:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480291456 00000100:00100000:0.0:1787508878.016183:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480291456 00000100:00100000:0.0:1787508878.016229:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480290816 00000100:00100000:0.0:1787508878.016233:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480290816 00000100:00100000:0.0:1787508878.016249:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480291328 00000100:00100000:0.0:1787508878.016251:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480291328 00000100:00100000:0.0:1787508878.016267:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480291840 00000100:00100000:0.0:1787508878.016270:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480291840 00000100:00100000:0.0:1787508878.016286:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3356 00000100:00100000:0.0:1787508878.016294:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cda07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874324480291456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508878.016344:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cda07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874324480291456:12345-0@lo:400:kworker.0 Request processed in 51us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508878.016351:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3356 00000100:00100000:0.0:1787508878.016367:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3357 00000100:00100000:0.0:1787508878.016373:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cda07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874324480290816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508878.016398:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cda07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874324480290816:12345-0@lo:400:kworker.0 Request processed in 26us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508878.016404:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3357 00000100:00100000:0.0:1787508878.016415:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3358 00000100:00100000:0.0:1787508878.016421:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cda07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480291328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508878.016446:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cda07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480291328:12345-0@lo:400:kworker.0 Request processed in 26us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508878.016453:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3358 00000100:00100000:0.0:1787508878.016463:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3359 00000100:00100000:0.0:1787508878.016468:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cda06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480291840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508878.016493:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cda06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480291840:12345-0@lo:400:kworker.0 Request processed in 25us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508878.016498:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3359 00000100:00100000:0.0:1787508878.016551:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d39f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874324480290816:0@lo:400:kworker.0 00000100:00100000:0.0:1787508878.016563:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d39fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480291328:0@lo:400:kworker.0 00000100:00100000:0.0:1787508878.016573:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d39faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480291840:0@lo:400:kworker.0 00000100:00100000:0.0:1787508878.016582:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d39fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874324480291456:0@lo:400:kworker.0 00000100:00100000:2.0:1787508878.016709:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d39f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480290688:0@lo:400:kworker.0 00000100:00100000:2.0:1787508878.016745:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508878.016773:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d39f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480291200:0@lo:400:kworker.0 00000100:00100000:2.0:1787508878.016794:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508878.016826:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d39f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874324480291712:0@lo:400:kworker.0 00000100:00100000:2.0:1787508878.016846:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508878.016866:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787508878.016872:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d39f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480290560:0@lo:400:kworker.0 00000100:00100000:2.0:1787508878.016905:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508878.016926:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d39f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480291072:0@lo:400:kworker.0 00000100:00100000:2.0:1787508878.016976:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508878.016995:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d39f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480291584:0@lo:400:kworker.0 00000100:00100000:2.0:1787508878.017014:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508878.017040:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480290432 00000100:00100000:2.0:1787508878.017045:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480290432 00000100:00100000:2.0:1787508878.017075:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480290944 00000100:00100000:2.0:1787508878.017078:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480290944 00000100:00100000:2.0:1787508878.017098:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30056 00000100:00100000:2.0:1787508878.017104:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cda04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480290432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508878.017143:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cda04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480290432:12345-0@lo:400:kworker.0 Request processed in 39us (2672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508878.017149:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30056 00000100:00100000:2.0:1787508878.017162:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30057 00000100:00100000:2.0:1787508878.017168:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cda04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480290944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508878.017194:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cda04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480290944:12345-0@lo:400:kworker.0 Request processed in 27us (2674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508878.017199:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30057 00000100:00100000:2.0:1787508878.017216:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480291712 00000100:00100000:2.0:1787508878.017218:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480291712 00000100:00100000:2.0:1787508878.017243:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480291584 00000100:00100000:2.0:1787508878.017245:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480291584 00000100:00100000:2.0:1787508878.017258:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3360 00000100:00100000:2.0:1787508878.017262:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874324480291712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508878.017294:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874324480291712:12345-0@lo:400:kworker.0 Request processed in 32us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508878.017300:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3360 00000100:00100000:2.0:1787508878.017310:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3361 00000100:00100000:2.0:1787508878.017316:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480291584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508878.017340:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480291584:12345-0@lo:400:kworker.0 Request processed in 25us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508878.017346:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3361 00000100:00080000:2.0:1787508878.017366:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787508878.017369:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508878.017381:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480290688 00000100:00100000:2.0:1787508878.017384:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480290688 00000100:00100000:2.0:1787508878.017409:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480291200 00000100:00100000:2.0:1787508878.017411:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480291200 00000100:00100000:2.0:1787508878.017424:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480290560 00000100:00100000:2.0:1787508878.017426:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480290560 00000100:00100000:2.0:1787508878.017439:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480291072 00000100:00100000:2.0:1787508878.017441:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480291072 00000100:00100000:2.0:1787508878.017455:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2665 00000100:00100000:2.0:1787508878.017460:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480290688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508878.017490:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480290688:12345-0@lo:400:kworker.0 Request processed in 30us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508878.017495:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2665 00000100:00100000:2.0:1787508878.017504:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2666 00000100:00100000:2.0:1787508878.017509:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480291200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508878.017532:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480291200:12345-0@lo:400:kworker.0 Request processed in 22us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508878.017553:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2666 00000100:00100000:2.0:1787508878.017564:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2667 00000100:00100000:2.0:1787508878.017570:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480290560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508878.017596:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480290560:12345-0@lo:400:kworker.0 Request processed in 27us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508878.017602:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2667 00000100:00100000:2.0:1787508878.017612:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2668 00000100:00100000:2.0:1787508878.017617:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480291072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508878.017640:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480291072:12345-0@lo:400:kworker.0 Request processed in 24us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508878.017645:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2668 00000100:00080000:2.0:1787508878.017673:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787508878.017676:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787508878.017701:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d39f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480290560:0@lo:400:kworker.0 00000100:00100000:2.0:1787508878.017710:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d39f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480291072:0@lo:400:kworker.0 00000100:00100000:2.0:1787508878.017718:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d39f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480291584:0@lo:400:kworker.0 00000100:00100000:2.0:1787508878.017726:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d39f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480290688:0@lo:400:kworker.0 00000100:00100000:2.0:1787508878.017735:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d39f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480291200:0@lo:400:kworker.0 00000100:00100000:2.0:1787508878.017743:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d39f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874324480291712:0@lo:400:kworker.0 00000100:00100000:2.0:1787508878.017786:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d39f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480290432:0@lo:400:kworker.0 00000100:00100000:2.0:1787508878.017796:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d39f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480290944:0@lo:400:kworker.0 00000100:00100000:0.0:1787508878.023290:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508878.023536:0:225838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509724032 00000100:00100000:3.0:1787508878.023547:0:225838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509724032 00000100:00080000:2.0:1787508878.023648:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787508878.023694:0:225838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15117 00000100:00100000:3.0:1787508878.023706:0:225838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cda06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:349264:x1874324509724032:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:3.0:1787508878.023724:0:225838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508878.023748:0:225838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a75ad07c/0xb126349c40f36829 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1590:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaef23 expref: -99 pid: 225838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787508878.023775:0:225838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1590:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787508878.023799:0:225838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1590:0x0].0x0 since=13849s v=(0 0) 00010000:00010000:3.0:1787508878.023805:0:225838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1590:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787508878.023815:0:225838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a75ad07c/0xb126349c40f36829 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1590:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef23 expref: 7 pid: 225838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.023834:0:225838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a75ad07c/0xb126349c40f36829 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1590:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef23 expref: 7 pid: 225838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.023849:0:225838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fc00, rc 0) 00000100:00100000:3.0:1787508878.023926:0:225838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cda06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:349264:x1874324509724032:12345-192.168.201.30@tcp:101:dd.0 Request processed in 223us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508878.023933:0:225838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15117 00000100:00100000:0.0:1787508878.131224:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508878.131322:0:205407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509724160 00000100:00100000:2.0:1787508878.131332:0:205407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509724160 00002000:00100000:2.0:1787508878.131382:0:205407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1590:0x0] (0->4194303) req@ffff9090cda07480 x1874324509724160/t0(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:334/0 lens 488/0 e 0 to 0 dl 1787508889 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787508878.131393:0:205407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090cda07480 with x1874324509724160 ext(0->4194303) 00002000:00010000:2.0:1787508878.131399:0:205407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9090cda07480 00000100:00100000:2.0:1787508878.131434:0:205407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 62 00000100:00100000:2.0:1787508878.131444:0:205407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cda07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2403:x1874324509724160:12345-192.168.201.30@tcp:4:dd.0 00000100:00100000:2.0:1787508878.216634:0:205407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cda07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:2403:x1874324509724160:12345-192.168.201.30@tcp:4:dd.0 Request processed in 85177us (85407us total) trans 8589940576 rc 0/0 00000100:00100000:2.0:1787508878.216650:0:205407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 62 00002000:00100000:2.0:1787508878.216664:0:205407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1590:0x0] (0->4194303) req@ffff9090cda07480 x1874324509724160/t8589940576(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:334/0 lens 488/448 e 0 to 0 dl 1787508889 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787508878.216675:0:205407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090cda07480 with x1874324509724160 ext(0->4194303) 00002000:00010000:2.0:1787508878.216683:0:205407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9090cda07480 00000100:00100000:3.0:1787508878.224348:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508878.224800:0:203731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509724288 00000100:00100000:1.0:1787508878.224811:0:203731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509724288 00002000:00100000:1.0:1787508878.224879:0:203731:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x1590:0x0] (4194304->8388607) req@ffff9091f9acd180 x1874324509724288/t0(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:334/0 lens 488/0 e 0 to 0 dl 1787508889 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787508878.224898:0:203731:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091f9acd180 with x1874324509724288 ext(4194304->8388607) 00002000:00010000:1.0:1787508878.224904:0:203731:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9091f9acd180 00000100:00100000:1.0:1787508878.224967:0:203731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:1.0:1787508878.224979:0:203731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9acd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:2400:x1874324509724288:12345-192.168.201.30@tcp:4:dd.0 00000100:00100000:3.0:1787508878.250673:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508878.253666:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509724544 00000100:00100000:1.0:1787508878.253684:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509724544 00000100:00100000:1.0:1787508878.253777:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15520 00000100:00100000:1.0:1787508878.253788:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cbebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+28:349264:x1874324509724544:12345-192.168.201.30@tcp:35:dd.0 00000100:00100000:1.0:1787508878.254154:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cbebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+29:349264:x1874324509724544:12345-192.168.201.30@tcp:35:dd.0 Request processed in 367us (3491us total) trans 12884944304 rc 0/0 00000100:00100000:1.0:1787508878.254163:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15520 00000100:00080000:2.0:1787508878.254258:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787508878.275537:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508878.276676:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509724672 00000100:00100000:1.0:1787508878.276692:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509724672 00000100:00100000:1.0:1787508878.276765:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94344 00000100:00100000:1.0:1787508878.276777:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cbebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+29:349265:x1874324509724672:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508878.276806:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508878.276829:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f36830 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaef2a expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508878.276904:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f36837 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508878.276920:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f36837 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508878.276930:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f36837 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508878.277004:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508878.277008:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508878.277027:0:205405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f36837 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508878.277051:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f36830 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef2a expref: 31 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508878.277072:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f36837 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef2a expref: 30 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508878.277081:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508878.277083:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508878.277087:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ae00, rc 0) 00000100:00100000:1.0:1787508878.277162:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cbebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+30:349265:x1874324509724672:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 386us (1633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508878.277170:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94344 00000100:00100000:0.0:1787508878.283488:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508878.284086:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509724800 00000100:00100000:3.0:1787508878.284095:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509724800 00000100:00100000:3.0:1787508878.284151:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94345 00000100:00100000:3.0:1787508878.284162:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cda04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+30:349265:x1874324509724800:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:3.0:1787508878.284234:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3683e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284252:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3683e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284263:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3683e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284280:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f36845 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284287:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f36845 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284294:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f36845 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284380:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3684c lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284389:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3684c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284395:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3684c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787508878.284434:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x127c:0x0]: returning size 10485760 00000004:00200000:3.0:1787508878.284438:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787508878.284451:0:209004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3684c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284465:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3683e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284471:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3683e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284478:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3683e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284487:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3683e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284493:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508878.284496:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3683e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284503:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3683e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284515:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508878.284518:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508878.284522:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3683e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284528:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f3683e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284539:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f36845 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284544:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f36845 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284549:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f36845 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284554:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508878.284556:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f36845 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284565:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f36845 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284571:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe75d78b6 (ffff9090cc088a00) 00010000:00010000:3.0:1787508878.284573:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508878.284575:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f36845 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284581:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e600/0xb126349c40f36845 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284588:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3684c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284594:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3684c lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284599:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3684c lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284605:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508878.284607:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3684c lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284613:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3684c lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284619:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127c:0x0].0x0 (ffff9090cc088e00) 00010000:00010000:3.0:1787508878.284621:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508878.284624:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3684c lrc: 2/0,0 mode: --/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.284629:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e400/0xb126349c40f3684c lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508878.284709:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cda04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+30:349265:x1874324509724800:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 548us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508878.284717:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94345 00000100:00100000:1.0:1787508878.305678:0:203731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9acd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:2400:x1874324509724288:12345-192.168.201.30@tcp:4:dd.0 Request processed in 80690us (81329us total) trans 8589940577 rc 0/0 00000100:00100000:1.0:1787508878.305693:0:203731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 63 00002000:00100000:1.0:1787508878.305708:0:203731:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x1590:0x0] (4194304->8388607) req@ffff9091f9acd180 x1874324509724288/t8589940577(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:334/0 lens 488/448 e 0 to 0 dl 1787508889 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787508878.305718:0:203731:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091f9acd180 with x1874324509724288 ext(4194304->8388607) 00002000:00010000:1.0:1787508878.305725:0:203731:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9091f9acd180 00000100:00100000:0.0:1787508878.310158:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508878.310341:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509725056 00000100:00100000:2.0:1787508878.310352:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509725056 00000100:00100000:2.0:1787508878.310457:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94346 00000100:00100000:2.0:1787508878.310468:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cda05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+30:349267:x1874324509725056:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:2.0:1787508878.310487:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508878.310490:0:230618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787508878.310519:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f36837 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef2a expref: 30 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.310537:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508878.310541:0:230618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508878.310554:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad200/0xb126349c40f36853 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaef31 expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.310661:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3face00/0xb126349c40f3685a lrc: 3/0,1 mode: --/CW res: [0x2000013a4:0x127c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.310674:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3681b lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef1c expref: 30 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.310682:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3face00/0xb126349c40f3685a lrc: 4/0,1 mode: --/CW res: [0x2000013a4:0x127c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.310714:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3681b lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef1c expref: 30 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.310729:0:230618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3681b lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef1c expref: 30 pid: 202226 timeout: 13949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508878.310742:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb62a00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480291968:192.168.201.30@tcp:104: 00000100:00100000:2.0:1787508878.310831:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1967240 going to sleep for 11 seconds 00000100:00100000:0.0:1787508878.312708:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb62a00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480291968:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508878.312736:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3face00/0xb126349c40f3685a lrc: 3/0,1 mode: --/CW res: [0x2000013a4:0x127c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508878.313004:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508878.313168:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509725184 00000100:00100000:2.0:1787508878.313176:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509725184 00010000:00010000:2.0:1787508878.313213:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3681b lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef1c expref: 31 pid: 202226 timeout: 13949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508878.313247:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27984 00000100:00100000:2.0:1787508878.313261:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cda05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+31:2401:x1874324509725184:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508878.313278:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508878.313284:0:229383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3681b lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef1c expref: 31 pid: 202226 timeout: 13949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.313298:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3681b lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef1c expref: 31 pid: 202226 timeout: 13949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.313318:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f3681b lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef1c expref: 31 pid: 202226 timeout: 13949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.313333:0:229383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127c:0x0].0x0 (ffff9090cc088e00) 00010000:00010000:2.0:1787508878.313339:0:229383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3face00/0xb126349c40f3685a lrc: 3/0,1 mode: --/CW res: [0x2000013a4:0x127c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.313348:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3face00/0xb126349c40f3685a lrc: 3/0,1 mode: CW/CW res: [0x2000013a4:0x127c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.313356:0:229383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3face00/0xb126349c40f3685a lrc: 4/0,1 mode: CW/CW res: [0x2000013a4:0x127c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.313465:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508878.313764:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3face00/0xb126349c40f3685a lrc: 3/0,1 mode: CW/CW res: [0x2000013a4:0x127c:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508878.313771:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3face00/0xb126349c40f3685a lrc: 3/0,1 mode: CW/CW res: [0x2000013a4:0x127c:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508878.313935:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cda05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+30:2401:x1874324509725184:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 677us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508878.313968:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27984 00000004:00200000:0.0:1787508878.314031:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x127c:0x0]: returning size 10485760 00010000:00010000:1.0:1787508878.314562:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad200/0xb126349c40f36853 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef31 expref: 31 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508878.314581:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3face00/0xb126349c40f3685a lrc: 3/0,0 mode: CW/CW res: [0x2000013a4:0x127c:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef31 expref: 30 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508878.314589:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127c:0x0].0x0 (ffff9090cc088e00) 00010000:00010000:1.0:1787508878.314592:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787508878.314596:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d3face00, rc 0) 00000100:00100000:1.0:1787508878.314680:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cda05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+30:349267:x1874324509725056:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 4213us (4533us total) trans 12884944305 rc 0/0 00000100:00100000:1.0:1787508878.314687:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94346 00000100:00100000:0.0:1787508878.317475:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508878.317516:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509725312 00000100:00100000:2.0:1787508878.317527:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509725312 00000100:00100000:2.0:1787508878.317576:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94347 00000100:00100000:2.0:1787508878.317586:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cda04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+30:349267:x1874324509725312:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:2.0:1787508878.317611:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508878.317631:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac000/0xb126349c40f36868 lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaef38 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.317687:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac000/0xb126349c40f36868 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef38 expref: 31 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.317699:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac000/0xb126349c40f36868 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef38 expref: 31 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.317714:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127c:0x0].0x0 (ffff9090cc088e00) 00010000:00010000:2.0:1787508878.317716:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787508878.317719:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d3fac000, rc 0) 00000100:00100000:2.0:1787508878.317769:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cda04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+31:349267:x1874324509725312:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 184us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508878.317875:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94347 00000100:00100000:2.0:1787508878.319275:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508878.319339:0:225835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509725440 00000100:00100000:0.0:1787508878.319346:0:225835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509725440 00000100:00100000:0.0:1787508878.319383:0:225835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15118 00000100:00100000:0.0:1787508878.319389:0:225835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:349267:x1874324509725440:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:0.0:1787508878.319399:0:225835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508878.319411:0:225835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012917839/0xb126349c40f3686f lrc: 2/0,0 mode: --/GROUP res: [0x2c0000401:0x1590:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaef3f expref: -99 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508878.319431:0:225835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a75ad07c/0xb126349c40f36829 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef23 expref: 12 pid: 225838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508878.319438:0:225835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1590:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787508878.319441:0:225835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1590:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787508878.319445:0:225835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012917839/0xb126349c40f3686f lrc: 4/0,0 mode: --/GROUP res: [0x2c0000401:0x1590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 14091995 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef3f expref: 12 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508878.319469:0:225835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a75ad07c/0xb126349c40f36829 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef23 expref: 12 pid: 225838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508878.319480:0:225835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a75ad07c/0xb126349c40f36829 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef23 expref: 12 pid: 225838 timeout: 13949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508878.319490:0:225835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cda05f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:225835:1874324480292096:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508878.319548:0:225835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c9919a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787508878.321409:0:225835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cda05f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:225835:1874324480292096:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508878.321439:0:225835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000012917839/0xb126349c40f3686f lrc: 3/0,0 mode: --/GROUP res: [0x2c0000401:0x1590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 14091995 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef3f expref: 12 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508878.321458:0:225835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5400, rc 0) 00000100:00100000:0.0:1787508878.321523:0:225835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:349267:x1874324509725440:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 2132us (2252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508878.321532:0:225835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15118 00000100:00100000:3.0:1787508878.324883:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508878.325129:0:203732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509725568 00000100:00100000:0.0:1787508878.325140:0:203732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509725568 00002000:00100000:0.0:1787508878.325193:0:203732:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1590:0x0] (8388608->10485759) req@ffff9090cbebdf80 x1874324509725568/t0(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:334/0 lens 488/0 e 0 to 0 dl 1787508889 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787508878.325260:0:203732:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090cbebdf80 with x1874324509725568 ext(8388608->10485759) 00010000:00010000:0.0:1787508878.325271:0:203732:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a75ad07c/0xb126349c40f36829 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef23 expref: 12 pid: 225838 timeout: 13949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508878.325287:0:203732:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a75ad07c/0xb126349c40f36829 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef23 expref: 12 pid: 225838 timeout: 13949 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787508878.325296:0:203732:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9090cbebdf80 00000100:00100000:0.0:1787508878.325365:0:203732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:0.0:1787508878.325376:0:203732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cbebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:2400:x1874324509725568:12345-192.168.201.30@tcp:4:dd.0 00000100:00100000:0.0:1787508878.344734:0:203732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cbebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:2400:x1874324509725568:12345-192.168.201.30@tcp:4:dd.0 Request processed in 19347us (19847us total) trans 8589940578 rc 0/0 00000100:00100000:0.0:1787508878.344749:0:203732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00002000:00100000:0.0:1787508878.344764:0:203732:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1590:0x0] (8388608->10485759) req@ffff9090cbebdf80 x1874324509725568/t8589940578(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:334/0 lens 488/448 e 0 to 0 dl 1787508889 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787508878.344774:0:203732:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090cbebdf80 with x1874324509725568 ext(8388608->10485759) 00010000:00010000:0.0:1787508878.344785:0:203732:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a75ad07c/0xb126349c40f36829 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef23 expref: 14 pid: 225838 timeout: 13949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508878.344804:0:203732:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a75ad07c/0xb126349c40f36829 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef23 expref: 14 pid: 225838 timeout: 13949 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787508878.344811:0:203732:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9090cbebdf80 00000100:00100000:2.0:1787508878.358528:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508878.358709:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509725696 00000100:00100000:0.0:1787508878.358720:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509725696 00010000:00010000:0.0:1787508878.358764:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a75ad07c/0xb126349c40f36829 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef23 expref: 14 pid: 225838 timeout: 13949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508878.359203:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27985 00000100:00100000:0.0:1787508878.359215:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:2401:x1874324509725696:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787508878.359231:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787508878.359250:0:202211:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1590:0x0] updating lvb size from disk: 0 -> 10485760 00002000:00010000:0.0:1787508878.359253:0:202211:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1590:0x0] updating lvb mtime from disk: 0 -> 1787508878 00002000:00010000:0.0:1787508878.359256:0:202211:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1590:0x0] updating lvb ctime from disk: 0 -> 1787508878 00002000:00010000:0.0:1787508878.359258:0:202211:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1590:0x0] updating lvb blocks from disk: 0 -> 20480 00010000:00010000:0.0:1787508878.359265:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a75ad07c/0xb126349c40f36829 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1590:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef23 expref: 14 pid: 225838 timeout: 13949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508878.359281:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a75ad07c/0xb126349c40f36829 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1590:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef23 expref: 14 pid: 225838 timeout: 13949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508878.359304:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a75ad07c/0xb126349c40f36829 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1590:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef23 expref: 14 pid: 225838 timeout: 13949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508878.359321:0:202211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1590:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787508878.359325:0:202211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1590:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787508878.359333:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000012917839/0xb126349c40f3686f lrc: 2/0,0 mode: GROUP/GROUP res: [0x2c0000401:0x1590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 14091995 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef3f expref: 13 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508878.359343:0:202211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012917839/0xb126349c40f3686f lrc: 3/0,0 mode: GROUP/GROUP res: [0x2c0000401:0x1590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 14091995 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef3f expref: 13 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508878.359379:0:202211:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000012917839/0xb126349c40f3686f lrc: 3/0,0 mode: GROUP/GROUP res: [0x2c0000401:0x1590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 14091995 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef3f expref: 13 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508878.359394:0:202211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cda05f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:202211:1874324480292224:192.168.201.30@tcp:105: 00000100:00100000:0.0:1787508878.359796:0:202211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c9919a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787508878.367345:0:202211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cda05f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:202211:1874324480292224:192.168.201.30@tcp:105: 00010000:00010000:1.0:1787508878.367373:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508878.367452:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:2401:x1874324509725696:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 8238us (8934us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508878.367463:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27985 00000100:00100000:1.0:1787508878.386539:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508878.386676:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509725824 00000100:00100000:2.0:1787508878.386690:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509725824 00000100:00100000:2.0:1787508878.386797:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94348 00000100:00100000:2.0:1787508878.386812:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cd4a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+15:349269:x1874324509725824:12345-192.168.201.30@tcp:101:multiop.0 00000100:00080000:0.0:1787508878.386817:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787508878.386851:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508878.386881:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac200/0xb126349c40f36876 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaef46 expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.387040:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac600/0xb126349c40f3687d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.387058:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac600/0xb126349c40f3687d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.387072:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac600/0xb126349c40f3687d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508878.387128:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508878.387131:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508878.387156:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac600/0xb126349c40f3687d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.387187:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac200/0xb126349c40f36876 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef46 expref: 17 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.387211:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac600/0xb126349c40f3687d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef46 expref: 16 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.387222:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508878.387225:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508878.387230:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d3fac600, rc 0) 00000100:00100000:2.0:1787508878.387324:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cd4a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:349269:x1874324509725824:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 515us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508878.387335:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94348 00000100:00100000:3.0:1787508878.390785:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508878.391049:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509726080 00000100:00100000:2.0:1787508878.391063:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509726080 00000100:00100000:2.0:1787508878.391129:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94349 00000100:00100000:2.0:1787508878.391140:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cbebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:349269:x1874324509726080:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:2.0:1787508878.391167:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508878.391172:0:202227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787508878.391207:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac600/0xb126349c40f3687d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef46 expref: 16 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.391236:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508878.391243:0:202227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508878.391444:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad000/0xb126349c40f36884 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaef4d expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.391650:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac800/0xb126349c40f3688b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.391667:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac800/0xb126349c40f3688b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.391679:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac800/0xb126349c40f3688b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.391693:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad400/0xb126349c40f36892 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.391701:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad400/0xb126349c40f36892 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.391708:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad400/0xb126349c40f36892 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.391779:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac400/0xb126349c40f36899 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.391789:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac400/0xb126349c40f36899 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.391815:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac400/0xb126349c40f36899 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508878.391905:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x127c:0x0]: returning size 10485760 00010000:00010000:2.0:1787508878.392077:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac800/0xb126349c40f3688b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.392087:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac800/0xb126349c40f3688b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.392094:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac800/0xb126349c40f3688b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.392102:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac800/0xb126349c40f3688b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.392109:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d3fac800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508878.392115:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac800/0xb126349c40f3688b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.392124:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac800/0xb126349c40f3688b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.392135:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508878.392138:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508878.392143:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac800/0xb126349c40f3688b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.392149:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac800/0xb126349c40f3688b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.392167:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad400/0xb126349c40f36892 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.392174:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad400/0xb126349c40f36892 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.392179:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad400/0xb126349c40f36892 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.392184:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d3fad400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508878.392187:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad400/0xb126349c40f36892 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.392194:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad400/0xb126349c40f36892 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.392201:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe75d78b6 (ffff9090cc088a00) 00010000:00010000:2.0:1787508878.392204:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508878.392207:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad400/0xb126349c40f36892 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.392214:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad400/0xb126349c40f36892 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.393388:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad000/0xb126349c40f36884 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef4d expref: 18 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.393425:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac400/0xb126349c40f36899 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef4d expref: 17 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508878.393442:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127c:0x0].0x0 (ffff9090cc088e00) 00010000:00010000:2.0:1787508878.393445:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787508878.393449:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d3fac400, rc 0) 00000100:00100000:2.0:1787508878.393560:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cbebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:349269:x1874324509726080:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 2419us (2788us total) trans 12884944306 rc 0/0 00000100:00100000:2.0:1787508878.393571:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94349 00000100:00100000:0.0:1787508878.401731:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508878.402300:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509726208 00000100:00100000:3.0:1787508878.402315:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509726208 00000100:00100000:3.0:1787508878.402412:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15119 00000100:00100000:3.0:1787508878.402424:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cda05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:349269:x1874324509726208:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:3.0:1787508878.402448:0:225831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508878.402473:0:225831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc4d2917/0xb126349c40f368a7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1590:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaef54 expref: -99 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.402510:0:225831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1590:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787508878.402514:0:225831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1590:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1787508878.402521:0:225831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc4d2917/0xb126349c40f368a7 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x1590:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef54 expref: 6 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.402536:0:225831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cc4d2917/0xb126349c40f368a7 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x1590:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef54 expref: 6 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508878.402552:0:225831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e400, rc 0) 00000100:00100000:3.0:1787508878.402622:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cda05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:349269:x1874324509726208:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 200us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508878.402630:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15119 00000100:00080000:0.0:1787508878.403075:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508878.522389:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787508878.522423:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cd4a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480292352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787508878.522520:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508878.522588:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480292352 00000100:00100000:1.0:1787508878.522597:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480292352 00000100:00100000:1.0:1787508878.522664:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1831 00000100:00100000:1.0:1787508878.522675:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cd4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480292352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787508878.522715:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 87465664 pending 0 free 3898224640 avail 3666702336 00000100:00100000:1.0:1787508878.522766:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cd4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480292352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508878.522774:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1831 00000100:00100000:2.0:1787508878.523139:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cda05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480292480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787508878.523503:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cd4a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480292352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787508878.523533:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508878.526256:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480292480 00000100:00100000:0.0:1787508878.526271:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480292480 00000100:00100000:0.0:1787508878.526335:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1832 00000100:00100000:0.0:1787508878.526343:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480292480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787508878.526366:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 87465664 pending 0 free 3898224640 avail 3666702336 00000100:00100000:0.0:1787508878.526452:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480292480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (2924us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508878.526460:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1832 00000100:00100000:2.0:1787508878.526532:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cda05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480292480:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787508878.910243:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508879.546373:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480292608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787508879.546453:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508879.546561:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480292608 00000100:00100000:2.0:1787508879.546570:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480292608 00000100:00100000:2.0:1787508879.546626:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30058 00000100:00100000:2.0:1787508879.546635:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cbebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480292608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787508879.546682:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442709504 avail 1296470016 00000100:00100000:2.0:1787508879.546741:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cbebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480292608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508879.546749:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30058 00000100:00100000:3.0:1787508879.546828:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480292608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787508879.548988:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787508879.549011:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480292736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787508879.549080:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508879.549334:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480292736 00000100:00100000:2.0:1787508879.549343:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480292736 00000100:00100000:2.0:1787508879.549403:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30059 00000100:00100000:2.0:1787508879.549411:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cbebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480292736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787508879.549443:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440636928 avail 1294397440 00000100:00100000:2.0:1787508879.549498:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cbebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480292736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508879.549508:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30059 00000100:00100000:0.0:1787508879.549664:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480292736:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787508879.932982:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508880.458526:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508880.458649:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509726336 00000100:00100000:2.0:1787508880.458660:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509726336 00000100:00100000:2.0:1787508880.458802:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94350 00000100:00100000:2.0:1787508880.458813:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cd4a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:349273:x1874324509726336:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:2.0:1787508880.458843:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508880.458878:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad000/0xb126349c40f368ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaef5b expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.459016:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad400/0xb126349c40f368b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.459030:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad400/0xb126349c40f368b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.459043:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad400/0xb126349c40f368b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508880.459094:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:2.0:1787508880.459097:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787508880.459116:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad400/0xb126349c40f368b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.459141:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad000/0xb126349c40f368ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef5b expref: 19 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.459157:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad400/0xb126349c40f368b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef5b expref: 18 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.459168:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508880.459170:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787508880.459174:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d3fad400, rc 0) 00000100:00100000:2.0:1787508880.459248:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cd4a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+18:349273:x1874324509726336:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 437us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508880.459253:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94350 00000100:00080000:0.0:1787508880.462159:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787508880.467304:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508880.467405:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509726592 00000100:00100000:2.0:1787508880.467419:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509726592 00000100:00100000:2.0:1787508880.467507:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94351 00000100:00100000:2.0:1787508880.467520:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cbebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+18:349273:x1874324509726592:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:2.0:1787508880.467547:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787508880.467552:0:202226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787508880.467585:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad400/0xb126349c40f368b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef5b expref: 18 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.467607:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508880.467613:0:202226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787508880.467630:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad000/0xb126349c40f368bc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaef62 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.467809:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac800/0xb126349c40f368c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.467825:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac800/0xb126349c40f368c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.467836:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac800/0xb126349c40f368c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.467861:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac600/0xb126349c40f368ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.467870:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac600/0xb126349c40f368ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.467876:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac600/0xb126349c40f368ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.467992:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac200/0xb126349c40f368d1 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.468002:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac200/0xb126349c40f368d1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.468009:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac200/0xb126349c40f368d1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787508880.468018:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x127c:0x0]: returning size 10485760 00010000:00010000:2.0:1787508880.468113:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac800/0xb126349c40f368c3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.468120:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac800/0xb126349c40f368c3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.468127:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac800/0xb126349c40f368c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.468133:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac800/0xb126349c40f368c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.468139:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d3fac800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508880.468144:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac800/0xb126349c40f368c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.468151:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac800/0xb126349c40f368c3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.468159:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:2.0:1787508880.468162:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508880.468166:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac800/0xb126349c40f368c3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.468172:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac800/0xb126349c40f368c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.468182:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac600/0xb126349c40f368ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.468188:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac600/0xb126349c40f368ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.468193:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac600/0xb126349c40f368ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.468196:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d3fac600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508880.468198:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac600/0xb126349c40f368ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.468204:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac600/0xb126349c40f368ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.468210:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe75d78b6 (ffff9090cc088a00) 00010000:00010000:2.0:1787508880.468212:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508880.468216:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac600/0xb126349c40f368ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.468221:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac600/0xb126349c40f368ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.468257:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fad000/0xb126349c40f368bc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef62 expref: 20 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.468269:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac200/0xb126349c40f368d1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef62 expref: 19 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508880.468276:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127c:0x0].0x0 (ffff9090cc088e00) 00010000:00010000:2.0:1787508880.468278:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787508880.468280:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d3fac200, rc 0) 00000100:00100000:2.0:1787508880.468360:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cbebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+19:349273:x1874324509726592:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 843us (1073us total) trans 12884944307 rc 0/0 00000100:00100000:2.0:1787508880.468368:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94351 00000100:00100000:3.0:1787508880.471403:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508880.471451:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508880.471465:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509726976 00000100:00100000:2.0:1787508880.471479:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509726976 00000100:00100000:2.0:1787508880.471556:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15521 00000100:00100000:2.0:1787508880.471569:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cbebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+19:349273:x1874324509726976:12345-192.168.201.30@tcp:35:multiop.0 00000100:00100000:2.0:1787508880.471866:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cbebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+20:349273:x1874324509726976:12345-192.168.201.30@tcp:35:multiop.0 Request processed in 298us (476us total) trans 12884944308 rc 0/0 00000100:00100000:2.0:1787508880.471876:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15521 00000100:00100000:1.0:1787508880.473873:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509726720 00000100:00100000:1.0:1787508880.473899:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509726720 00000100:00100000:3.0:1787508880.473923:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508880.473992:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9852 00000100:00100000:1.0:1787508880.474005:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cbebc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+20:2400:x1874324509726720:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508880.474024:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508880.474061:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d3fac200/0xb126349c40f368d1 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x127c:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef62 expref: 20 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508880.474072:0:225842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509727104 00000100:00100000:0.0:1787508880.474076:0:225842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509727104 00010000:00010000:1.0:1787508880.474095:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127c:0x0].0x0 (ffff9090cc088e00) 00010000:00010000:1.0:1787508880.474101:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508880.474133:0:225842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15120 00000100:00100000:0.0:1787508880.474140:0:225842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cbebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:349273:x1874324509727104:12345-192.168.201.30@tcp:101:multiop.0 00010000:00010000:0.0:1787508880.474155:0:225842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1787508880.474157:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cbebc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+19:2400:x1874324509726720:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 156us (2705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508880.474163:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9852 00010000:00010000:0.0:1787508880.474174:0:225842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fe407b7/0xb126349c40f368df lrc: 2/0,0 mode: --/GROUP res: [0x2c0000401:0x1590:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaef69 expref: -99 pid: 225842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508880.474202:0:225842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1590:0x0].0x0 since=2s v=(2 0) 00010000:00010000:0.0:1787508880.474210:0:225842:0:(ldlm_resource.c:1780:ldlm_resource_insert_lock_before()) ### About to insert this lock before 00000000cc4d2917: ns: filter-lustre-OST0001_UUID lock: 000000009fe407b7/0xb126349c40f368df lrc: 3/0,0 mode: --/GROUP res: [0x2c0000401:0x1590:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 16022000 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef69 expref: 7 pid: 225842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508880.474220:0:225842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1590:0x0].0x0 since=0s v=(3 0) 00010000:00010000:0.0:1787508880.474228:0:225842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009fe407b7/0xb126349c40f368df lrc: 3/0,0 mode: --/GROUP res: [0x2c0000401:0x1590:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 16022000 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef69 expref: 7 pid: 225842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508880.474243:0:225842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5600, rc 0) 00000100:00100000:0.0:1787508880.474270:0:225842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cbebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:349273:x1874324509727104:12345-192.168.201.30@tcp:101:multiop.0 Request processed in 130us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508880.474277:0:225842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15120 00000100:00080000:3.0:1787508880.474799:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787508880.954333:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508881.513007:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508881.513061:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508881.513093:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508881.513118:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508881.513139:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508881.513166:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508881.513172:0:225843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509727744 00000100:00100000:2.0:1787508881.513186:0:225843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509727744 00000100:00100000:1.0:1787508881.513205:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509727616 00000100:00100000:1.0:1787508881.513210:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509727616 00000100:00100000:3.0:1787508881.513295:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509727488 00000100:00100000:3.0:1787508881.513300:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509727488 00000100:00100000:3.0:1787508881.513342:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509727360 00000100:00100000:3.0:1787508881.513345:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509727360 00000100:00100000:3.0:1787508881.513364:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509727872 00000100:00100000:3.0:1787508881.513366:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509727872 00000100:00100000:3.0:1787508881.513387:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3362 00000100:00100000:3.0:1787508881.513397:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cd4a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2402:x1874324509727488:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508881.513484:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cd4a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2402:x1874324509727488:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 89us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508881.513492:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3362 00000100:00100000:3.0:1787508881.513514:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3363 00000100:00100000:3.0:1787508881.513520:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cd4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+31:2402:x1874324509727360:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508881.513543:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cd4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+31:2402:x1874324509727360:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508881.513549:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3363 00000100:00100000:3.0:1787508881.513558:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3364 00000100:00100000:3.0:1787508881.513564:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cd4a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+19:2402:x1874324509727872:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508881.513585:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cd4a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+19:2402:x1874324509727872:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508881.513591:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3364 00000100:00080000:3.0:1787508881.513738:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787508881.513743:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787508881.513746:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787508881.513748:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508881.513978:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509727232 00000100:00100000:0.0:1787508881.513985:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509727232 00000100:00100000:0.0:1787508881.514033:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1082 00000100:00100000:0.0:1787508881.514041:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fccc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509727232:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508881.514081:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fccc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509727232:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 41us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508881.514088:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1082 00000100:00100000:1.0:1787508881.514397:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2669 00000100:00100000:1.0:1787508881.514408:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cd4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509727616:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508881.514443:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cd4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509727616:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 40us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508881.514450:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2669 00000100:00100000:3.0:1787508881.515850:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508881.515907:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508881.515934:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508881.516541:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509728128 00000100:00100000:0.0:1787508881.516554:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509728128 00000100:00100000:3.0:1787508881.516636:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509728256 00000100:00100000:3.0:1787508881.516640:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509728256 00000100:00100000:2.0:1787508881.520173:0:225843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2670 00000100:00100000:2.0:1787508881.520197:0:225843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:2402:x1874324509727744:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508881.521125:0:225843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:2402:x1874324509727744:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 931us (8023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508881.521139:0:225843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2670 00000100:00080000:1.0:1787508881.522087:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787508881.522611:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509728000 00000100:00100000:2.0:1787508881.522624:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509728000 00000100:00100000:2.0:1787508881.522709:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3365 00000100:00100000:2.0:1787508881.522720:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cbebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2403:x1874324509728000:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508881.522794:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cbebfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2403:x1874324509728000:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 75us (6886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508881.522802:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3365 00000100:00080000:2.0:1787508881.522862:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787508881.522985:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2671 00000100:00100000:0.0:1787508881.523116:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cbebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509728128:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508881.523171:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cbebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2403:x1874324509728128:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 177us (7345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508881.523179:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2671 00000100:00100000:3.0:1787508881.523495:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2672 00000100:00100000:3.0:1787508881.523505:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cbebf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2403:x1874324509728256:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508881.523540:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cbebf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2403:x1874324509728256:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 38us (7606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508881.523548:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2672 00010000:00010000:1.0:1787508881.981253:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508882.109484:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787508882.109524:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cda04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480292864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787508882.109632:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508882.109694:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cbebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480292992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787508882.109739:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508882.109927:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480292864 00000100:00100000:1.0:1787508882.109938:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480292864 00000100:00100000:1.0:1787508882.110036:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480292992 00000100:00100000:1.0:1787508882.110040:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480292992 00000100:00100000:1.0:1787508882.110063:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1833 00000100:00100000:1.0:1787508882.110073:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480292864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787508882.110112:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 190521920 pending 10559488 free 3871453184 avail 3639930880 00000100:00100000:1.0:1787508882.110180:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480292864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508882.110187:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1833 00000100:00100000:1.0:1787508882.110215:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1834 00000100:00100000:1.0:1787508882.110221:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cbebea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480292992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787508882.110232:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 190521920 pending 10559488 free 3871453184 avail 3639930880 00000100:00100000:1.0:1787508882.110259:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cbebea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480292992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508882.110265:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1834 00000100:00080000:2.0:1787508882.110431:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787508882.110483:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cda04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480292864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787508882.112192:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cbebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480292992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787508882.540605:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508882.544059:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509728384 00000100:00100000:2.0:1787508882.544088:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509728384 00000100:00100000:2.0:1787508882.544438:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9853 00000100:00100000:2.0:1787508882.544455:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cbebe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+13:2403:x1874324509728384:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508882.544479:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508882.544536:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012917839/0xb126349c40f3686f lrc: 0/0,0 mode: --/GROUP res: [0x2c0000401:0x1590:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 14091995 flags: 0x44801000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef3f expref: 13 pid: 225835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508882.544571:0:202212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1590:0x0].0x0 since=2s v=(3 0) 00010000:00010000:2.0:1787508882.544577:0:202212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1590:0x0].0x0 since=0s v=(0 3) 00010000:00010000:2.0:1787508882.544587:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009fe407b7/0xb126349c40f368df lrc: 2/0,0 mode: GROUP/GROUP res: [0x2c0000401:0x1590:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 16022000 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef69 expref: 6 pid: 225842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508882.544600:0:202212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fe407b7/0xb126349c40f368df lrc: 3/0,0 mode: GROUP/GROUP res: [0x2c0000401:0x1590:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 16022000 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef69 expref: 6 pid: 225842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508882.544650:0:202212:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009fe407b7/0xb126349c40f368df lrc: 3/0,0 mode: GROUP/GROUP res: [0x2c0000401:0x1590:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 16022000 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef69 expref: 6 pid: 225842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508882.544668:0:202212:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb63b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:202212:1874324480293120:192.168.201.30@tcp:105: 00000100:00100000:2.0:1787508882.546069:0:202212:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d1967000 going to sleep for 11 seconds 00000100:00100000:2.0:1787508882.551405:0:202212:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb63b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:202212:1874324480293120:192.168.201.30@tcp:105: 00010000:00010000:2.0:1787508882.551440:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787508882.551527:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cbebe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+12:2403:x1874324509728384:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 7075us (10947us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508882.551540:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9853 00010000:00010000:3.0:1787508883.003996:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508883.130587:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cda04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480293504:0@lo:400:kworker.0 00000100:00100000:0.0:1787508883.130695:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508883.130743:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cda05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480294016:0@lo:400:kworker.0 00000100:00100000:0.0:1787508883.130767:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508883.130798:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d39f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874324480294528:0@lo:400:kworker.0 00000100:00100000:0.0:1787508883.130839:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508883.130868:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787508883.130874:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cda06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480293376:0@lo:400:kworker.0 00000100:00100000:0.0:1787508883.130902:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508883.130922:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cda05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480293888:0@lo:400:kworker.0 00000100:00100000:0.0:1787508883.130974:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508883.130993:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d39fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874324480294400:0@lo:400:kworker.0 00000100:00100000:0.0:1787508883.131016:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508883.131053:0:208928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480293504 00000100:00100000:0.0:1787508883.131062:0:208928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480293504 00000100:00100000:0.0:1787508883.131135:0:208928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480294016 00000100:00100000:0.0:1787508883.131139:0:208928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480294016 00000100:00100000:0.0:1787508883.131170:0:208928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2673 00000100:00100000:0.0:1787508883.131181:0:208928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d39f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480293504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508883.131245:0:208928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d39f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480293504:12345-0@lo:400:kworker.0 Request processed in 65us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508883.131254:0:208928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2673 00000100:00100000:0.0:1787508883.131276:0:208928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2674 00000100:00100000:0.0:1787508883.131283:0:208928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d39f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480294016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508883.131311:0:208928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d39f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480294016:12345-0@lo:400:kworker.0 Request processed in 29us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508883.131318:0:208928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2674 00000100:00100000:0.0:1787508883.131348:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480293376 00000100:00100000:0.0:1787508883.131352:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480293376 00000100:00100000:0.0:1787508883.131382:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480293888 00000100:00100000:0.0:1787508883.131385:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480293888 00000100:00100000:0.0:1787508883.131404:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30060 00000100:00100000:0.0:1787508883.131412:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d39f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480293376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508883.131449:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d39f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480293376:12345-0@lo:400:kworker.0 Request processed in 38us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508883.131460:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30060 00000100:00100000:0.0:1787508883.131473:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30061 00000100:00100000:0.0:1787508883.131480:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d39f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480293888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508883.131513:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d39f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480293888:12345-0@lo:400:kworker.0 Request processed in 35us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508883.131519:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30061 00000100:00080000:0.0:1787508883.131541:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787508883.131588:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cda06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480293376:0@lo:400:kworker.0 00000100:00100000:0.0:1787508883.131601:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cda05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480293888:0@lo:400:kworker.0 00000100:00100000:0.0:1787508883.131611:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cda04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480293504:0@lo:400:kworker.0 00000100:00100000:0.0:1787508883.131620:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cda05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480294016:0@lo:400:kworker.0 00000100:00100000:1.0:1787508883.131973:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cda06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480293632:0@lo:400:kworker.0 00000100:00100000:1.0:1787508883.132018:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508883.132051:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d39f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480294144:0@lo:400:kworker.0 00000100:00100000:1.0:1787508883.132076:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508883.132094:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d39f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480294656:0@lo:400:kworker.0 00000100:00100000:1.0:1787508883.132118:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508883.132139:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1787508883.132146:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cda06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480293248:0@lo:400:kworker.0 00000100:00100000:1.0:1787508883.132179:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508883.132211:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cda05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480293760:0@lo:400:kworker.0 00000100:00100000:1.0:1787508883.132234:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508883.132249:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d39fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480294272:0@lo:400:kworker.0 00000100:00100000:1.0:1787508883.132267:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508883.132284:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d39f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480294784:0@lo:400:kworker.0 00000100:00100000:1.0:1787508883.132303:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508883.132330:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480293248 00000100:00100000:1.0:1787508883.132335:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480293248 00000100:00100000:1.0:1787508883.132384:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:1.0:1787508883.132392:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fccc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480293248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508883.132432:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fccc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3618:x1874324480293248:12345-0@lo:400:kworker.0 Request processed in 42us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508883.132440:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:1.0:1787508883.132471:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480294528 00000100:00100000:1.0:1787508883.132475:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480294528 00000100:00100000:1.0:1787508883.132524:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480294400 00000100:00100000:1.0:1787508883.132528:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480294400 00000100:00100000:1.0:1787508883.132542:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480294656 00000100:00100000:1.0:1787508883.132544:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480294656 00000100:00100000:1.0:1787508883.132554:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480293760 00000100:00100000:1.0:1787508883.132556:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480293760 00000100:00100000:1.0:1787508883.132566:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480294272 00000100:00100000:1.0:1787508883.132568:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480294272 00000100:00100000:1.0:1787508883.132577:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480294784 00000100:00100000:1.0:1787508883.132579:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480294784 00000100:00100000:1.0:1787508883.132592:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3366 00000100:00100000:1.0:1787508883.132598:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d39f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874324480294528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508883.132637:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d39f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1874324480294528:12345-0@lo:400:kworker.0 Request processed in 39us (1797us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508883.132644:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3366 00000100:00100000:1.0:1787508883.132656:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3367 00000100:00100000:1.0:1787508883.132663:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d39fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874324480294400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508883.132692:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d39fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874324480294400:12345-0@lo:400:kworker.0 Request processed in 30us (1676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508883.132699:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3367 00000100:00100000:1.0:1787508883.132709:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3368 00000100:00100000:1.0:1787508883.132715:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cd4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480294656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508883.132741:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cd4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1874324480294656:12345-0@lo:400:kworker.0 Request processed in 26us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508883.132746:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3368 00000100:00100000:1.0:1787508883.132757:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3369 00000100:00100000:1.0:1787508883.132763:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480293760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508883.132899:0:203996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480293632 00000100:00100000:0.0:1787508883.132905:0:203996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480293632 00000100:00100000:0.0:1787508883.132959:0:203996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480294144 00000100:00100000:0.0:1787508883.132963:0:203996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480294144 00000100:00100000:0.0:1787508883.132986:0:203996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2675 00000100:00100000:0.0:1787508883.132993:0:203996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cd4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480293632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508883.133302:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3370 00000100:00100000:3.0:1787508883.133314:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480294272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508883.133404:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3371 00000100:00100000:2.0:1787508883.133415:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480294784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508883.134179:0:203996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cd4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480293632:12345-0@lo:400:kworker.0 Request processed in 1183us (2157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508883.134191:0:203996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2675 00000100:00100000:0.0:1787508883.134219:0:203996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2676 00000100:00100000:0.0:1787508883.134228:0:203996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cd4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480294144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508883.134267:0:203996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cd4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480294144:12345-0@lo:400:kworker.0 Request processed in 41us (2190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508883.134277:0:203996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2676 00000100:00080000:0.0:1787508883.134336:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787508883.134342:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787508883.134390:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cda06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:79de3f65-4bad-42d0-a46f-842a654b33a0:3618:1874324480293248:0@lo:400:kworker.0 00000100:00100000:0.0:1787508883.134408:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cda05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480293760:0@lo:400:kworker.0 00000100:00100000:0.0:1787508883.134422:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cda06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480293632:0@lo:400:kworker.0 00000100:00100000:0.0:1787508883.134433:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d39f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480294144:0@lo:400:kworker.0 00000100:00100000:0.0:1787508883.134445:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d39f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3618:1874324480294656:0@lo:400:kworker.0 00000100:00100000:0.0:1787508883.134504:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d39fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874324480294400:0@lo:400:kworker.0 00000100:00100000:0.0:1787508883.134518:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d39f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3617:1874324480294528:0@lo:400:kworker.0 00000100:00100000:3.0:1787508883.136798:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480294272:12345-0@lo:400:kworker.0 Request processed in 3468us (4510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508883.136825:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3370 00000100:00100000:0.0:1787508883.137850:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d39fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480294272:0@lo:400:kworker.0 00000100:00100000:2.0:1787508883.140394:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480294784:12345-0@lo:400:kworker.0 Request processed in 6966us (8073us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508883.140413:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3371 00000100:00100000:0.0:1787508883.140619:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d39f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480294784:0@lo:400:kworker.0 00000100:00100000:1.0:1787508883.143049:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480293760:12345-0@lo:400:kworker.0 Request processed in 10271us (10798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508883.143067:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3369 00000100:00100000:0.0:1787508883.642363:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787508883.642397:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480294912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787508883.642500:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508883.642961:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787508883.642975:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d39fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480295040:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787508883.643012:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508883.643276:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480294912 00000100:00100000:0.0:1787508883.643285:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480294912 00000100:00100000:0.0:1787508883.643348:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480295040 00000100:00100000:0.0:1787508883.643352:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480295040 00000100:00100000:0.0:1787508883.643372:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1835 00000100:00100000:0.0:1787508883.643393:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d39f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480294912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787508883.643430:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 87465664 pending 0 free 3898224640 avail 3666702336 00000100:00100000:0.0:1787508883.643494:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d39f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480294912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508883.643504:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1835 00000100:00100000:0.0:1787508883.643524:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1836 00000100:00100000:0.0:1787508883.643532:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cbebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480295040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787508883.643542:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 87465664 pending 0 free 3898224640 avail 3666702336 00000100:00100000:0.0:1787508883.643570:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cbebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480295040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508883.643577:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1836 00000100:00100000:3.0:1787508883.643794:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d39fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480295040:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787508883.644024:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480294912:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787508884.026655:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787508884.157683:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944308 is committed 00000001:00080000:3.0:1787508884.158432:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944305 is committed 00010000:00010000:1.0:1787508884.158503:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36814 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508884.158520:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36814 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508884.158529:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36814 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508884.158536:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8ee00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508884.158542:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36814 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508884.158556:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36814 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508884.158578:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe75d78b6 (ffff9090cc088a00) 00010000:00010000:1.0:1787508884.158582:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508884.158588:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36814 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508884.158595:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8ee00/0xb126349c40f36814 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe75d78b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787508884.159005:0:204539:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589940578 is committed 00000100:00100000:3.0:1787508884.666226:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787508884.666260:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cbebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480295168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787508884.666363:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508884.666971:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787508884.666985:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cbebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480295296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787508884.667026:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508884.667099:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480295168 00000100:00100000:0.0:1787508884.667108:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480295168 00000100:00100000:0.0:1787508884.667174:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480295296 00000100:00100000:0.0:1787508884.667178:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480295296 00000100:00100000:0.0:1787508884.667203:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30062 00000100:00100000:0.0:1787508884.667213:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cbebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480295168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787508884.667258:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442709504 avail 1296470016 00000100:00100000:0.0:1787508884.667312:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cbebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480295168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508884.667320:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30062 00000100:00100000:0.0:1787508884.667337:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30063 00000100:00100000:0.0:1787508884.667343:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480295296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787508884.667362:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440636928 avail 1294397440 00000100:00100000:0.0:1787508884.667397:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3618:x1874324480295296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508884.667402:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30063 00000100:00100000:0.0:1787508884.667447:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cbebce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480295168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787508884.672405:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cbebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480295296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787508884.737938:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508884.738808:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509728512 00000100:00100000:3.0:1787508884.738821:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509728512 00000100:00100000:3.0:1787508884.738917:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9854 00000100:00100000:3.0:1787508884.738927:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2403:x1874324509728512:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508884.738970:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508884.739011:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fe407b7/0xb126349c40f368df lrc: 0/0,0 mode: --/GROUP res: [0x2c0000401:0x1590:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 16022000 flags: 0x44801000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef69 expref: 7 pid: 225842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508884.739104:0:205406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1590:0x0].0x0 since=2s v=(0 3) 00010000:00010000:3.0:1787508884.739109:0:205406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1590:0x0].0x0 since=0s v=(0 3) 00010000:00010000:3.0:1787508884.739117:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc4d2917/0xb126349c40f368a7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef54 expref: 6 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508884.739127:0:205406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc4d2917/0xb126349c40f368a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef54 expref: 6 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508884.739163:0:205406:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cc4d2917/0xb126349c40f368a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1590:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef54 expref: 6 pid: 225831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508884.739176:0:205406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cbebca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:205406:1874324480295424:192.168.201.30@tcp:105: 00000100:00100000:3.0:1787508884.739335:0:205406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d6311e40 going to sleep for 11 seconds 00000100:00080000:0.0:1787508884.740185:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787508884.756677:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508884.758200:0:205406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cbebca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:205406:1874324480295424:192.168.201.30@tcp:105: 00010000:00010000:1.0:1787508884.758228:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508884.758322:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2403:x1874324509728512:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 19396us (20393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508884.758453:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9854 00000100:00100000:2.0:1787508884.758562:0:205407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509728640 00000100:00100000:2.0:1787508884.758571:0:205407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509728640 00002000:00100000:2.0:1787508884.758613:0:205407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1590:0x0] (0->4095) req@ffff9090d39f9c00 x1874324509728640/t0(0) o3->eb35f31c-097f-45a3-8275-bc75f97f89ee@192.168.201.30@tcp:340/0 lens 488/0 e 0 to 0 dl 1787508895 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787508884.758623:0:205407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090d39f9c00 with x1874324509728640 ext(0->4095) 00002000:00010000:2.0:1787508884.758628:0:205407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9090d39f9c00 00000100:00100000:2.0:1787508884.758657:0:205407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:2.0:1787508884.758665:0:205407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d39f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509728640:12345-192.168.201.30@tcp:3:multiop.0 00000100:00100000:2.0:1787508884.758817:0:205407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d39f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509728640:12345-192.168.201.30@tcp:3:multiop.0 Request processed in 152us (2148us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787508884.758824:0:205407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 64 00002000:00100000:2.0:1787508884.758830:0:205407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1590:0x0] (0->4095) req@ffff9090d39f9c00 x1874324509728640/t0(0) o3->eb35f31c-097f-45a3-8275-bc75f97f89ee@192.168.201.30@tcp:340/0 lens 488/4536 e 0 to 0 dl 1787508895 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787508884.758838:0:205407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090d39f9c00 with x1874324509728640 ext(0->4095) 00002000:00010000:2.0:1787508884.758841:0:205407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9090d39f9c00 00000100:00100000:0.0:1787508884.770250:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508884.770350:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509728896 00000100:00100000:3.0:1787508884.770369:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509728896 00000100:00100000:3.0:1787508884.770499:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15522 00000100:00100000:3.0:1787508884.770516:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fdb9cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:349269:x1874324509728896:12345-192.168.201.30@tcp:35:multiop.0 00000100:00100000:3.0:1787508884.770863:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fdb9cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:349269:x1874324509728896:12345-192.168.201.30@tcp:35:multiop.0 Request processed in 350us (620us total) trans 12884944309 rc 0/0 00000100:00100000:3.0:1787508884.770872:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15522 00000100:00080000:0.0:1787508884.770928:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787508885.051623:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787508886.076646:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508886.637251:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508886.637305:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508886.637407:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509729024 00000100:00100000:2.0:1787508886.637422:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509729024 00000100:00100000:2.0:1787508886.637499:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1084 00000100:00100000:2.0:1787508886.637512:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fccc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509729024:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1787508886.637613:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fccc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2403:x1874324509729024:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 104us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508886.637623:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1084 00000100:00100000:1.0:1787508886.637755:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509729152 00000100:00100000:1.0:1787508886.637761:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509729152 00000100:00100000:1.0:1787508886.637826:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3372 00000100:00100000:1.0:1787508886.637834:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cbebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+27:2403:x1874324509729152:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508886.637874:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cbebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+27:2403:x1874324509729152:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 41us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508886.637882:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3372 00000100:00080000:2.0:1787508886.637966:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787508886.647614:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508886.647655:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508886.647979:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508886.648004:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508886.648025:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508886.648050:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508886.648072:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508886.648256:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509729280 00000100:00100000:3.0:1787508886.648270:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509729280 00000100:00100000:3.0:1787508886.648357:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509729664 00000100:00100000:3.0:1787508886.648374:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509729664 00000100:00100000:3.0:1787508886.648398:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509729792 00000100:00100000:3.0:1787508886.648401:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509729792 00000100:00100000:3.0:1787508886.648426:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3373 00000100:00100000:3.0:1787508886.648439:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cbebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2403:x1874324509729280:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508886.648538:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cbebed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2403:x1874324509729280:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 100us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508886.648548:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3373 00000100:00100000:3.0:1787508886.648574:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3374 00000100:00100000:3.0:1787508886.648581:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cbebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:2402:x1874324509729664:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508886.648615:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cbebca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:2402:x1874324509729664:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 35us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508886.648622:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3374 00000100:00100000:3.0:1787508886.648634:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3375 00000100:00100000:3.0:1787508886.648640:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2402:x1874324509729792:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508886.648663:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2402:x1874324509729792:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508886.648669:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3375 00000100:00100000:3.0:1787508886.648690:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509729408 00000100:00100000:3.0:1787508886.648694:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509729408 00000100:00100000:3.0:1787508886.649859:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509729920 00000100:00100000:3.0:1787508886.649870:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509729920 00000100:00100000:3.0:1787508886.649905:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509729536 00000100:00100000:3.0:1787508886.649909:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509729536 00000100:00100000:3.0:1787508886.649932:0:225831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509730048 00000100:00100000:3.0:1787508886.649935:0:225831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509730048 00000100:00100000:3.0:1787508886.649986:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2677 00000100:00100000:3.0:1787508886.649995:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cbebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509729408:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508886.650057:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cbebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2403:x1874324509729408:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 63us (2400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508886.650065:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2677 00000100:00100000:3.0:1787508886.650085:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2678 00000100:00100000:3.0:1787508886.650091:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509729920:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508886.650117:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509729920:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (2112us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508886.650123:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2678 00000100:00100000:3.0:1787508886.650136:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2679 00000100:00100000:3.0:1787508886.650142:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509729536:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508886.650170:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509729536:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 28us (2144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508886.650176:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2679 00000100:00100000:3.0:1787508886.650187:0:225831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2680 00000100:00100000:3.0:1787508886.650193:0:225831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509730048:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508886.650217:0:225831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509730048:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (2144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508886.650224:0:225831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2680 00000100:00080000:2.0:1787508886.656052:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787508886.656067:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787508886.656073:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787508886.656076:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1787508887.098353:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508887.226221:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787508887.226248:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480295552:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787508887.226339:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508887.226433:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480295552 00000100:00100000:2.0:1787508887.226442:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480295552 00000100:00100000:2.0:1787508887.226522:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1837 00000100:00100000:2.0:1787508887.226534:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480295552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787508887.226573:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 179962432 pending 0 free 3871453184 avail 3639930880 00000100:00100000:2.0:1787508887.226619:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480295552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508887.226627:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1837 00000100:00080000:2.0:1787508887.226654:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787508887.226694:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480295552:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787508887.227592:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480295680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787508887.227651:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508887.230156:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480295680 00000100:00100000:2.0:1787508887.230191:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480295680 00000100:00100000:2.0:1787508887.230288:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1838 00000100:00100000:2.0:1787508887.230299:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e69da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480295680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787508887.230333:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 179962432 pending 0 free 3871453184 avail 3639930880 00000100:00080000:0.0:1787508887.230552:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787508887.239839:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e69da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480295680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9524us (12169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508887.239860:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1838 00000100:00100000:3.0:1787508887.245892:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480295680:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787508888.126836:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508888.250301:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787508888.250364:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787508888.250394:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d39f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480295936:0@lo:400:kworker.0 00000100:00100000:1.0:1787508888.251328:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508888.251652:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480295936 00000100:00100000:2.0:1787508888.251664:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480295936 00000100:00100000:2.0:1787508888.251748:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30064 00000100:00100000:2.0:1787508888.251760:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480295936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508888.251854:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1874324480295936:12345-0@lo:400:kworker.0 Request processed in 97us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508888.251863:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30064 00000100:00100000:1.0:1787508888.252741:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d39f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3618:1874324480295936:0@lo:400:kworker.0 00000100:00100000:3.0:1787508888.252972:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d39fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79de3f65-4bad-42d0-a46f-842a654b33a0:3619:1874324480295808:0@lo:400:kworker.0 00000100:00100000:3.0:1787508888.253048:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508888.253203:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480295808 00000100:00100000:1.0:1787508888.253210:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480295808 00000100:00100000:1.0:1787508888.253267:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1787508888.253275:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fccc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3619:x1874324480295808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508888.253327:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fccc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3619:x1874324480295808:12345-0@lo:400:kworker.0 Request processed in 53us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508888.253333:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:3.0:1787508888.254342:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d39fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:79de3f65-4bad-42d0-a46f-842a654b33a0:3619:1874324480295808:0@lo:400:kworker.0 00000100:00100000:2.0:1787508888.256725:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480296064:0@lo:400:kworker.0 00000100:00100000:3.0:1787508888.256748:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480296192:0@lo:400:kworker.0 00000100:00100000:0.0:1787508888.256864:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091e6a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480296320:0@lo:400:kworker.0 00000100:00100000:2.0:1787508888.260282:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508888.260374:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480296576:0@lo:400:kworker.0 00000100:00100000:1.0:1787508888.262742:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480296064 00000100:00100000:1.0:1787508888.262764:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480296064 00000100:00100000:1.0:1787508888.262901:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2681 00000100:00100000:1.0:1787508888.262917:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480296064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508888.263092:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508888.263154:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480296704:0@lo:400:kworker.0 00000100:00100000:1.0:1787508888.264209:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3616:x1874324480296064:12345-0@lo:400:kworker.0 Request processed in 1289us (3931us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508888.264223:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2681 00000100:00100000:1.0:1787508888.264255:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480296192 00000100:00100000:1.0:1787508888.264262:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480296192 00000100:00100000:1.0:1787508888.264301:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2682 00000100:00100000:1.0:1787508888.264309:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6392300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480296192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508888.264355:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6392300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480296192:12345-0@lo:400:kworker.0 Request processed in 47us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508888.264363:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2682 00000100:00100000:3.0:1787508888.264578:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508888.264619:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480297216:0@lo:400:kworker.0 00000100:00100000:2.0:1787508888.264636:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508888.264666:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508888.264666:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480297088:0@lo:400:kworker.0 00000100:00100000:2.0:1787508888.264690:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508888.264731:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480296192:0@lo:400:kworker.0 00000100:00100000:2.0:1787508888.264731:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3616:1874324480296064:0@lo:400:kworker.0 00000100:00100000:3.0:1787508888.264765:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480296704 00000100:00100000:3.0:1787508888.264769:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480296704 00000100:00100000:3.0:1787508888.264799:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2683 00000100:00100000:3.0:1787508888.264805:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d6390700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480296704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508888.264843:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d6390700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480296704:12345-0@lo:400:kworker.0 Request processed in 38us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508888.264850:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2683 00000100:00100000:3.0:1787508888.264885:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480297216 00000100:00100000:3.0:1787508888.264889:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480297216 00000100:00100000:0.0:1787508888.264917:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508888.264928:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480297088 00000100:00100000:3.0:1787508888.264932:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480297088 00000100:00100000:0.0:1787508888.264966:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480296832:0@lo:400:kworker.0 00000100:00100000:3.0:1787508888.264972:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480296320 00000100:00100000:3.0:1787508888.264975:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480296320 00000100:00100000:3.0:1787508888.264993:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3376 00000100:00100000:0.0:1787508888.264995:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508888.265000:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480297216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508888.265058:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480297216:12345-0@lo:400:kworker.0 Request processed in 58us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508888.265065:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3376 00000100:00100000:3.0:1787508888.265079:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480296832 00000100:00100000:3.0:1787508888.265082:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480296832 00000100:00100000:3.0:1787508888.265095:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3377 00000100:00100000:3.0:1787508888.265099:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480297088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508888.265134:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1874324480297088:12345-0@lo:400:kworker.0 Request processed in 34us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508888.265141:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3377 00000100:00100000:3.0:1787508888.265152:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3378 00000100:00100000:3.0:1787508888.265159:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d39f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480296320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508888.265187:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d39f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1874324480296320:12345-0@lo:400:kworker.0 Request processed in 30us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508888.265193:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3378 00000100:00100000:3.0:1787508888.265204:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3379 00000100:00100000:3.0:1787508888.265210:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d39faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480296832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508888.265235:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d39faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1874324480296832:12345-0@lo:400:kworker.0 Request processed in 26us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508888.265242:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3379 00000100:00100000:3.0:1787508888.265273:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480296448:0@lo:400:kworker.0 00000100:00100000:3.0:1787508888.265307:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508888.265329:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d2d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480296960:0@lo:400:kworker.0 00000100:00100000:3.0:1787508888.265351:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508888.265371:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3618:1874324480296832:0@lo:400:kworker.0 00000100:00100000:0.0:1787508888.265378:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480297344:0@lo:400:kworker.0 00000100:00100000:0.0:1787508888.265403:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508888.265404:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480296704:0@lo:400:kworker.0 00000100:00100000:3.0:1787508888.265414:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480297216:0@lo:400:kworker.0 00000100:00100000:1.0:1787508888.265621:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480296960 00000100:00100000:1.0:1787508888.265627:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480296960 00000100:00100000:1.0:1787508888.265662:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480297344 00000100:00100000:1.0:1787508888.265665:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480297344 00000100:00100000:1.0:1787508888.265685:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3380 00000100:00100000:1.0:1787508888.265692:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480296960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508888.265847:0:203728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480296576 00000100:00100000:2.0:1787508888.265853:0:203728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480296576 00000100:00100000:2.0:1787508888.265894:0:203728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2684 00000100:00100000:2.0:1787508888.265901:0:203728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480296576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508888.265967:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091e6a5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3618:1874324480296320:0@lo:400:kworker.0 00000100:00080000:0.0:1787508888.265992:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787508888.265997:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787508888.266000:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508888.266118:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480296960:12345-0@lo:400:kworker.0 Request processed in 425us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508888.266126:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3380 00000100:00100000:1.0:1787508888.266143:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3381 00000100:00100000:1.0:1787508888.266150:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d39fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480297344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508888.266183:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d39fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1874324480297344:12345-0@lo:400:kworker.0 Request processed in 34us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508888.266189:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3381 00000100:00100000:2.0:1787508888.266269:0:203728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480296576:12345-0@lo:400:kworker.0 Request processed in 369us (1633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508888.266276:0:203728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2684 00000100:00100000:2.0:1787508888.266316:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480296576:0@lo:400:kworker.0 00000100:00100000:2.0:1787508888.266329:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3616:1874324480297088:0@lo:400:kworker.0 00000100:00100000:0.0:1787508888.266418:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480296448 00000100:00100000:0.0:1787508888.266424:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480296448 00000100:00100000:0.0:1787508888.266607:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30065 00000100:00100000:0.0:1787508888.266615:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480296448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787508888.266661:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480296448:12345-0@lo:400:kworker.0 Request processed in 47us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508888.266667:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30065 00000100:00100000:0.0:1787508888.266708:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3618:1874324480297344:0@lo:400:kworker.0 00000100:00100000:3.0:1787508888.267188:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480296448:0@lo:400:kworker.0 00000100:00100000:3.0:1787508888.267210:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d2d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480296960:0@lo:400:kworker.0 00000100:00100000:3.0:1787508888.767378:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d39f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480297472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787508888.767511:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508888.768645:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480297472 00000100:00100000:0.0:1787508888.768661:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480297472 00000100:00100000:2.0:1787508888.769059:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1839 00000100:00100000:2.0:1787508888.769087:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480297472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787508888.769132:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 87465664 pending 0 free 3898224640 avail 3666702336 00000100:00100000:2.0:1787508888.769239:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480297472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 157us (1727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508888.769247:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1839 00000100:00100000:3.0:1787508888.770397:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d39f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480297472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787508888.776974:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787508888.777007:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480297600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787508888.777108:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508888.777702:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480297600 00000100:00100000:1.0:1787508888.777724:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480297600 00000100:00100000:1.0:1787508888.777802:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1840 00000100:00100000:1.0:1787508888.777815:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480297600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787508888.777849:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 87465664 pending 0 free 3898224640 avail 3666702336 00000100:00100000:1.0:1787508888.777930:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480297600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508888.777978:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1840 00000100:00100000:3.0:1787508888.779607:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480297600:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787508889.150012:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508889.791047:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787508889.791074:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480297728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787508889.791150:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508889.791198:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480297728 00000100:00100000:1.0:1787508889.791207:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480297728 00000100:00100000:1.0:1787508889.791257:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30066 00000100:00100000:1.0:1787508889.791267:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480297728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787508889.791301:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440636928 avail 1294397440 00000100:00100000:1.0:1787508889.791347:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3616:x1874324480297728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508889.791354:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30066 00000100:00100000:1.0:1787508889.791413:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480297728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787508889.791657:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787508889.791668:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480297856:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787508889.791706:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508889.791809:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480297856 00000100:00100000:3.0:1787508889.791813:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480297856 00000100:00100000:3.0:1787508889.791849:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30067 00000100:00100000:3.0:1787508889.791856:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480297856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787508889.791878:0:202232:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442709504 avail 1296470016 00000100:00100000:3.0:1787508889.791928:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480297856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508889.791935:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30067 00000100:00100000:1.0:1787508889.792032:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480297856:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787508890.170894:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787508890.811824:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944309 is committed 00010000:00010000:3.0:1787508891.196394:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508891.751427:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508891.751466:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508891.751499:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508891.751520:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508891.751539:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508891.751559:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508891.751594:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508891.751626:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508891.751650:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508891.751689:0:202219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509730176 00000100:00100000:3.0:1787508891.751698:0:202219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509730176 00000100:00100000:3.0:1787508891.751746:0:202219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1086 00000100:00100000:3.0:1787508891.751755:0:202219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fccc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509730176:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508891.751840:0:202219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fccc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2402:x1874324509730176:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 85us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508891.751847:0:202219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1086 00000100:00100000:3.0:1787508891.751883:0:203996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509730688 00000100:00100000:3.0:1787508891.751887:0:203996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509730688 00000100:00100000:3.0:1787508891.751919:0:203996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509731200 00000100:00100000:3.0:1787508891.751923:0:203996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509731200 00000100:00100000:3.0:1787508891.751958:0:203996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509730560 00000100:00100000:3.0:1787508891.751962:0:203996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509730560 00000100:00100000:3.0:1787508891.751981:0:203996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509731072 00000100:00100000:3.0:1787508891.751984:0:203996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509731072 00000100:00100000:3.0:1787508891.752006:0:203996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2685 00000100:00100000:3.0:1787508891.752013:0:203996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509730688:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508891.752043:0:203996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509730688:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 31us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508891.752050:0:203996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2685 00000100:00100000:3.0:1787508891.752062:0:203996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2686 00000100:00100000:3.0:1787508891.752067:0:203996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509731200:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508891.752089:0:203996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2402:x1874324509731200:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 22us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508891.752094:0:203996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2686 00000100:00100000:3.0:1787508891.752105:0:203996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2687 00000100:00100000:3.0:1787508891.752110:0:203996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509730560:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508891.752128:0:203996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2402:x1874324509730560:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 18us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508891.752134:0:203996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2687 00000100:00100000:3.0:1787508891.752145:0:203996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2688 00000100:00100000:3.0:1787508891.752150:0:203996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509731072:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508891.752169:0:203996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2402:x1874324509731072:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 19us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508891.752175:0:203996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2688 00000100:00100000:3.0:1787508891.752199:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509730432 00000100:00100000:3.0:1787508891.752203:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509730432 00000100:00100000:3.0:1787508891.752228:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509730944 00000100:00100000:3.0:1787508891.752230:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509730944 00000100:00100000:3.0:1787508891.752246:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509730304 00000100:00100000:3.0:1787508891.752248:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509730304 00000100:00100000:3.0:1787508891.752261:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509730816 00000100:00100000:3.0:1787508891.752263:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509730816 00000100:00100000:3.0:1787508891.752276:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3382 00000100:00100000:3.0:1787508891.752282:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2402:x1874324509730432:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508891.752308:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2402:x1874324509730432:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508891.752315:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3382 00000100:00100000:3.0:1787508891.752326:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3383 00000100:00100000:3.0:1787508891.752332:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d55a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2402:x1874324509730944:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508891.752352:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d55a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2402:x1874324509730944:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 20us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508891.752358:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3383 00000100:00100000:3.0:1787508891.752369:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3384 00000100:00100000:3.0:1787508891.752374:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+27:2402:x1874324509730304:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508891.752397:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+27:2402:x1874324509730304:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508891.752403:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3384 00000100:00100000:3.0:1787508891.752413:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3385 00000100:00100000:3.0:1787508891.752418:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c6b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:2402:x1874324509730816:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1787508891.752436:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c6b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:2402:x1874324509730816:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 18us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508891.752442:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3385 00000100:00080000:3.0:1787508891.752589:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787508891.752593:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787508891.752596:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787508891.752598:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787508892.218752:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787508892.239221:0:236839:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 108a: lseek: parallel updates ============ 14:14:51 (1787508891) 00000100:00100000:0.0:1787508892.298724:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508892.298806:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509731328 00000100:00100000:1.0:1787508892.298816:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509731328 00000100:00100000:1.0:1787508892.298878:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94352 00000100:00100000:1.0:1787508892.298889:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d39f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+27:349846:x1874324509731328:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508892.298910:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508892.298933:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f368e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaef70 expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.299029:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f368ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.299043:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f368ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.299055:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f368ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508892.299098:0:205405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:1.0:1787508892.299103:0:205405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787508892.299124:0:205405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f368ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.299148:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f368e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef70 expref: 29 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.299164:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f368ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef70 expref: 28 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.299172:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508892.299175:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787508892.299179:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ba00, rc 0) 00000100:00100000:1.0:1787508892.299237:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d39f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+28:349846:x1874324509731328:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 350us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508892.299244:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94352 00000100:00100000:0.0:1787508892.308251:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508892.308335:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509731456 00000100:00100000:3.0:1787508892.308345:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509731456 00000100:00100000:3.0:1787508892.308405:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94353 00000100:00100000:3.0:1787508892.308416:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d39fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+28:349846:x1874324509731456:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508892.308437:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508892.308461:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6244000/0xb126349c40f368f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaef77 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.308535:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f368fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.308551:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f368fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.308576:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f368fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.308593:0:203348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36902 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.308601:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36902 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.308607:0:203348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36902 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.308670:0:203348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f368fb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.308677:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f368fb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.308683:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f368fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.308690:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f368fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.308695:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d6245e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508892.308700:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f368fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.308706:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f368fb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.308718:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508892.308721:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508892.308726:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f368fb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.308731:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6245e00/0xb126349c40f368fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.308743:0:203348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36902 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.308748:0:203348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36902 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.308753:0:203348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36902 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.308757:0:203348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:3.0:1787508892.308760:0:203348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36902 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.308769:0:203348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36902 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.308776:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1e3f1c85 (ffff9090d2273d00) 00010000:00010000:3.0:1787508892.308789:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508892.308793:0:203348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36902 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.308799:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e800/0xb126349c40f36902 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 203348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.308830:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6244000/0xb126349c40f368f4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef77 expref: 29 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.308841:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:3.0:1787508892.308843:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787508892.308847:0:203348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d6244000/0xb126349c40f368f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef77 expref: 29 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.308856:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d6244000, rc 0) 00000100:00100000:3.0:1787508892.308924:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d39fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+28:349846:x1874324509731456:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 509us (680us total) trans 0 rc 301/301 00000100:00100000:3.0:1787508892.308931:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94353 00000100:00100000:2.0:1787508892.319775:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508892.320096:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509731712 00000100:00100000:1.0:1787508892.320107:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509731712 00000100:00100000:1.0:1787508892.320508:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94354 00000100:00100000:1.0:1787508892.320521:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+28:349846:x1874324509731712:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1787508892.320547:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508892.320550:0:202226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787508892.320575:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f368ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef70 expref: 28 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.320593:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508892.320598:0:202226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787508892.320611:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f36909 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaef7e expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.320755:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36910 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.320768:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36910 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.320795:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36910 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.320810:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f36917 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.320817:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f36917 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.320825:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f36917 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.321293:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3691e lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.321303:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3691e lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.321310:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3691e lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508892.321321:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x127d:0x0]: returning size 0 00010000:00010000:1.0:1787508892.321345:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36910 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.321352:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36910 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.321358:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36910 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.321364:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36910 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.321370:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508892.321375:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36910 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.321383:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36910 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.321391:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508892.321394:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508892.321398:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36910 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.321404:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36910 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787508892.321413:0:202226:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b70bea37 reply state 00000000ad0510ce transno 12884944310 ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f36917 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.321426:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f36917 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.321432:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1e3f1c85 (ffff9090ce78ac00) 00010000:00010000:1.0:1787508892.321435:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787508892.321437:0:202226:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787508892.321462:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f36909 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef7e expref: 30 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.321476:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3691e lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef7e expref: 29 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.321484:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127d:0x0].0x0 (ffff9090ce78a700) 00010000:00010000:1.0:1787508892.321486:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787508892.321488:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b000, rc 0) 00000100:00100000:1.0:1787508892.321561:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+30:349846:x1874324509731712:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1043us (1796us total) trans 12884944310 rc 0/0 00000100:00100000:1.0:1787508892.321570:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94354 00000100:00100000:3.0:1787508892.325969:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508892.326014:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509731968 00000100:00100000:3.0:1787508892.326025:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509731968 00000100:00100000:3.0:1787508892.326080:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94355 00000100:00100000:3.0:1787508892.326091:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+30:349846:x1874324509731968:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1787508892.326115:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508892.326135:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3692c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaef85 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.326266:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36933 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x127d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.326281:0:209004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3691e lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef7e expref: 31 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.326290:0:209004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36933 lrc: 4/0,1 mode: --/EX res: [0x2000013a4:0x127d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.326321:0:209004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3691e lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef7e expref: 31 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.326335:0:209004:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3691e lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef7e expref: 31 pid: 202226 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508892.326349:0:209004:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a87b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480297984:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508892.326732:0:209004:0:(client.c:2715:ptlrpc_set_wait()) set ffff9091fd975180 going to sleep for 11 seconds 00000100:00100000:1.0:1787508892.335721:0:209004:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a87b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:209004:1874324480297984:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508892.335764:0:209004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36933 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x127d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508892.337750:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508892.338754:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509732096 00000100:00100000:3.0:1787508892.338767:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509732096 00010000:00010000:3.0:1787508892.338983:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3691e lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef7e expref: 32 pid: 202226 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508892.339064:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27986 00000100:00100000:3.0:1787508892.339075:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+32:2403:x1874324509732096:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508892.339091:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508892.339098:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3691e lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef7e expref: 32 pid: 202226 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.339112:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3691e lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef7e expref: 32 pid: 202226 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.339132:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f3691e lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef7e expref: 32 pid: 202226 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.339147:0:202213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127d:0x0].0x0 (ffff9090ce78a700) 00010000:00010000:3.0:1787508892.339153:0:202213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36933 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x127d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.339161:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36933 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x127d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.339169:0:202213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36933 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x127d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.339202:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508892.339257:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+31:2403:x1874324509732096:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 183us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508892.339265:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27986 00010000:00010000:0.0:1787508892.339299:0:209004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36933 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x127d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.339309:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36933 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x127d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508892.339326:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x127d:0x0]: returning size 0 00000004:00080000:0.0:1787508892.339495:0:209004:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x1535:0x0], index 0: 0 00010000:00010000:0.0:1787508892.339612:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36933 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x127d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.339620:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36933 lrc: 2/0,0 mode: EX/EX res: [0x2000013a4:0x127d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.339627:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36933 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x127d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.339633:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090e4c8e000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508892.339638:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36933 lrc: 3/0,0 mode: EX/EX res: [0x2000013a4:0x127d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.339657:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36933 lrc: 4/0,0 mode: EX/EX res: [0x2000013a4:0x127d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.339668:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127d:0x0].0x0 (ffff9090ce78a700) 00010000:00010000:0.0:1787508892.339671:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787508892.339675:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36933 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x127d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.339681:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8e000/0xb126349c40f36933 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x127d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.339855:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3692c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef85 expref: 31 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.339864:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508892.339867:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787508892.339870:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090e4c8fc00/0xb126349c40f3692c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef85 expref: 31 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.339880:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8fc00, rc 0) 00000100:00100000:0.0:1787508892.339909:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+30:349846:x1874324509731968:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 13820us (13952us total) trans 12884944311 rc 301/301 00000100:00100000:0.0:1787508892.339915:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94355 00000100:00100000:3.0:1787508892.347240:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508892.347688:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9a87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480298112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508892.347742:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508892.348677:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d39f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480298240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787508892.348686:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509732352 00000100:00100000:0.0:1787508892.348693:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509732352 00000100:00100000:1.0:1787508892.348721:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508892.348742:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15523 00000100:00100000:0.0:1787508892.348752:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+30:349846:x1874324509732352:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:1.0:1787508892.348756:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480298112 00000100:00100000:1.0:1787508892.348759:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480298112 00000100:00100000:1.0:1787508892.348915:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480298240 00000100:00100000:1.0:1787508892.348918:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480298240 00000100:00100000:1.0:1787508892.348937:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1841 00000100:00100000:1.0:1787508892.348959:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480298112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787508892.348979:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 179962432 pending 0 free 3871453184 avail 3639930880 00000100:00100000:0.0:1787508892.349038:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+31:349846:x1874324509732352:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 286us (1804us total) trans 12884944312 rc 0/0 00000100:00100000:3.0:1787508892.349045:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1842 00000100:00100000:0.0:1787508892.349045:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15523 00000100:00100000:3.0:1787508892.349054:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480298240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787508892.349064:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 179962432 pending 0 free 3871453184 avail 3639930880 00000100:00100000:1.0:1787508892.349207:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480298112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 247us (1463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508892.349214:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1841 00000100:00080000:1.0:1787508892.349230:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508892.349265:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9a87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480298112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787508892.360168:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480298240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 11105us (11435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508892.360184:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1842 00000100:00100000:3.0:1787508892.360270:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d39f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480298240:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787508892.360402:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508892.360426:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509732608 00000100:00100000:3.0:1787508892.360432:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509732608 00000100:00100000:3.0:1787508892.360471:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15524 00000100:00100000:3.0:1787508892.360479:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+31:349846:x1874324509732608:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1787508892.361142:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+32:349846:x1874324509732608:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 661us (740us total) trans 12884944313 rc 0/0 00000100:00100000:3.0:1787508892.361151:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15524 00000100:00100000:3.0:1787508892.399244:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508892.403366:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509732736 00000100:00100000:0.0:1787508892.403381:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509732736 00000100:00100000:0.0:1787508892.403454:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94356 00000100:00100000:0.0:1787508892.403465:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+32:349854:x1874324509732736:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1787508892.403488:0:202228:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508892.403509:0:202228:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f36941 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaef8c expref: -99 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.403567:0:202228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f36948 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.403580:0:202228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f36948 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.403590:0:202228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f36948 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508892.403637:0:202228:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787508892.403642:0:202228:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508892.403672:0:202228:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f36948 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202228 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.403696:0:202228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f36941 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef8c expref: 34 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.403722:0:202228:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f36948 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef8c expref: 33 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.403731:0:202228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508892.403734:0:202228:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508892.403738:0:202228:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e4400, rc 0) 00000100:00100000:0.0:1787508892.403802:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+33:349854:x1874324509732736:12345-192.168.201.30@tcp:101:dd.0 Request processed in 338us (4566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508892.403810:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94356 00000100:00100000:2.0:1787508892.405991:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508892.406087:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509732992 00000100:00100000:0.0:1787508892.406096:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509732992 00000100:00100000:0.0:1787508892.406140:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94357 00000100:00100000:0.0:1787508892.406149:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+33:349854:x1874324509732992:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1787508892.406167:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508892.406170:0:202227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787508892.406194:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4400/0xb126349c40f36948 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef8c expref: 33 pid: 202228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.406293:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508892.406297:0:202227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508892.406310:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f3694f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaef93 expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.406450:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f36956 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.406462:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f36956 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.406471:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f36956 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.406483:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3695d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.406491:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3695d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.406502:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3695d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.406555:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f36964 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.406562:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f36964 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.406570:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f36964 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508892.406578:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x127d:0x0]: returning size 0 00010000:00010000:0.0:1787508892.406666:0:202227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f36956 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.406675:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f36956 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.406681:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f36956 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.406688:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f36956 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.406694:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508892.406698:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f36956 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.406706:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f36956 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.407196:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508892.407245:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508892.407250:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f36956 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.407257:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5e00/0xb126349c40f36956 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.407269:0:202227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3695d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.407274:0:202227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3695d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.407280:0:202227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3695d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.407285:0:202227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e5400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508892.407287:0:202227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3695d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.407293:0:202227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3695d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.407300:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1e3f1c85 (ffff9090ce78ac00) 00010000:00010000:0.0:1787508892.407302:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508892.407305:0:202227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3695d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.407310:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5400/0xb126349c40f3695d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.407351:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5000/0xb126349c40f3694f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef93 expref: 35 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.407365:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f36964 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef93 expref: 34 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.407372:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127d:0x0].0x0 (ffff9090ca4e2d00) 00010000:00010000:0.0:1787508892.407374:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787508892.407376:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090c96e5600, rc 0) 00000100:00100000:0.0:1787508892.407437:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+34:349854:x1874324509732992:12345-192.168.201.30@tcp:101:dd.0 Request processed in 1288us (1453us total) trans 12884944314 rc 0/0 00000100:00100000:0.0:1787508892.407446:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94357 00000100:00100000:0.0:1787508892.413105:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508892.413989:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509733120 00000100:00100000:1.0:1787508892.414001:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509733120 00000100:00100000:1.0:1787508892.414064:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94358 00000100:00100000:1.0:1787508892.414076:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d39fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+34:349854:x1874324509733120:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:1.0:1787508892.414099:0:205405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508892.414119:0:205405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36972 lrc: 2/0,0 mode: --/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaef9a expref: -99 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.414155:0:205405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f36979 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.414168:0:205405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f36979 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.414179:0:205405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f36979 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 205405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.414300:0:205405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36972 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef9a expref: 36 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.414316:0:205405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ba00/0xb126349c40f36979 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef9a expref: 35 pid: 205405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.414324:0:205405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127d:0x0].0x0 (ffff9090ca4e2d00) 00010000:00010000:1.0:1787508892.414327:0:205405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787508892.414331:0:205405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ba00, rc 0) 00000100:00100000:1.0:1787508892.414392:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d39fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+35:349854:x1874324509733120:12345-192.168.201.30@tcp:101:dd.0 Request processed in 319us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508892.414400:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94358 00000100:00100000:3.0:1787508892.433973:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508892.434452:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509733376 00000100:00100000:0.0:1787508892.434463:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509733376 00000100:00100000:0.0:1787508892.434529:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94359 00000100:00100000:0.0:1787508892.434540:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+35:349854:x1874324509733376:12345-192.168.201.30@tcp:36:dd.0 00010000:00010000:0.0:1787508892.434665:0:209004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508892.434694:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e5600/0xb126349c40f36964 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaef93 expref: 35 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.434712:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127d:0x0].0x0 (ffff9090ca4e2d00) 00010000:00010000:0.0:1787508892.434718:0:209004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508892.434874:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f36980 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x127d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.434893:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f36980 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x127d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.434903:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f36980 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x127d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787508892.434968:0:209004:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884944315 00000004:00010000:0.0:1787508892.434992:0:209004:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000384a9944 reply state 00000000dce3f345 transno 12884944316 ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f36980 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x127d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.435005:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f36980 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x127d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.435012:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127d:0x0].0x0 (ffff9090ca4e2d00) 00010000:00010000:0.0:1787508892.435015:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787508892.435017:0:209004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787508892.435105:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+37:349854:x1874324509733376:12345-192.168.201.30@tcp:36:dd.0 Request processed in 566us (1140us total) trans 12884944316 rc 0/0 00000100:00100000:0.0:1787508892.435113:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94359 00000020:00080000:0.0:1787508892.435119:0:209004:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787508892.443682:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508892.444033:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509733504 00000100:00100000:0.0:1787508892.444043:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509733504 00000100:00100000:0.0:1787508892.444103:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94360 00000100:00100000:0.0:1787508892.444113:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+37:349854:x1874324509733504:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1787508892.444136:0:203348:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508892.444155:0:203348:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20400/0xb126349c40f36987 lrc: 2/0,0 mode: --/CR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaefa1 expref: -99 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.444231:0:203348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20400/0xb126349c40f36987 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefa1 expref: 38 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.444246:0:203348:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20400/0xb126349c40f36987 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefa1 expref: 38 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.444266:0:203348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127d:0x0].0x0 (ffff9090ca4e2d00) 00010000:00010000:0.0:1787508892.444269:0:203348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787508892.444273:0:203348:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9091f9b20400, rc 0) 00000100:00100000:0.0:1787508892.444342:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+38:349854:x1874324509733504:12345-192.168.201.30@tcp:101:dd.0 Request processed in 231us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508892.444349:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94360 00000100:00100000:0.0:1787508892.449572:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508892.449723:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509733632 00000100:00100000:1.0:1787508892.449736:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509733632 00000100:00100000:1.0:1787508892.449805:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15121 00000100:00100000:1.0:1787508892.449815:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d39f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:349854:x1874324509733632:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:1.0:1787508892.449834:0:203727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508892.449860:0:203727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d5c36ef/0xb126349c40f3698e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaefa8 expref: -99 pid: 203727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787508892.449888:0:203727:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1535:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787508892.449910:0:203727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1535:0x0].0x0 since=13863s v=(0 0) 00010000:00010000:1.0:1787508892.449915:0:203727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1535:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787508892.449924:0:203727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d5c36ef/0xb126349c40f3698e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefa8 expref: 7 pid: 203727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.449972:0:203727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002d5c36ef/0xb126349c40f3698e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefa8 expref: 7 pid: 203727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.449986:0:203727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ae00, rc 0) 00000100:00100000:1.0:1787508892.450050:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d39f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:349854:x1874324509733632:12345-192.168.201.30@tcp:101:dd.0 Request processed in 235us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508892.450058:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15121 00000100:00100000:1.0:1787508892.457022:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508892.457147:0:205404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509733760 00000100:00100000:0.0:1787508892.457158:0:205404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509733760 00002000:00010000:0.0:1787508892.457209:0:205404:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5429 (0->18446744073709551615) 00002000:00100000:0.0:1787508892.457214:0:205404:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090cdea0a80 with x1874324509733760 ext(0->18446744073709551615) 00002000:00010000:0.0:1787508892.457225:0:205404:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9090cdea0a80. 00000100:00100000:0.0:1787508892.457255:0:205404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:0.0:1787508892.457265:0:205404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cdea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2400:x1874324509733760:12345-192.168.201.30@tcp:10:dd.0 00002000:00010000:0.0:1787508892.457543:0:205404:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x1535:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787508892.457547:0:205404:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x1535:0x0] updating lvb mtime from disk: 0 -> 1787508893 00002000:00010000:0.0:1787508892.457550:0:205404:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x1535:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787508892.457552:0:205404:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x1535:0x0] updating lvb ctime from disk: 0 -> 1787508893 00002000:00010000:0.0:1787508892.457624:0:205404:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x1535:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787508892.457784:0:205404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cdea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2400:x1874324509733760:12345-192.168.201.30@tcp:10:dd.0 Request processed in 513us (763us total) trans 8589941264 rc 0/0 00000100:00100000:0.0:1787508892.457793:0:205404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 65 00002000:00010000:0.0:1787508892.457799:0:205404:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5429 (0->18446744073709551615) 00002000:00100000:0.0:1787508892.457801:0:205404:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090cdea0a80 with x1874324509733760 ext(0->18446744073709551615) 00002000:00010000:0.0:1787508892.457805:0:205404:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9090cdea0a80. 00000100:00100000:1.0:1787508892.468877:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508892.469376:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509734016 00000100:00100000:0.0:1787508892.469391:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509734016 00000100:00100000:0.0:1787508892.469488:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15525 00000100:00100000:0.0:1787508892.469500:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9a87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+38:349854:x1874324509734016:12345-192.168.201.30@tcp:35:dd.0 00000100:00100000:0.0:1787508892.469823:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9a87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+39:349854:x1874324509734016:12345-192.168.201.30@tcp:35:dd.0 Request processed in 325us (1044us total) trans 12884944317 rc 0/0 00000100:00100000:0.0:1787508892.469832:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15525 00000100:00100000:2.0:1787508892.486218:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508892.486736:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509734144 00000100:00100000:0.0:1787508892.486749:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509734144 00000100:00100000:0.0:1787508892.487102:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94361 00000100:00100000:0.0:1787508892.487113:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+16:349857:x1874324509734144:12345-192.168.201.30@tcp:101:lseek_test.0 00010000:00010000:0.0:1787508892.487135:0:202227:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508892.487158:0:202227:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21400/0xb126349c40f36995 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaefaf expref: -99 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.487222:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21800/0xb126349c40f3699c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.487235:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21800/0xb126349c40f3699c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.487246:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21800/0xb126349c40f3699c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508892.487291:0:202227:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787508892.487296:0:202227:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508892.487341:0:202227:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21800/0xb126349c40f3699c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.487367:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21400/0xb126349c40f36995 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefaf expref: 18 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.487387:0:202227:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21800/0xb126349c40f3699c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefaf expref: 17 pid: 202227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.487395:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508892.487399:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508892.487403:0:202227:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9091f9b21800, rc 0) 00000100:00100000:0.0:1787508892.487476:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:349857:x1874324509734144:12345-192.168.201.30@tcp:101:lseek_test.0 Request processed in 364us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508892.487483:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94361 00000100:00100000:3.0:1787508892.492121:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508892.492186:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509734400 00000100:00100000:1.0:1787508892.492196:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509734400 00000100:00100000:1.0:1787508892.492462:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94362 00000100:00100000:1.0:1787508892.492475:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+17:349857:x1874324509734400:12345-192.168.201.30@tcp:101:lseek_test.0 00010000:00010000:1.0:1787508892.492495:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508892.492514:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f369a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaefb6 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.492587:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f369aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.492601:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f369aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.492612:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f369aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.492624:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f369b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.492632:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f369b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.492637:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f369b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.492765:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f369b8 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.492772:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f369b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.492787:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f369b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508892.492794:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x127d:0x0]: returning size 10000 00010000:00010000:1.0:1787508892.492853:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f369aa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.492859:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f369aa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.492862:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f369aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.492867:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f369aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.492871:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508892.492874:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f369aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.492881:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f369aa lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.492890:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508892.492892:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508892.492895:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f369aa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.492899:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f369aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.492909:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f369b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.492913:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f369b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.492916:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f369b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.492919:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508892.492920:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f369b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.492924:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f369b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.492927:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1e3f1c85 (ffff9090ce78ac00) 00010000:00010000:1.0:1787508892.492928:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508892.492930:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f369b1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.492934:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f369b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.493008:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f369a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefb6 expref: 20 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.493021:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f369b8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefb6 expref: 19 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.493028:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127d:0x0].0x0 (ffff9090ca4e2d00) 00010000:00010000:1.0:1787508892.493030:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787508892.493033:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b200, rc 0) 00000100:00100000:1.0:1787508892.493086:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+19:349857:x1874324509734400:12345-192.168.201.30@tcp:101:lseek_test.0 Request processed in 614us (973us total) trans 12884944318 rc 0/0 00000100:00100000:1.0:1787508892.493094:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94362 00000100:00100000:2.0:1787508892.495256:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508892.495306:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509734528 00000100:00100000:1.0:1787508892.495316:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509734528 00000100:00100000:1.0:1787508892.495365:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15122 00000100:00100000:1.0:1787508892.495375:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091e6a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:349857:x1874324509734528:12345-192.168.201.30@tcp:101:lseek_test.0 00010000:00010000:1.0:1787508892.495392:0:225836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508892.495409:0:225836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003209cef6/0xb126349c40f369c6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaefbd expref: -99 pid: 225836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.495440:0:225836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002d5c36ef/0xb126349c40f3698e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefa8 expref: 7 pid: 203727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.495455:0:225836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1535:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787508892.495458:0:225836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1535:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787508892.495462:0:225836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003209cef6/0xb126349c40f369c6 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefbd expref: 6 pid: 225836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.495491:0:225836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002d5c36ef/0xb126349c40f3698e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefa8 expref: 7 pid: 203727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.495502:0:225836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002d5c36ef/0xb126349c40f3698e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefa8 expref: 7 pid: 203727 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508892.495513:0:225836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:225836:1874324480298368:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508892.495579:0:225836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d21c4000 going to sleep for 11 seconds 00000100:00100000:1.0:1787508892.497423:0:225836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:225836:1874324480298368:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508892.497456:0:225836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003209cef6/0xb126349c40f369c6 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefbd expref: 6 pid: 225836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.497475:0:225836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b000, rc 0) 00000100:00100000:1.0:1787508892.497528:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091e6a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:349857:x1874324509734528:12345-192.168.201.30@tcp:101:lseek_test.0 Request processed in 2154us (2282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508892.497538:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15122 00000100:00100000:2.0:1787508892.498288:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508892.498329:0:208929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509734656 00000100:00100000:0.0:1787508892.498336:0:208929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509734656 00002000:00100000:0.0:1787508892.498376:0:208929:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x1535:0x0] (0->9999) req@ffff9091dabbc000 x1874324509734656/t0(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:348/0 lens 10488/0 e 0 to 0 dl 1787508903 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787508892.498382:0:208929:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091dabbc000 with x1874324509734656 ext(0->9999) 00010000:00010000:0.0:1787508892.498389:0:208929:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002d5c36ef/0xb126349c40f3698e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefa8 expref: 8 pid: 203727 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.498402:0:208929:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002d5c36ef/0xb126349c40f3698e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefa8 expref: 8 pid: 203727 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787508892.498410:0:208929:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9091dabbc000 00000100:00100000:0.0:1787508892.498443:0:208929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:0.0:1787508892.498453:0:208929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091dabbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2400:x1874324509734656:12345-192.168.201.30@tcp:4:dd.0 00000100:00100000:0.0:1787508892.499172:0:208929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091dabbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2400:x1874324509734656:12345-192.168.201.30@tcp:4:dd.0 Request processed in 715us (883us total) trans 8589941265 rc 0/0 00000100:00100000:0.0:1787508892.499181:0:208929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00002000:00100000:0.0:1787508892.499189:0:208929:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x1535:0x0] (0->9999) req@ffff9091dabbc000 x1874324509734656/t8589941265(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:348/0 lens 10488/448 e 0 to 0 dl 1787508903 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787508892.499350:0:208929:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9091dabbc000 with x1874324509734656 ext(0->9999) 00010000:00010000:0.0:1787508892.499361:0:208929:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002d5c36ef/0xb126349c40f3698e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefa8 expref: 10 pid: 203727 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.499375:0:208929:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002d5c36ef/0xb126349c40f3698e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefa8 expref: 10 pid: 203727 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787508892.499383:0:208929:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9091dabbc000 00000100:00100000:2.0:1787508892.500972:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508892.501026:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509734784 00000100:00100000:3.0:1787508892.501036:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509734784 00010000:00010000:3.0:1787508892.501069:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002d5c36ef/0xb126349c40f3698e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefa8 expref: 10 pid: 203727 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508892.501102:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27987 00000100:00100000:3.0:1787508892.501112:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2403:x1874324509734784:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508892.501127:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787508892.501143:0:202212:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x1535:0x0] updating lvb size from disk: 0 -> 10000 00002000:00010000:3.0:1787508892.501147:0:202212:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x1535:0x0] updating lvb blocks from disk: 0 -> 24 00010000:00010000:3.0:1787508892.501153:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002d5c36ef/0xb126349c40f3698e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefa8 expref: 10 pid: 203727 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.501164:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002d5c36ef/0xb126349c40f3698e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefa8 expref: 10 pid: 203727 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.501182:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d5c36ef/0xb126349c40f3698e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefa8 expref: 10 pid: 203727 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.501195:0:202212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1535:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787508892.501247:0:202212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1535:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787508892.501256:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003209cef6/0xb126349c40f369c6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefbd expref: 5 pid: 225836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.501268:0:202212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003209cef6/0xb126349c40f369c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefbd expref: 5 pid: 225836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.501302:0:202212:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003209cef6/0xb126349c40f369c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefbd expref: 5 pid: 225836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508892.501313:0:202212:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c8ea7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:202212:1874324480298496:192.168.201.30@tcp:105: 00000100:00100000:3.0:1787508892.501373:0:202212:0:(client.c:2715:ptlrpc_set_wait()) set ffff9091fd975900 going to sleep for 11 seconds 00000100:00100000:0.0:1787508892.503049:0:202212:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c8ea7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:202212:1874324480298496:192.168.201.30@tcp:105: 00000100:00100000:2.0:1787508892.503059:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:0.0:1787508892.503076:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787508892.503130:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:2403:x1874324509734784:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 2018us (2197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508892.503141:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27987 00000100:00100000:1.0:1787508892.503315:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509734912 00000100:00100000:1.0:1787508892.503322:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509734912 00000100:00100000:1.0:1787508892.503372:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15123 00000100:00100000:1.0:1787508892.503381:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c999fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2401:x1874324509734912:12345-192.168.201.30@tcp:23:lseek_test.0 00000100:00100000:1.0:1787508892.503449:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c999fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2401:x1874324509734912:12345-192.168.201.30@tcp:23:lseek_test.0 Request processed in 69us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508892.503456:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15123 00000100:00100000:2.0:1787508892.504933:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508892.505061:0:227154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509735168 00000100:00100000:3.0:1787508892.505068:0:227154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509735168 00000100:00100000:3.0:1787508892.505112:0:227154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15526 00000100:00100000:3.0:1787508892.505123:0:227154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+19:349857:x1874324509735168:12345-192.168.201.30@tcp:35:lseek_test.0 00000100:00100000:3.0:1787508892.505668:0:227154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+20:349857:x1874324509735168:12345-192.168.201.30@tcp:35:lseek_test.0 Request processed in 544us (737us total) trans 12884944319 rc 0/0 00000100:00100000:3.0:1787508892.505676:0:227154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15526 00000100:00100000:2.0:1787508892.511026:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508892.511104:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509735296 00000100:00100000:0.0:1787508892.511113:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509735296 00000100:00100000:0.0:1787508892.511169:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94363 00000100:00100000:0.0:1787508892.511180:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+39:349858:x1874324509735296:12345-192.168.201.30@tcp:101:truncate.0 00010000:00010000:0.0:1787508892.511208:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508892.511229:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21400/0xb126349c40f369cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaefc4 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.511283:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21200/0xb126349c40f369d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.511294:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21200/0xb126349c40f369d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.511302:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21200/0xb126349c40f369d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508892.511341:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 69632 00000004:00200000:0.0:1787508892.511343:0:209004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508892.511360:0:209004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21200/0xb126349c40f369d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.511378:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21400/0xb126349c40f369cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefc4 expref: 41 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.511404:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21200/0xb126349c40f369d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefc4 expref: 40 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.511410:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508892.511412:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787508892.511415:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9091f9b21200, rc 0) 00000100:00100000:0.0:1787508892.511466:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+40:349858:x1874324509735296:12345-192.168.201.30@tcp:101:truncate.0 Request processed in 289us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508892.511471:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94363 00000100:00100000:2.0:1787508892.513838:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508892.514067:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509735424 00000100:00100000:0.0:1787508892.514077:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509735424 00000100:00100000:0.0:1787508892.514302:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94364 00000100:00100000:0.0:1787508892.514311:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c9680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+40:349858:x1874324509735424:12345-192.168.201.30@tcp:101:truncate.0 00010000:00010000:0.0:1787508892.514328:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508892.514346:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20600/0xb126349c40f369db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaefcb expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.514412:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20200/0xb126349c40f369e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.514426:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20200/0xb126349c40f369e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.514438:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20200/0xb126349c40f369e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.514448:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f369e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.514455:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f369e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.514460:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f369e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.514537:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20c00/0xb126349c40f369f0 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.514543:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20c00/0xb126349c40f369f0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.514552:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20c00/0xb126349c40f369f0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508892.514591:0:230618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x127d:0x0]: returning size 10000 00000004:00200000:0.0:1787508892.514595:0:230618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787508892.514615:0:230618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20c00/0xb126349c40f369f0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.514627:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20c00/0xb126349c40f369f0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.514634:0:230618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20200/0xb126349c40f369e2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.514638:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20200/0xb126349c40f369e2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.514654:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20200/0xb126349c40f369e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.514661:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20200/0xb126349c40f369e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.514671:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9091f9b20200 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508892.514675:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20200/0xb126349c40f369e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.514682:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20200/0xb126349c40f369e2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.514695:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508892.514698:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508892.514702:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20200/0xb126349c40f369e2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.514713:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20200/0xb126349c40f369e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.514724:0:230618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f369e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.514728:0:230618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f369e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.514732:0:230618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f369e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.514734:0:230618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9091f9b20e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508892.514736:0:230618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f369e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.514739:0:230618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f369e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.514743:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1e3f1c85 (ffff9090ce78ac00) 00010000:00010000:0.0:1787508892.514745:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508892.514746:0:230618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f369e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.514749:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f369e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.514766:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20600/0xb126349c40f369db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefcb expref: 42 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.514832:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20c00/0xb126349c40f369f0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefcb expref: 41 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.514841:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127d:0x0].0x0 (ffff9090ca4e2d00) 00010000:00010000:0.0:1787508892.514844:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787508892.514847:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9091f9b20c00, rc 0) 00000100:00100000:0.0:1787508892.515044:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c9680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+41:349858:x1874324509735424:12345-192.168.201.30@tcp:101:truncate.0 Request processed in 728us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508892.515052:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94364 00000100:00100000:2.0:1787508892.518694:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508892.519103:0:202227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509735680 00000100:00100000:0.0:1787508892.519113:0:202227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509735680 00000100:00100000:0.0:1787508892.519179:0:202227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94365 00000100:00100000:0.0:1787508892.519192:0:202227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+41:349858:x1874324509735680:12345-192.168.201.30@tcp:36:truncate.0 00010000:00010000:0.0:1787508892.519250:0:202227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787508892.519277:0:202227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20c00/0xb126349c40f369f0 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefcb expref: 41 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.519297:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127d:0x0].0x0 (ffff9090ca4e2d00) 00010000:00010000:0.0:1787508892.519301:0:202227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508892.519482:0:202227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21400/0xb126349c40f369f7 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x127d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.519496:0:202227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f369b8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefb6 expref: 19 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.519505:0:202227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21400/0xb126349c40f369f7 lrc: 4/0,1 mode: --/PW res: [0x2000013a4:0x127d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.519555:0:202227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f369b8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefb6 expref: 19 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.519573:0:202227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f369b8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefb6 expref: 19 pid: 202226 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508892.519589:0:202227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091ffb60000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:202227:1874324480298624:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508892.519746:0:202227:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c9a6c780 going to sleep for 11 seconds 00000100:00100000:1.0:1787508892.525221:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508892.525308:0:202227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091ffb60000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:202227:1874324480298624:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508892.525338:0:202227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21400/0xb126349c40f369f7 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x127d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508892.525553:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509735808 00000100:00100000:3.0:1787508892.525560:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509735808 00010000:00010000:3.0:1787508892.525600:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f369b8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefb6 expref: 20 pid: 202226 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508892.525672:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27988 00000100:00100000:3.0:1787508892.525680:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+20:2400:x1874324509735808:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508892.525692:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508892.525697:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f369b8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefb6 expref: 20 pid: 202226 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.525707:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f369b8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefb6 expref: 20 pid: 202226 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.525724:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b200/0xb126349c40f369b8 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefb6 expref: 20 pid: 202226 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.525735:0:205406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127d:0x0].0x0 (ffff9090ca4e2d00) 00010000:00010000:3.0:1787508892.525739:0:205406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21400/0xb126349c40f369f7 lrc: 3/0,1 mode: --/PW res: [0x2000013a4:0x127d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.525746:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21400/0xb126349c40f369f7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x127d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.525751:0:205406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21400/0xb126349c40f369f7 lrc: 4/0,1 mode: PW/PW res: [0x2000013a4:0x127d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.525773:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508892.525831:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+19:2400:x1874324509735808:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 151us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508892.525837:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27988 00010000:00010000:0.0:1787508892.525880:0:202227:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21400/0xb126349c40f369f7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x127d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.525885:0:202227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21400/0xb126349c40f369f7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x127d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787508892.525993:0:202227:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884944320 00000004:00010000:0.0:1787508892.526035:0:202227:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5ff8444 reply state 000000003987790b transno 12884944321 ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21400/0xb126349c40f369f7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a4:0x127d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.526045:0:202227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21400/0xb126349c40f369f7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x127d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.526049:0:202227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127d:0x0].0x0 (ffff9090ca4e2d00) 00010000:00010000:0.0:1787508892.526051:0:202227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787508892.526052:0:202227:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787508892.526116:0:202227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+43:349858:x1874324509735680:12345-192.168.201.30@tcp:36:truncate.0 Request processed in 6925us (7435us total) trans 12884944321 rc 0/0 00000100:00100000:0.0:1787508892.526123:0:202227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94365 00000020:00080000:0.0:1787508892.526126:0:202227:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787508892.528485:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508892.528571:0:225840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509735936 00000100:00100000:3.0:1787508892.528580:0:225840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509735936 00000100:00100000:3.0:1787508892.528659:0:225840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15124 00000100:00100000:3.0:1787508892.528674:0:225840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ffb60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6da43cb4-2376-46ce-b4ec-7d299949c5a8+9:349858:x1874324509735936:12345-192.168.201.30@tcp:101:truncate.0 00010000:00010000:3.0:1787508892.528692:0:225840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508892.528711:0:225840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021fbb812/0xb126349c40f369fe lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaefd2 expref: -99 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.528740:0:225840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003209cef6/0xb126349c40f369c6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefbd expref: 5 pid: 225836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.528748:0:225840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1535:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787508892.528752:0:225840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1535:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787508892.528757:0:225840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021fbb812/0xb126349c40f369fe lrc: 4/0,0 mode: --/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefd2 expref: 10 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.528794:0:225840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003209cef6/0xb126349c40f369c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefbd expref: 5 pid: 225836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.528809:0:225840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003209cef6/0xb126349c40f369c6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefbd expref: 5 pid: 225836 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508892.529064:0:225840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c8ea6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:225840:1874324480298752:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508892.530350:0:225840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9091fd975cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787508892.535066:0:225840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c8ea6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:225840:1874324480298752:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508892.535072:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:0.0:1787508892.535109:0:225840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000021fbb812/0xb126349c40f369fe lrc: 3/0,0 mode: --/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefd2 expref: 10 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.535130:0:225840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e800, rc 0) 00000100:00100000:0.0:1787508892.535206:0:225840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ffb60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:349858:x1874324509735936:12345-192.168.201.30@tcp:101:truncate.0 Request processed in 6525us (6722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508892.535216:0:225840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15124 00000100:00100000:1.0:1787508892.536372:0:229383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509736064 00000100:00100000:1.0:1787508892.536384:0:229383:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509736064 00010000:00010000:1.0:1787508892.536439:0:229383:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003209cef6/0xb126349c40f369c6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefbd expref: 6 pid: 225836 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508892.536483:0:229383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27989 00000100:00100000:1.0:1787508892.536495:0:229383:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509736064:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508892.536511:0:229383:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508892.536535:0:229383:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003209cef6/0xb126349c40f369c6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefbd expref: 6 pid: 225836 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.536549:0:229383:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003209cef6/0xb126349c40f369c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefbd expref: 6 pid: 225836 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.536587:0:229383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003209cef6/0xb126349c40f369c6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefbd expref: 6 pid: 225836 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.536605:0:229383:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1535:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787508892.536610:0:229383:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1535:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787508892.536619:0:229383:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000021fbb812/0xb126349c40f369fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefd2 expref: 9 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.536631:0:229383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021fbb812/0xb126349c40f369fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefd2 expref: 9 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.536679:0:229383:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000021fbb812/0xb126349c40f369fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefd2 expref: 9 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508892.536694:0:229383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:229383:1874324480298880:192.168.201.30@tcp:105: 00000100:00100000:1.0:1787508892.536836:0:229383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d21c4000 going to sleep for 11 seconds 00000100:00100000:1.0:1787508892.540307:0:229383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:229383:1874324480298880:192.168.201.30@tcp:105: 00010000:00010000:1.0:1787508892.540333:0:229383:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508892.540402:0:229383:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509736064:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 3902us (5321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508892.540413:0:229383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27989 00000100:00100000:2.0:1787508892.541537:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508892.541609:0:203733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509736192 00000100:00100000:1.0:1787508892.541617:0:203733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509736192 00002000:00010000:1.0:1787508892.541667:0:203733:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5429 (2000->18446744073709551615) 00002000:00100000:1.0:1787508892.541672:0:203733:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090cc620380 with x1874324509736192 ext(2000->18446744073709551615) 00002000:00010000:1.0:1787508892.541684:0:203733:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9090cc620380. 00000100:00100000:1.0:1787508892.541715:0:203733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00100000:1.0:1787508892.541726:0:203733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cc620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2400:x1874324509736192:12345-192.168.201.30@tcp:10:truncate.0 00002000:00010000:1.0:1787508892.542301:0:203733:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x1535:0x0] updating lvb size from disk: 10000 -> 2000 00002000:00010000:1.0:1787508892.542306:0:203733:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x1535:0x0] updating lvb mtime from disk: 1787508893 -> 1787508893 00002000:00010000:1.0:1787508892.542309:0:203733:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x1535:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787508892.542312:0:203733:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x1535:0x0] updating lvb ctime from disk: 1787508893 -> 1787508893 00002000:00010000:1.0:1787508892.542315:0:203733:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x1535:0x0] updating lvb blocks from disk: 24 -> 8 00000100:00100000:1.0:1787508892.542456:0:203733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cc620380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:2400:x1874324509736192:12345-192.168.201.30@tcp:10:truncate.0 Request processed in 729us (921us total) trans 8589941266 rc 0/0 00000100:00100000:1.0:1787508892.542465:0:203733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 66 00002000:00010000:1.0:1787508892.542469:0:203733:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5429 (2000->18446744073709551615) 00002000:00100000:1.0:1787508892.542472:0:203733:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090cc620380 with x1874324509736192 ext(2000->18446744073709551615) 00002000:00010000:1.0:1787508892.542477:0:203733:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9090cc620380. 00000100:00100000:2.0:1787508892.560751:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508892.560851:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509736448 00000100:00100000:1.0:1787508892.560862:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509736448 00000100:00100000:1.0:1787508892.560936:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94366 00000100:00100000:1.0:1787508892.560981:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+19:349859:x1874324509736448:12345-192.168.201.30@tcp:101:lseek_test.0 00010000:00010000:1.0:1787508892.561005:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508892.561025:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f36a05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaefd9 expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.561104:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36a0c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.561120:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36a0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.561132:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36a0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.561144:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f36a13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.561152:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f36a13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.561159:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f36a13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.561294:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f36a1a lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.561304:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f36a1a lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.561311:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f36a1a lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508892.561321:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x127d:0x0]: returning size 2000 00010000:00010000:1.0:1787508892.561409:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36a0c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.561417:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36a0c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.561424:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36a0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.561430:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36a0c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.561436:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508892.561440:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36a0c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.561447:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36a0c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.561463:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508892.561466:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508892.561471:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36a0c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.561477:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36a0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.561490:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f36a13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.561497:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f36a13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.561502:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f36a13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.561507:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247ac00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508892.561510:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f36a13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.561515:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f36a13 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.561522:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1e3f1c85 (ffff9090ce78ac00) 00010000:00010000:1.0:1787508892.561525:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508892.561528:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f36a13 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.561533:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f36a13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.561864:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b000/0xb126349c40f36a05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefd9 expref: 22 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.561879:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f36a1a lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefd9 expref: 21 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.561886:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127d:0x0].0x0 (ffff9090ca4e2d00) 00010000:00010000:1.0:1787508892.561888:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787508892.561891:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247a800, rc 0) 00000100:00100000:1.0:1787508892.562031:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+21:349859:x1874324509736448:12345-192.168.201.30@tcp:101:lseek_test.0 Request processed in 1052us (1289us total) trans 12884944322 rc 0/0 00000100:00100000:1.0:1787508892.562039:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94366 00000100:00100000:3.0:1787508892.565657:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508892.566255:0:203728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509736576 00000100:00100000:1.0:1787508892.566265:0:203728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509736576 00000100:00100000:1.0:1787508892.566357:0:203728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15125 00000100:00100000:1.0:1787508892.566368:0:203728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:349859:x1874324509736576:12345-192.168.201.30@tcp:101:lseek_test.0 00010000:00010000:1.0:1787508892.566386:0:203728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508892.566418:0:203728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9dbee83/0xb126349c40f36a28 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaefe0 expref: -99 pid: 203728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.566452:0:203728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021fbb812/0xb126349c40f369fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefd2 expref: 10 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.566461:0:203728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1535:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787508892.566466:0:203728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1535:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1787508892.566472:0:203728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9dbee83/0xb126349c40f36a28 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefe0 expref: 6 pid: 203728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.566506:0:203728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021fbb812/0xb126349c40f369fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefd2 expref: 10 pid: 225840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.566522:0:203728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021fbb812/0xb126349c40f369fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefd2 expref: 10 pid: 225840 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508892.566534:0:203728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:203728:1874324480299008:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508892.566625:0:203728:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d21c49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787508892.569319:0:203728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:203728:1874324480299008:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508892.569359:0:203728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9dbee83/0xb126349c40f36a28 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefe0 expref: 6 pid: 203728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.569380:0:203728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b200, rc 0) 00000100:00100000:1.0:1787508892.569436:0:203728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:349859:x1874324509736576:12345-192.168.201.30@tcp:101:lseek_test.0 Request processed in 3070us (3798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508892.569445:0:203728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15125 00000100:00100000:3.0:1787508892.570259:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508892.570346:0:202211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509736704 00000100:00100000:2.0:1787508892.570355:0:202211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509736704 00010000:00010000:2.0:1787508892.570391:0:202211:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021fbb812/0xb126349c40f369fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefd2 expref: 11 pid: 225840 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508892.570441:0:202211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27990 00000100:00100000:2.0:1787508892.570450:0:202211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:2401:x1874324509736704:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508892.570463:0:202211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787508892.570486:0:202211:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021fbb812/0xb126349c40f369fe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefd2 expref: 11 pid: 225840 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508892.570506:0:202211:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021fbb812/0xb126349c40f369fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefd2 expref: 11 pid: 225840 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508892.570542:0:202211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021fbb812/0xb126349c40f369fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefd2 expref: 11 pid: 225840 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508892.570565:0:202211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1535:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1787508892.570569:0:202211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1535:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1787508892.570577:0:202211:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9dbee83/0xb126349c40f36a28 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefe0 expref: 5 pid: 203728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508892.570586:0:202211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9dbee83/0xb126349c40f36a28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefe0 expref: 5 pid: 203728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508892.570619:0:202211:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d9dbee83/0xb126349c40f36a28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefe0 expref: 5 pid: 203728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508892.570633:0:202211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9b61f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:202211:1874324480299136:192.168.201.30@tcp:105: 00000100:00100000:2.0:1787508892.570708:0:202211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090ce980780 going to sleep for 11 seconds 00000100:00100000:3.0:1787508892.574202:0:202211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9b61f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:202211:1874324480299136:192.168.201.30@tcp:105: 00010000:00010000:3.0:1787508892.574229:0:202211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508892.574291:0:202211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2401:x1874324509736704:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 3841us (4034us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508892.574302:0:202211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27990 00000100:00100000:2.0:1787508892.577366:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508892.577494:0:225833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509736832 00000100:00100000:0.0:1787508892.577504:0:225833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509736832 00000100:00100000:0.0:1787508892.577573:0:225833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15126 00000100:00100000:0.0:1787508892.577584:0:225833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2403:x1874324509736832:12345-192.168.201.30@tcp:23:lseek_test.0 00000100:00100000:0.0:1787508892.577696:0:225833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2403:x1874324509736832:12345-192.168.201.30@tcp:23:lseek_test.0 Request processed in 114us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508892.577702:0:225833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15126 00000100:00100000:2.0:1787508892.580706:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508892.580913:0:202230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509737088 00000100:00100000:1.0:1787508892.580923:0:202230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509737088 00000100:00100000:1.0:1787508892.581041:0:202230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15527 00000100:00100000:1.0:1787508892.581052:0:202230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+21:349859:x1874324509737088:12345-192.168.201.30@tcp:35:lseek_test.0 00000100:00100000:1.0:1787508892.581342:0:202230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eb35f31c-097f-45a3-8275-bc75f97f89ee+22:349859:x1874324509737088:12345-192.168.201.30@tcp:35:lseek_test.0 Request processed in 291us (645us total) trans 12884944323 rc 0/0 00000100:00100000:1.0:1787508892.581355:0:202230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15527 00000100:00100000:3.0:1787508892.687907:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508892.688210:0:209004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509737344 00000100:00100000:0.0:1787508892.688222:0:209004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509737344 00000100:00100000:0.0:1787508892.688291:0:209004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94367 00000100:00100000:0.0:1787508892.688302:0:209004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+43:349867:x1874324509737344:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1787508892.688327:0:209004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508892.688331:0:209004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787508892.688357:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21200/0xb126349c40f369d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefc4 expref: 43 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.688378:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508892.688383:0:209004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508892.688397:0:209004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20c00/0xb126349c40f36a2f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaefe7 expref: -99 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.688544:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20600/0xb126349c40f36a36 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.688568:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20600/0xb126349c40f36a36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.688578:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20600/0xb126349c40f36a36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.688589:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f36a3d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.688596:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f36a3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.688603:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f36a3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.688672:0:209004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20200/0xb126349c40f36a44 lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.688682:0:209004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20200/0xb126349c40f36a44 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.688694:0:209004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20200/0xb126349c40f36a44 lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787508892.688703:0:209004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x127d:0x0]: returning size 2000 00010000:00010000:0.0:1787508892.688779:0:209004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20600/0xb126349c40f36a36 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.688786:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20600/0xb126349c40f36a36 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.688793:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20600/0xb126349c40f36a36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.688799:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20600/0xb126349c40f36a36 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.688805:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9091f9b20600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508892.688810:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20600/0xb126349c40f36a36 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.688817:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20600/0xb126349c40f36a36 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.688825:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:0.0:1787508892.688828:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508892.688832:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20600/0xb126349c40f36a36 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.688838:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20600/0xb126349c40f36a36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.688853:0:209004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f36a3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.688858:0:209004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f36a3d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.688862:0:209004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f36a3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.688866:0:209004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9091f9b20e00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:0.0:1787508892.688869:0:209004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f36a3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.688874:0:209004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f36a3d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.688880:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1e3f1c85 (ffff9090ce78ac00) 00010000:00010000:0.0:1787508892.688882:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787508892.688884:0:209004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f36a3d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.688889:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f36a3d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.688920:0:209004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20c00/0xb126349c40f36a2f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefe7 expref: 45 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.688933:0:209004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20200/0xb126349c40f36a44 lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefe7 expref: 44 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.689007:0:209004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127d:0x0].0x0 (ffff9090ca4e2d00) 00010000:00010000:0.0:1787508892.689010:0:209004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787508892.689012:0:209004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9091f9b20200, rc 0) 00000100:00100000:0.0:1787508892.689070:0:209004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6da43cb4-2376-46ce-b4ec-7d299949c5a8+44:349867:x1874324509737344:12345-192.168.201.30@tcp:101:dd.0 Request processed in 770us (1174us total) trans 12884944324 rc 0/0 00000100:00100000:0.0:1787508892.689078:0:209004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94367 00000100:00100000:2.0:1787508892.720331:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508892.720555:0:230618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509737600 00000100:00100000:0.0:1787508892.720577:0:230618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509737600 00000100:00100000:0.0:1787508892.720634:0:230618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94368 00000100:00100000:0.0:1787508892.720653:0:230618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c788d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+44:349867:x1874324509737600:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1787508892.720677:0:230618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508892.720681:0:230618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1787508892.720837:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20400/0xb126349c40f36987 lrc: 0/0,0 mode: --/CR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefa1 expref: 44 pid: 203348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.720866:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20200/0xb126349c40f36a44 lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefe7 expref: 43 pid: 209004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.720876:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127d:0x0].0x0 (ffff9090ca4e2d00) 00010000:00010000:0.0:1787508892.720880:0:230618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787508892.720894:0:230618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20c00/0xb126349c40f36a52 lrc: 2/0,0 mode: --/EX res: [0x2000013a4:0x127d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaefee expref: -99 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.721002:0:230618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f36a59 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x127d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.721021:0:230618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f36a1a lrc: 2/0,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefd9 expref: 21 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.721029:0:230618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f36a59 lrc: 4/0,1 mode: --/EX res: [0x2000013a4:0x127d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.721062:0:230618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f36a1a lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefd9 expref: 21 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.721076:0:230618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f36a1a lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefd9 expref: 21 pid: 202226 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787508892.721088:0:230618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cbebc380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480299264:192.168.201.30@tcp:104: 00000100:00100000:0.0:1787508892.721163:0:230618:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090c9a6c780 going to sleep for 11 seconds 00000100:00100000:0.0:1787508892.724390:0:230618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cbebc380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:230618:1874324480299264:192.168.201.30@tcp:104: 00010000:00010000:0.0:1787508892.724422:0:230618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f36a59 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x127d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508892.735985:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508892.736352:0:225839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509737728 00000100:00100000:1.0:1787508892.736362:0:225839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509737728 00010000:00010000:1.0:1787508892.736405:0:225839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f36a1a lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefd9 expref: 22 pid: 202226 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508892.736446:0:225839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27991 00000100:00100000:1.0:1787508892.736457:0:225839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090ce781180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+22:2401:x1874324509737728:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787508892.736471:0:225839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787508892.736479:0:225839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f36a1a lrc: 4/0,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefd9 expref: 22 pid: 202226 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.736494:0:225839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f36a1a lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefd9 expref: 22 pid: 202226 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.736514:0:225839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a800/0xb126349c40f36a1a lrc: 0/0,0 mode: --/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefd9 expref: 22 pid: 202226 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.736531:0:225839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127d:0x0].0x0 (ffff9090ca4e2d00) 00010000:00010000:1.0:1787508892.736536:0:225839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f36a59 lrc: 3/0,1 mode: --/EX res: [0x2000013a4:0x127d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.736547:0:225839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f36a59 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x127d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.736662:0:225839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f36a59 lrc: 4/0,1 mode: EX/EX res: [0x2000013a4:0x127d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508892.736703:0:225839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787508892.736761:0:225839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090ce781180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eb35f31c-097f-45a3-8275-bc75f97f89ee+21:2401:x1874324509737728:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 304us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508892.736769:0:225839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27991 00010000:00010000:0.0:1787508892.737413:0:230618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f36a59 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x127d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.737423:0:230618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f36a59 lrc: 3/0,1 mode: EX/EX res: [0x2000013a4:0x127d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 230618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787508892.737563:0:230618:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x1591:0x0], index 1: 0 00010000:00010000:0.0:1787508892.737669:0:230618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f36a59 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x127d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefee expref: 45 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.737685:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127d:0x0].0x0 (ffff9090ca4e2d00) 00010000:00010000:0.0:1787508892.737688:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1787508892.737702:0:230618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20c00/0xb126349c40f36a52 lrc: 0/0,0 mode: --/EX res: [0x2000013a4:0x127d:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefee expref: 45 pid: 230618 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.737718:0:230618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b20e00/0xb126349c40f36a59 lrc: 3/0,0 mode: CR/CR res: [0x2000013a4:0x127d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefee expref: 44 pid: 230618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508892.737742:0:230618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127d:0x0].0x0 (ffff9090ca4e2d00) 00010000:00010000:0.0:1787508892.737745:0:230618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1787508892.737747:0:230618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9091f9b20e00, rc 0) 00000100:00100000:0.0:1787508892.737810:0:230618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c788d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:6da43cb4-2376-46ce-b4ec-7d299949c5a8+44:349867:x1874324509737600:12345-192.168.201.30@tcp:101:dd.0 Request processed in 17156us (17488us total) trans 12884944325 rc 0/0 00000100:00100000:0.0:1787508892.737818:0:230618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94368 00000100:00100000:2.0:1787508892.748171:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508892.748260:0:203996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509737856 00000100:00100000:3.0:1787508892.748269:0:203996:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509737856 00000100:00100000:3.0:1787508892.748326:0:203996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15127 00000100:00100000:3.0:1787508892.748336:0:203996:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da37f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:349867:x1874324509737856:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:3.0:1787508892.748357:0:203996:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508892.748376:0:203996:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031ca7b1a/0xb126349c40f36a60 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeff5 expref: -99 pid: 203996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.748423:0:203996:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9dbee83/0xb126349c40f36a28 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefe0 expref: 5 pid: 203728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.748433:0:203996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1535:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1787508892.748437:0:203996:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1535:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1787508892.748443:0:203996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031ca7b1a/0xb126349c40f36a60 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeff5 expref: 11 pid: 203996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.748478:0:203996:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d9dbee83/0xb126349c40f36a28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefe0 expref: 5 pid: 203728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.748493:0:203996:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d9dbee83/0xb126349c40f36a28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefe0 expref: 5 pid: 203728 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508892.748507:0:203996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c8ea5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:203996:1874324480299392:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508892.748599:0:203996:0:(client.c:2715:ptlrpc_set_wait()) set ffff9091fd9750c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508892.756548:0:203996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c8ea5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:203996:1874324480299392:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508892.756597:0:203996:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000031ca7b1a/0xb126349c40f36a60 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeff5 expref: 11 pid: 203996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.756618:0:203996:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8e600, rc 0) 00000100:00100000:3.0:1787508892.756696:0:203996:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da37f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:349867:x1874324509737856:12345-192.168.201.30@tcp:101:dd.0 Request processed in 8360us (8533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508892.756706:0:203996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15127 00000100:00100000:2.0:1787508892.756925:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508892.761696:0:202213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509737984 00000100:00100000:3.0:1787508892.761779:0:202213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509737984 00010000:00010000:3.0:1787508892.761830:0:202213:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d9dbee83/0xb126349c40f36a28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefe0 expref: 6 pid: 203728 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508892.761955:0:202213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27992 00000100:00100000:3.0:1787508892.761966:0:202213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da37ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509737984:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508892.761981:0:202213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508892.762004:0:202213:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d9dbee83/0xb126349c40f36a28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefe0 expref: 6 pid: 203728 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.762020:0:202213:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d9dbee83/0xb126349c40f36a28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefe0 expref: 6 pid: 203728 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.762041:0:202213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9dbee83/0xb126349c40f36a28 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaefe0 expref: 6 pid: 203728 timeout: 13963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.762060:0:202213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1535:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1787508892.762064:0:202213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1535:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1787508892.762072:0:202213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000031ca7b1a/0xb126349c40f36a60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeff5 expref: 10 pid: 203996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.762082:0:202213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031ca7b1a/0xb126349c40f36a60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeff5 expref: 10 pid: 203996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508892.762118:0:202213:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000031ca7b1a/0xb126349c40f36a60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeff5 expref: 10 pid: 203996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508892.762132:0:202213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c8ea5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:202213:1874324480299520:192.168.201.30@tcp:105: 00000100:00100000:3.0:1787508892.764296:0:202213:0:(client.c:2715:ptlrpc_set_wait()) set ffff9091fd9750c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508892.768152:0:202213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c8ea5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:202213:1874324480299520:192.168.201.30@tcp:105: 00010000:00010000:3.0:1787508892.768179:0:202213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508892.768247:0:202213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da37ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:2400:x1874324509737984:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 6282us (11322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508892.768258:0:202213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27992 00010000:00010000:0.0:1787508893.251267:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787508893.370212:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79de3f65-4bad-42d0-a46f-842a654b33a0:3617:1874324480299648:0@lo:400:kworker.0 00000100:00100000:3.0:1787508893.370290:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508893.370309:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c6bf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480299904:0@lo:400:kworker.0 00000100:00100000:3.0:1787508893.370340:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e36b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874324480300160:0@lo:400:kworker.0 00000100:00100000:1.0:1787508893.370342:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508893.370363:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e36b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480300416:0@lo:400:kworker.0 00000100:00100000:3.0:1787508893.370364:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508893.370382:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508893.370392:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e36b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480300672:0@lo:400:kworker.0 00000100:00100000:1.0:1787508893.370396:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e36b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480300928:0@lo:400:kworker.0 00000100:00100000:3.0:1787508893.370412:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508893.370434:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e36b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480301184:0@lo:400:kworker.0 00000100:00100000:1.0:1787508893.370439:0:226134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480299904 00000100:00100000:1.0:1787508893.370445:0:226134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480299904 00000100:00100000:3.0:1787508893.370454:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508893.370470:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787508893.370475:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e36b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480300032:0@lo:400:kworker.0 00000100:00100000:3.0:1787508893.370494:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508893.370495:0:226134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480300416 00000100:00100000:1.0:1787508893.370498:0:226134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480300416 00000100:00100000:3.0:1787508893.370508:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e36b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480300544:0@lo:400:kworker.0 00000100:00100000:1.0:1787508893.370517:0:226134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480300032 00000100:00100000:1.0:1787508893.370519:0:226134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480300032 00000100:00100000:1.0:1787508893.370540:0:226134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2689 00000100:00100000:1.0:1787508893.370549:0:226134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e36b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480299904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508893.370597:0:226134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e36b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480299904:12345-0@lo:400:kworker.0 Request processed in 49us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508893.370603:0:226134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2689 00000100:00100000:1.0:1787508893.370620:0:226134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2690 00000100:00100000:1.0:1787508893.370626:0:226134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e36b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480300416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508893.370668:0:226134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e36b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480300416:12345-0@lo:400:kworker.0 Request processed in 42us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508893.370670:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508893.370674:0:226134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2690 00000100:00100000:1.0:1787508893.370685:0:226134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480300544 00000100:00100000:1.0:1787508893.370687:0:226134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480300544 00000100:00100000:3.0:1787508893.370688:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e36b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480301056:0@lo:400:kworker.0 00000100:00100000:1.0:1787508893.370705:0:226134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2691 00000100:00100000:3.0:1787508893.370709:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508893.370711:0:226134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480300032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508893.370736:0:225838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2692 00000100:00100000:1.0:1787508893.370740:0:226134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480300032:12345-0@lo:400:kworker.0 Request processed in 30us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508893.370743:0:225838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8ea5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480300544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508893.370746:0:226134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2691 00000100:00100000:1.0:1787508893.370762:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480299648 00000100:00100000:1.0:1787508893.370766:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480299648 00000100:00100000:3.0:1787508893.370770:0:225838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8ea5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3617:x1874324480300544:12345-0@lo:400:kworker.0 Request processed in 29us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508893.370776:0:225838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2692 00000100:00100000:1.0:1787508893.370787:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:1.0:1787508893.370792:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fccc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3617:x1874324480299648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508893.370818:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fccc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3617:x1874324480299648:12345-0@lo:400:kworker.0 Request processed in 26us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508893.370823:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e36b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480300032:0@lo:400:kworker.0 00000100:00100000:1.0:1787508893.370824:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:3.0:1787508893.370834:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e36b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480300544:0@lo:400:kworker.0 00000100:00100000:3.0:1787508893.370842:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79de3f65-4bad-42d0-a46f-842a654b33a0:3617:1874324480299648:0@lo:400:kworker.0 00000100:00080000:1.0:1787508893.370846:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508893.370855:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508893.370884:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c6bf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480299904:0@lo:400:kworker.0 00000100:00100000:1.0:1787508893.370893:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e36b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480300416:0@lo:400:kworker.0 00000100:00100000:1.0:1787508893.370905:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787508893.370911:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480299776:0@lo:400:kworker.0 00000100:00100000:1.0:1787508893.370935:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508893.370974:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e36b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480300288:0@lo:400:kworker.0 00000100:00100000:1.0:1787508893.370995:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508893.371010:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e36b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480300800:0@lo:400:kworker.0 00000100:00100000:3.0:1787508893.371025:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480300160 00000100:00100000:1.0:1787508893.371028:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508893.371029:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480300160 00000100:00100000:1.0:1787508893.371050:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480299776 00000100:00100000:3.0:1787508893.371053:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480300672 00000100:00100000:1.0:1787508893.371054:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480299776 00000100:00100000:3.0:1787508893.371055:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480300672 00000100:00100000:3.0:1787508893.371064:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480301184 00000100:00100000:3.0:1787508893.371066:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480301184 00000100:00100000:1.0:1787508893.371075:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480300288 00000100:00100000:1.0:1787508893.371077:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480300288 00000100:00100000:3.0:1787508893.371081:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480301056 00000100:00100000:3.0:1787508893.371083:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480301056 00000100:00100000:1.0:1787508893.371089:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30068 00000100:00100000:3.0:1787508893.371095:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480300928 00000100:00100000:1.0:1787508893.371095:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e36b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480299776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508893.371097:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480300928 00000100:00100000:3.0:1787508893.371106:0:205405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480300800 00000100:00100000:3.0:1787508893.371109:0:205405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480300800 00000100:00100000:3.0:1787508893.371122:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3386 00000100:00100000:3.0:1787508893.371127:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874324480300160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508893.371131:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e36b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480299776:12345-0@lo:400:kworker.0 Request processed in 36us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508893.371137:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30068 00000100:00100000:1.0:1787508893.371148:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30069 00000100:00100000:1.0:1787508893.371154:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e36b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480300288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508893.371160:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874324480300160:12345-0@lo:400:kworker.0 Request processed in 34us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508893.371166:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3386 00000100:00100000:1.0:1787508893.371177:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e36b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480300288:12345-0@lo:400:kworker.0 Request processed in 24us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508893.371181:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3387 00000100:00100000:1.0:1787508893.371183:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30069 00000100:00100000:3.0:1787508893.371186:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480300672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508893.371211:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480300672:12345-0@lo:400:kworker.0 Request processed in 24us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508893.371211:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480299776:0@lo:400:kworker.0 00000100:00100000:3.0:1787508893.371217:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3387 00000100:00100000:1.0:1787508893.371219:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e36b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480300288:0@lo:400:kworker.0 00000100:00100000:3.0:1787508893.371229:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3388 00000100:00100000:3.0:1787508893.371235:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480301184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508893.371235:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3389 00000100:00100000:1.0:1787508893.371241:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8ea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480301056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787508893.371260:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480301184:12345-0@lo:400:kworker.0 Request processed in 26us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508893.371264:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8ea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1874324480301056:12345-0@lo:400:kworker.0 Request processed in 24us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508893.371266:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3388 00000100:00100000:1.0:1787508893.371270:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3389 00000100:00100000:3.0:1787508893.371277:0:205405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3390 00000100:00100000:1.0:1787508893.371280:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3391 00000100:00100000:3.0:1787508893.371282:0:205405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e36b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480300928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508893.371285:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e36b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480300800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508893.371309:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e36b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1874324480300800:12345-0@lo:400:kworker.0 Request processed in 24us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508893.371315:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3391 00000100:00080000:0.0:1787508893.371431:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787508893.371434:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787508893.371604:0:205405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e36b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480300928:12345-0@lo:400:kworker.0 Request processed in 320us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508893.371611:0:205405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3390 00000100:00100000:3.0:1787508893.371653:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e36b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3617:1874324480301056:0@lo:400:kworker.0 00000100:00100000:3.0:1787508893.371663:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e36b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874324480300160:0@lo:400:kworker.0 00000100:00100000:3.0:1787508893.371672:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e36b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480300672:0@lo:400:kworker.0 00000100:00100000:3.0:1787508893.371681:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e36b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480301184:0@lo:400:kworker.0 00000100:00100000:1.0:1787508893.372974:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e36b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3619:1874324480300800:0@lo:400:kworker.0 00000100:00100000:1.0:1787508893.372999:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e36b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480300928:0@lo:400:kworker.0 00000100:00100000:2.0:1787508893.882467:0:3618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cbebc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480301312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787508893.882554:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787508893.882662:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480301312 00000100:00100000:0.0:1787508893.882672:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480301312 00000100:00100000:0.0:1787508893.882731:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1843 00000100:00100000:0.0:1787508893.882741:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da37d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480301312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787508893.882773:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 95903424 pending 36864 free 3898224640 avail 3666702336 00000100:00100000:0.0:1787508893.882825:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da37d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1874324480301312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508893.882831:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1843 00000100:00100000:0.0:1787508893.882886:0:3618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cbebc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3618:1874324480301312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787508893.892450:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e36b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480301440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787508893.892530:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508893.892673:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480301440 00000100:00100000:2.0:1787508893.892682:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480301440 00000100:00100000:2.0:1787508893.892743:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1844 00000100:00100000:2.0:1787508893.892753:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480301440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787508893.892788:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 95903424 pending 36864 free 3898224640 avail 3666702336 00000100:00100000:2.0:1787508893.892834:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480301440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508893.892841:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1844 00000100:00100000:3.0:1787508893.893379:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e36b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480301440:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787508894.271748:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508894.698169:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508894.698276:0:202226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509738368 00000100:00100000:1.0:1787508894.698287:0:202226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509738368 00000100:00100000:1.0:1787508894.698378:0:202226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94369 00000100:00100000:1.0:1787508894.698390:0:202226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da37d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+21:349869:x1874324509738368:12345-192.168.201.30@tcp:101:lseek_test.0 00010000:00010000:1.0:1787508894.698417:0:202226:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508894.698440:0:202226:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f36a67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaeffc expref: -99 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508894.698520:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36a6e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508894.698536:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36a6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508894.698548:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36a6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508894.698558:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f36a75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508894.698565:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f36a75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508894.698570:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f36a75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508894.698717:0:202226:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f36a7c lrc: 3/1,0 mode: --/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508894.698727:0:202226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f36a7c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508894.698735:0:202226:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f36a7c lrc: 3/1,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787508894.698745:0:202226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a4:0x127d:0x0]: returning size 2000 00010000:00010000:1.0:1787508894.698834:0:202226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36a6e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508894.698842:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36a6e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508894.698848:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36a6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508894.698855:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36a6e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508894.698861:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247b800 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508894.698866:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36a6e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508894.698874:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36a6e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508894.698886:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9090d08ec800) 00010000:00010000:1.0:1787508894.698889:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508894.698893:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36a6e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508894.698903:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247b800/0xb126349c40f36a6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508894.698916:0:202226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f36a75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508894.698922:0:202226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f36a75 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508894.698929:0:202226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f36a75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508894.698934:0:202226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247a600 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:1.0:1787508894.698937:0:202226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f36a75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508894.698993:0:202226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f36a75 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508894.699000:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1e3f1c85 (ffff9090ce78ac00) 00010000:00010000:1.0:1787508894.699002:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787508894.699005:0:202226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f36a75 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508894.699011:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247a600/0xb126349c40f36a75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508894.699049:0:202226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ac00/0xb126349c40f36a67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeffc expref: 24 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508894.699066:0:202226:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247ae00/0xb126349c40f36a7c lrc: 3/0,0 mode: PR/PR res: [0x2000013a4:0x127d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeffc expref: 23 pid: 202226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508894.699073:0:202226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127d:0x0].0x0 (ffff9090ca4e2d00) 00010000:00010000:1.0:1787508894.699075:0:202226:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787508894.699078:0:202226:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247ae00, rc 0) 00000100:00100000:1.0:1787508894.699137:0:202226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da37d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eb35f31c-097f-45a3-8275-bc75f97f89ee+23:349869:x1874324509738368:12345-192.168.201.30@tcp:101:lseek_test.0 Request processed in 750us (980us total) trans 12884944326 rc 0/0 00000100:00100000:1.0:1787508894.699145:0:202226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94369 00000100:00080000:0.0:1787508894.699742:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508894.716059:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508894.722039:0:230130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509738496 00000100:00100000:3.0:1787508894.722055:0:230130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509738496 00000100:00080000:0.0:1787508894.722145:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787508894.722155:0:230130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15128 00000100:00100000:3.0:1787508894.722171:0:230130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da37c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:eb35f31c-097f-45a3-8275-bc75f97f89ee+5:349869:x1874324509738496:12345-192.168.201.30@tcp:101:lseek_test.0 00010000:00010000:3.0:1787508894.722190:0:230130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787508894.722210:0:230130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091c6a84b/0xb126349c40f36a8a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaf003 expref: -99 pid: 230130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508894.722241:0:230130:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000031ca7b1a/0xb126349c40f36a60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeff5 expref: 10 pid: 203996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508894.722258:0:230130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1535:0x0].0x0 since=2s v=(2 0) 00010000:00010000:3.0:1787508894.722263:0:230130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1535:0x0].0x0 since=0s v=(1 2) 00010000:00010000:3.0:1787508894.722269:0:230130:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091c6a84b/0xb126349c40f36a8a lrc: 4/0,0 mode: --/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaf003 expref: 6 pid: 230130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508894.722310:0:230130:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000031ca7b1a/0xb126349c40f36a60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeff5 expref: 10 pid: 203996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508894.722327:0:230130:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000031ca7b1a/0xb126349c40f36a60 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeff5 expref: 10 pid: 203996 timeout: 13965 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508894.722342:0:230130:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c8ea6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:230130:1874324480301568:192.168.201.30@tcp:104: 00000100:00100000:3.0:1787508894.722443:0:230130:0:(client.c:2715:ptlrpc_set_wait()) set ffff9091fd9750c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508894.733868:0:230130:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c8ea6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:230130:1874324480301568:192.168.201.30@tcp:104: 00010000:00010000:3.0:1787508894.734013:0:230130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000091c6a84b/0xb126349c40f36a8a lrc: 3/0,0 mode: --/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaf003 expref: 6 pid: 230130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508894.734037:0:230130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090e4c8ee00, rc 0) 00000100:00100000:3.0:1787508894.734151:0:230130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da37c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:349869:x1874324509738496:12345-192.168.201.30@tcp:101:lseek_test.0 Request processed in 11985us (18102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508894.734161:0:230130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15128 00000100:00100000:2.0:1787508894.906857:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c8ea6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480301824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787508894.907649:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508894.907712:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787508894.907722:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e36b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480301696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787508894.907832:0:203182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480301824 00000100:00100000:1.0:1787508894.907840:0:203182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480301824 00000100:00100000:1.0:1787508894.907892:0:203182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30070 00000100:00100000:1.0:1787508894.907902:0:203182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cf198450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480301824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787508894.907976:0:203182:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442709504 avail 1296470016 00000100:00100000:1.0:1787508894.914028:0:203182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cf198450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480301824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6112us (6367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508894.914047:0:203182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30070 00000100:00100000:2.0:1787508894.914972:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508894.915038:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c8ea6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480301824:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787508894.915692:0:202231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480301696 00000100:00100000:0.0:1787508894.915701:0:202231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480301696 00000100:00100000:0.0:1787508894.915760:0:202231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30071 00000100:00100000:0.0:1787508894.915771:0:202231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da37df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480301696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787508894.915808:0:202231:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440636928 avail 1294397440 00000100:00100000:0.0:1787508894.915876:0:202231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da37df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480301696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508894.915883:0:202231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30071 00000100:00100000:2.0:1787508894.916097:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e36b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480301696:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787508895.290193:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787508896.314259:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787508896.875373:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508896.875427:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508896.875454:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508896.875485:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508896.875511:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508896.875528:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508896.875545:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508896.875559:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508896.875592:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508896.875660:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509739008 00000100:00100000:1.0:1787508896.875670:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509739008 00000100:00100000:1.0:1787508896.875748:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509739520 00000100:00100000:1.0:1787508896.875752:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509739520 00000100:00100000:1.0:1787508896.875775:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509739136 00000100:00100000:1.0:1787508896.875777:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509739136 00000100:00100000:1.0:1787508896.875793:0:225841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509739648 00000100:00100000:1.0:1787508896.875795:0:225841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509739648 00000100:00100000:1.0:1787508896.875817:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2693 00000100:00100000:1.0:1787508896.875827:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da37d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:2400:x1874324509739008:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508896.875907:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da37d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:2400:x1874324509739008:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 81us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508896.875915:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2693 00000100:00100000:1.0:1787508896.875931:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2694 00000100:00100000:1.0:1787508896.875937:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da37e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509739520:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508896.876021:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da37e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509739520:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 85us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508896.876028:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2694 00000100:00100000:1.0:1787508896.876041:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2695 00000100:00100000:1.0:1787508896.876047:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da37c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2400:x1874324509739136:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508896.876071:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da37c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2400:x1874324509739136:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508896.876077:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2695 00000100:00100000:1.0:1787508896.876088:0:225841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2696 00000100:00100000:1.0:1787508896.876095:0:225841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da37f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509739648:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1787508896.876115:0:225841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da37f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509739648:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 21us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508896.876121:0:225841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2696 00000100:00100000:0.0:1787508896.876328:0:202221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509738624 00000100:00100000:0.0:1787508896.876333:0:202221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509738624 00000100:00100000:0.0:1787508896.876371:0:202221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1088 00000100:00100000:0.0:1787508896.876378:0:202221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed598c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2400:x1874324509738624:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508896.876402:0:202221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed598c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e131a8-bbdb-47f1-a255-84e9bafdda4c+13:2400:x1874324509738624:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508896.876408:0:202221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1088 00000100:00100000:0.0:1787508896.876445:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509738752 00000100:00100000:0.0:1787508896.876448:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509738752 00000100:00100000:0.0:1787508896.876469:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509739264 00000100:00100000:0.0:1787508896.876471:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509739264 00000100:00100000:0.0:1787508896.876484:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509738880 00000100:00100000:0.0:1787508896.876486:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509738880 00000100:00100000:0.0:1787508896.876497:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509739392 00000100:00100000:0.0:1787508896.876499:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509739392 00000100:00100000:0.0:1787508896.876512:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3392 00000100:00100000:0.0:1787508896.876517:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da37dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+44:2400:x1874324509738752:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508896.876547:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da37dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+44:2400:x1874324509738752:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 29us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508896.876553:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3392 00000100:00100000:0.0:1787508896.876563:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3393 00000100:00100000:0.0:1787508896.876580:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da37c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+23:2400:x1874324509739264:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508896.876603:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da37c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+23:2400:x1874324509739264:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 34us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508896.876609:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3393 00000100:00100000:0.0:1787508896.876619:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3394 00000100:00100000:0.0:1787508896.876624:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da37ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2400:x1874324509738880:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508896.876641:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da37ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da43cb4-2376-46ce-b4ec-7d299949c5a8+10:2400:x1874324509738880:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 17us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508896.876646:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3394 00000100:00100000:0.0:1787508896.876654:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3395 00000100:00100000:0.0:1787508896.876659:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da37ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2400:x1874324509739392:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1787508896.876673:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da37ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+11:2400:x1874324509739392:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 14us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508896.876678:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3395 00000100:00080000:2.0:1787508896.876795:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787508896.876800:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787508896.876802:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787508896.876805:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787508896.887265:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508896.887600:0:203732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509738112 00000100:00100000:1.0:1787508896.887612:0:203732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509738112 00002000:00100000:1.0:1787508896.887665:0:203732:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x1535:0x0] (0->1048575) req@ffff9090da37fb80 x1874324509738112/t0(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:352/0 lens 488/0 e 0 to 0 dl 1787508907 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787508896.887682:0:203732:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090da37fb80 with x1874324509738112 ext(0->1048575) 00010000:00010000:1.0:1787508896.887692:0:203732:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000031ca7b1a/0xb126349c40f36a60 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeff5 expref: 11 pid: 203996 timeout: 13965 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508896.887711:0:203732:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000031ca7b1a/0xb126349c40f36a60 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeff5 expref: 11 pid: 203996 timeout: 13967 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787508896.887720:0:203732:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9090da37fb80 00000100:00100000:1.0:1787508896.887759:0:203732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:1.0:1787508896.887769:0:203732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:2402:x1874324509738112:12345-192.168.201.30@tcp:4:dd.0 00000100:00100000:1.0:1787508896.933687:0:203732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:2402:x1874324509738112:12345-192.168.201.30@tcp:4:dd.0 Request processed in 45694us (46207us total) trans 8589941268 rc 0/0 00000100:00100000:1.0:1787508896.933710:0:203732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00002000:00100000:1.0:1787508896.933732:0:203732:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x1535:0x0] (0->1048575) req@ffff9090da37fb80 x1874324509738112/t8589941268(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:352/0 lens 488/448 e 0 to 0 dl 1787508907 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787508896.933745:0:203732:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090da37fb80 with x1874324509738112 ext(0->1048575) 00010000:00010000:1.0:1787508896.933760:0:203732:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000031ca7b1a/0xb126349c40f36a60 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeff5 expref: 14 pid: 203996 timeout: 13967 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508896.933788:0:203732:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000031ca7b1a/0xb126349c40f36a60 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeff5 expref: 14 pid: 203996 timeout: 13967 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787508896.933796:0:203732:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9090da37fb80 00000100:00100000:3.0:1787508896.946733:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508896.946861:0:225835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509739776 00000100:00100000:0.0:1787508896.946875:0:225835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509739776 00000100:00100000:0.0:1787508896.947013:0:225835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15129 00000100:00100000:0.0:1787508896.947026:0:225835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8ea4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6da43cb4-2376-46ce-b4ec-7d299949c5a8+14:2401:x1874324509739776:12345-192.168.201.30@tcp:16:dd.0 00000001:00080000:0.0:1787508896.950027:0:203722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589941268 is committed 00000100:00100000:3.0:1787508896.950987:0:225835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8ea4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2401:x1874324509739776:12345-192.168.201.30@tcp:16:dd.0 Request processed in 3916us (4221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508896.951003:0:225835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15129 00000100:00100000:0.0:1787508896.965627:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508896.965769:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508896.968158:0:202212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509740032 00000100:00100000:2.0:1787508896.968181:0:202212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509740032 00010000:00010000:2.0:1787508896.968259:0:202212:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000031ca7b1a/0xb126349c40f36a60 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeff5 expref: 7 pid: 203996 timeout: 13967 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508896.968345:0:202212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27993 00000100:00100000:2.0:1787508896.968358:0:202212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cbebe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2400:x1874324509740032:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787508896.968380:0:202212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787508896.968406:0:202212:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x1535:0x0] updating lvb size from disk: 2000 -> 1048576 00002000:00010000:2.0:1787508896.968411:0:202212:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x1535:0x0] updating lvb blocks from disk: 8 -> 2048 00010000:00010000:2.0:1787508896.968418:0:202212:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 0000000031ca7b1a/0xb126349c40f36a60 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeff5 expref: 7 pid: 203996 timeout: 13967 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508896.968437:0:202212:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000031ca7b1a/0xb126349c40f36a60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeff5 expref: 7 pid: 203996 timeout: 13967 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508896.968468:0:202212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031ca7b1a/0xb126349c40f36a60 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1535:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaeff5 expref: 7 pid: 203996 timeout: 13967 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508896.968507:0:202212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1535:0x0].0x0 since=3s v=(1 2) 00010000:00010000:2.0:1787508896.968513:0:202212:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1535:0x0].0x0 since=0s v=(0 1) 00010000:00010000:2.0:1787508896.968524:0:202212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000091c6a84b/0xb126349c40f36a8a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaf003 expref: 5 pid: 230130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508896.968536:0:202212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091c6a84b/0xb126349c40f36a8a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaf003 expref: 5 pid: 230130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508896.968599:0:202212:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000091c6a84b/0xb126349c40f36a8a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x1535:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaf003 expref: 5 pid: 230130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787508896.968618:0:202212:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090da37f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:202212:1874324480301952:192.168.201.30@tcp:105: 00000100:00100000:2.0:1787508896.969710:0:202212:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090ce980480 going to sleep for 11 seconds 00000100:00100000:3.0:1787508896.975249:0:226134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509739904 00000100:00100000:3.0:1787508896.975273:0:226134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509739904 00000100:00100000:2.0:1787508896.980799:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508896.981511:0:225838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509740160 00000100:00100000:0.0:1787508896.981525:0:225838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509740160 00000100:00100000:0.0:1787508896.981624:0:225838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15130 00000100:00100000:0.0:1787508896.981637:0:225838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da37e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:349869:x1874324509740160:12345-192.168.201.30@tcp:101:lseek_test.0 00010000:00010000:0.0:1787508896.981662:0:225838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787508896.981689:0:225838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000378f1967/0xb126349c40f36a91 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1591:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaf011 expref: -99 pid: 225838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787508896.981723:0:225838:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1591:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787508896.981754:0:225838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1591:0x0].0x0 since=13868s v=(0 0) 00010000:00010000:0.0:1787508896.981760:0:225838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1591:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787508896.981771:0:225838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000378f1967/0xb126349c40f36a91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1591:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaf011 expref: 7 pid: 225838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508896.981791:0:225838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000378f1967/0xb126349c40f36a91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1591:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaf011 expref: 7 pid: 225838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787508896.981808:0:225838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9091f9b20c00, rc 0) 00000100:00100000:0.0:1787508896.981887:0:225838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da37e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:349869:x1874324509740160:12345-192.168.201.30@tcp:101:lseek_test.0 Request processed in 252us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787508896.981896:0:225838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15130 00000100:00100000:3.0:1787508896.982733:0:202212:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090da37f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:202212:1874324480301952:192.168.201.30@tcp:105: 00010000:00010000:3.0:1787508896.982767:0:202212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508896.982832:0:202212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cbebe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:2400:x1874324509740032:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 14476us (17062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508896.982845:0:202212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27993 00000100:00100000:2.0:1787508896.987004:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508896.987255:0:225832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509740288 00000100:00100000:3.0:1787508896.987269:0:225832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509740288 00000100:00100000:3.0:1787508896.987361:0:225832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15131 00000100:00100000:3.0:1787508896.987375:0:225832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da37ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509740288:12345-192.168.201.30@tcp:23:lseek_test.0 00000100:00100000:3.0:1787508896.987539:0:225832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da37ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509740288:12345-192.168.201.30@tcp:23:lseek_test.0 Request processed in 167us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508896.987548:0:225832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15131 00000100:00100000:1.0:1787508896.988330:0:226134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15132 00000100:00100000:1.0:1787508896.988340:0:226134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cbebc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6da43cb4-2376-46ce-b4ec-7d299949c5a8+6:349867:x1874324509739904:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:1.0:1787508896.988355:0:226134:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787508896.988380:0:226134:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c8021ba/0xb126349c40f36a98 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1591:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4420f064bfaaf00a expref: -99 pid: 226134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508896.988418:0:226134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000378f1967/0xb126349c40f36a91 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x1591:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaf011 expref: 6 pid: 225838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508896.988428:0:226134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1591:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787508896.988433:0:226134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1591:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787508896.988438:0:226134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c8021ba/0xb126349c40f36a98 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1591:0x0].0x0 rrc: 3 type: EXT [1048576->8388607] (req 1048576->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaf00a expref: 7 pid: 226134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508896.988497:0:226134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000378f1967/0xb126349c40f36a91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1591:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaf011 expref: 6 pid: 225838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508896.988513:0:226134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000378f1967/0xb126349c40f36a91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1591:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaf011 expref: 6 pid: 225838 timeout: 13968 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508896.988530:0:226134:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e36b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:226134:1874324480302080:192.168.201.30@tcp:104: 00000100:00100000:1.0:1787508896.988637:0:226134:0:(client.c:2715:ptlrpc_set_wait()) set ffff9090d21c4600 going to sleep for 11 seconds 00000100:00100000:2.0:1787508896.994269:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508896.994711:0:226134:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e36b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:226134:1874324480302080:192.168.201.30@tcp:104: 00010000:00010000:1.0:1787508896.994763:0:226134:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c8021ba/0xb126349c40f36a98 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1591:0x0].0x0 rrc: 3 type: EXT [1048576->8388607] (req 1048576->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaf00a expref: 7 pid: 226134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787508896.994811:0:226134:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9090d247b800, rc 0) 00000100:00100000:1.0:1787508896.994995:0:226134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cbebc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:349867:x1874324509739904:12345-192.168.201.30@tcp:101:dd.0 Request processed in 6654us (29382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508896.995006:0:226134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15132 00000100:00100000:3.0:1787508896.995530:0:210243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509740544 00000100:00100000:3.0:1787508896.995541:0:210243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509740544 00000100:00100000:3.0:1787508896.995624:0:210243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15528 00000100:00100000:3.0:1787508896.995636:0:210243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fdb9f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+23:349869:x1874324509740544:12345-192.168.201.30@tcp:35:lseek_test.0 00000100:00100000:3.0:1787508896.996050:0:210243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fdb9f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eb35f31c-097f-45a3-8275-bc75f97f89ee+24:349869:x1874324509740544:12345-192.168.201.30@tcp:35:lseek_test.0 Request processed in 415us (1797us total) trans 12884944327 rc 0/0 00000100:00100000:3.0:1787508896.996059:0:210243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15528 00000100:00100000:0.0:1787508896.998239:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508896.999639:0:205406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509740672 00000100:00100000:3.0:1787508896.999658:0:205406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509740672 00010000:00010000:3.0:1787508896.999721:0:205406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000378f1967/0xb126349c40f36a91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1591:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaf011 expref: 7 pid: 225838 timeout: 13968 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508896.999787:0:205406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27994 00000100:00100000:3.0:1787508896.999800:0:205406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091fde19450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+7:2400:x1874324509740672:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787508896.999818:0:205406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787508896.999848:0:205406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000378f1967/0xb126349c40f36a91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x1591:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaf011 expref: 7 pid: 225838 timeout: 13968 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508896.999866:0:205406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000378f1967/0xb126349c40f36a91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x1591:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaf011 expref: 7 pid: 225838 timeout: 13968 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508896.999899:0:205406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000378f1967/0xb126349c40f36a91 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1591:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaf011 expref: 7 pid: 225838 timeout: 13968 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508896.999921:0:205406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1591:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787508896.999926:0:205406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1591:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787508896.999936:0:205406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009c8021ba/0xb126349c40f36a98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1591:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaf00a expref: 6 pid: 226134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508897.000085:0:205406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c8021ba/0xb126349c40f36a98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1591:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaf00a expref: 6 pid: 226134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787508897.000144:0:205406:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009c8021ba/0xb126349c40f36a98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1591:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0x4420f064bfaaf00a expref: 6 pid: 226134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787508897.000168:0:205406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c8ea4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:205406:1874324480302208:192.168.201.30@tcp:105: 00000100:00100000:3.0:1787508897.000299:0:205406:0:(client.c:2715:ptlrpc_set_wait()) set ffff9091fd9750c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787508897.019596:0:205406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c8ea4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:205406:1874324480302208:192.168.201.30@tcp:105: 00010000:00010000:3.0:1787508897.019636:0:205406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787508897.019816:0:205406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091fde19450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eb35f31c-097f-45a3-8275-bc75f97f89ee+6:2400:x1874324509740672:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 20016us (21589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508897.019830:0:205406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27994 00000100:00100000:3.0:1787508897.225728:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1787508897.229994:0:205407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509740800 00000100:00100000:2.0:1787508897.230017:0:205407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509740800 00002000:00100000:2.0:1787508897.230134:0:205407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1591:0x0] (4194304->8388607) req@ffff9090c8ea6a00 x1874324509740800/t0(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:353/0 lens 488/0 e 0 to 0 dl 1787508908 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787508897.230147:0:205407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090c8ea6a00 with x1874324509740800 ext(4194304->8388607) 00002000:00010000:2.0:1787508897.230156:0:205407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9090c8ea6a00 00000100:00100000:2.0:1787508897.230209:0:205407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:2.0:1787508897.230223:0:205407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090c8ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2401:x1874324509740800:12345-192.168.201.30@tcp:4:dd.0 00000100:00100000:1.0:1787508897.232135:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1787508897.232499:0:203731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509740928 00000100:00100000:3.0:1787508897.232518:0:203731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509740928 00002000:00100000:3.0:1787508897.232620:0:203731:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x1591:0x0] (1048576->4194303) req@ffff9090e36b4700 x1874324509740928/t0(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:353/0 lens 488/0 e 0 to 0 dl 1787508908 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787508897.232634:0:203731:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090e36b4700 with x1874324509740928 ext(1048576->4194303) 00002000:00010000:3.0:1787508897.232646:0:203731:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9090e36b4700 00000100:00100000:3.0:1787508897.232698:0:203731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:3.0:1787508897.232710:0:203731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e36b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+8:2403:x1874324509740928:12345-192.168.201.30@tcp:4:dd.0 00000100:00100000:0.0:1787508897.294419:0:203731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e36b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:2403:x1874324509740928:12345-192.168.201.30@tcp:4:dd.0 Request processed in 61692us (62278us total) trans 8589940579 rc 0/0 00000100:00100000:0.0:1787508897.294444:0:203731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 68 00002000:00100000:0.0:1787508897.294464:0:203731:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x1591:0x0] (1048576->4194303) req@ffff9090e36b4700 x1874324509740928/t8589940579(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:353/0 lens 488/448 e 0 to 0 dl 1787508908 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787508897.294489:0:203731:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090e36b4700 with x1874324509740928 ext(1048576->4194303) 00002000:00010000:0.0:1787508897.294497:0:203731:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9090e36b4700 00010000:00010000:1.0:1787508897.338196:0:204785:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787508897.358046:0:205407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090c8ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:2401:x1874324509740800:12345-192.168.201.30@tcp:4:dd.0 Request processed in 127812us (132321us total) trans 8589940580 rc 0/0 00000100:00100000:0.0:1787508897.358061:0:205407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 67 00002000:00100000:0.0:1787508897.358076:0:205407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1591:0x0] (4194304->8388607) req@ffff9090c8ea6a00 x1874324509740800/t8589940580(0) o4->6da43cb4-2376-46ce-b4ec-7d299949c5a8@192.168.201.30@tcp:353/0 lens 488/448 e 0 to 0 dl 1787508908 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787508897.358087:0:205407:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9090c8ea6a00 with x1874324509740800 ext(4194304->8388607) 00002000:00010000:0.0:1787508897.358095:0:205407:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9090c8ea6a00 00000100:00100000:2.0:1787508897.364984:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1787508897.365167:0:203727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509741056 00000100:00100000:1.0:1787508897.365177:0:203727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509741056 00000100:00100000:1.0:1787508897.365240:0:203727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15133 00000100:00100000:1.0:1787508897.365251:0:203727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da37ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+11:2402:x1874324509741056:12345-192.168.201.30@tcp:16:dd.0 00000001:00080000:2.0:1787508897.369611:0:204539:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589940580 is committed 00000100:00100000:1.0:1787508897.369823:0:203727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da37ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6da43cb4-2376-46ce-b4ec-7d299949c5a8+7:2402:x1874324509741056:12345-192.168.201.30@tcp:16:dd.0 Request processed in 4567us (4883us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508897.369835:0:203727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15133 00000100:00100000:1.0:1787508897.374270:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1787508897.374369:0:202229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324509741312 00000100:00100000:0.0:1787508897.374380:0:202229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324509741312 00000100:00100000:0.0:1787508897.374453:0:202229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15529 00000100:00100000:0.0:1787508897.374464:0:202229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e36b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+44:349867:x1874324509741312:12345-192.168.201.30@tcp:35:dd.0 00000001:00080000:0.0:1787508897.374716:0:202229:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884944328 00000100:00100000:0.0:1787508897.375071:0:202229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e36b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da43cb4-2376-46ce-b4ec-7d299949c5a8+46:349867:x1874324509741312:12345-192.168.201.30@tcp:35:dd.0 Request processed in 380us (582us total) trans 12884944329 rc 0/0 00000100:00100000:0.0:1787508897.375081:0:202229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15529 00000020:00080000:0.0:1787508897.375086:0:202229:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:3.0:1787508897.379807:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944329 is committed 00000001:00080000:3.0:1787508897.379824:0:202206:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884944327 is committed 00010000:00010000:2.0:1787508897.380679:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f36917 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508897.380694:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f36917 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508897.380702:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f36917 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508897.380708:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090d247bc00 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508897.380712:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f36917 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508897.380719:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f36917 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508897.380736:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1e3f1c85 (ffff9090ce78ac00) 00010000:00010000:2.0:1787508897.380738:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508897.380743:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f36917 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508897.380749:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090d247bc00/0xb126349c40f36917 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1e3f1c85 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 202226 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508897.380778:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f36980 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x127d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508897.380784:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f36980 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x127d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508897.380795:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f36980 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x127d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508897.380801:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9090c96e4000 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508897.380803:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f36980 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x127d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508897.380809:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f36980 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x127d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508897.380816:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127d:0x0].0x0 (ffff9090ca4e2d00) 00010000:00010000:2.0:1787508897.380819:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508897.380822:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f36980 lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x127d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508897.380827:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9090c96e4000/0xb126349c40f36980 lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x127d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 209004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508897.380838:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21400/0xb126349c40f369f7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a4:0x127d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508897.380857:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21400/0xb126349c40f369f7 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a4:0x127d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508897.380863:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21400/0xb126349c40f369f7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x127d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508897.380867:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9091f9b21400 already unused, calling callback (ffffffffc19024f0) 00010000:00010000:2.0:1787508897.380870:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21400/0xb126349c40f369f7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a4:0x127d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508897.380880:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21400/0xb126349c40f369f7 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a4:0x127d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508897.381608:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a4:0x127d:0x0].0x0 (ffff9090ca4e2d00) 00010000:00010000:2.0:1787508897.381611:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787508897.381616:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21400/0xb126349c40f369f7 lrc: 2/0,0 mode: --/TXN res: [0x2000013a4:0x127d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787508897.381622:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9091f9b21400/0xb126349c40f369f7 lrc: 0/0,0 mode: --/TXN res: [0x2000013a4:0x127d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 202227 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787508897.466375:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787508897.466401:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090c8ea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480302336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787508897.466479:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787508897.466652:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480302336 00000100:00100000:3.0:1787508897.466660:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480302336 00000100:00100000:3.0:1787508897.466728:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1845 00000100:00100000:3.0:1787508897.466739:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e36b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480302336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787508897.466761:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 189448768 pending 0 free 3871453184 avail 3632541696 00000100:00100000:3.0:1787508897.466820:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e36b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480302336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508897.466828:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1845 00000100:00080000:0.0:1787508897.466997:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787508897.467104:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cbebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480302464:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787508897.467133:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508897.467181:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090c8ea4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480302336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787508897.467422:0:205008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480302464 00000100:00100000:3.0:1787508897.467427:0:205008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480302464 00000100:00100000:3.0:1787508897.467471:0:205008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1846 00000100:00100000:3.0:1787508897.467479:0:205008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e36b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480302464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787508897.467492:0:205008:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 189448768 pending 0 free 3871453184 avail 3632541696 00000100:00100000:3.0:1787508897.467533:0:205008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e36b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480302464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787508897.467540:0:205008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1846 00000100:00100000:1.0:1787508897.467617:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cbebe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480302464:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787508897.467665:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787508898.362183:0:202215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508898.490257:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e36b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480302976:0@lo:400:kworker.0 00000100:00100000:1.0:1787508898.490326:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508898.490361:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e36b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480303488:0@lo:400:kworker.0 00000100:00100000:1.0:1787508898.490384:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508898.490403:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874324480304000:0@lo:400:kworker.0 00000100:00100000:1.0:1787508898.490426:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508898.490468:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787508898.490474:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e36b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480302848:0@lo:400:kworker.0 00000100:00100000:1.0:1787508898.490496:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508898.490512:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e36b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480303360:0@lo:400:kworker.0 00000100:00100000:1.0:1787508898.490528:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508898.490554:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d55a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480303872:0@lo:400:kworker.0 00000100:00100000:1.0:1787508898.490574:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508898.490606:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480302976 00000100:00100000:1.0:1787508898.490613:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480302976 00000100:00100000:1.0:1787508898.490654:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480303488 00000100:00100000:1.0:1787508898.490658:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480303488 00000100:00100000:1.0:1787508898.490675:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480302848 00000100:00100000:1.0:1787508898.490677:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480302848 00000100:00100000:1.0:1787508898.490701:0:225836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480303360 00000100:00100000:1.0:1787508898.490703:0:225836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480303360 00000100:00100000:1.0:1787508898.490725:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2697 00000100:00100000:1.0:1787508898.490734:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480302976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508898.490781:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480302976:12345-0@lo:400:kworker.0 Request processed in 49us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508898.490787:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2697 00000100:00100000:1.0:1787508898.490801:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2698 00000100:00100000:1.0:1787508898.490806:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480303488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508898.490831:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480303488:12345-0@lo:400:kworker.0 Request processed in 25us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508898.490837:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2698 00000100:00100000:1.0:1787508898.490846:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2699 00000100:00100000:1.0:1787508898.490850:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480302848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508898.490871:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480302848:12345-0@lo:400:kworker.0 Request processed in 21us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508898.490877:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2699 00000100:00100000:1.0:1787508898.490885:0:225836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2700 00000100:00100000:1.0:1787508898.490890:0:225836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4c87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480303360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508898.490909:0:225836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4c87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3619:x1874324480303360:12345-0@lo:400:kworker.0 Request processed in 19us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508898.490914:0:225836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2700 00000100:00100000:1.0:1787508898.490933:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480304000 00000100:00100000:1.0:1787508898.490936:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480304000 00000100:00100000:1.0:1787508898.490986:0:203348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480303872 00000100:00100000:1.0:1787508898.490989:0:203348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480303872 00000100:00100000:1.0:1787508898.491005:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3396 00000100:00100000:1.0:1787508898.491011:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874324480304000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508898.491038:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1874324480304000:12345-0@lo:400:kworker.0 Request processed in 28us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508898.491044:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3396 00000100:00100000:1.0:1787508898.491055:0:203348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3397 00000100:00100000:1.0:1787508898.491060:0:203348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480303872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508898.491087:0:203348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1874324480303872:12345-0@lo:400:kworker.0 Request processed in 28us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508898.491093:0:203348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3397 00000100:00080000:1.0:1787508898.491123:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787508898.491127:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787508898.491129:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787508898.491162:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e36b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480302848:0@lo:400:kworker.0 00000100:00100000:1.0:1787508898.491173:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e36b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480303360:0@lo:400:kworker.0 00000100:00100000:1.0:1787508898.491182:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d55a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3619:1874324480303872:0@lo:400:kworker.0 00000100:00100000:1.0:1787508898.491192:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e36b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480302976:0@lo:400:kworker.0 00000100:00100000:1.0:1787508898.491202:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e36b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480303488:0@lo:400:kworker.0 00000100:00100000:1.0:1787508898.491210:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3619:1874324480304000:0@lo:400:kworker.0 00000100:00100000:2.0:1787508898.491382:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e36b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480302720:0@lo:400:kworker.0 00000100:00100000:2.0:1787508898.491415:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508898.491445:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e36b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480303232:0@lo:400:kworker.0 00000100:00100000:2.0:1787508898.491478:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508898.491494:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e36b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874324480303744:0@lo:400:kworker.0 00000100:00100000:2.0:1787508898.491515:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508898.491535:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1787508898.491552:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e36b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79de3f65-4bad-42d0-a46f-842a654b33a0:3617:1874324480302592:0@lo:400:kworker.0 00000100:00100000:2.0:1787508898.491576:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508898.491602:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e36b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874324480303104:0@lo:400:kworker.0 00000100:00100000:2.0:1787508898.491624:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508898.491644:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e36b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480303616:0@lo:400:kworker.0 00000100:00100000:2.0:1787508898.491663:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508898.491680:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9091f9ac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480304128:0@lo:400:kworker.0 00000100:00100000:2.0:1787508898.491704:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508898.491730:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480303744 00000100:00100000:2.0:1787508898.491735:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480303744 00000100:00100000:2.0:1787508898.491767:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480303104 00000100:00100000:2.0:1787508898.491770:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480303104 00000100:00100000:2.0:1787508898.491780:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480303616 00000100:00100000:2.0:1787508898.491782:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480303616 00000100:00100000:2.0:1787508898.491790:0:202228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480304128 00000100:00100000:2.0:1787508898.491792:0:202228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480304128 00000100:00100000:2.0:1787508898.491807:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3398 00000100:00100000:2.0:1787508898.491813:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874324480303744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508898.491847:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1874324480303744:12345-0@lo:400:kworker.0 Request processed in 34us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508898.491853:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3398 00000100:00100000:2.0:1787508898.491866:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3399 00000100:00100000:2.0:1787508898.491872:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874324480303104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508898.491894:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1874324480303104:12345-0@lo:400:kworker.0 Request processed in 22us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508898.491898:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3399 00000100:00100000:2.0:1787508898.491908:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3400 00000100:00100000:2.0:1787508898.491912:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480303616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508898.491935:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1874324480303616:12345-0@lo:400:kworker.0 Request processed in 23us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508898.491964:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3400 00000100:00100000:2.0:1787508898.491976:0:202228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3401 00000100:00100000:2.0:1787508898.491983:0:202228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480304128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508898.492008:0:202228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1874324480304128:12345-0@lo:400:kworker.0 Request processed in 27us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508898.492014:0:202228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3401 00000100:00100000:2.0:1787508898.492037:0:202220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480302592 00000100:00100000:2.0:1787508898.492041:0:202220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480302592 00000100:00100000:2.0:1787508898.492066:0:202220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:2.0:1787508898.492073:0:202220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091ed599850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3617:x1874324480302592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787508898.492100:0:202220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091ed599850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79de3f65-4bad-42d0-a46f-842a654b33a0+24:3617:x1874324480302592:12345-0@lo:400:kworker.0 Request processed in 29us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508898.492106:0:202220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00080000:2.0:1787508898.492137:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787508898.492140:0:202222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787508898.492155:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e36b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:79de3f65-4bad-42d0-a46f-842a654b33a0:3617:1874324480302592:0@lo:400:kworker.0 00000100:00100000:2.0:1787508898.492165:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e36b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3617:1874324480303104:0@lo:400:kworker.0 00000100:00100000:2.0:1787508898.492173:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e36b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3617:1874324480303616:0@lo:400:kworker.0 00000100:00100000:2.0:1787508898.492182:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9091f9ac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3617:1874324480304128:0@lo:400:kworker.0 00000100:00100000:2.0:1787508898.492190:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e36b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3617:1874324480303744:0@lo:400:kworker.0 00000100:00100000:1.0:1787508898.496711:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480302720 00000100:00100000:1.0:1787508898.496727:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480302720 00000100:00100000:1.0:1787508898.496802:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480303232 00000100:00100000:1.0:1787508898.496806:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480303232 00000100:00100000:1.0:1787508898.496834:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30072 00000100:00100000:1.0:1787508898.496843:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090da37f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480302720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508898.496959:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090da37f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480302720:12345-0@lo:400:kworker.0 Request processed in 117us (5542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508898.496967:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30072 00000100:00100000:1.0:1787508898.496984:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30073 00000100:00100000:1.0:1787508898.496990:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480303232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787508898.497022:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3617:x1874324480303232:12345-0@lo:400:kworker.0 Request processed in 32us (5543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508898.497028:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30073 00000100:00100000:2.0:1787508898.498096:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e36b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480302720:0@lo:400:kworker.0 00000100:00100000:2.0:1787508898.498110:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e36b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3617:1874324480303232:0@lo:400:kworker.0 00000100:00100000:1.0:1787508899.006271:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787508899.006294:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480304256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787508899.006370:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508899.006416:0:203729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480304256 00000100:00100000:1.0:1787508899.006423:0:203729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480304256 00000100:00100000:1.0:1787508899.006467:0:203729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1847 00000100:00100000:1.0:1787508899.006475:0:203729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090e4ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480304256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787508899.006502:0:203729:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 103231168 pending 0 free 3897176064 avail 3665653760 00000100:00100000:1.0:1787508899.006554:0:203729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090e4ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1874324480304256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508899.006561:0:203729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1847 00000100:00100000:1.0:1787508899.006602:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3616:1874324480304256:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787508899.019130:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787508899.019151:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090cbebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480304384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787508899.019212:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508899.020826:0:203730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480304384 00000100:00100000:2.0:1787508899.020839:0:203730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480304384 00000100:00100000:2.0:1787508899.020904:0:203730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1848 00000100:00100000:2.0:1787508899.020916:0:203730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090cbebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480304384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787508899.020964:0:203730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 103231168 pending 0 free 3897176064 avail 3665653760 00000100:00100000:2.0:1787508899.021035:0:203730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090cbebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1874324480304384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (1822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508899.021042:0:203730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1848 00000100:00100000:0.0:1787508899.025501:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090cbebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3619:1874324480304384:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1787508899.059295:0:236889:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanityn test_108a: @@@@@@ FAIL: offset 1048576 != 8388608 00010000:00010000:3.0:1787508899.389126:0:226765:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787508900.026574:0:3619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090e4ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480304512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787508900.026658:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787508900.026715:0:225829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480304512 00000100:00100000:1.0:1787508900.026723:0:225829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480304512 00000100:00100000:1.0:1787508900.026770:0:225829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30074 00000100:00100000:1.0:1787508900.026778:0:225829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9091f9ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480304512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787508900.026824:0:225829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 9543680 pending 0 free 1440636928 avail 1294397440 00000100:00100000:1.0:1787508900.026870:0:225829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9091f9ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:3619:x1874324480304512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787508900.026877:0:225829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30074 00000100:00100000:1.0:1787508900.026922:0:3619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090e4ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3619:1874324480304512:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787508900.032101:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787508900.032125:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9090d0874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480304640:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787508900.032193:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787508900.032245:0:202232:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874324480304640 00000100:00100000:2.0:1787508900.032252:0:202232:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874324480304640 00000100:00100000:2.0:1787508900.032310:0:202232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30075 00000100:00100000:2.0:1787508900.032318:0:202232:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9090d0874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480304640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787508900.032675:0:202232:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 7483392 pending 0 free 1442709504 avail 1296470016 00000100:00100000:2.0:1787508900.032720:0:202232:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9090d0874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1874324480304640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 403us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787508900.032727:0:202232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30075 00000100:00100000:2.0:1787508900.032771:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9090d0874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3617:1874324480304640:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787508900.411524:0:202214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 67461 lines, 67461 kept, 0 dropped, 0 bad.